Recent runs || View in Spyglass
PR | andyzhangx: test: support Win2022 test on capz |
Result | FAILURE |
Tests | 2 failed / 18 succeeded |
Started | |
Elapsed | 1h5m |
Revision | 406a0d30aff10d48525d3e58710a2b1ac4047aa0 |
Refs |
988 |
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=AzureFile\sCSI\sDriver\sEnd\-to\-End\sTests\sDynamic\sProvisioning\sshould\screate\sa\svolume\son\sdemand\swith\smount\soptions\s\[kubernetes\.io\/azure\-file\]\s\[file\.csi\.azure\.com\]\s\[Windows\]$'
/home/prow/go/src/sigs.k8s.io/azurefile-csi-driver/test/e2e/dynamic_provisioning_test.go:104 Unexpected error: <*errors.errorString | 0xc0000a6c30>: { s: "pod \"azurefile-volume-tester-9nnth\" failed with status: {Phase:Failed Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-19 11:25:00 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-19 11:25:00 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-19 11:25:00 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-19 11:25:00 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:10.1.0.7 PodIP:192.168.139.196 PodIPs:[{IP:192.168.139.196}] StartTime:2022-04-19 11:25:00 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:volume-tester State:{Waiting:&ContainerStateWaiting{Reason:RunContainerError,Message:context deadline exceeded,} Running:nil Terminated:nil} LastTerminationState:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:0,Signal:0,Reason:,Message:,StartedAt:0001-01-01 00:00:00 +0000 UTC,FinishedAt:0001-01-01 00:00:00 +0000 UTC,ContainerID:containerd://d590356c7af6f935e27c54d35977e44304503d1afed64e7e658a4b01ed4ba111,}} Ready:false RestartCount:0 Image:mcr.microsoft.com/windows/servercore:ltsc2022 ImageID:mcr.microsoft.com/windows/servercore@sha256:378d85bd8e7388a777d25009f8523d1e95a5f544f131eaada83171045d5b2c1e ContainerID:containerd://d590356c7af6f935e27c54d35977e44304503d1afed64e7e658a4b01ed4ba111 Started:0xc00095ea98}] QOSClass:BestEffort EphemeralContainerStatuses:[]}", } pod "azurefile-volume-tester-9nnth" failed with status: {Phase:Failed Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-19 11:25:00 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-19 11:25:00 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-19 11:25:00 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-19 11:25:00 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:10.1.0.7 PodIP:192.168.139.196 PodIPs:[{IP:192.168.139.196}] StartTime:2022-04-19 11:25:00 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:volume-tester State:{Waiting:&ContainerStateWaiting{Reason:RunContainerError,Message:context deadline exceeded,} Running:nil Terminated:nil} LastTerminationState:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:0,Signal:0,Reason:,Message:,StartedAt:0001-01-01 00:00:00 +0000 UTC,FinishedAt:0001-01-01 00:00:00 +0000 UTC,ContainerID:containerd://d590356c7af6f935e27c54d35977e44304503d1afed64e7e658a4b01ed4ba111,}} Ready:false RestartCount:0 Image:mcr.microsoft.com/windows/servercore:ltsc2022 ImageID:mcr.microsoft.com/windows/servercore@sha256:378d85bd8e7388a777d25009f8523d1e95a5f544f131eaada83171045d5b2c1e ContainerID:containerd://d590356c7af6f935e27c54d35977e44304503d1afed64e7e658a4b01ed4ba111 Started:0xc00095ea98}] QOSClass:BestEffort EphemeralContainerStatuses:[]} occurred /home/prow/go/src/sigs.k8s.io/azurefile-csi-driver/test/e2e/testsuites/testsuites.go:691from junit_01.xml
�[1mSTEP�[0m: Creating a kubernetes client Apr 19 11:23:22.995: INFO: >>> kubeConfig: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig �[1mSTEP�[0m: Building a namespace api object, basename azurefile �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace Apr 19 11:23:23.796: INFO: >>> kubeConfig: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig �[1mSTEP�[0m: setting up the StorageClass �[1mSTEP�[0m: creating a StorageClass �[1mSTEP�[0m: setting up the PVC and PV �[1mSTEP�[0m: creating a PVC �[1mSTEP�[0m: waiting for PVC to be in phase "Bound" Apr 19 11:23:23.915: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-pxzfr] to have phase Bound Apr 19 11:23:23.971: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:23:26.029: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:23:28.088: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:23:30.145: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:23:32.203: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:23:34.260: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:23:36.318: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:23:38.375: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:23:40.432: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:23:42.489: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:23:44.545: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:23:46.603: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:23:48.661: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:23:50.717: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:23:52.774: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:23:54.831: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:23:56.889: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:23:58.947: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:24:01.004: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:24:03.062: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:24:05.119: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:24:07.177: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:24:09.234: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:24:11.291: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:24:13.348: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:24:15.405: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:24:17.462: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:24:19.519: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:24:21.577: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:24:23.635: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:24:25.692: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:24:27.749: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:24:29.806: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:24:31.864: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:24:33.921: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:24:35.978: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:24:38.035: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:24:40.091: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:24:42.149: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:24:44.206: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:24:46.264: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:24:48.320: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:24:50.378: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:24:52.436: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:24:54.494: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:24:56.551: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:24:58.608: INFO: PersistentVolumeClaim pvc-pxzfr found but phase is Pending instead of Bound. Apr 19 11:25:00.664: INFO: PersistentVolumeClaim pvc-pxzfr found and phase=Bound (1m36.749125018s) �[1mSTEP�[0m: checking the PVC �[1mSTEP�[0m: validating provisioned PV �[1mSTEP�[0m: checking the PV �[1mSTEP�[0m: deploying the pod �[1mSTEP�[0m: sleep 1s waiting for volume ready in windows-2022 �[1mSTEP�[0m: checking that the pods command exits with no error Apr 19 11:25:01.837: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-9nnth" in namespace "azurefile-2540" to be "Succeeded or Failed" Apr 19 11:25:01.893: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 56.660083ms Apr 19 11:25:03.951: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 2.114722881s Apr 19 11:25:06.008: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 4.171647611s Apr 19 11:25:08.067: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 6.230539326s Apr 19 11:25:10.127: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 8.290495175s Apr 19 11:25:12.187: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 10.350451887s Apr 19 11:25:14.248: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 12.411860452s Apr 19 11:25:16.308: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 14.471587796s Apr 19 11:25:18.367: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 16.530120945s Apr 19 11:25:20.425: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 18.588383167s Apr 19 11:25:22.484: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 20.647818636s Apr 19 11:25:24.544: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 22.707111896s Apr 19 11:25:26.602: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 24.765498999s Apr 19 11:25:28.661: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 26.82450649s Apr 19 11:25:30.722: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 28.885258683s Apr 19 11:25:32.781: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 30.944422794s Apr 19 11:25:34.841: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 33.004548366s Apr 19 11:25:36.900: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 35.063410378s Apr 19 11:25:38.960: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 37.122917321s Apr 19 11:25:41.021: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 39.184155608s Apr 19 11:25:43.081: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 41.244037212s Apr 19 11:25:45.141: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 43.304785192s Apr 19 11:25:47.201: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 45.363960949s Apr 19 11:25:49.260: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 47.423799935s Apr 19 11:25:51.320: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 49.483027425s Apr 19 11:25:53.378: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 51.541344381s Apr 19 11:25:55.437: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 53.60079525s Apr 19 11:25:57.497: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 55.659991468s Apr 19 11:25:59.556: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 57.719151554s Apr 19 11:26:01.615: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 59.778265268s Apr 19 11:26:03.673: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.836899043s Apr 19 11:26:05.734: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.897434334s Apr 19 11:26:07.793: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.956315485s Apr 19 11:26:09.851: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.014772233s Apr 19 11:26:11.910: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.073550172s Apr 19 11:26:13.970: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.133242803s Apr 19 11:26:16.028: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.191418617s Apr 19 11:26:18.087: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.250091862s Apr 19 11:26:20.147: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.310025145s Apr 19 11:26:22.205: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.368523842s Apr 19 11:26:24.264: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.427528269s Apr 19 11:26:26.324: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.48701955s Apr 19 11:26:28.382: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.545518675s Apr 19 11:26:30.442: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.605355622s Apr 19 11:26:32.501: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.664649013s Apr 19 11:26:34.561: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.724476155s Apr 19 11:26:36.620: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.783789832s Apr 19 11:26:38.680: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.843838644s Apr 19 11:26:40.740: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.903496543s Apr 19 11:26:42.800: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.963117133s Apr 19 11:26:44.860: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 1m43.022970416s Apr 19 11:26:46.918: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 1m45.081811309s Apr 19 11:26:48.978: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 1m47.141317462s Apr 19 11:26:51.037: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 1m49.200204933s Apr 19 11:26:53.096: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 1m51.259663207s Apr 19 11:26:55.158: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 1m53.321771448s Apr 19 11:26:57.218: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 1m55.381000551s Apr 19 11:26:59.276: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 1m57.439821919s Apr 19 11:27:01.336: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 1m59.499325594s Apr 19 11:27:03.394: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 2m1.557889715s Apr 19 11:27:05.453: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 2m3.61636728s Apr 19 11:27:07.512: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 2m5.675640993s Apr 19 11:27:09.572: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 2m7.735745187s Apr 19 11:27:11.632: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 2m9.795368904s Apr 19 11:27:13.691: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 2m11.854837586s Apr 19 11:27:15.752: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 2m13.91492841s Apr 19 11:27:17.811: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 2m15.974696428s Apr 19 11:27:19.871: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.034566654s Apr 19 11:27:21.930: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.093686835s Apr 19 11:27:23.990: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.153370919s Apr 19 11:27:26.049: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.211942366s Apr 19 11:27:28.108: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.271426706s Apr 19 11:27:30.166: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.329912795s Apr 19 11:27:32.226: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.389177622s Apr 19 11:27:34.286: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.449035865s Apr 19 11:27:36.345: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.508127678s Apr 19 11:27:38.403: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.566608839s Apr 19 11:27:40.462: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.625210579s Apr 19 11:27:42.520: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.683694453s Apr 19 11:27:44.580: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.743260487s Apr 19 11:27:46.639: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.802585185s Apr 19 11:27:48.698: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.861524298s Apr 19 11:27:50.758: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.921879895s Apr 19 11:27:52.818: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.98118491s Apr 19 11:27:54.881: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 2m53.04422801s Apr 19 11:27:56.940: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 2m55.103792738s Apr 19 11:27:58.999: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 2m57.162092664s Apr 19 11:28:01.061: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 2m59.224578901s Apr 19 11:28:03.120: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 3m1.283681171s Apr 19 11:28:05.180: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 3m3.343729029s Apr 19 11:28:07.240: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 3m5.403185694s Apr 19 11:28:09.299: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 3m7.462713815s Apr 19 11:28:11.358: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 3m9.52127227s Apr 19 11:28:13.418: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 3m11.580985837s Apr 19 11:28:15.477: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 3m13.640315381s Apr 19 11:28:17.536: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 3m15.699338015s Apr 19 11:28:19.595: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 3m17.758769056s Apr 19 11:28:21.655: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 3m19.818328875s Apr 19 11:28:23.714: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 3m21.877703775s Apr 19 11:28:25.774: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 3m23.937160648s Apr 19 11:28:27.832: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 3m25.995732701s Apr 19 11:28:29.891: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.054330999s Apr 19 11:28:31.950: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.113378698s Apr 19 11:28:34.009: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.172551655s Apr 19 11:28:36.068: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.231721079s Apr 19 11:28:38.129: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.2919721s Apr 19 11:28:40.187: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.350875242s Apr 19 11:28:42.246: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.409758028s Apr 19 11:28:44.306: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.469211603s Apr 19 11:28:46.366: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.52907699s Apr 19 11:28:48.424: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.587646438s Apr 19 11:28:50.484: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.647055778s Apr 19 11:28:52.543: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.706720274s Apr 19 11:28:54.602: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.765652664s Apr 19 11:28:56.661: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.823918606s Apr 19 11:28:58.720: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.883165808s Apr 19 11:29:00.777: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.940260821s Apr 19 11:29:02.834: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.997535957s Apr 19 11:29:04.891: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 4m3.054035872s Apr 19 11:29:06.948: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 4m5.111449522s Apr 19 11:29:09.005: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 4m7.168466197s Apr 19 11:29:11.062: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 4m9.225744705s Apr 19 11:29:13.119: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 4m11.282058949s Apr 19 11:29:15.175: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 4m13.338556896s Apr 19 11:29:17.232: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 4m15.395078031s Apr 19 11:29:19.287: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 4m17.450749362s Apr 19 11:29:21.344: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 4m19.507314575s Apr 19 11:29:23.404: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 4m21.567094383s Apr 19 11:29:25.461: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 4m23.624233975s Apr 19 11:29:27.519: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 4m25.68224619s Apr 19 11:29:29.576: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 4m27.739664232s Apr 19 11:29:31.632: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 4m29.795798399s Apr 19 11:29:33.689: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 4m31.852311732s Apr 19 11:29:35.746: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 4m33.909321196s Apr 19 11:29:37.801: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 4m35.96481868s Apr 19 11:29:39.857: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.020667769s Apr 19 11:29:41.915: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.0782678s Apr 19 11:29:43.972: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.134958113s Apr 19 11:29:46.028: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.19161403s Apr 19 11:29:48.085: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.248875395s Apr 19 11:29:50.142: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.305295216s Apr 19 11:29:52.198: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.361791328s Apr 19 11:29:54.255: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.418265035s Apr 19 11:29:56.311: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.474023937s Apr 19 11:29:58.368: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.530991738s Apr 19 11:30:00.424: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.58734572s Apr 19 11:30:02.481: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.644385154s Apr 19 11:30:04.538: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 5m2.701097082s Apr 19 11:30:06.594: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 5m4.757127456s Apr 19 11:30:08.651: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 5m6.81409391s Apr 19 11:30:10.708: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 5m8.870982634s Apr 19 11:30:12.764: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 5m10.926956804s Apr 19 11:30:14.821: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 5m12.984264271s Apr 19 11:30:16.878: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 5m15.041619758s Apr 19 11:30:18.936: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 5m17.099644628s Apr 19 11:30:20.993: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 5m19.156077438s Apr 19 11:30:23.050: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 5m21.213340383s Apr 19 11:30:25.107: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 5m23.270828908s Apr 19 11:30:27.164: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 5m25.327158878s Apr 19 11:30:29.221: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 5m27.384465252s Apr 19 11:30:31.279: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 5m29.442550066s Apr 19 11:30:33.336: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 5m31.498946635s Apr 19 11:30:35.392: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 5m33.555216022s Apr 19 11:30:37.449: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 5m35.612010058s Apr 19 11:30:39.505: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 5m37.668203912s Apr 19 11:30:41.562: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 5m39.725057696s Apr 19 11:30:43.617: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 5m41.780909615s Apr 19 11:30:45.675: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 5m43.837937273s Apr 19 11:30:47.731: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 5m45.894612583s Apr 19 11:30:49.788: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 5m47.951761905s Apr 19 11:30:51.845: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 5m50.008542417s Apr 19 11:30:53.902: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 5m52.065298822s Apr 19 11:30:55.959: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 5m54.122224841s Apr 19 11:30:58.016: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 5m56.179091945s Apr 19 11:31:00.072: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 5m58.235050487s Apr 19 11:31:02.128: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 6m0.291630248s Apr 19 11:31:04.185: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 6m2.348281161s Apr 19 11:31:06.240: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 6m4.403851019s Apr 19 11:31:08.297: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 6m6.460358073s Apr 19 11:31:10.354: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 6m8.517246992s Apr 19 11:31:12.413: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 6m10.576853247s Apr 19 11:31:14.470: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 6m12.633677543s Apr 19 11:31:16.527: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 6m14.690490834s Apr 19 11:31:18.584: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 6m16.747234134s Apr 19 11:31:20.645: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 6m18.808407902s Apr 19 11:31:22.701: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 6m20.863948377s Apr 19 11:31:24.759: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 6m22.922486658s Apr 19 11:31:26.815: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 6m24.97861221s Apr 19 11:31:28.872: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 6m27.035229481s Apr 19 11:31:30.928: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Pending", Reason="", readiness=false. Elapsed: 6m29.0909638s Apr 19 11:31:32.985: INFO: Pod "azurefile-volume-tester-9nnth": Phase="Failed", Reason="", readiness=false. Elapsed: 6m31.148032918s Apr 19 11:31:32.985: INFO: deleting Pod "azurefile-2540"/"azurefile-volume-tester-9nnth" Apr 19 11:31:33.061: INFO: Pod azurefile-volume-tester-9nnth has the following logs: �[1mSTEP�[0m: Deleting pod azurefile-volume-tester-9nnth in namespace azurefile-2540 Apr 19 11:31:33.133: INFO: deleting PVC "azurefile-2540"/"pvc-pxzfr" Apr 19 11:31:33.133: INFO: Deleting PersistentVolumeClaim "pvc-pxzfr" �[1mSTEP�[0m: waiting for claim's PV "pvc-ee61c0dc-cf8b-4713-bc61-88296639811c" to be deleted Apr 19 11:31:33.301: INFO: Waiting up to 10m0s for PersistentVolume pvc-ee61c0dc-cf8b-4713-bc61-88296639811c to get deleted Apr 19 11:31:33.354: INFO: PersistentVolume pvc-ee61c0dc-cf8b-4713-bc61-88296639811c found and phase=Released (53.437942ms) Apr 19 11:31:38.408: INFO: PersistentVolume pvc-ee61c0dc-cf8b-4713-bc61-88296639811c was removed Apr 19 11:31:38.408: INFO: Waiting up to 5m0s for PersistentVolumeClaim azurefile-2540 to be removed Apr 19 11:31:38.460: INFO: Claim "azurefile-2540" in namespace "pvc-pxzfr" doesn't exist in the system Apr 19 11:31:38.461: INFO: deleting StorageClass azurefile-2540-file.csi.azure.com-dynamic-sc-4bzb7 �[1mSTEP�[0m: Collecting events from namespace "azurefile-2540". �[1mSTEP�[0m: Found 11 events. Apr 19 11:31:38.574: INFO: At 2022-04-19 11:23:23 +0000 UTC - event for pvc-pxzfr: {file.csi.azure.com_capz-uyjrvr-md-0-vhn4n_97700786-c405-48f7-98d9-fc55e6d4b3c8 } Provisioning: External provisioner is provisioning volume for claim "azurefile-2540/pvc-pxzfr" Apr 19 11:31:38.574: INFO: At 2022-04-19 11:23:23 +0000 UTC - event for pvc-pxzfr: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "file.csi.azure.com" or manually created by system administrator Apr 19 11:31:38.574: INFO: At 2022-04-19 11:25:00 +0000 UTC - event for azurefile-volume-tester-9nnth: {default-scheduler } Scheduled: Successfully assigned azurefile-2540/azurefile-volume-tester-9nnth to capz-uyjr-zzjxd Apr 19 11:31:38.574: INFO: At 2022-04-19 11:25:00 +0000 UTC - event for pvc-pxzfr: {file.csi.azure.com_capz-uyjrvr-md-0-vhn4n_97700786-c405-48f7-98d9-fc55e6d4b3c8 } ProvisioningSucceeded: Successfully provisioned volume pvc-ee61c0dc-cf8b-4713-bc61-88296639811c Apr 19 11:31:38.574: INFO: At 2022-04-19 11:25:10 +0000 UTC - event for azurefile-volume-tester-9nnth: {kubelet capz-uyjr-zzjxd} Pulling: Pulling image "mcr.microsoft.com/windows/servercore:ltsc2022" Apr 19 11:31:38.574: INFO: At 2022-04-19 11:29:30 +0000 UTC - event for azurefile-volume-tester-9nnth: {kubelet capz-uyjr-zzjxd} Pulled: Successfully pulled image "mcr.microsoft.com/windows/servercore:ltsc2022" in 4m20.0661007s Apr 19 11:31:38.574: INFO: At 2022-04-19 11:29:30 +0000 UTC - event for azurefile-volume-tester-9nnth: {kubelet capz-uyjr-zzjxd} Created: Created container volume-tester Apr 19 11:31:38.574: INFO: At 2022-04-19 11:31:30 +0000 UTC - event for azurefile-volume-tester-9nnth: {kubelet capz-uyjr-zzjxd} Failed: Error: context deadline exceeded Apr 19 11:31:38.574: INFO: At 2022-04-19 11:31:31 +0000 UTC - event for azurefile-volume-tester-9nnth: {kubelet capz-uyjr-zzjxd} Pulled: Container image "mcr.microsoft.com/windows/servercore:ltsc2022" already present on machine Apr 19 11:31:38.574: INFO: At 2022-04-19 11:31:35 +0000 UTC - event for azurefile-volume-tester-9nnth: {kubelet capz-uyjr-zzjxd} Started: Started container volume-tester Apr 19 11:31:38.574: INFO: At 2022-04-19 11:31:36 +0000 UTC - event for azurefile-volume-tester-9nnth: {kubelet capz-uyjr-zzjxd} Killing: Stopping container volume-tester Apr 19 11:31:38.627: INFO: POD NODE PHASE GRACE CONDITIONS Apr 19 11:31:38.627: INFO: Apr 19 11:31:38.701: INFO: Logging node info for node capz-uyjr-pw5j4 Apr 19 11:31:38.757: INFO: Node Info: &Node{ObjectMeta:{capz-uyjr-pw5j4 bf03da55-f370-4e36-a6c9-eca2677d5f77 3830 0 2022-04-19 11:06:11 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D4s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-uyjr-pw5j4 kubernetes.io/os:windows node.kubernetes.io/instance-type:Standard_D4s_v3 node.kubernetes.io/windows-build:10.0.20348 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[cluster.x-k8s.io/cluster-name:capz-uyjrvr cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-uyjrvr-md-win-595b5984b6-9mmk6 cluster.x-k8s.io/owner-kind:MachineSet cluster.x-k8s.io/owner-name:capz-uyjrvr-md-win-595b5984b6 csi.volume.kubernetes.io/nodeid:{"file.csi.azure.com":"capz-uyjr-pw5j4"} kubeadm.alpha.kubernetes.io/cri-socket:npipe:////./pipe/containerd-containerd node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.1.0.5/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.5.129 projectcalico.org/VXLANTunnelMACAddr:00:15:5d:2e:51:4a volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-19 11:06:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-04-19 11:06:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}} } {manager Update v1 2022-04-19 11:06:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {calico-node.exe Update v1 2022-04-19 11:08:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{},"f:projectcalico.org/VXLANTunnelMACAddr":{}}}} status} {Go-http-client Update v1 2022-04-19 11:23:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-uyjrvr/providers/Microsoft.Compute/virtualMachines/capz-uyjr-pw5j4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{17179398144 0} {<nil>} 16776756Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{123221307598 0} {<nil>} 123221307598 DecimalSI},memory: {{17074540544 0} {<nil>} 16674356Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-19 11:28:20 +0000 UTC,LastTransitionTime:2022-04-19 11:06:11 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-19 11:28:20 +0000 UTC,LastTransitionTime:2022-04-19 11:06:11 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-19 11:28:20 +0000 UTC,LastTransitionTime:2022-04-19 11:06:11 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-19 11:28:20 +0000 UTC,LastTransitionTime:2022-04-19 11:07:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-uyjr-pw5j4,},NodeAddress{Type:InternalIP,Address:10.1.0.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:capz-uyjr-pw5j4,SystemUUID:057A776A-BC3C-4D6E-825D-587D25847F3E,BootID:,KernelVersion:10.0.20348.405,OSImage:Windows Server 2022 Datacenter,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/sigwindowstools/calico-install@sha256:141afecd724eb757ee41593cc73f35fb19a2ce13cad73179cf3b1cef81a637d1 docker.io/sigwindowstools/calico-install:v3.22.1-hostprocess],SizeBytes:148096127,},ContainerImage{Names:[capzci.azurecr.io/azurefile-csi@sha256:d6138752fd29dce33c0720a4f03100331f8a67a44694d6777824543335009e87 capzci.azurecr.io/azurefile-csi:e2e-cad0db442626e8889df95d74f13f0d82fdcf0060],SizeBytes:130300512,},ContainerImage{Names:[docker.io/sigwindowstools/calico-node@sha256:b8e6e2f190e58d6b61b7f2a19b0e2e17a377e5b9d7b9528e9b7953d9f9ab59bb docker.io/sigwindowstools/calico-node:v3.22.1-hostprocess],SizeBytes:128793648,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:dbec3a8166686b09b242176ab5b99e993da4126438bbce68147c3fd654f35662 mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.4.0],SizeBytes:125554391,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:c96a6255c42766f6b8bb1a7cda02b0060ab1b20b2e2dafcc64ec09e7646745a6 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.5.0],SizeBytes:124471446,},ContainerImage{Names:[ghcr.io/kubernetes-sigs/sig-windows/csi-proxy@sha256:96b4144986319a747ba599892454be2737aae6005d96b8e13ed481321ac3afba ghcr.io/kubernetes-sigs/sig-windows/csi-proxy:v1.0.2],SizeBytes:123925937,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:119397646,},ContainerImage{Names:[docker.io/sigwindowstools/kube-proxy@sha256:0f8a44b795d1824358f24cc56f0024d18a39ae044656686596d8b7fa6d78e1fa docker.io/sigwindowstools/kube-proxy:v1.23.5-calico-hostprocess],SizeBytes:116337721,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 19 11:31:38.757: INFO: Logging kubelet events for node capz-uyjr-pw5j4 Apr 19 11:31:38.815: INFO: Logging pods the kubelet thinks is on node capz-uyjr-pw5j4 Apr 19 11:31:38.921: INFO: calico-node-windows-d8h6f started at 2022-04-19 11:06:12 +0000 UTC (1+2 container statuses recorded) Apr 19 11:31:38.921: INFO: Init container install-cni ready: true, restart count 0 Apr 19 11:31:38.921: INFO: Container calico-node-felix ready: true, restart count 0 Apr 19 11:31:38.921: INFO: Container calico-node-startup ready: true, restart count 0 Apr 19 11:31:38.921: INFO: csi-proxy-6pxhv started at 2022-04-19 11:07:33 +0000 UTC (0+1 container statuses recorded) Apr 19 11:31:38.921: INFO: Container csi-proxy ready: true, restart count 0 Apr 19 11:31:38.921: INFO: csi-azurefile-node-win-2hbht started at 2022-04-19 11:21:34 +0000 UTC (0+3 container statuses recorded) Apr 19 11:31:38.921: INFO: Container azurefile ready: true, restart count 0 Apr 19 11:31:38.921: INFO: Container liveness-probe ready: true, restart count 0 Apr 19 11:31:38.921: INFO: Container node-driver-registrar ready: true, restart count 0 Apr 19 11:31:38.921: INFO: kube-proxy-windows-n6rxh started at 2022-04-19 11:06:12 +0000 UTC (0+1 container statuses recorded) Apr 19 11:31:38.921: INFO: Container kube-proxy ready: true, restart count 0 Apr 19 11:31:39.211: INFO: Latency metrics for node capz-uyjr-pw5j4 Apr 19 11:31:39.211: INFO: Logging node info for node capz-uyjr-zzjxd Apr 19 11:31:39.269: INFO: Node Info: &Node{ObjectMeta:{capz-uyjr-zzjxd 67c88250-50bd-4c54-afe4-677af198ecd0 4076 0 2022-04-19 11:05:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D4s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-uyjr-zzjxd kubernetes.io/os:windows node.kubernetes.io/instance-type:Standard_D4s_v3 node.kubernetes.io/windows-build:10.0.20348 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[cluster.x-k8s.io/cluster-name:capz-uyjrvr cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-uyjrvr-md-win-595b5984b6-9phzm cluster.x-k8s.io/owner-kind:MachineSet cluster.x-k8s.io/owner-name:capz-uyjrvr-md-win-595b5984b6 csi.volume.kubernetes.io/nodeid:{"file.csi.azure.com":"capz-uyjr-zzjxd"} kubeadm.alpha.kubernetes.io/cri-socket:npipe:////./pipe/containerd-containerd node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.1.0.7/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.139.193 projectcalico.org/VXLANTunnelMACAddr:00:15:5d:d9:b3:1a volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-19 11:05:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-04-19 11:06:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}} } {manager Update v1 2022-04-19 11:06:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {calico-node.exe Update v1 2022-04-19 11:07:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{},"f:projectcalico.org/VXLANTunnelMACAddr":{}}}} status} {Go-http-client Update v1 2022-04-19 11:22:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-uyjrvr/providers/Microsoft.Compute/virtualMachines/capz-uyjr-zzjxd,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{17179398144 0} {<nil>} 16776756Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{123221307598 0} {<nil>} 123221307598 DecimalSI},memory: {{17074540544 0} {<nil>} 16674356Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-19 11:30:01 +0000 UTC,LastTransitionTime:2022-04-19 11:05:53 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-19 11:30:01 +0000 UTC,LastTransitionTime:2022-04-19 11:05:53 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-19 11:30:01 +0000 UTC,LastTransitionTime:2022-04-19 11:05:53 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-19 11:30:01 +0000 UTC,LastTransitionTime:2022-04-19 11:07:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-uyjr-zzjxd,},NodeAddress{Type:InternalIP,Address:10.1.0.7,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:capz-uyjr-zzjxd,SystemUUID:A57CE631-1EC5-4E4B-A8E4-67D2362B3705,BootID:,KernelVersion:10.0.20348.405,OSImage:Windows Server 2022 Datacenter,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:378d85bd8e7388a777d25009f8523d1e95a5f544f131eaada83171045d5b2c1e mcr.microsoft.com/windows/servercore:ltsc2022],SizeBytes:2226956779,},ContainerImage{Names:[docker.io/sigwindowstools/calico-install@sha256:141afecd724eb757ee41593cc73f35fb19a2ce13cad73179cf3b1cef81a637d1 docker.io/sigwindowstools/calico-install:v3.22.1-hostprocess],SizeBytes:148096127,},ContainerImage{Names:[capzci.azurecr.io/azurefile-csi@sha256:d6138752fd29dce33c0720a4f03100331f8a67a44694d6777824543335009e87 capzci.azurecr.io/azurefile-csi:e2e-cad0db442626e8889df95d74f13f0d82fdcf0060],SizeBytes:130300512,},ContainerImage{Names:[docker.io/sigwindowstools/calico-node@sha256:b8e6e2f190e58d6b61b7f2a19b0e2e17a377e5b9d7b9528e9b7953d9f9ab59bb docker.io/sigwindowstools/calico-node:v3.22.1-hostprocess],SizeBytes:128793648,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:dbec3a8166686b09b242176ab5b99e993da4126438bbce68147c3fd654f35662 mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.4.0],SizeBytes:125554391,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:c96a6255c42766f6b8bb1a7cda02b0060ab1b20b2e2dafcc64ec09e7646745a6 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.5.0],SizeBytes:124471446,},ContainerImage{Names:[ghcr.io/kubernetes-sigs/sig-windows/csi-proxy@sha256:96b4144986319a747ba599892454be2737aae6005d96b8e13ed481321ac3afba ghcr.io/kubernetes-sigs/sig-windows/csi-proxy:v1.0.2],SizeBytes:123925937,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:119397646,},ContainerImage{Names:[docker.io/sigwindowstools/kube-proxy@sha256:0f8a44b795d1824358f24cc56f0024d18a39ae044656686596d8b7fa6d78e1fa docker.io/sigwindowstools/kube-proxy:v1.23.5-calico-hostprocess],SizeBytes:116337721,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 19 11:31:39.269: INFO: Logging kubelet events for node capz-uyjr-zzjxd Apr 19 11:31:39.331: INFO: Logging pods the kubelet thinks is on node capz-uyjr-zzjxd Apr 19 11:31:39.412: INFO: calico-node-windows-gf8wx started at 2022-04-19 11:05:53 +0000 UTC (1+2 container statuses recorded) Apr 19 11:31:39.412: INFO: Init container install-cni ready: true, restart count 0 Apr 19 11:31:39.412: INFO: Container calico-node-felix ready: true, restart count 1 Apr 19 11:31:39.412: INFO: Container calico-node-startup ready: true, restart count 0 Apr 19 11:31:39.412: INFO: kube-proxy-windows-mwrfk started at 2022-04-19 11:05:53 +0000 UTC (0+1 container statuses recorded) Apr 19 11:31:39.412: INFO: Container kube-proxy ready: true, restart count 0 Apr 19 11:31:39.413: INFO: csi-proxy-vk8hg started at 2022-04-19 11:07:04 +0000 UTC (0+1 container statuses recorded) Apr 19 11:31:39.413: INFO: Container csi-proxy ready: true, restart count 0 Apr 19 11:31:39.413: INFO: csi-azurefile-node-win-ksg7h started at 2022-04-19 11:21:34 +0000 UTC (0+3 container statuses recorded) Apr 19 11:31:39.413: INFO: Container azurefile ready: true, restart count 0 Apr 19 11:31:39.413: INFO: Container liveness-probe ready: true, restart count 0 Apr 19 11:31:39.413: INFO: Container node-driver-registrar ready: true, restart count 0 Apr 19 11:31:39.670: INFO: Latency metrics for node capz-uyjr-zzjxd Apr 19 11:31:39.670: INFO: Logging node info for node capz-uyjrvr-control-plane-8t9mz Apr 19 11:31:39.727: INFO: Node Info: &Node{ObjectMeta:{capz-uyjrvr-control-plane-8t9mz 6d59ac34-cf5f-40e1-a9c6-e51ae79582c7 4160 0 2022-04-19 11:03:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:westus2-1 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-uyjrvr-control-plane-8t9mz kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/master: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:Standard_D2s_v3 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:westus2-1] map[cluster.x-k8s.io/cluster-name:capz-uyjrvr cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-uyjrvr-control-plane-gcpz7 cluster.x-k8s.io/owner-kind:KubeadmControlPlane cluster.x-k8s.io/owner-name:capz-uyjrvr-control-plane kubeadm.alpha.kubernetes.io/cri-socket:/run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.0.4/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.176.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-19 11:03:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node-role.kubernetes.io/control-plane":{},"f:node-role.kubernetes.io/master":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {manager Update v1 2022-04-19 11:04:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {kube-controller-manager Update v1 2022-04-19 11:04:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:taints":{}}} } {Go-http-client Update v1 2022-04-19 11:04:36 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {calico-node Update v1 2022-04-19 11:04:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-uyjrvr/providers/Microsoft.Compute/virtualMachines/capz-uyjrvr-control-plane-8t9mz,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{133018140672 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8340819968 0} {<nil>} 8145332Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{119716326407 0} {<nil>} 119716326407 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8235962368 0} {<nil>} 8042932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-04-19 11:04:38 +0000 UTC,LastTransitionTime:2022-04-19 11:04:38 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-19 11:30:35 +0000 UTC,LastTransitionTime:2022-04-19 11:03:36 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-19 11:30:35 +0000 UTC,LastTransitionTime:2022-04-19 11:03:36 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-19 11:30:35 +0000 UTC,LastTransitionTime:2022-04-19 11:03:36 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-19 11:30:35 +0000 UTC,LastTransitionTime:2022-04-19 11:04:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-uyjrvr-control-plane-8t9mz,},NodeAddress{Type:InternalIP,Address:10.0.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d408f93aaf404596827f9ed9f94a133f,SystemUUID:11ed2a8a-8a39-b54f-9e16-8c155bc2878f,BootID:ed6e2d6c-2b99-4123-bfab-83aa6868560d,KernelVersion:5.13.0-1017-azure,OSImage:Ubuntu 20.04.4 LTS,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 k8s.gcr.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[docker.io/calico/cni@sha256:2219eae79544b098119a06a8bb5608867f9ac00471592a00e2347f3ae4bea687 docker.io/calico/cni:v3.22.1],SizeBytes:80514590,},ContainerImage{Names:[docker.io/calico/node@sha256:1f8ed83e5264b4206cce7e1def11bca0b3ea7d5f4eb9b0ca0dbfc8cb968ca57e docker.io/calico/node:v3.22.1],SizeBytes:69647221,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:e42a0aba3637d123481cca14fd8314a482616593edf58f9594c9382e50498f9b docker.io/calico/kube-controllers:v3.22.1],SizeBytes:54948023,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:c1f625d115fbd9a12eac615653fc81c0edb33b2b5a76d1e09d5daed11fa557c1 k8s.gcr.io/kube-proxy:v1.23.5],SizeBytes:39278412,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:ddf5bf7196eb534271f9e5d403f4da19838d5610bb5ca191001bde5f32b5492e k8s.gcr.io/kube-apiserver:v1.23.5],SizeBytes:32603217,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:cca0fb3532abedcc95c5f64268d54da9ecc56cc4817ff08d0128941cf2b0e1a4 k8s.gcr.io/kube-controller-manager:v1.23.5],SizeBytes:30174093,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:489efb65da9edc40bf0911f3e6371e5bb6b8ad8fde1d55193a6cc84c2ef36626 k8s.gcr.io/kube-scheduler:v1.23.5],SizeBytes:15131395,},ContainerImage{Names:[k8s.gcr.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e k8s.gcr.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[docker.io/calico/pod2daemon-flexvol@sha256:35802ba083546a7c5e8b5bf0ee7ffad7f8a468e8c2b3631e7e9647512c94041d docker.io/calico/pod2daemon-flexvol:v3.22.1],SizeBytes:8462620,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 19 11:31:39.728: INFO: Logging kubelet events for node capz-uyjrvr-control-plane-8t9mz Apr 19 11:31:39.785: INFO: Logging pods the kubelet thinks is on node capz-uyjrvr-control-plane-8t9mz Apr 19 11:31:39.893: INFO: etcd-capz-uyjrvr-control-plane-8t9mz started at 2022-04-19 11:04:06 +0000 UTC (0+1 container statuses recorded) Apr 19 11:31:39.894: INFO: Container etcd ready: true, restart count 0 Apr 19 11:31:39.894: INFO: coredns-64897985d-fcblc started at 2022-04-19 11:04:26 +0000 UTC (0+1 container statuses recorded) Apr 19 11:31:39.894: INFO: Container coredns ready: true, restart count 0 Apr 19 11:31:39.894: INFO: coredns-64897985d-vfff7 started at 2022-04-19 11:04:26 +0000 UTC (0+1 container statuses recorded) Apr 19 11:31:39.894: INFO: Container coredns ready: true, restart count 0 Apr 19 11:31:39.894: INFO: kube-apiserver-capz-uyjrvr-control-plane-8t9mz started at 2022-04-19 11:04:06 +0000 UTC (0+1 container statuses recorded) Apr 19 11:31:39.894: INFO: Container kube-apiserver ready: true, restart count 0 Apr 19 11:31:39.894: INFO: kube-controller-manager-capz-uyjrvr-control-plane-8t9mz started at 2022-04-19 11:04:06 +0000 UTC (0+1 container statuses recorded) Apr 19 11:31:39.894: INFO: Container kube-controller-manager ready: true, restart count 0 Apr 19 11:31:39.894: INFO: kube-scheduler-capz-uyjrvr-control-plane-8t9mz started at 2022-04-19 11:04:06 +0000 UTC (0+1 container statuses recorded) Apr 19 11:31:39.894: INFO: Container kube-scheduler ready: true, restart count 0 Apr 19 11:31:39.894: INFO: calico-node-58ljd started at 2022-04-19 11:03:58 +0000 UTC (3+1 container statuses recorded) Apr 19 11:31:39.894: INFO: Init container upgrade-ipam ready: true, restart count 0 Apr 19 11:31:39.894: INFO: Init container install-cni ready: true, restart count 0 Apr 19 11:31:39.894: INFO: Init container flexvol-driver ready: true, restart count 0 Apr 19 11:31:39.894: INFO: Container calico-node ready: true, restart count 0 Apr 19 11:31:39.894: INFO: kube-proxy-nzs98 started at 2022-04-19 11:04:06 +0000 UTC (0+1 container statuses recorded) Apr 19 11:31:39.894: INFO: Container kube-proxy ready: true, restart count 0 Apr 19 11:31:39.894: INFO: calico-kube-controllers-7c664f4648-9gtm8 started at 2022-04-19 11:04:26 +0000 UTC (0+1 container statuses recorded) Apr 19 11:31:39.894: INFO: Container calico-kube-controllers ready: true, restart count 0 Apr 19 11:31:40.143: INFO: Latency metrics for node capz-uyjrvr-control-plane-8t9mz Apr 19 11:31:40.143: INFO: Logging node info for node capz-uyjrvr-md-0-qdz4l Apr 19 11:31:40.202: INFO: Node Info: &Node{ObjectMeta:{capz-uyjrvr-md-0-qdz4l 08412d1c-a776-4117-bff7-f1d69c6a7d81 3855 0 2022-04-19 11:05:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D4s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-uyjrvr-md-0-qdz4l kubernetes.io/os:linux node.kubernetes.io/instance-type:Standard_D4s_v3 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[cluster.x-k8s.io/cluster-name:capz-uyjrvr cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-uyjrvr-md-0-6f4bd878bc-d2ll8 cluster.x-k8s.io/owner-kind:MachineSet cluster.x-k8s.io/owner-name:capz-uyjrvr-md-0-6f4bd878bc kubeadm.alpha.kubernetes.io/cri-socket:/run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.1.0.4/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.57.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{manager Update v1 2022-04-19 11:05:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {Go-http-client Update v1 2022-04-19 11:05:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-04-19 11:05:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}} } {calico-node Update v1 2022-04-19 11:06:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {Go-http-client Update v1 2022-04-19 11:06:22 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-uyjrvr/providers/Microsoft.Compute/virtualMachines/capz-uyjrvr-md-0-qdz4l,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{133018140672 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16783433728 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{119716326407 0} {<nil>} 119716326407 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16678576128 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-04-19 11:06:19 +0000 UTC,LastTransitionTime:2022-04-19 11:06:19 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-19 11:28:29 +0000 UTC,LastTransitionTime:2022-04-19 11:05:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-19 11:28:29 +0000 UTC,LastTransitionTime:2022-04-19 11:05:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-19 11:28:29 +0000 UTC,LastTransitionTime:2022-04-19 11:05:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-19 11:28:29 +0000 UTC,LastTransitionTime:2022-04-19 11:06:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-uyjrvr-md-0-qdz4l,},NodeAddress{Type:InternalIP,Address:10.1.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:b3924b312cb84b11910e9b257734a388,SystemUUID:749088f0-b995-a542-9cee-4b6884c6652e,BootID:27b2adf1-5b68-4423-ab9a-3f9619704ab2,KernelVersion:5.13.0-1017-azure,OSImage:Ubuntu 20.04.4 LTS,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 k8s.gcr.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[docker.io/calico/cni@sha256:2219eae79544b098119a06a8bb5608867f9ac00471592a00e2347f3ae4bea687 docker.io/calico/cni:v3.22.1],SizeBytes:80514590,},ContainerImage{Names:[docker.io/calico/node@sha256:1f8ed83e5264b4206cce7e1def11bca0b3ea7d5f4eb9b0ca0dbfc8cb968ca57e docker.io/calico/node:v3.22.1],SizeBytes:69647221,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:c1f625d115fbd9a12eac615653fc81c0edb33b2b5a76d1e09d5daed11fa557c1 k8s.gcr.io/kube-proxy:v1.23.5],SizeBytes:39278412,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:ddf5bf7196eb534271f9e5d403f4da19838d5610bb5ca191001bde5f32b5492e k8s.gcr.io/kube-apiserver:v1.23.5],SizeBytes:32603217,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:cca0fb3532abedcc95c5f64268d54da9ecc56cc4817ff08d0128941cf2b0e1a4 k8s.gcr.io/kube-controller-manager:v1.23.5],SizeBytes:30174093,},ContainerImage{Names:[docker.io/andyzhangx/samba@sha256:1c268eae7ec1eb9fbbbd4f0aab3ee41c7a4c4ecb0313c498cb11cfdcc762ad3e docker.io/andyzhangx/samba:win-fix],SizeBytes:21999042,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:489efb65da9edc40bf0911f3e6371e5bb6b8ad8fde1d55193a6cc84c2ef36626 k8s.gcr.io/kube-scheduler:v1.23.5],SizeBytes:15131395,},ContainerImage{Names:[k8s.gcr.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e k8s.gcr.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[docker.io/calico/pod2daemon-flexvol@sha256:35802ba083546a7c5e8b5bf0ee7ffad7f8a468e8c2b3631e7e9647512c94041d docker.io/calico/pod2daemon-flexvol:v3.22.1],SizeBytes:8462620,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 19 11:31:40.202: INFO: Logging kubelet events for node capz-uyjrvr-md-0-qdz4l Apr 19 11:31:40.260: INFO: Logging pods the kubelet thinks is on node capz-uyjrvr-md-0-qdz4l Apr 19 11:31:40.342: INFO: kube-proxy-9dpnw started at 2022-04-19 11:05:52 +0000 UTC (0+1 container statuses recorded) Apr 19 11:31:40.342: INFO: Container kube-proxy ready: true, restart count 0 Apr 19 11:31:40.342: INFO: calico-node-nvdnb started at 2022-04-19 11:05:52 +0000 UTC (3+1 container statuses recorded) Apr 19 11:31:40.342: INFO: Init container upgrade-ipam ready: true, restart count 0 Apr 19 11:31:40.342: INFO: Init container install-cni ready: true, restart count 0 Apr 19 11:31:40.342: INFO: Init container flexvol-driver ready: true, restart count 0 Apr 19 11:31:40.342: INFO: Container calico-node ready: true, restart count 0 Apr 19 11:31:40.342: INFO: smb-server-55b87d449c-dlfhd started at 2022-04-19 11:22:54 +0000 UTC (0+1 container statuses recorded) Apr 19 11:31:40.342: INFO: Container smb-server ready: true, restart count 0 Apr 19 11:31:40.565: INFO: Latency metrics for node capz-uyjrvr-md-0-qdz4l Apr 19 11:31:40.566: INFO: Logging node info for node capz-uyjrvr-md-0-vhn4n Apr 19 11:31:40.622: INFO: Node Info: &Node{ObjectMeta:{capz-uyjrvr-md-0-vhn4n ae1b6805-0d1e-428b-bea0-b2c0b5e34e0a 3648 0 2022-04-19 11:05:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D4s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-uyjrvr-md-0-vhn4n kubernetes.io/os:linux node.kubernetes.io/instance-type:Standard_D4s_v3 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[cluster.x-k8s.io/cluster-name:capz-uyjrvr cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-uyjrvr-md-0-6f4bd878bc-297gj cluster.x-k8s.io/owner-kind:MachineSet cluster.x-k8s.io/owner-name:capz-uyjrvr-md-0-6f4bd878bc kubeadm.alpha.kubernetes.io/cri-socket:/run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.1.0.6/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.35.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-19 11:05:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-04-19 11:05:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}} } {manager Update v1 2022-04-19 11:05:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {calico-node Update v1 2022-04-19 11:05:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {Go-http-client Update v1 2022-04-19 11:05:55 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-uyjrvr/providers/Microsoft.Compute/virtualMachines/capz-uyjrvr-md-0-vhn4n,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{133018140672 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16783433728 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{119716326407 0} {<nil>} 119716326407 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16678576128 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-04-19 11:05:49 +0000 UTC,LastTransitionTime:2022-04-19 11:05:49 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-19 11:27:02 +0000 UTC,LastTransitionTime:2022-04-19 11:05:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-19 11:27:02 +0000 UTC,LastTransitionTime:2022-04-19 11:05:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-19 11:27:02 +0000 UTC,LastTransitionTime:2022-04-19 11:05:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-19 11:27:02 +0000 UTC,LastTransitionTime:2022-04-19 11:05:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-uyjrvr-md-0-vhn4n,},NodeAddress{Type:InternalIP,Address:10.1.0.6,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:7ee51c355aff4837a5b8e86ace9254f3,SystemUUID:8bbb2054-a0cf-b347-8fc3-48ca7e25cc3b,BootID:9b195d9b-39c3-4f27-bb29-3df41b27fc98,KernelVersion:5.13.0-1017-azure,OSImage:Ubuntu 20.04.4 LTS,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 k8s.gcr.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[capzci.azurecr.io/azurefile-csi@sha256:d6138752fd29dce33c0720a4f03100331f8a67a44694d6777824543335009e87 capzci.azurecr.io/azurefile-csi:e2e-cad0db442626e8889df95d74f13f0d82fdcf0060],SizeBytes:95830382,},ContainerImage{Names:[docker.io/calico/cni@sha256:2219eae79544b098119a06a8bb5608867f9ac00471592a00e2347f3ae4bea687 docker.io/calico/cni:v3.22.1],SizeBytes:80514590,},ContainerImage{Names:[docker.io/calico/node@sha256:1f8ed83e5264b4206cce7e1def11bca0b3ea7d5f4eb9b0ca0dbfc8cb968ca57e docker.io/calico/node:v3.22.1],SizeBytes:69647221,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner@sha256:542c9258a1441e4927883ea73425e21f9a14043a649686bf6b51700f34c64f8e mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v3.1.0],SizeBytes:59205633,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-resizer@sha256:ab6c2e18a4d943f2bf8688e1779622277a1d14c355c9d4bfc0d761d86c5108b3 mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.4.0],SizeBytes:56924121,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-attacher@sha256:19fbca01394f7ed80151731180cfde0a3367f038beae2a97cda7928034010057 mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v3.4.0],SizeBytes:56301028,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:c1f625d115fbd9a12eac615653fc81c0edb33b2b5a76d1e09d5daed11fa557c1 k8s.gcr.io/kube-proxy:v1.23.5],SizeBytes:39278412,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:ddf5bf7196eb534271f9e5d403f4da19838d5610bb5ca191001bde5f32b5492e k8s.gcr.io/kube-apiserver:v1.23.5],SizeBytes:32603217,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:cca0fb3532abedcc95c5f64268d54da9ecc56cc4817ff08d0128941cf2b0e1a4 k8s.gcr.io/kube-controller-manager:v1.23.5],SizeBytes:30174093,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:a889e925e15f9423f7842f1b769f64cbcf6a20b6956122836fc835cf22d9073f mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v5.0.1],SizeBytes:22192414,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:489efb65da9edc40bf0911f3e6371e5bb6b8ad8fde1d55193a6cc84c2ef36626 k8s.gcr.io/kube-scheduler:v1.23.5],SizeBytes:15131395,},ContainerImage{Names:[k8s.gcr.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e k8s.gcr.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[docker.io/calico/pod2daemon-flexvol@sha256:35802ba083546a7c5e8b5bf0ee7ffad7f8a468e8c2b3631e7e9647512c94041d docker.io/calico/pod2daemon-flexvol:v3.22.1],SizeBytes:8462620,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:c96a6255c42766f6b8bb1a7cda02b0060ab1b20b2e2dafcc64ec09e7646745a6 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.5.0],SizeBytes:8222208,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 19 11:31:40.623: INFO: Logging kubelet events for node capz-uyjrvr-md-0-vhn4n Apr 19 11:31:40.681: INFO: Logging pods the kubelet thinks is on node capz-uyjrvr-md-0-vhn4n Apr 19 11:31:40.768: INFO: calico-node-vlpjr started at 2022-04-19 11:05:25 +0000 UTC (3+1 container statuses recorded) Apr 19 11:31:40.769: INFO: Init container upgrade-ipam ready: true, restart count 0 Apr 19 11:31:40.769: INFO: Init container install-cni ready: true, restart count 0 Apr 19 11:31:40.769: INFO: Init container flexvol-driver ready: true, restart count 0 Apr 19 11:31:40.769: INFO: Container calico-node ready: true, restart count 0 Apr 19 11:31:40.769: INFO: kube-proxy-q85v4 started at 2022-04-19 11:05:25 +0000 UTC (0+1 container statuses recorded) Apr 19 11:31:40.769: INFO: Container kube-proxy ready: true, restart count 0 Apr 19 11:31:40.769: INFO: csi-azurefile-controller-554696b9b-zmhs2 started at 2022-04-19 11:21:34 +0000 UTC (0+6 container statuses recorded) Apr 19 11:31:40.769: INFO: Container azurefile ready: true, restart count 0 Apr 19 11:31:40.769: INFO: Container csi-attacher ready: true, restart count 0 Apr 19 11:31:40.769: INFO: Container csi-provisioner ready: true, restart count 0 Apr 19 11:31:40.769: INFO: Container csi-resizer ready: true, restart count 0 Apr 19 11:31:40.769: INFO: Container csi-snapshotter ready: true, restart count 0 Apr 19 11:31:40.769: INFO: Container liveness-probe ready: true, restart count 0 Apr 19 11:31:40.993: INFO: Latency metrics for node capz-uyjrvr-md-0-vhn4n Apr 19 11:31:40.993: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "azurefile-2540" for this suite.
Find azurefile-volume-tester-9nnth mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=AzureFile\sCSI\sDriver\sEnd\-to\-End\sTests\sDynamic\sProvisioning\sshould\screate\smultiple\sPV\sobjects\,\sbind\sto\sPVCs\sand\sattach\sall\sto\sdifferent\spods\son\sthe\ssame\snode\s\[kubernetes\.io\/azure\-file\]\s\[file\.csi\.azure\.com\]\s\[Windows\]$'
/home/prow/go/src/sigs.k8s.io/azurefile-csi-driver/test/e2e/dynamic_provisioning_test.go:185 Unexpected error: <*errors.errorString | 0xc0008621e0>: { s: "PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 still exists within 10m0s", } PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 still exists within 10m0s occurred /home/prow/go/src/sigs.k8s.io/azurefile-csi-driver/test/e2e/testsuites/testsuites.go:291from junit_01.xml
�[1mSTEP�[0m: Creating a kubernetes client Apr 19 11:32:31.455: INFO: >>> kubeConfig: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig �[1mSTEP�[0m: Building a namespace api object, basename azurefile �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace Apr 19 11:32:32.281: INFO: >>> kubeConfig: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig �[1mSTEP�[0m: setting up the StorageClass �[1mSTEP�[0m: creating a StorageClass �[1mSTEP�[0m: setting up the PVC and PV �[1mSTEP�[0m: creating a PVC �[1mSTEP�[0m: waiting for PVC to be in phase "Bound" Apr 19 11:32:32.397: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-mnnfb] to have phase Bound Apr 19 11:32:32.450: INFO: PersistentVolumeClaim pvc-mnnfb found but phase is Pending instead of Bound. Apr 19 11:32:34.504: INFO: PersistentVolumeClaim pvc-mnnfb found and phase=Bound (2.107539841s) �[1mSTEP�[0m: checking the PVC �[1mSTEP�[0m: validating provisioned PV �[1mSTEP�[0m: checking the PV �[1mSTEP�[0m: deploying the pod �[1mSTEP�[0m: checking that the pod is running �[1mSTEP�[0m: setting up the StorageClass �[1mSTEP�[0m: creating a StorageClass �[1mSTEP�[0m: setting up the PVC and PV �[1mSTEP�[0m: creating a PVC �[1mSTEP�[0m: waiting for PVC to be in phase "Bound" Apr 19 11:32:46.886: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-nxv8p] to have phase Bound Apr 19 11:32:46.939: INFO: PersistentVolumeClaim pvc-nxv8p found but phase is Pending instead of Bound. Apr 19 11:32:48.994: INFO: PersistentVolumeClaim pvc-nxv8p found and phase=Bound (2.107965958s) �[1mSTEP�[0m: checking the PVC �[1mSTEP�[0m: validating provisioned PV �[1mSTEP�[0m: checking the PV �[1mSTEP�[0m: deploying the pod �[1mSTEP�[0m: checking that the pod is running Apr 19 11:33:01.270: INFO: deleting Pod "azurefile-5466"/"azurefile-volume-tester-rvql6" Apr 19 11:33:01.327: INFO: Pod azurefile-volume-tester-rvql6 has the following logs: �[1mSTEP�[0m: Deleting pod azurefile-volume-tester-rvql6 in namespace azurefile-5466 Apr 19 11:33:01.388: INFO: deleting PVC "azurefile-5466"/"pvc-nxv8p" Apr 19 11:33:01.388: INFO: Deleting PersistentVolumeClaim "pvc-nxv8p" �[1mSTEP�[0m: waiting for claim's PV "pvc-d4e4bf93-1558-470a-82f9-5c38092da282" to be deleted Apr 19 11:33:01.557: INFO: Waiting up to 10m0s for PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 to get deleted Apr 19 11:33:01.611: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (53.608887ms) Apr 19 11:33:06.669: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (5.111680708s) Apr 19 11:33:11.724: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (10.166739396s) Apr 19 11:33:16.780: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (15.223351423s) Apr 19 11:33:21.837: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (20.280128231s) Apr 19 11:33:26.891: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (25.333651386s) Apr 19 11:33:31.944: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (30.387252685s) Apr 19 11:33:37.001: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (35.44423223s) Apr 19 11:33:42.058: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (40.501089737s) Apr 19 11:33:47.112: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (45.555315459s) Apr 19 11:33:52.168: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (50.610843676s) Apr 19 11:33:57.224: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (55.666753297s) Apr 19 11:34:02.280: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (1m0.723191429s) Apr 19 11:34:07.334: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (1m5.777329368s) Apr 19 11:34:12.392: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (1m10.834827647s) Apr 19 11:34:17.446: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (1m15.88912132s) Apr 19 11:34:22.504: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (1m20.947340915s) Apr 19 11:34:27.559: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (1m26.002397499s) Apr 19 11:34:32.615: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (1m31.058218213s) Apr 19 11:34:37.672: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (1m36.115404513s) Apr 19 11:34:42.726: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (1m41.169248354s) Apr 19 11:34:47.785: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (1m46.22812367s) Apr 19 11:34:52.840: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (1m51.283133769s) Apr 19 11:34:57.898: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (1m56.340647989s) Apr 19 11:35:02.953: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (2m1.396011266s) Apr 19 11:35:08.007: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (2m6.449804854s) Apr 19 11:35:13.063: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (2m11.50632476s) Apr 19 11:35:18.120: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (2m16.56317799s) Apr 19 11:35:23.177: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (2m21.619786561s) Apr 19 11:35:28.233: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (2m26.675846446s) Apr 19 11:35:33.292: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (2m31.734548049s) Apr 19 11:35:38.348: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (2m36.790613865s) Apr 19 11:35:43.406: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (2m41.848783046s) Apr 19 11:35:48.463: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (2m46.906379361s) Apr 19 11:35:53.524: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (2m51.967352622s) Apr 19 11:35:58.581: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (2m57.023917355s) Apr 19 11:36:03.635: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (3m2.078289953s) Apr 19 11:36:08.690: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (3m7.133041583s) Apr 19 11:36:13.745: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (3m12.188149227s) Apr 19 11:36:18.803: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (3m17.246427411s) Apr 19 11:36:23.859: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (3m22.30200705s) Apr 19 11:36:28.918: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (3m27.360547158s) Apr 19 11:36:33.976: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (3m32.41871867s) Apr 19 11:36:39.034: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (3m37.47678242s) Apr 19 11:36:44.092: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (3m42.534984355s) Apr 19 11:36:49.152: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (3m47.594771455s) Apr 19 11:36:54.211: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (3m52.654503054s) Apr 19 11:36:59.272: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (3m57.714885544s) Apr 19 11:37:04.329: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (4m2.772401599s) Apr 19 11:37:09.388: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (4m7.831026578s) Apr 19 11:37:14.449: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (4m12.891750933s) Apr 19 11:37:19.507: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (4m17.949598254s) Apr 19 11:37:24.568: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (4m23.011376239s) Apr 19 11:37:29.628: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (4m28.070809249s) Apr 19 11:37:34.689: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (4m33.13207213s) Apr 19 11:37:39.748: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (4m38.191382473s) Apr 19 11:37:44.810: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (4m43.253360577s) Apr 19 11:37:49.868: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (4m48.311355668s) Apr 19 11:37:54.930: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (4m53.372927371s) Apr 19 11:37:59.988: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (4m58.43104537s) Apr 19 11:38:05.049: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (5m3.491812065s) Apr 19 11:38:10.110: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (5m8.553004142s) Apr 19 11:38:15.171: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (5m13.614296158s) Apr 19 11:38:20.230: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (5m18.672870257s) Apr 19 11:38:25.289: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (5m23.731952239s) Apr 19 11:38:30.348: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (5m28.790682088s) Apr 19 11:38:35.407: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (5m33.850330276s) Apr 19 11:38:40.468: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (5m38.91119316s) Apr 19 11:38:45.529: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (5m43.972335042s) Apr 19 11:38:50.588: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (5m49.030780028s) Apr 19 11:38:55.645: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (5m54.088015892s) Apr 19 11:39:00.703: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (5m59.145820867s) Apr 19 11:39:05.765: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (6m4.207957237s) Apr 19 11:39:10.820: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (6m9.263157193s) Apr 19 11:39:15.876: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (6m14.319375501s) Apr 19 11:39:20.932: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (6m19.375196173s) Apr 19 11:39:25.989: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (6m24.431625484s) Apr 19 11:39:31.045: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (6m29.487596858s) Apr 19 11:39:36.101: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (6m34.544154754s) Apr 19 11:39:41.156: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (6m39.599004921s) Apr 19 11:39:46.212: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (6m44.655432782s) Apr 19 11:39:51.267: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (6m49.710090003s) Apr 19 11:39:56.327: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (6m54.770106622s) Apr 19 11:40:01.385: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (6m59.827774001s) Apr 19 11:40:06.443: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (7m4.886180293s) Apr 19 11:40:11.498: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (7m9.941241845s) Apr 19 11:40:16.556: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (7m14.999075017s) Apr 19 11:40:21.613: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (7m20.055591795s) Apr 19 11:40:26.667: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (7m25.110004049s) Apr 19 11:40:31.721: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (7m30.164400695s) Apr 19 11:40:36.775: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (7m35.218071457s) Apr 19 11:40:41.834: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (7m40.27663693s) Apr 19 11:40:46.887: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (7m45.330217433s) Apr 19 11:40:51.941: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (7m50.383968139s) Apr 19 11:40:56.996: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (7m55.438639716s) Apr 19 11:41:02.050: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (8m0.493303898s) Apr 19 11:41:07.108: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (8m5.551014088s) Apr 19 11:41:12.164: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (8m10.607458223s) Apr 19 11:41:17.221: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (8m15.664204876s) Apr 19 11:41:22.275: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (8m20.718072748s) Apr 19 11:41:27.330: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (8m25.772878891s) Apr 19 11:41:32.384: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (8m30.827118564s) Apr 19 11:41:37.437: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (8m35.880390605s) Apr 19 11:41:42.491: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (8m40.934199965s) Apr 19 11:41:47.546: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (8m45.988731573s) Apr 19 11:41:52.600: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (8m51.043517979s) Apr 19 11:41:57.656: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (8m56.09922565s) Apr 19 11:42:02.715: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (9m1.157581993s) Apr 19 11:42:07.772: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (9m6.215120339s) Apr 19 11:42:12.827: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (9m11.269671572s) Apr 19 11:42:17.880: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (9m16.32327091s) Apr 19 11:42:22.938: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (9m21.380538657s) Apr 19 11:42:27.994: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (9m26.437509637s) Apr 19 11:42:33.050: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (9m31.493414868s) Apr 19 11:42:38.118: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (9m36.560900767s) Apr 19 11:42:43.173: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (9m41.616135538s) Apr 19 11:42:48.230: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (9m46.672654721s) Apr 19 11:42:53.285: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (9m51.727905967s) Apr 19 11:42:58.340: INFO: PersistentVolume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 found and phase=Bound (9m56.7829613s) Apr 19 11:43:03.344: INFO: deleting StorageClass azurefile-5466-file.csi.azure.com-dynamic-sc-bxx8w Apr 19 11:43:03.401: INFO: deleting Pod "azurefile-5466"/"azurefile-volume-tester-n6ljk" Apr 19 11:43:03.486: INFO: Pod azurefile-volume-tester-n6ljk has the following logs: �[1mSTEP�[0m: Deleting pod azurefile-volume-tester-n6ljk in namespace azurefile-5466 Apr 19 11:43:03.542: INFO: deleting PVC "azurefile-5466"/"pvc-mnnfb" Apr 19 11:43:03.542: INFO: Deleting PersistentVolumeClaim "pvc-mnnfb" �[1mSTEP�[0m: waiting for claim's PV "pvc-ff94db42-1a0f-4acf-8467-7db40a2cc3a3" to be deleted Apr 19 11:43:03.713: INFO: Waiting up to 10m0s for PersistentVolume pvc-ff94db42-1a0f-4acf-8467-7db40a2cc3a3 to get deleted Apr 19 11:43:03.769: INFO: PersistentVolume pvc-ff94db42-1a0f-4acf-8467-7db40a2cc3a3 found and phase=Bound (55.191368ms) Apr 19 11:43:08.822: INFO: PersistentVolume pvc-ff94db42-1a0f-4acf-8467-7db40a2cc3a3 was removed Apr 19 11:43:08.822: INFO: Waiting up to 5m0s for PersistentVolumeClaim azurefile-5466 to be removed Apr 19 11:43:08.877: INFO: Claim "azurefile-5466" in namespace "pvc-mnnfb" doesn't exist in the system Apr 19 11:43:08.877: INFO: deleting StorageClass azurefile-5466-file.csi.azure.com-dynamic-sc-bhpbj �[1mSTEP�[0m: Collecting events from namespace "azurefile-5466". �[1mSTEP�[0m: Found 17 events. Apr 19 11:43:09.000: INFO: At 2022-04-19 11:32:32 +0000 UTC - event for pvc-mnnfb: {file.csi.azure.com_capz-uyjrvr-md-0-vhn4n_97700786-c405-48f7-98d9-fc55e6d4b3c8 } Provisioning: External provisioner is provisioning volume for claim "azurefile-5466/pvc-mnnfb" Apr 19 11:43:09.000: INFO: At 2022-04-19 11:32:32 +0000 UTC - event for pvc-mnnfb: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "file.csi.azure.com" or manually created by system administrator Apr 19 11:43:09.000: INFO: At 2022-04-19 11:32:32 +0000 UTC - event for pvc-mnnfb: {file.csi.azure.com_capz-uyjrvr-md-0-vhn4n_97700786-c405-48f7-98d9-fc55e6d4b3c8 } ProvisioningSucceeded: Successfully provisioned volume pvc-ff94db42-1a0f-4acf-8467-7db40a2cc3a3 Apr 19 11:43:09.000: INFO: At 2022-04-19 11:32:34 +0000 UTC - event for azurefile-volume-tester-n6ljk: {default-scheduler } Scheduled: Successfully assigned azurefile-5466/azurefile-volume-tester-n6ljk to capz-uyjr-zzjxd Apr 19 11:43:09.000: INFO: At 2022-04-19 11:32:40 +0000 UTC - event for azurefile-volume-tester-n6ljk: {kubelet capz-uyjr-zzjxd} Pulled: Container image "mcr.microsoft.com/windows/servercore:ltsc2022" already present on machine Apr 19 11:43:09.000: INFO: At 2022-04-19 11:32:40 +0000 UTC - event for azurefile-volume-tester-n6ljk: {kubelet capz-uyjr-zzjxd} Created: Created container volume-tester Apr 19 11:43:09.000: INFO: At 2022-04-19 11:32:44 +0000 UTC - event for azurefile-volume-tester-n6ljk: {kubelet capz-uyjr-zzjxd} Started: Started container volume-tester Apr 19 11:43:09.000: INFO: At 2022-04-19 11:32:46 +0000 UTC - event for pvc-nxv8p: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "file.csi.azure.com" or manually created by system administrator Apr 19 11:43:09.000: INFO: At 2022-04-19 11:32:46 +0000 UTC - event for pvc-nxv8p: {file.csi.azure.com_capz-uyjrvr-md-0-vhn4n_97700786-c405-48f7-98d9-fc55e6d4b3c8 } Provisioning: External provisioner is provisioning volume for claim "azurefile-5466/pvc-nxv8p" Apr 19 11:43:09.000: INFO: At 2022-04-19 11:32:47 +0000 UTC - event for pvc-nxv8p: {file.csi.azure.com_capz-uyjrvr-md-0-vhn4n_97700786-c405-48f7-98d9-fc55e6d4b3c8 } ProvisioningSucceeded: Successfully provisioned volume pvc-d4e4bf93-1558-470a-82f9-5c38092da282 Apr 19 11:43:09.000: INFO: At 2022-04-19 11:32:49 +0000 UTC - event for azurefile-volume-tester-rvql6: {default-scheduler } Scheduled: Successfully assigned azurefile-5466/azurefile-volume-tester-rvql6 to capz-uyjr-zzjxd Apr 19 11:43:09.000: INFO: At 2022-04-19 11:32:52 +0000 UTC - event for azurefile-volume-tester-rvql6: {kubelet capz-uyjr-zzjxd} FailedMount: MountVolume.SetUp failed for volume "pvc-d4e4bf93-1558-470a-82f9-5c38092da282" : rpc error: code = Internal desc = Could not mount target "c:\\var\\lib\\kubelet\\pods\\0e6c2c19-1f1b-4e52-a4e5-03b96981fb80\\volumes\\kubernetes.io~csi\\pvc-d4e4bf93-1558-470a-82f9-5c38092da282\\mount": open c:\var\lib\kubelet\pods\0e6c2c19-1f1b-4e52-a4e5-03b96981fb80\volumes\kubernetes.io~csi\pvc-d4e4bf93-1558-470a-82f9-5c38092da282\mount: Access is denied. Apr 19 11:43:09.000: INFO: At 2022-04-19 11:32:55 +0000 UTC - event for azurefile-volume-tester-rvql6: {kubelet capz-uyjr-zzjxd} Created: Created container volume-tester Apr 19 11:43:09.000: INFO: At 2022-04-19 11:32:55 +0000 UTC - event for azurefile-volume-tester-rvql6: {kubelet capz-uyjr-zzjxd} Pulled: Container image "mcr.microsoft.com/windows/servercore:ltsc2022" already present on machine Apr 19 11:43:09.000: INFO: At 2022-04-19 11:32:58 +0000 UTC - event for azurefile-volume-tester-rvql6: {kubelet capz-uyjr-zzjxd} Started: Started container volume-tester Apr 19 11:43:09.000: INFO: At 2022-04-19 11:33:01 +0000 UTC - event for azurefile-volume-tester-rvql6: {kubelet capz-uyjr-zzjxd} Killing: Stopping container volume-tester Apr 19 11:43:09.000: INFO: At 2022-04-19 11:43:03 +0000 UTC - event for azurefile-volume-tester-n6ljk: {kubelet capz-uyjr-zzjxd} Killing: Stopping container volume-tester Apr 19 11:43:09.055: INFO: POD NODE PHASE GRACE CONDITIONS Apr 19 11:43:09.055: INFO: azurefile-volume-tester-rvql6 capz-uyjr-zzjxd Failed 30s [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-04-19 11:32:49 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-04-19 11:33:04 +0000 UTC ContainersNotReady containers with unready status: [volume-tester]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-04-19 11:33:04 +0000 UTC ContainersNotReady containers with unready status: [volume-tester]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-04-19 11:32:49 +0000 UTC }] Apr 19 11:43:09.055: INFO: Apr 19 11:43:09.124: INFO: Logging node info for node capz-uyjr-pw5j4 Apr 19 11:43:09.180: INFO: Node Info: &Node{ObjectMeta:{capz-uyjr-pw5j4 bf03da55-f370-4e36-a6c9-eca2677d5f77 5460 0 2022-04-19 11:06:11 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D4s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-uyjr-pw5j4 kubernetes.io/os:windows node.kubernetes.io/instance-type:Standard_D4s_v3 node.kubernetes.io/windows-build:10.0.20348 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[cluster.x-k8s.io/cluster-name:capz-uyjrvr cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-uyjrvr-md-win-595b5984b6-9mmk6 cluster.x-k8s.io/owner-kind:MachineSet cluster.x-k8s.io/owner-name:capz-uyjrvr-md-win-595b5984b6 csi.volume.kubernetes.io/nodeid:{"file.csi.azure.com":"capz-uyjr-pw5j4"} kubeadm.alpha.kubernetes.io/cri-socket:npipe:////./pipe/containerd-containerd node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.1.0.5/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.5.129 projectcalico.org/VXLANTunnelMACAddr:00:15:5d:2e:51:4a volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-19 11:06:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-04-19 11:06:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}} } {manager Update v1 2022-04-19 11:06:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {calico-node.exe Update v1 2022-04-19 11:08:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{},"f:projectcalico.org/VXLANTunnelMACAddr":{}}}} status} {Go-http-client Update v1 2022-04-19 11:23:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-uyjrvr/providers/Microsoft.Compute/virtualMachines/capz-uyjr-pw5j4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{17179398144 0} {<nil>} 16776756Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{123221307598 0} {<nil>} 123221307598 DecimalSI},memory: {{17074540544 0} {<nil>} 16674356Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-19 11:38:33 +0000 UTC,LastTransitionTime:2022-04-19 11:06:11 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-19 11:38:33 +0000 UTC,LastTransitionTime:2022-04-19 11:06:11 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-19 11:38:33 +0000 UTC,LastTransitionTime:2022-04-19 11:06:11 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-19 11:38:33 +0000 UTC,LastTransitionTime:2022-04-19 11:07:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-uyjr-pw5j4,},NodeAddress{Type:InternalIP,Address:10.1.0.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:capz-uyjr-pw5j4,SystemUUID:057A776A-BC3C-4D6E-825D-587D25847F3E,BootID:,KernelVersion:10.0.20348.405,OSImage:Windows Server 2022 Datacenter,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/sigwindowstools/calico-install@sha256:141afecd724eb757ee41593cc73f35fb19a2ce13cad73179cf3b1cef81a637d1 docker.io/sigwindowstools/calico-install:v3.22.1-hostprocess],SizeBytes:148096127,},ContainerImage{Names:[capzci.azurecr.io/azurefile-csi@sha256:d6138752fd29dce33c0720a4f03100331f8a67a44694d6777824543335009e87 capzci.azurecr.io/azurefile-csi:e2e-cad0db442626e8889df95d74f13f0d82fdcf0060],SizeBytes:130300512,},ContainerImage{Names:[docker.io/sigwindowstools/calico-node@sha256:b8e6e2f190e58d6b61b7f2a19b0e2e17a377e5b9d7b9528e9b7953d9f9ab59bb docker.io/sigwindowstools/calico-node:v3.22.1-hostprocess],SizeBytes:128793648,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:dbec3a8166686b09b242176ab5b99e993da4126438bbce68147c3fd654f35662 mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.4.0],SizeBytes:125554391,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:c96a6255c42766f6b8bb1a7cda02b0060ab1b20b2e2dafcc64ec09e7646745a6 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.5.0],SizeBytes:124471446,},ContainerImage{Names:[ghcr.io/kubernetes-sigs/sig-windows/csi-proxy@sha256:96b4144986319a747ba599892454be2737aae6005d96b8e13ed481321ac3afba ghcr.io/kubernetes-sigs/sig-windows/csi-proxy:v1.0.2],SizeBytes:123925937,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:119397646,},ContainerImage{Names:[docker.io/sigwindowstools/kube-proxy@sha256:0f8a44b795d1824358f24cc56f0024d18a39ae044656686596d8b7fa6d78e1fa docker.io/sigwindowstools/kube-proxy:v1.23.5-calico-hostprocess],SizeBytes:116337721,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 19 11:43:09.180: INFO: Logging kubelet events for node capz-uyjr-pw5j4 Apr 19 11:43:09.238: INFO: Logging pods the kubelet thinks is on node capz-uyjr-pw5j4 Apr 19 11:43:09.337: INFO: kube-proxy-windows-n6rxh started at 2022-04-19 11:06:12 +0000 UTC (0+1 container statuses recorded) Apr 19 11:43:09.337: INFO: Container kube-proxy ready: true, restart count 0 Apr 19 11:43:09.337: INFO: calico-node-windows-d8h6f started at 2022-04-19 11:06:12 +0000 UTC (1+2 container statuses recorded) Apr 19 11:43:09.337: INFO: Init container install-cni ready: true, restart count 0 Apr 19 11:43:09.337: INFO: Container calico-node-felix ready: true, restart count 0 Apr 19 11:43:09.337: INFO: Container calico-node-startup ready: true, restart count 0 Apr 19 11:43:09.337: INFO: csi-proxy-6pxhv started at 2022-04-19 11:07:33 +0000 UTC (0+1 container statuses recorded) Apr 19 11:43:09.337: INFO: Container csi-proxy ready: true, restart count 0 Apr 19 11:43:09.337: INFO: csi-azurefile-node-win-2hbht started at 2022-04-19 11:21:34 +0000 UTC (0+3 container statuses recorded) Apr 19 11:43:09.337: INFO: Container azurefile ready: true, restart count 0 Apr 19 11:43:09.337: INFO: Container liveness-probe ready: true, restart count 0 Apr 19 11:43:09.337: INFO: Container node-driver-registrar ready: true, restart count 0 Apr 19 11:43:09.603: INFO: Latency metrics for node capz-uyjr-pw5j4 Apr 19 11:43:09.603: INFO: Logging node info for node capz-uyjr-zzjxd Apr 19 11:43:09.660: INFO: Node Info: &Node{ObjectMeta:{capz-uyjr-zzjxd 67c88250-50bd-4c54-afe4-677af198ecd0 5698 0 2022-04-19 11:05:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D4s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-uyjr-zzjxd kubernetes.io/os:windows node.kubernetes.io/instance-type:Standard_D4s_v3 node.kubernetes.io/windows-build:10.0.20348 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[cluster.x-k8s.io/cluster-name:capz-uyjrvr cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-uyjrvr-md-win-595b5984b6-9phzm cluster.x-k8s.io/owner-kind:MachineSet cluster.x-k8s.io/owner-name:capz-uyjrvr-md-win-595b5984b6 csi.volume.kubernetes.io/nodeid:{"file.csi.azure.com":"capz-uyjr-zzjxd"} kubeadm.alpha.kubernetes.io/cri-socket:npipe:////./pipe/containerd-containerd node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.1.0.7/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.139.193 projectcalico.org/VXLANTunnelMACAddr:00:15:5d:d9:b3:1a volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-19 11:05:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-04-19 11:06:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}} } {manager Update v1 2022-04-19 11:06:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {calico-node.exe Update v1 2022-04-19 11:07:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{},"f:projectcalico.org/VXLANTunnelMACAddr":{}}}} status} {Go-http-client Update v1 2022-04-19 11:22:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-uyjrvr/providers/Microsoft.Compute/virtualMachines/capz-uyjr-zzjxd,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{17179398144 0} {<nil>} 16776756Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{123221307598 0} {<nil>} 123221307598 DecimalSI},memory: {{17074540544 0} {<nil>} 16674356Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-19 11:40:13 +0000 UTC,LastTransitionTime:2022-04-19 11:05:53 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-19 11:40:13 +0000 UTC,LastTransitionTime:2022-04-19 11:05:53 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-19 11:40:13 +0000 UTC,LastTransitionTime:2022-04-19 11:05:53 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-19 11:40:13 +0000 UTC,LastTransitionTime:2022-04-19 11:07:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-uyjr-zzjxd,},NodeAddress{Type:InternalIP,Address:10.1.0.7,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:capz-uyjr-zzjxd,SystemUUID:A57CE631-1EC5-4E4B-A8E4-67D2362B3705,BootID:,KernelVersion:10.0.20348.405,OSImage:Windows Server 2022 Datacenter,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:378d85bd8e7388a777d25009f8523d1e95a5f544f131eaada83171045d5b2c1e mcr.microsoft.com/windows/servercore:ltsc2022],SizeBytes:2226956779,},ContainerImage{Names:[docker.io/sigwindowstools/calico-install@sha256:141afecd724eb757ee41593cc73f35fb19a2ce13cad73179cf3b1cef81a637d1 docker.io/sigwindowstools/calico-install:v3.22.1-hostprocess],SizeBytes:148096127,},ContainerImage{Names:[capzci.azurecr.io/azurefile-csi@sha256:d6138752fd29dce33c0720a4f03100331f8a67a44694d6777824543335009e87 capzci.azurecr.io/azurefile-csi:e2e-cad0db442626e8889df95d74f13f0d82fdcf0060],SizeBytes:130300512,},ContainerImage{Names:[docker.io/sigwindowstools/calico-node@sha256:b8e6e2f190e58d6b61b7f2a19b0e2e17a377e5b9d7b9528e9b7953d9f9ab59bb docker.io/sigwindowstools/calico-node:v3.22.1-hostprocess],SizeBytes:128793648,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:dbec3a8166686b09b242176ab5b99e993da4126438bbce68147c3fd654f35662 mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.4.0],SizeBytes:125554391,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:c96a6255c42766f6b8bb1a7cda02b0060ab1b20b2e2dafcc64ec09e7646745a6 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.5.0],SizeBytes:124471446,},ContainerImage{Names:[ghcr.io/kubernetes-sigs/sig-windows/csi-proxy@sha256:96b4144986319a747ba599892454be2737aae6005d96b8e13ed481321ac3afba ghcr.io/kubernetes-sigs/sig-windows/csi-proxy:v1.0.2],SizeBytes:123925937,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:119397646,},ContainerImage{Names:[docker.io/sigwindowstools/kube-proxy@sha256:0f8a44b795d1824358f24cc56f0024d18a39ae044656686596d8b7fa6d78e1fa docker.io/sigwindowstools/kube-proxy:v1.23.5-calico-hostprocess],SizeBytes:116337721,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 19 11:43:09.660: INFO: Logging kubelet events for node capz-uyjr-zzjxd Apr 19 11:43:09.719: INFO: Logging pods the kubelet thinks is on node capz-uyjr-zzjxd Apr 19 11:43:09.796: INFO: csi-azurefile-node-win-ksg7h started at 2022-04-19 11:21:34 +0000 UTC (0+3 container statuses recorded) Apr 19 11:43:09.796: INFO: Container azurefile ready: true, restart count 0 Apr 19 11:43:09.796: INFO: Container liveness-probe ready: true, restart count 0 Apr 19 11:43:09.796: INFO: Container node-driver-registrar ready: true, restart count 0 Apr 19 11:43:09.796: INFO: azurefile-volume-tester-rvql6 started at 2022-04-19 11:32:49 +0000 UTC (0+1 container statuses recorded) Apr 19 11:43:09.796: INFO: Container volume-tester ready: false, restart count 0 Apr 19 11:43:09.796: INFO: calico-node-windows-gf8wx started at 2022-04-19 11:05:53 +0000 UTC (1+2 container statuses recorded) Apr 19 11:43:09.796: INFO: Init container install-cni ready: true, restart count 0 Apr 19 11:43:09.796: INFO: Container calico-node-felix ready: true, restart count 1 Apr 19 11:43:09.796: INFO: Container calico-node-startup ready: true, restart count 0 Apr 19 11:43:09.796: INFO: kube-proxy-windows-mwrfk started at 2022-04-19 11:05:53 +0000 UTC (0+1 container statuses recorded) Apr 19 11:43:09.796: INFO: Container kube-proxy ready: true, restart count 0 Apr 19 11:43:09.796: INFO: csi-proxy-vk8hg started at 2022-04-19 11:07:04 +0000 UTC (0+1 container statuses recorded) Apr 19 11:43:09.796: INFO: Container csi-proxy ready: true, restart count 0 Apr 19 11:43:10.044: INFO: Latency metrics for node capz-uyjr-zzjxd Apr 19 11:43:10.044: INFO: Logging node info for node capz-uyjrvr-control-plane-8t9mz Apr 19 11:43:10.101: INFO: Node Info: &Node{ObjectMeta:{capz-uyjrvr-control-plane-8t9mz 6d59ac34-cf5f-40e1-a9c6-e51ae79582c7 5783 0 2022-04-19 11:03:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:westus2-1 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-uyjrvr-control-plane-8t9mz kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/master: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:Standard_D2s_v3 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:westus2-1] map[cluster.x-k8s.io/cluster-name:capz-uyjrvr cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-uyjrvr-control-plane-gcpz7 cluster.x-k8s.io/owner-kind:KubeadmControlPlane cluster.x-k8s.io/owner-name:capz-uyjrvr-control-plane kubeadm.alpha.kubernetes.io/cri-socket:/run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.0.4/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.176.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-19 11:03:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node-role.kubernetes.io/control-plane":{},"f:node-role.kubernetes.io/master":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {manager Update v1 2022-04-19 11:04:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {kube-controller-manager Update v1 2022-04-19 11:04:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:taints":{}}} } {Go-http-client Update v1 2022-04-19 11:04:36 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {calico-node Update v1 2022-04-19 11:04:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-uyjrvr/providers/Microsoft.Compute/virtualMachines/capz-uyjrvr-control-plane-8t9mz,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{133018140672 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8340819968 0} {<nil>} 8145332Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{119716326407 0} {<nil>} 119716326407 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8235962368 0} {<nil>} 8042932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-04-19 11:04:38 +0000 UTC,LastTransitionTime:2022-04-19 11:04:38 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-19 11:40:47 +0000 UTC,LastTransitionTime:2022-04-19 11:03:36 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-19 11:40:47 +0000 UTC,LastTransitionTime:2022-04-19 11:03:36 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-19 11:40:47 +0000 UTC,LastTransitionTime:2022-04-19 11:03:36 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-19 11:40:47 +0000 UTC,LastTransitionTime:2022-04-19 11:04:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-uyjrvr-control-plane-8t9mz,},NodeAddress{Type:InternalIP,Address:10.0.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d408f93aaf404596827f9ed9f94a133f,SystemUUID:11ed2a8a-8a39-b54f-9e16-8c155bc2878f,BootID:ed6e2d6c-2b99-4123-bfab-83aa6868560d,KernelVersion:5.13.0-1017-azure,OSImage:Ubuntu 20.04.4 LTS,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 k8s.gcr.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[docker.io/calico/cni@sha256:2219eae79544b098119a06a8bb5608867f9ac00471592a00e2347f3ae4bea687 docker.io/calico/cni:v3.22.1],SizeBytes:80514590,},ContainerImage{Names:[docker.io/calico/node@sha256:1f8ed83e5264b4206cce7e1def11bca0b3ea7d5f4eb9b0ca0dbfc8cb968ca57e docker.io/calico/node:v3.22.1],SizeBytes:69647221,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:e42a0aba3637d123481cca14fd8314a482616593edf58f9594c9382e50498f9b docker.io/calico/kube-controllers:v3.22.1],SizeBytes:54948023,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:c1f625d115fbd9a12eac615653fc81c0edb33b2b5a76d1e09d5daed11fa557c1 k8s.gcr.io/kube-proxy:v1.23.5],SizeBytes:39278412,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:ddf5bf7196eb534271f9e5d403f4da19838d5610bb5ca191001bde5f32b5492e k8s.gcr.io/kube-apiserver:v1.23.5],SizeBytes:32603217,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:cca0fb3532abedcc95c5f64268d54da9ecc56cc4817ff08d0128941cf2b0e1a4 k8s.gcr.io/kube-controller-manager:v1.23.5],SizeBytes:30174093,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:489efb65da9edc40bf0911f3e6371e5bb6b8ad8fde1d55193a6cc84c2ef36626 k8s.gcr.io/kube-scheduler:v1.23.5],SizeBytes:15131395,},ContainerImage{Names:[k8s.gcr.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e k8s.gcr.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[docker.io/calico/pod2daemon-flexvol@sha256:35802ba083546a7c5e8b5bf0ee7ffad7f8a468e8c2b3631e7e9647512c94041d docker.io/calico/pod2daemon-flexvol:v3.22.1],SizeBytes:8462620,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 19 11:43:10.101: INFO: Logging kubelet events for node capz-uyjrvr-control-plane-8t9mz Apr 19 11:43:10.159: INFO: Logging pods the kubelet thinks is on node capz-uyjrvr-control-plane-8t9mz Apr 19 11:43:10.264: INFO: etcd-capz-uyjrvr-control-plane-8t9mz started at 2022-04-19 11:04:06 +0000 UTC (0+1 container statuses recorded) Apr 19 11:43:10.264: INFO: Container etcd ready: true, restart count 0 Apr 19 11:43:10.264: INFO: calico-kube-controllers-7c664f4648-9gtm8 started at 2022-04-19 11:04:26 +0000 UTC (0+1 container statuses recorded) Apr 19 11:43:10.264: INFO: Container calico-kube-controllers ready: true, restart count 0 Apr 19 11:43:10.264: INFO: coredns-64897985d-fcblc started at 2022-04-19 11:04:26 +0000 UTC (0+1 container statuses recorded) Apr 19 11:43:10.264: INFO: Container coredns ready: true, restart count 0 Apr 19 11:43:10.264: INFO: coredns-64897985d-vfff7 started at 2022-04-19 11:04:26 +0000 UTC (0+1 container statuses recorded) Apr 19 11:43:10.264: INFO: Container coredns ready: true, restart count 0 Apr 19 11:43:10.264: INFO: kube-apiserver-capz-uyjrvr-control-plane-8t9mz started at 2022-04-19 11:04:06 +0000 UTC (0+1 container statuses recorded) Apr 19 11:43:10.264: INFO: Container kube-apiserver ready: true, restart count 0 Apr 19 11:43:10.264: INFO: kube-controller-manager-capz-uyjrvr-control-plane-8t9mz started at 2022-04-19 11:04:06 +0000 UTC (0+1 container statuses recorded) Apr 19 11:43:10.264: INFO: Container kube-controller-manager ready: true, restart count 0 Apr 19 11:43:10.264: INFO: kube-scheduler-capz-uyjrvr-control-plane-8t9mz started at 2022-04-19 11:04:06 +0000 UTC (0+1 container statuses recorded) Apr 19 11:43:10.264: INFO: Container kube-scheduler ready: true, restart count 0 Apr 19 11:43:10.264: INFO: calico-node-58ljd started at 2022-04-19 11:03:58 +0000 UTC (3+1 container statuses recorded) Apr 19 11:43:10.264: INFO: Init container upgrade-ipam ready: true, restart count 0 Apr 19 11:43:10.264: INFO: Init container install-cni ready: true, restart count 0 Apr 19 11:43:10.264: INFO: Init container flexvol-driver ready: true, restart count 0 Apr 19 11:43:10.264: INFO: Container calico-node ready: true, restart count 0 Apr 19 11:43:10.264: INFO: kube-proxy-nzs98 started at 2022-04-19 11:04:06 +0000 UTC (0+1 container statuses recorded) Apr 19 11:43:10.264: INFO: Container kube-proxy ready: true, restart count 0 Apr 19 11:43:10.516: INFO: Latency metrics for node capz-uyjrvr-control-plane-8t9mz Apr 19 11:43:10.516: INFO: Logging node info for node capz-uyjrvr-md-0-qdz4l Apr 19 11:43:10.573: INFO: Node Info: &Node{ObjectMeta:{capz-uyjrvr-md-0-qdz4l 08412d1c-a776-4117-bff7-f1d69c6a7d81 5476 0 2022-04-19 11:05:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D4s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-uyjrvr-md-0-qdz4l kubernetes.io/os:linux node.kubernetes.io/instance-type:Standard_D4s_v3 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[cluster.x-k8s.io/cluster-name:capz-uyjrvr cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-uyjrvr-md-0-6f4bd878bc-d2ll8 cluster.x-k8s.io/owner-kind:MachineSet cluster.x-k8s.io/owner-name:capz-uyjrvr-md-0-6f4bd878bc kubeadm.alpha.kubernetes.io/cri-socket:/run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.1.0.4/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.57.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{manager Update v1 2022-04-19 11:05:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {Go-http-client Update v1 2022-04-19 11:05:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-04-19 11:05:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}} } {calico-node Update v1 2022-04-19 11:06:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {Go-http-client Update v1 2022-04-19 11:06:22 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-uyjrvr/providers/Microsoft.Compute/virtualMachines/capz-uyjrvr-md-0-qdz4l,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{133018140672 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16783433728 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{119716326407 0} {<nil>} 119716326407 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16678576128 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-04-19 11:06:19 +0000 UTC,LastTransitionTime:2022-04-19 11:06:19 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-19 11:38:41 +0000 UTC,LastTransitionTime:2022-04-19 11:05:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-19 11:38:41 +0000 UTC,LastTransitionTime:2022-04-19 11:05:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-19 11:38:41 +0000 UTC,LastTransitionTime:2022-04-19 11:05:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-19 11:38:41 +0000 UTC,LastTransitionTime:2022-04-19 11:06:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-uyjrvr-md-0-qdz4l,},NodeAddress{Type:InternalIP,Address:10.1.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:b3924b312cb84b11910e9b257734a388,SystemUUID:749088f0-b995-a542-9cee-4b6884c6652e,BootID:27b2adf1-5b68-4423-ab9a-3f9619704ab2,KernelVersion:5.13.0-1017-azure,OSImage:Ubuntu 20.04.4 LTS,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 k8s.gcr.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[docker.io/calico/cni@sha256:2219eae79544b098119a06a8bb5608867f9ac00471592a00e2347f3ae4bea687 docker.io/calico/cni:v3.22.1],SizeBytes:80514590,},ContainerImage{Names:[docker.io/calico/node@sha256:1f8ed83e5264b4206cce7e1def11bca0b3ea7d5f4eb9b0ca0dbfc8cb968ca57e docker.io/calico/node:v3.22.1],SizeBytes:69647221,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:c1f625d115fbd9a12eac615653fc81c0edb33b2b5a76d1e09d5daed11fa557c1 k8s.gcr.io/kube-proxy:v1.23.5],SizeBytes:39278412,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:ddf5bf7196eb534271f9e5d403f4da19838d5610bb5ca191001bde5f32b5492e k8s.gcr.io/kube-apiserver:v1.23.5],SizeBytes:32603217,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:cca0fb3532abedcc95c5f64268d54da9ecc56cc4817ff08d0128941cf2b0e1a4 k8s.gcr.io/kube-controller-manager:v1.23.5],SizeBytes:30174093,},ContainerImage{Names:[docker.io/andyzhangx/samba@sha256:1c268eae7ec1eb9fbbbd4f0aab3ee41c7a4c4ecb0313c498cb11cfdcc762ad3e docker.io/andyzhangx/samba:win-fix],SizeBytes:21999042,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:489efb65da9edc40bf0911f3e6371e5bb6b8ad8fde1d55193a6cc84c2ef36626 k8s.gcr.io/kube-scheduler:v1.23.5],SizeBytes:15131395,},ContainerImage{Names:[k8s.gcr.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e k8s.gcr.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[docker.io/calico/pod2daemon-flexvol@sha256:35802ba083546a7c5e8b5bf0ee7ffad7f8a468e8c2b3631e7e9647512c94041d docker.io/calico/pod2daemon-flexvol:v3.22.1],SizeBytes:8462620,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 19 11:43:10.573: INFO: Logging kubelet events for node capz-uyjrvr-md-0-qdz4l Apr 19 11:43:10.632: INFO: Logging pods the kubelet thinks is on node capz-uyjrvr-md-0-qdz4l Apr 19 11:43:10.713: INFO: kube-proxy-9dpnw started at 2022-04-19 11:05:52 +0000 UTC (0+1 container statuses recorded) Apr 19 11:43:10.714: INFO: Container kube-proxy ready: true, restart count 0 Apr 19 11:43:10.714: INFO: calico-node-nvdnb started at 2022-04-19 11:05:52 +0000 UTC (3+1 container statuses recorded) Apr 19 11:43:10.714: INFO: Init container upgrade-ipam ready: true, restart count 0 Apr 19 11:43:10.714: INFO: Init container install-cni ready: true, restart count 0 Apr 19 11:43:10.714: INFO: Init container flexvol-driver ready: true, restart count 0 Apr 19 11:43:10.714: INFO: Container calico-node ready: true, restart count 0 Apr 19 11:43:10.714: INFO: smb-server-55b87d449c-dlfhd started at 2022-04-19 11:22:54 +0000 UTC (0+1 container statuses recorded) Apr 19 11:43:10.714: INFO: Container smb-server ready: true, restart count 0 Apr 19 11:43:10.934: INFO: Latency metrics for node capz-uyjrvr-md-0-qdz4l Apr 19 11:43:10.934: INFO: Logging node info for node capz-uyjrvr-md-0-vhn4n Apr 19 11:43:10.991: INFO: Node Info: &Node{ObjectMeta:{capz-uyjrvr-md-0-vhn4n ae1b6805-0d1e-428b-bea0-b2c0b5e34e0a 6003 0 2022-04-19 11:05:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D4s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-uyjrvr-md-0-vhn4n kubernetes.io/os:linux node.kubernetes.io/instance-type:Standard_D4s_v3 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[cluster.x-k8s.io/cluster-name:capz-uyjrvr cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-uyjrvr-md-0-6f4bd878bc-297gj cluster.x-k8s.io/owner-kind:MachineSet cluster.x-k8s.io/owner-name:capz-uyjrvr-md-0-6f4bd878bc kubeadm.alpha.kubernetes.io/cri-socket:/run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.1.0.6/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.35.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-19 11:05:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-04-19 11:05:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}} } {manager Update v1 2022-04-19 11:05:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {calico-node Update v1 2022-04-19 11:05:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {Go-http-client Update v1 2022-04-19 11:05:55 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-uyjrvr/providers/Microsoft.Compute/virtualMachines/capz-uyjrvr-md-0-vhn4n,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{133018140672 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16783433728 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{119716326407 0} {<nil>} 119716326407 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16678576128 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-04-19 11:05:49 +0000 UTC,LastTransitionTime:2022-04-19 11:05:49 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-19 11:42:20 +0000 UTC,LastTransitionTime:2022-04-19 11:05:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-19 11:42:20 +0000 UTC,LastTransitionTime:2022-04-19 11:05:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-19 11:42:20 +0000 UTC,LastTransitionTime:2022-04-19 11:05:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-19 11:42:20 +0000 UTC,LastTransitionTime:2022-04-19 11:05:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-uyjrvr-md-0-vhn4n,},NodeAddress{Type:InternalIP,Address:10.1.0.6,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:7ee51c355aff4837a5b8e86ace9254f3,SystemUUID:8bbb2054-a0cf-b347-8fc3-48ca7e25cc3b,BootID:9b195d9b-39c3-4f27-bb29-3df41b27fc98,KernelVersion:5.13.0-1017-azure,OSImage:Ubuntu 20.04.4 LTS,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 k8s.gcr.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[capzci.azurecr.io/azurefile-csi@sha256:d6138752fd29dce33c0720a4f03100331f8a67a44694d6777824543335009e87 capzci.azurecr.io/azurefile-csi:e2e-cad0db442626e8889df95d74f13f0d82fdcf0060],SizeBytes:95830382,},ContainerImage{Names:[docker.io/calico/cni@sha256:2219eae79544b098119a06a8bb5608867f9ac00471592a00e2347f3ae4bea687 docker.io/calico/cni:v3.22.1],SizeBytes:80514590,},ContainerImage{Names:[docker.io/calico/node@sha256:1f8ed83e5264b4206cce7e1def11bca0b3ea7d5f4eb9b0ca0dbfc8cb968ca57e docker.io/calico/node:v3.22.1],SizeBytes:69647221,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner@sha256:542c9258a1441e4927883ea73425e21f9a14043a649686bf6b51700f34c64f8e mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v3.1.0],SizeBytes:59205633,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-resizer@sha256:ab6c2e18a4d943f2bf8688e1779622277a1d14c355c9d4bfc0d761d86c5108b3 mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.4.0],SizeBytes:56924121,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-attacher@sha256:19fbca01394f7ed80151731180cfde0a3367f038beae2a97cda7928034010057 mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v3.4.0],SizeBytes:56301028,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:c1f625d115fbd9a12eac615653fc81c0edb33b2b5a76d1e09d5daed11fa557c1 k8s.gcr.io/kube-proxy:v1.23.5],SizeBytes:39278412,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:ddf5bf7196eb534271f9e5d403f4da19838d5610bb5ca191001bde5f32b5492e k8s.gcr.io/kube-apiserver:v1.23.5],SizeBytes:32603217,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:cca0fb3532abedcc95c5f64268d54da9ecc56cc4817ff08d0128941cf2b0e1a4 k8s.gcr.io/kube-controller-manager:v1.23.5],SizeBytes:30174093,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:a889e925e15f9423f7842f1b769f64cbcf6a20b6956122836fc835cf22d9073f mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v5.0.1],SizeBytes:22192414,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:489efb65da9edc40bf0911f3e6371e5bb6b8ad8fde1d55193a6cc84c2ef36626 k8s.gcr.io/kube-scheduler:v1.23.5],SizeBytes:15131395,},ContainerImage{Names:[k8s.gcr.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e k8s.gcr.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[docker.io/calico/pod2daemon-flexvol@sha256:35802ba083546a7c5e8b5bf0ee7ffad7f8a468e8c2b3631e7e9647512c94041d docker.io/calico/pod2daemon-flexvol:v3.22.1],SizeBytes:8462620,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:c96a6255c42766f6b8bb1a7cda02b0060ab1b20b2e2dafcc64ec09e7646745a6 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.5.0],SizeBytes:8222208,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 19 11:43:10.991: INFO: Logging kubelet events for node capz-uyjrvr-md-0-vhn4n Apr 19 11:43:11.050: INFO: Logging pods the kubelet thinks is on node capz-uyjrvr-md-0-vhn4n Apr 19 11:43:11.135: INFO: calico-node-vlpjr started at 2022-04-19 11:05:25 +0000 UTC (3+1 container statuses recorded) Apr 19 11:43:11.135: INFO: Init container upgrade-ipam ready: true, restart count 0 Apr 19 11:43:11.135: INFO: Init container install-cni ready: true, restart count 0 Apr 19 11:43:11.135: INFO: Init container flexvol-driver ready: true, restart count 0 Apr 19 11:43:11.135: INFO: Container calico-node ready: true, restart count 0 Apr 19 11:43:11.135: INFO: kube-proxy-q85v4 started at 2022-04-19 11:05:25 +0000 UTC (0+1 container statuses recorded) Apr 19 11:43:11.135: INFO: Container kube-proxy ready: true, restart count 0 Apr 19 11:43:11.135: INFO: csi-azurefile-controller-554696b9b-zmhs2 started at 2022-04-19 11:21:34 +0000 UTC (0+6 container statuses recorded) Apr 19 11:43:11.135: INFO: Container azurefile ready: true, restart count 0 Apr 19 11:43:11.135: INFO: Container csi-attacher ready: true, restart count 0 Apr 19 11:43:11.135: INFO: Container csi-provisioner ready: true, restart count 0 Apr 19 11:43:11.135: INFO: Container csi-resizer ready: true, restart count 0 Apr 19 11:43:11.135: INFO: Container csi-snapshotter ready: true, restart count 0 Apr 19 11:43:11.135: INFO: Container liveness-probe ready: true, restart count 0 Apr 19 11:43:11.349: INFO: Latency metrics for node capz-uyjrvr-md-0-vhn4n Apr 19 11:43:11.350: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "azurefile-5466" for this suite.
Filter through log files | View test history on testgrid
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a deployment object, write and read to it, delete the pod and write and read to it again [kubernetes.io/azure-file] [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a pod with multiple volumes [kubernetes.io/azure-file] [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a pod with volume mount subpath [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a statefulset object, write and read to it, delete the pod and write and read to it again [file.csi.azure.com]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a storage account with tags [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a volume on demand and mount it as readOnly in a pod [kubernetes.io/azure-file] [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a volume on demand and resize it [kubernetes.io/azure-file] [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a volume on demand with mount options (Bring Your Own Key) [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a volume on demand with useDataPlaneAPI [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create an CSI inline volume [file.csi.azure.com]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should delete PV with reclaimPolicy "Delete" [kubernetes.io/azure-file] [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should mount on-prem smb server [file.csi.azure.com]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should retain PV with reclaimPolicy "Retain" [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Pre-Provisioned should use a pre-provisioned volume and mount it as readOnly in a pod [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Pre-Provisioned should use a pre-provisioned volume and mount it by multiple pods [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Pre-Provisioned should use a pre-provisioned volume and retain PV with reclaimPolicy "Retain" [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Pre-Provisioned should use existing credentials in k8s cluster [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Pre-Provisioned should use provided credentials [file.csi.azure.com] [Windows]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning [env] should retain PV with reclaimPolicy "Retain" [file.csi.azure.com] [disk]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a NFS volume on demand on a storage account with private endpoint [file.csi.azure.com] [nfs]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a NFS volume on demand with mount options [file.csi.azure.com] [nfs]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a deployment object, write and read to it, delete the pod and write and read to it again [file.csi.azure.com] [disk]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a pod with multiple NFS volumes [file.csi.azure.com]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a pod, write and read to it, take a volume snapshot, and validate whether it is ready to use [file.csi.azure.com]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a vhd disk volume on demand [kubernetes.io/azure-file] [file.csi.azure.com][disk]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a vhd disk volume on demand and mount it as readOnly in a pod [file.csi.azure.com][disk]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create a volume after driver restart [kubernetes.io/azure-file] [file.csi.azure.com]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create an inline volume by in-tree driver [kubernetes.io/azure-file]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should create multiple PV objects, bind to PVCs and attach all to different pods on the same node [file.csi.azure.com][disk]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should delete PV with reclaimPolicy "Delete" [file.csi.azure.com] [disk]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should receive FailedMount event with invalid mount options [file.csi.azure.com] [disk]
AzureFile CSI Driver End-to-End Tests Dynamic Provisioning should receive FailedMount event with invalid mount options [file.csi.azure.com] [disk]