Recent runs || View in Spyglass
PR | andyzhangx: test: support Win2022 test on capz |
Result | FAILURE |
Tests | 2 failed / 17 succeeded |
Started | |
Elapsed | 1h31m |
Revision | d7600c07bbfa811ac4d88920710966de02038df5 |
Refs |
1280 |
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=AzureDisk\sCSI\sDriver\sEnd\-to\-End\sTests\sPre\-Provisioned\s\[single\-az\]\sshould\ssucceed\swhen\sreattaching\sa\sdisk\sto\sa\snew\snode\son\sDanglingAttachError\s\[disk\.csi\.azure\.com\]$'
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning_test.go:249 Unexpected error: <*errors.errorString | 0xc000124500>: { s: "pod \"azuredisk-volume-tester-2bkfz\" failed with status: {Phase:Failed Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-13 11:39:55 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-13 11:39:55 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-13 11:39:55 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-13 11:39:55 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:10.1.0.5 PodIP:192.168.220.131 PodIPs:[{IP:192.168.220.131}] StartTime:2022-04-13 11:39:55 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:volume-tester State:{Waiting:&ContainerStateWaiting{Reason:RunContainerError,Message:context deadline exceeded,} Running:nil Terminated:nil} LastTerminationState:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:0,Signal:0,Reason:,Message:,StartedAt:0001-01-01 00:00:00 +0000 UTC,FinishedAt:0001-01-01 00:00:00 +0000 UTC,ContainerID:containerd://5868b39e01c4c8cf924be94a9d72777d8e489ef306ff1a089982ce39075ee631,}} Ready:false RestartCount:0 Image:mcr.microsoft.com/windows/servercore:ltsc2022 ImageID:mcr.microsoft.com/windows/servercore@sha256:378d85bd8e7388a777d25009f8523d1e95a5f544f131eaada83171045d5b2c1e ContainerID:containerd://5868b39e01c4c8cf924be94a9d72777d8e489ef306ff1a089982ce39075ee631 Started:0xc000ad6758}] QOSClass:BestEffort EphemeralContainerStatuses:[]}", } pod "azuredisk-volume-tester-2bkfz" failed with status: {Phase:Failed Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-13 11:39:55 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-13 11:39:55 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-13 11:39:55 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-13 11:39:55 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:10.1.0.5 PodIP:192.168.220.131 PodIPs:[{IP:192.168.220.131}] StartTime:2022-04-13 11:39:55 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:volume-tester State:{Waiting:&ContainerStateWaiting{Reason:RunContainerError,Message:context deadline exceeded,} Running:nil Terminated:nil} LastTerminationState:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:0,Signal:0,Reason:,Message:,StartedAt:0001-01-01 00:00:00 +0000 UTC,FinishedAt:0001-01-01 00:00:00 +0000 UTC,ContainerID:containerd://5868b39e01c4c8cf924be94a9d72777d8e489ef306ff1a089982ce39075ee631,}} Ready:false RestartCount:0 Image:mcr.microsoft.com/windows/servercore:ltsc2022 ImageID:mcr.microsoft.com/windows/servercore@sha256:378d85bd8e7388a777d25009f8523d1e95a5f544f131eaada83171045d5b2c1e ContainerID:containerd://5868b39e01c4c8cf924be94a9d72777d8e489ef306ff1a089982ce39075ee631 Started:0xc000ad6758}] QOSClass:BestEffort EphemeralContainerStatuses:[]} occurred /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:807from junit_01.xml
�[1mSTEP�[0m: Creating a kubernetes client Apr 13 11:39:40.358: INFO: >>> kubeConfig: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig �[1mSTEP�[0m: Building a namespace api object, basename azuredisk �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace �[1mSTEP�[0m: Successfully provisioned a shared disk volume: "/subscriptions/===REDACTED===/resourceGroups/capz-hs54n1/providers/Microsoft.Compute/disks/reattach-disk-multiple-nodes" �[1mSTEP�[0m: setting up the PV �[1mSTEP�[0m: creating a PV �[1mSTEP�[0m: setting up the PVC �[1mSTEP�[0m: creating a PVC �[1mSTEP�[0m: waiting for PVC to be in phase "Bound" Apr 13 11:39:43.752: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-6jbhr] to have phase Bound Apr 13 11:39:43.805: INFO: PersistentVolumeClaim pvc-6jbhr found and phase=Bound (52.954168ms) �[1mSTEP�[0m: checking the PVC �[1mSTEP�[0m: validating provisioned PV �[1mSTEP�[0m: checking the PV �[1mSTEP�[0m: attaching disk to node#0 �[1mSTEP�[0m: deploying the pod �[1mSTEP�[0m: checking that the pod's command exits with no error Apr 13 11:39:55.953: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-2bkfz" in namespace "azuredisk-5356" to be "Succeeded or Failed" Apr 13 11:39:56.006: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 52.646732ms Apr 13 11:39:58.060: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 2.10701323s Apr 13 11:40:00.115: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 4.162153158s Apr 13 11:40:02.170: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 6.216787073s Apr 13 11:40:04.223: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 8.27034768s Apr 13 11:40:06.278: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 10.324914082s Apr 13 11:40:08.333: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 12.379468766s Apr 13 11:40:10.386: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 14.433145567s Apr 13 11:40:12.440: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 16.486813292s Apr 13 11:40:14.494: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 18.540475378s Apr 13 11:40:16.549: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 20.595511718s Apr 13 11:40:18.605: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 22.651929793s Apr 13 11:40:20.660: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 24.706722375s Apr 13 11:40:22.713: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 26.7603045s Apr 13 11:40:24.767: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 28.814183223s Apr 13 11:40:26.821: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 30.867865183s Apr 13 11:40:28.876: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 32.922705154s Apr 13 11:40:30.929: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 34.976410252s Apr 13 11:40:32.983: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 37.030330531s Apr 13 11:40:35.043: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 39.090092843s Apr 13 11:40:37.097: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 41.143990657s Apr 13 11:40:39.152: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 43.198921638s Apr 13 11:40:41.208: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 45.255176848s Apr 13 11:40:43.262: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 47.308732361s Apr 13 11:40:45.316: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 49.363127151s Apr 13 11:40:47.372: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 51.418693903s Apr 13 11:40:49.426: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 53.47270013s Apr 13 11:40:51.479: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 55.526126116s Apr 13 11:40:53.533: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 57.579948217s Apr 13 11:40:55.588: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 59.634893897s Apr 13 11:40:57.643: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.690209924s Apr 13 11:40:59.697: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.743892119s Apr 13 11:41:01.750: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.797432151s Apr 13 11:41:03.805: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m7.852401234s Apr 13 11:41:05.861: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m9.907542775s Apr 13 11:41:07.915: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m11.96238217s Apr 13 11:41:09.971: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.018316616s Apr 13 11:41:12.027: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.074166747s Apr 13 11:41:14.083: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.130390847s Apr 13 11:41:16.140: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.186570429s Apr 13 11:41:18.195: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.241509488s Apr 13 11:41:20.251: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.297510156s Apr 13 11:41:22.305: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.35245723s Apr 13 11:41:24.361: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.407644846s Apr 13 11:41:26.416: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.463260242s Apr 13 11:41:28.472: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.518643995s Apr 13 11:41:30.527: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.573525205s Apr 13 11:41:32.582: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.629243833s Apr 13 11:41:34.638: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.685265758s Apr 13 11:41:36.694: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.741421107s Apr 13 11:41:38.750: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.797295501s Apr 13 11:41:40.806: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.853272972s Apr 13 11:41:42.862: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.90881931s Apr 13 11:41:44.918: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.965323309s Apr 13 11:41:46.974: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m51.020558535s Apr 13 11:41:49.029: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m53.076354618s Apr 13 11:41:51.086: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m55.133250629s Apr 13 11:41:53.141: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m57.188119407s Apr 13 11:41:55.196: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m59.242637362s Apr 13 11:41:57.251: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m1.297948975s Apr 13 11:41:59.306: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m3.35276805s Apr 13 11:42:01.360: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m5.407362545s Apr 13 11:42:03.416: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m7.46274538s Apr 13 11:42:05.471: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m9.517683235s Apr 13 11:42:07.525: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m11.572300396s Apr 13 11:42:09.582: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m13.629451111s Apr 13 11:42:11.638: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m15.685335318s Apr 13 11:42:13.696: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m17.743344256s Apr 13 11:42:15.752: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m19.798622671s Apr 13 11:42:17.810: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m21.856744381s Apr 13 11:42:19.865: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m23.911888209s Apr 13 11:42:21.921: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m25.967804383s Apr 13 11:42:23.976: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.022827381s Apr 13 11:42:26.031: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.078429479s Apr 13 11:42:28.088: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.134649151s Apr 13 11:42:30.144: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.190749498s Apr 13 11:42:32.200: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.246943021s Apr 13 11:42:34.255: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.30170281s Apr 13 11:42:36.310: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.356921803s Apr 13 11:42:38.365: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.412027316s Apr 13 11:42:40.420: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.466991619s Apr 13 11:42:42.475: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.522040495s Apr 13 11:42:44.530: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.576745954s Apr 13 11:42:46.585: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.631677416s Apr 13 11:42:48.640: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.686939654s Apr 13 11:42:50.696: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.74317847s Apr 13 11:42:52.752: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.798739769s Apr 13 11:42:54.809: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.855608654s Apr 13 11:42:56.864: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.910817248s Apr 13 11:42:58.920: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.96698836s Apr 13 11:43:00.976: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m5.023291937s Apr 13 11:43:03.032: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m7.078670297s Apr 13 11:43:05.087: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m9.134386147s Apr 13 11:43:07.145: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m11.191789824s Apr 13 11:43:09.202: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m13.249358128s Apr 13 11:43:11.258: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m15.304764738s Apr 13 11:43:13.313: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m17.360433149s Apr 13 11:43:15.369: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m19.415741457s Apr 13 11:43:17.424: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m21.471370752s Apr 13 11:43:19.480: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m23.526968599s Apr 13 11:43:21.536: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m25.582678356s Apr 13 11:43:23.592: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m27.63929172s Apr 13 11:43:25.649: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m29.696423626s Apr 13 11:43:27.704: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m31.751461589s Apr 13 11:43:29.760: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m33.80648659s Apr 13 11:43:31.815: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m35.861889104s Apr 13 11:43:33.871: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m37.918441936s Apr 13 11:43:35.926: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m39.973127728s Apr 13 11:43:37.981: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.028293122s Apr 13 11:43:40.037: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.084091276s Apr 13 11:43:42.092: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.139345146s Apr 13 11:43:44.150: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.196682982s Apr 13 11:43:46.209: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.256146316s Apr 13 11:43:48.265: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.311842703s Apr 13 11:43:50.320: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.366704739s Apr 13 11:43:52.375: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.422139606s Apr 13 11:43:54.430: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.477048505s Apr 13 11:43:56.487: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.533780028s Apr 13 11:43:58.542: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.589444689s Apr 13 11:44:00.598: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.644898358s Apr 13 11:44:02.654: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.700597382s Apr 13 11:44:04.709: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.75597425s Apr 13 11:44:06.764: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.811368174s Apr 13 11:44:08.820: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.866684571s Apr 13 11:44:10.876: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.92295806s Apr 13 11:44:12.931: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.978086114s Apr 13 11:44:14.988: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m19.034753543s Apr 13 11:44:17.045: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m21.092416548s Apr 13 11:44:19.101: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m23.147570027s Apr 13 11:44:21.156: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m25.202611291s Apr 13 11:44:23.211: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m27.258103069s Apr 13 11:44:25.266: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m29.312902999s Apr 13 11:44:27.321: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m31.36800004s Apr 13 11:44:29.376: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m33.423351133s Apr 13 11:44:31.432: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m35.478546684s Apr 13 11:44:33.486: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m37.533394478s Apr 13 11:44:35.542: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m39.588964938s Apr 13 11:44:37.599: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m41.645904272s Apr 13 11:44:39.654: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m43.700619992s Apr 13 11:44:41.709: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m45.756204479s Apr 13 11:44:43.765: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m47.812362755s Apr 13 11:44:45.821: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m49.868343523s Apr 13 11:44:47.876: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m51.923060897s Apr 13 11:44:49.932: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m53.979238486s Apr 13 11:44:51.988: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.035150486s Apr 13 11:44:54.044: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.091123795s Apr 13 11:44:56.102: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.149052253s Apr 13 11:44:58.157: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 5m2.204284278s Apr 13 11:45:00.213: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 5m4.259915133s Apr 13 11:45:02.268: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 5m6.314556511s Apr 13 11:45:04.323: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 5m8.369951559s Apr 13 11:45:06.378: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 5m10.42538723s Apr 13 11:45:08.433: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 5m12.479951877s Apr 13 11:45:10.490: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 5m14.537120836s Apr 13 11:45:12.548: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 5m16.594532453s Apr 13 11:45:14.603: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 5m18.650290987s Apr 13 11:45:16.658: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 5m20.705222593s Apr 13 11:45:18.713: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 5m22.760350626s Apr 13 11:45:20.768: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 5m24.815087237s Apr 13 11:45:22.823: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 5m26.870115061s Apr 13 11:45:24.880: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 5m28.926660928s Apr 13 11:45:26.934: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 5m30.981094674s Apr 13 11:45:28.990: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 5m33.036576588s Apr 13 11:45:31.045: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 5m35.092201418s Apr 13 11:45:33.100: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 5m37.146887259s Apr 13 11:45:35.156: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 5m39.202583793s Apr 13 11:45:37.210: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 5m41.25681878s Apr 13 11:45:39.268: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 5m43.314488894s Apr 13 11:45:41.324: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 5m45.370593524s Apr 13 11:45:43.379: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 5m47.425901447s Apr 13 11:45:45.435: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 5m49.481953448s Apr 13 11:45:47.490: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 5m51.537392714s Apr 13 11:45:49.546: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 5m53.593044415s Apr 13 11:45:51.601: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 5m55.648424066s Apr 13 11:45:53.656: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 5m57.702993027s Apr 13 11:45:55.712: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 5m59.758684559s Apr 13 11:45:57.767: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 6m1.814232988s Apr 13 11:45:59.822: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 6m3.869177524s Apr 13 11:46:01.878: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 6m5.925199305s Apr 13 11:46:03.934: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 6m7.98130586s Apr 13 11:46:05.991: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 6m10.037689493s Apr 13 11:46:08.046: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 6m12.093227257s Apr 13 11:46:10.102: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 6m14.149197244s Apr 13 11:46:12.158: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 6m16.205217645s Apr 13 11:46:14.213: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 6m18.260425946s Apr 13 11:46:16.269: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 6m20.315781155s Apr 13 11:46:18.324: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 6m22.371392339s Apr 13 11:46:20.379: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 6m24.426407892s Apr 13 11:46:22.435: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 6m26.482442187s Apr 13 11:46:24.491: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 6m28.537506795s Apr 13 11:46:26.546: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 6m30.592600636s Apr 13 11:46:28.600: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 6m32.647456208s Apr 13 11:46:30.657: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 6m34.703869995s Apr 13 11:46:32.714: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 6m36.760784101s Apr 13 11:46:34.769: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 6m38.816309625s Apr 13 11:46:36.825: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 6m40.872267442s Apr 13 11:46:38.881: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 6m42.927471027s Apr 13 11:46:40.937: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 6m44.984061846s Apr 13 11:46:42.992: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 6m47.039019747s Apr 13 11:46:45.049: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 6m49.096022633s Apr 13 11:46:47.104: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 6m51.15137894s Apr 13 11:46:49.160: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 6m53.207237892s Apr 13 11:46:51.216: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 6m55.262496883s Apr 13 11:46:53.272: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 6m57.318623362s Apr 13 11:46:55.327: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 6m59.373864374s Apr 13 11:46:57.382: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 7m1.429217633s Apr 13 11:46:59.438: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 7m3.48499958s Apr 13 11:47:01.494: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 7m5.540736472s Apr 13 11:47:03.549: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 7m7.596297898s Apr 13 11:47:05.606: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 7m9.652653384s Apr 13 11:47:07.662: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 7m11.708742175s Apr 13 11:47:09.717: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 7m13.764213323s Apr 13 11:47:11.773: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 7m15.819987464s Apr 13 11:47:13.828: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 7m17.874998111s Apr 13 11:47:15.884: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 7m19.930786466s Apr 13 11:47:17.939: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 7m21.986372804s Apr 13 11:47:19.996: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 7m24.042483383s Apr 13 11:47:22.050: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 7m26.097208175s Apr 13 11:47:24.107: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 7m28.154013304s Apr 13 11:47:26.162: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 7m30.208756367s Apr 13 11:47:28.216: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 7m32.26338488s Apr 13 11:47:30.272: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 7m34.318806574s Apr 13 11:47:32.327: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 7m36.374023797s Apr 13 11:47:34.383: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 7m38.429652791s Apr 13 11:47:36.438: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 7m40.485056051s Apr 13 11:47:38.494: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 7m42.54051154s Apr 13 11:47:40.549: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 7m44.595472973s Apr 13 11:47:42.603: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 7m46.650141814s Apr 13 11:47:44.659: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 7m48.705505227s Apr 13 11:47:46.718: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 7m50.765257108s Apr 13 11:47:48.776: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 7m52.822694724s Apr 13 11:47:50.831: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 7m54.878172377s Apr 13 11:47:52.886: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 7m56.932959643s Apr 13 11:47:54.942: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 7m58.988911686s Apr 13 11:47:56.998: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 8m1.044654709s Apr 13 11:47:59.053: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 8m3.100026822s Apr 13 11:48:01.109: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 8m5.15619342s Apr 13 11:48:03.165: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Pending", Reason="", readiness=false. Elapsed: 8m7.212189199s Apr 13 11:48:05.221: INFO: Pod "azuredisk-volume-tester-2bkfz": Phase="Failed", Reason="", readiness=false. Elapsed: 8m9.267800808s Apr 13 11:48:05.221: INFO: deleting Pod "azuredisk-5356"/"azuredisk-volume-tester-2bkfz" Apr 13 11:48:05.299: INFO: Pod azuredisk-volume-tester-2bkfz has the following logs: �[1mSTEP�[0m: Deleting pod azuredisk-volume-tester-2bkfz in namespace azuredisk-5356 Apr 13 11:48:05.564: INFO: deleting PVC "azuredisk-5356"/"pvc-6jbhr" Apr 13 11:48:05.564: INFO: Deleting PersistentVolumeClaim "pvc-6jbhr" Apr 13 11:48:05.618: INFO: Waiting up to 5m0s for PersistentVolumeClaim azuredisk-5356 to be removed Apr 13 11:48:05.671: INFO: Claim "azuredisk-5356" in namespace "pvc-6jbhr" doesn't exist in the system �[1mSTEP�[0m: deleting PV "azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst" Apr 13 11:48:05.671: INFO: Deleting PersistentVolume "azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst" �[1mSTEP�[0m: waiting for claim's PV "azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst" to be deleted Apr 13 11:48:05.726: INFO: Waiting up to 10m0s for PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst to get deleted Apr 13 11:48:05.779: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (52.973911ms) Apr 13 11:48:10.837: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (5.110673215s) Apr 13 11:48:15.891: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (10.164909705s) Apr 13 11:48:20.946: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (15.219965885s) Apr 13 11:48:26.000: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (20.274224327s) Apr 13 11:48:31.057: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (25.330339627s) Apr 13 11:48:36.113: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (30.386748992s) Apr 13 11:48:41.170: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (35.444056528s) Apr 13 11:48:46.228: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (40.501598182s) Apr 13 11:48:51.286: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (45.559559582s) Apr 13 11:48:56.341: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (50.61433006s) Apr 13 11:49:01.394: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (55.667952548s) Apr 13 11:49:06.453: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (1m0.726319862s) Apr 13 11:49:11.510: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (1m5.784037064s) Apr 13 11:49:16.565: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (1m10.838510206s) Apr 13 11:49:21.623: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (1m15.897037929s) Apr 13 11:49:26.677: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (1m20.950611733s) Apr 13 11:49:31.731: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (1m26.004893027s) Apr 13 11:49:36.785: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (1m31.058373751s) Apr 13 11:49:41.839: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (1m36.112443265s) Apr 13 11:49:46.892: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (1m41.166021396s) Apr 13 11:49:51.947: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (1m46.221057715s) Apr 13 11:49:57.011: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (1m51.284578918s) Apr 13 11:50:02.065: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (1m56.338681233s) Apr 13 11:50:07.122: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (2m1.395494966s) Apr 13 11:50:12.175: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (2m6.449047399s) Apr 13 11:50:17.230: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (2m11.503620903s) Apr 13 11:50:22.284: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (2m16.557296533s) Apr 13 11:50:27.338: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (2m21.612161397s) Apr 13 11:50:32.392: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (2m26.665948558s) Apr 13 11:50:37.446: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (2m31.719393096s) Apr 13 11:50:42.499: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (2m36.773244827s) Apr 13 11:50:47.553: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (2m41.826897042s) Apr 13 11:50:52.606: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (2m46.880257159s) Apr 13 11:50:57.660: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (2m51.934192722s) Apr 13 11:51:02.715: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (2m56.988832979s) Apr 13 11:51:07.770: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (3m2.043721517s) Apr 13 11:51:12.832: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (3m7.10531256s) Apr 13 11:51:17.886: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (3m12.159929059s) Apr 13 11:51:22.940: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (3m17.213713038s) Apr 13 11:51:27.994: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (3m22.268012393s) Apr 13 11:51:33.048: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (3m27.321506432s) Apr 13 11:51:38.102: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (3m32.376061062s) Apr 13 11:51:43.156: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (3m37.429620518s) Apr 13 11:51:48.216: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (3m42.489512912s) Apr 13 11:51:53.271: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (3m47.544301603s) Apr 13 11:51:58.324: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (3m52.597927797s) Apr 13 11:52:03.382: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (3m57.655575982s) Apr 13 11:52:08.436: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (4m2.709418398s) Apr 13 11:52:13.491: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (4m7.764294871s) Apr 13 11:52:18.546: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (4m12.819325929s) Apr 13 11:52:23.599: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (4m17.873233451s) Apr 13 11:52:28.655: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (4m22.928358184s) Apr 13 11:52:33.709: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (4m27.98293795s) Apr 13 11:52:38.765: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (4m33.039011933s) Apr 13 11:52:43.819: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (4m38.092689749s) Apr 13 11:52:48.874: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (4m43.14739785s) Apr 13 11:52:53.928: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (4m48.201740827s) Apr 13 11:52:58.983: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (4m53.256951574s) Apr 13 11:53:04.037: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (4m58.311044864s) Apr 13 11:53:09.093: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (5m3.366500959s) Apr 13 11:53:14.150: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (5m8.423274061s) Apr 13 11:53:19.204: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (5m13.477465005s) Apr 13 11:53:24.260: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (5m18.533552372s) Apr 13 11:53:29.314: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (5m23.587473281s) Apr 13 11:53:34.368: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (5m28.642149515s) Apr 13 11:53:39.424: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (5m33.697886109s) Apr 13 11:53:44.478: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (5m38.751686816s) Apr 13 11:53:49.534: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (5m43.808197487s) Apr 13 11:53:54.588: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (5m48.862081342s) Apr 13 11:53:59.645: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (5m53.918348662s) Apr 13 11:54:04.698: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (5m58.971652898s) Apr 13 11:54:09.755: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (6m4.028422743s) Apr 13 11:54:14.809: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst found and phase=Released (6m9.082368068s) Apr 13 11:54:19.863: INFO: PersistentVolume azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst was removed �[1mSTEP�[0m: Collecting events from namespace "azuredisk-5356". �[1mSTEP�[0m: Found 11 events. Apr 13 11:54:19.920: INFO: At 2022-04-13 11:39:55 +0000 UTC - event for azuredisk-volume-tester-2bkfz: {default-scheduler } Scheduled: Successfully assigned azuredisk-5356/azuredisk-volume-tester-2bkfz to capz-hs54-xckjv Apr 13 11:54:19.920: INFO: At 2022-04-13 11:40:12 +0000 UTC - event for azuredisk-volume-tester-2bkfz: {attachdetach-controller } FailedAttachVolume: AttachVolume.Attach failed for volume "azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst" : rpc error: code = Unknown desc = Attach volume /subscriptions/===REDACTED===/resourceGroups/capz-hs54n1/providers/Microsoft.Compute/disks/reattach-disk-multiple-nodes to instance capz-hs54-xckjv failed with disk(/subscriptions/===REDACTED===/resourceGroups/capz-hs54n1/providers/Microsoft.Compute/disks/reattach-disk-multiple-nodes) already attached to node(/subscriptions/===REDACTED===/resourceGroups/capz-hs54n1/providers/Microsoft.Compute/virtualMachines/capz-hs54-hzrck), could not be attached to node(capz-hs54-xckjv) Apr 13 11:54:19.920: INFO: At 2022-04-13 11:40:30 +0000 UTC - event for azuredisk-volume-tester-2bkfz: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "azuredisk-5356-disk.csi.azure.com-preprovisioned-pv-fcjst" Apr 13 11:54:19.920: INFO: At 2022-04-13 11:41:10 +0000 UTC - event for azuredisk-volume-tester-2bkfz: {kubelet capz-hs54-xckjv} Pulling: Pulling image "mcr.microsoft.com/windows/servercore:ltsc2022" Apr 13 11:54:19.920: INFO: At 2022-04-13 11:46:03 +0000 UTC - event for azuredisk-volume-tester-2bkfz: {kubelet capz-hs54-xckjv} Pulled: Successfully pulled image "mcr.microsoft.com/windows/servercore:ltsc2022" in 4m52.2096973s Apr 13 11:54:19.920: INFO: At 2022-04-13 11:46:03 +0000 UTC - event for azuredisk-volume-tester-2bkfz: {kubelet capz-hs54-xckjv} Created: Created container volume-tester Apr 13 11:54:19.920: INFO: At 2022-04-13 11:48:03 +0000 UTC - event for azuredisk-volume-tester-2bkfz: {kubelet capz-hs54-xckjv} Failed: Error: context deadline exceeded Apr 13 11:54:19.920: INFO: At 2022-04-13 11:48:03 +0000 UTC - event for azuredisk-volume-tester-2bkfz: {kubelet capz-hs54-xckjv} Pulled: Container image "mcr.microsoft.com/windows/servercore:ltsc2022" already present on machine Apr 13 11:54:19.920: INFO: At 2022-04-13 11:48:08 +0000 UTC - event for azuredisk-volume-tester-2bkfz: {kubelet capz-hs54-xckjv} Started: Started container volume-tester Apr 13 11:54:19.920: INFO: At 2022-04-13 11:48:09 +0000 UTC - event for azuredisk-volume-tester-2bkfz: {kubelet capz-hs54-xckjv} Killing: Stopping container volume-tester Apr 13 11:54:19.920: INFO: At 2022-04-13 11:50:10 +0000 UTC - event for azuredisk-volume-tester-2bkfz: {kubelet capz-hs54-xckjv} FailedKillPod: error killing pod: failed to "KillPodSandbox" for "84b22c6c-474f-4b6d-9bea-799a2fda4c4f" with KillPodSandboxError: "rpc error: code = DeadlineExceeded desc = context deadline exceeded" Apr 13 11:54:19.973: INFO: POD NODE PHASE GRACE CONDITIONS Apr 13 11:54:19.973: INFO: Apr 13 11:54:20.042: INFO: Logging node info for node capz-hs54-hzrck Apr 13 11:54:20.099: INFO: Node Info: &Node{ObjectMeta:{capz-hs54-hzrck a5e9a839-5870-4fdb-8bed-13237d6a5658 6120 0 2022-04-13 11:18:49 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D4s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-hs54-hzrck kubernetes.io/os:windows node.kubernetes.io/instance-type:Standard_D4s_v3 node.kubernetes.io/windows-build:10.0.20348 topology.disk.csi.azure.com/zone: topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[cluster.x-k8s.io/cluster-name:capz-hs54n1 cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-hs54n1-md-win-76c844c685-npvck cluster.x-k8s.io/owner-kind:MachineSet cluster.x-k8s.io/owner-name:capz-hs54n1-md-win-76c844c685 csi.volume.kubernetes.io/nodeid:{"disk.csi.azure.com":"capz-hs54-hzrck"} kubeadm.alpha.kubernetes.io/cri-socket:npipe:////./pipe/containerd-containerd node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.1.0.7/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.211.129 projectcalico.org/VXLANTunnelMACAddr:00:15:5d:3c:87:0d volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-13 11:18:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {manager Update v1 2022-04-13 11:19:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {calico-node.exe Update v1 2022-04-13 11:20:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{},"f:projectcalico.org/VXLANTunnelMACAddr":{}}}} status} {Go-http-client Update v1 2022-04-13 11:24:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.disk.csi.azure.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2022-04-13 11:39:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}} }]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-hs54n1/providers/Microsoft.Compute/virtualMachines/capz-hs54-hzrck,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{17179398144 0} {<nil>} 16776756Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{123221307598 0} {<nil>} 123221307598 DecimalSI},memory: {{17074540544 0} {<nil>} 16674356Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-13 11:51:49 +0000 UTC,LastTransitionTime:2022-04-13 11:18:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-13 11:51:49 +0000 UTC,LastTransitionTime:2022-04-13 11:18:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-13 11:51:49 +0000 UTC,LastTransitionTime:2022-04-13 11:18:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-13 11:51:49 +0000 UTC,LastTransitionTime:2022-04-13 11:20:01 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-hs54-hzrck,},NodeAddress{Type:InternalIP,Address:10.1.0.7,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:capz-hs54-hzrck,SystemUUID:2C25F09E-902D-412A-A706-61198C34AA62,BootID:,KernelVersion:10.0.20348.405,OSImage:Windows Server 2022 Datacenter,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:378d85bd8e7388a777d25009f8523d1e95a5f544f131eaada83171045d5b2c1e mcr.microsoft.com/windows/servercore:ltsc2022],SizeBytes:2226956779,},ContainerImage{Names:[docker.io/sigwindowstools/calico-install@sha256:141afecd724eb757ee41593cc73f35fb19a2ce13cad73179cf3b1cef81a637d1 docker.io/sigwindowstools/calico-install:v3.22.1-hostprocess],SizeBytes:148096127,},ContainerImage{Names:[capzci.azurecr.io/azuredisk-csi@sha256:61a2e32fbb4b6722027417b9fe2ca6be53958707c8544393ba4f6fddb5239705 capzci.azurecr.io/azuredisk-csi:v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635],SizeBytes:141765990,},ContainerImage{Names:[docker.io/sigwindowstools/calico-node@sha256:b8e6e2f190e58d6b61b7f2a19b0e2e17a377e5b9d7b9528e9b7953d9f9ab59bb docker.io/sigwindowstools/calico-node:v3.22.1-hostprocess],SizeBytes:128793648,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:dbec3a8166686b09b242176ab5b99e993da4126438bbce68147c3fd654f35662 mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.4.0],SizeBytes:125554391,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:c96a6255c42766f6b8bb1a7cda02b0060ab1b20b2e2dafcc64ec09e7646745a6 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.5.0],SizeBytes:124471446,},ContainerImage{Names:[ghcr.io/kubernetes-sigs/sig-windows/csi-proxy@sha256:96b4144986319a747ba599892454be2737aae6005d96b8e13ed481321ac3afba ghcr.io/kubernetes-sigs/sig-windows/csi-proxy:v1.0.2],SizeBytes:123925937,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:119397646,},},VolumesInUse:[kubernetes.io/csi/disk.csi.azure.com^/subscriptions/===REDACTED===/resourceGroups/capz-hs54n1/providers/Microsoft.Compute/disks/pre-provisioned-readOnly],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 13 11:54:20.099: INFO: Logging kubelet events for node capz-hs54-hzrck Apr 13 11:54:20.156: INFO: Logging pods the kubelet thinks is on node capz-hs54-hzrck Apr 13 11:54:20.258: INFO: calico-node-windows-sxz8j started at 2022-04-13 11:18:50 +0000 UTC (1+2 container statuses recorded) Apr 13 11:54:20.258: INFO: Init container install-cni ready: true, restart count 0 Apr 13 11:54:20.258: INFO: Container calico-node-felix ready: true, restart count 1 Apr 13 11:54:20.258: INFO: Container calico-node-startup ready: true, restart count 0 Apr 13 11:54:20.258: INFO: csi-proxy-xtrv9 started at 2022-04-13 11:20:01 +0000 UTC (0+1 container statuses recorded) Apr 13 11:54:20.258: INFO: Container csi-proxy ready: true, restart count 0 Apr 13 11:54:20.258: INFO: csi-azuredisk-node-win-b9mdd started at 2022-04-13 11:22:33 +0000 UTC (1+3 container statuses recorded) Apr 13 11:54:20.258: INFO: Init container init ready: true, restart count 0 Apr 13 11:54:20.258: INFO: Container azuredisk ready: true, restart count 0 Apr 13 11:54:20.258: INFO: Container liveness-probe ready: true, restart count 0 Apr 13 11:54:20.258: INFO: Container node-driver-registrar ready: true, restart count 0 Apr 13 11:54:20.258: INFO: kube-proxy-windows-vwkk8 started at 2022-04-13 11:18:50 +0000 UTC (0+1 container statuses recorded) Apr 13 11:54:20.258: INFO: Container kube-proxy ready: false, restart count 0 Apr 13 11:54:20.517: INFO: Latency metrics for node capz-hs54-hzrck Apr 13 11:54:20.517: INFO: Logging node info for node capz-hs54-xckjv Apr 13 11:54:20.574: INFO: Node Info: &Node{ObjectMeta:{capz-hs54-xckjv 77884b65-724c-46ed-89a8-7419438e7166 6447 0 2022-04-13 11:18:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D4s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-hs54-xckjv kubernetes.io/os:windows node.kubernetes.io/instance-type:Standard_D4s_v3 node.kubernetes.io/windows-build:10.0.20348 topology.disk.csi.azure.com/zone: topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[cluster.x-k8s.io/cluster-name:capz-hs54n1 cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-hs54n1-md-win-76c844c685-f8hnr cluster.x-k8s.io/owner-kind:MachineSet cluster.x-k8s.io/owner-name:capz-hs54n1-md-win-76c844c685 csi.volume.kubernetes.io/nodeid:{"disk.csi.azure.com":"capz-hs54-xckjv"} kubeadm.alpha.kubernetes.io/cri-socket:npipe:////./pipe/containerd-containerd node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.1.0.5/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.220.129 projectcalico.org/VXLANTunnelMACAddr:00:15:5d:4e:e7:92 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-13 11:18:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-04-13 11:19:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}} } {manager Update v1 2022-04-13 11:19:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {calico-node.exe Update v1 2022-04-13 11:20:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{},"f:projectcalico.org/VXLANTunnelMACAddr":{}}}} status} {Go-http-client Update v1 2022-04-13 11:40:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.disk.csi.azure.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-hs54n1/providers/Microsoft.Compute/virtualMachines/capz-hs54-xckjv,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{17179398144 0} {<nil>} 16776756Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{123221307598 0} {<nil>} 123221307598 DecimalSI},memory: {{17074540544 0} {<nil>} 16674356Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-13 11:51:36 +0000 UTC,LastTransitionTime:2022-04-13 11:18:57 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-13 11:51:36 +0000 UTC,LastTransitionTime:2022-04-13 11:18:57 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-13 11:51:36 +0000 UTC,LastTransitionTime:2022-04-13 11:18:57 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-13 11:51:36 +0000 UTC,LastTransitionTime:2022-04-13 11:19:59 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-hs54-xckjv,},NodeAddress{Type:InternalIP,Address:10.1.0.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:capz-hs54-xckjv,SystemUUID:B93D2ECE-A677-4F89-B39F-AD7A6A38C8C1,BootID:,KernelVersion:10.0.20348.405,OSImage:Windows Server 2022 Datacenter,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:378d85bd8e7388a777d25009f8523d1e95a5f544f131eaada83171045d5b2c1e mcr.microsoft.com/windows/servercore:ltsc2022],SizeBytes:2226956779,},ContainerImage{Names:[docker.io/sigwindowstools/calico-install@sha256:141afecd724eb757ee41593cc73f35fb19a2ce13cad73179cf3b1cef81a637d1 docker.io/sigwindowstools/calico-install:v3.22.1-hostprocess],SizeBytes:148096127,},ContainerImage{Names:[capzci.azurecr.io/azuredisk-csi@sha256:61a2e32fbb4b6722027417b9fe2ca6be53958707c8544393ba4f6fddb5239705 capzci.azurecr.io/azuredisk-csi:v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635],SizeBytes:141765990,},ContainerImage{Names:[docker.io/sigwindowstools/calico-node@sha256:b8e6e2f190e58d6b61b7f2a19b0e2e17a377e5b9d7b9528e9b7953d9f9ab59bb docker.io/sigwindowstools/calico-node:v3.22.1-hostprocess],SizeBytes:128793648,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:dbec3a8166686b09b242176ab5b99e993da4126438bbce68147c3fd654f35662 mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.4.0],SizeBytes:125554391,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:c96a6255c42766f6b8bb1a7cda02b0060ab1b20b2e2dafcc64ec09e7646745a6 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.5.0],SizeBytes:124471446,},ContainerImage{Names:[ghcr.io/kubernetes-sigs/sig-windows/csi-proxy@sha256:96b4144986319a747ba599892454be2737aae6005d96b8e13ed481321ac3afba ghcr.io/kubernetes-sigs/sig-windows/csi-proxy:v1.0.2],SizeBytes:123925937,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:119397646,},},VolumesInUse:[kubernetes.io/csi/disk.csi.azure.com^/subscriptions/===REDACTED===/resourceGroups/capz-hs54n1/providers/Microsoft.Compute/disks/reattach-disk-multiple-nodes],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 13 11:54:20.574: INFO: Logging kubelet events for node capz-hs54-xckjv Apr 13 11:54:20.630: INFO: Logging pods the kubelet thinks is on node capz-hs54-xckjv Apr 13 11:54:20.719: INFO: calico-node-windows-2h4q8 started at 2022-04-13 11:18:58 +0000 UTC (1+2 container statuses recorded) Apr 13 11:54:20.719: INFO: Init container install-cni ready: true, restart count 0 Apr 13 11:54:20.719: INFO: Container calico-node-felix ready: true, restart count 1 Apr 13 11:54:20.719: INFO: Container calico-node-startup ready: true, restart count 0 Apr 13 11:54:20.719: INFO: kube-proxy-windows-bjgh6 started at 2022-04-13 11:18:58 +0000 UTC (0+1 container statuses recorded) Apr 13 11:54:20.719: INFO: Container kube-proxy ready: false, restart count 0 Apr 13 11:54:20.719: INFO: csi-proxy-r98hg started at 2022-04-13 11:19:59 +0000 UTC (0+1 container statuses recorded) Apr 13 11:54:20.719: INFO: Container csi-proxy ready: true, restart count 0 Apr 13 11:54:20.719: INFO: csi-azuredisk-node-win-796rw started at 2022-04-13 11:22:33 +0000 UTC (1+3 container statuses recorded) Apr 13 11:54:20.719: INFO: Init container init ready: true, restart count 0 Apr 13 11:54:20.719: INFO: Container azuredisk ready: true, restart count 0 Apr 13 11:54:20.719: INFO: Container liveness-probe ready: true, restart count 0 Apr 13 11:54:20.719: INFO: Container node-driver-registrar ready: true, restart count 0 Apr 13 11:54:20.964: INFO: Latency metrics for node capz-hs54-xckjv Apr 13 11:54:20.964: INFO: Logging node info for node capz-hs54n1-control-plane-68bd2 Apr 13 11:54:21.020: INFO: Node Info: &Node{ObjectMeta:{capz-hs54n1-control-plane-68bd2 f28d65d3-542d-49e9-b87f-c647072d5290 6382 0 2022-04-13 11:16:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:westus2-2 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-hs54n1-control-plane-68bd2 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/master: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:Standard_D2s_v3 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:westus2-2] map[cluster.x-k8s.io/cluster-name:capz-hs54n1 cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-hs54n1-control-plane-bqs28 cluster.x-k8s.io/owner-kind:KubeadmControlPlane cluster.x-k8s.io/owner-name:capz-hs54n1-control-plane kubeadm.alpha.kubernetes.io/cri-socket:/run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.0.4/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.31.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-13 11:16:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node-role.kubernetes.io/control-plane":{},"f:node-role.kubernetes.io/master":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {manager Update v1 2022-04-13 11:16:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {kube-controller-manager Update v1 2022-04-13 11:17:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:taints":{}}} } {Go-http-client Update v1 2022-04-13 11:17:21 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {calico-node Update v1 2022-04-13 11:17:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-hs54n1/providers/Microsoft.Compute/virtualMachines/capz-hs54n1-control-plane-68bd2,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{133018140672 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8340819968 0} {<nil>} 8145332Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{119716326407 0} {<nil>} 119716326407 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8235962368 0} {<nil>} 8042932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-04-13 11:17:24 +0000 UTC,LastTransitionTime:2022-04-13 11:17:24 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-13 11:53:36 +0000 UTC,LastTransitionTime:2022-04-13 11:16:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-13 11:53:36 +0000 UTC,LastTransitionTime:2022-04-13 11:16:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-13 11:53:36 +0000 UTC,LastTransitionTime:2022-04-13 11:16:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-13 11:53:36 +0000 UTC,LastTransitionTime:2022-04-13 11:17:11 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-hs54n1-control-plane-68bd2,},NodeAddress{Type:InternalIP,Address:10.0.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f4c83e8d7b3240c8a5c75a5a792bec20,SystemUUID:2a8d7cd8-919c-fe42-85fb-c1a96426087f,BootID:31b443cf-bfd2-4957-b372-05d446796761,KernelVersion:5.13.0-1017-azure,OSImage:Ubuntu 20.04.4 LTS,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 k8s.gcr.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[docker.io/calico/cni@sha256:2219eae79544b098119a06a8bb5608867f9ac00471592a00e2347f3ae4bea687 docker.io/calico/cni:v3.22.1],SizeBytes:80514590,},ContainerImage{Names:[docker.io/calico/node@sha256:1f8ed83e5264b4206cce7e1def11bca0b3ea7d5f4eb9b0ca0dbfc8cb968ca57e docker.io/calico/node:v3.22.1],SizeBytes:69647221,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:e42a0aba3637d123481cca14fd8314a482616593edf58f9594c9382e50498f9b docker.io/calico/kube-controllers:v3.22.1],SizeBytes:54948023,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:c1f625d115fbd9a12eac615653fc81c0edb33b2b5a76d1e09d5daed11fa557c1 k8s.gcr.io/kube-proxy:v1.23.5],SizeBytes:39278412,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:ddf5bf7196eb534271f9e5d403f4da19838d5610bb5ca191001bde5f32b5492e k8s.gcr.io/kube-apiserver:v1.23.5],SizeBytes:32603217,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:cca0fb3532abedcc95c5f64268d54da9ecc56cc4817ff08d0128941cf2b0e1a4 k8s.gcr.io/kube-controller-manager:v1.23.5],SizeBytes:30174093,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:489efb65da9edc40bf0911f3e6371e5bb6b8ad8fde1d55193a6cc84c2ef36626 k8s.gcr.io/kube-scheduler:v1.23.5],SizeBytes:15131395,},ContainerImage{Names:[k8s.gcr.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e k8s.gcr.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[docker.io/calico/pod2daemon-flexvol@sha256:35802ba083546a7c5e8b5bf0ee7ffad7f8a468e8c2b3631e7e9647512c94041d docker.io/calico/pod2daemon-flexvol:v3.22.1],SizeBytes:8462620,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 13 11:54:21.020: INFO: Logging kubelet events for node capz-hs54n1-control-plane-68bd2 Apr 13 11:54:21.077: INFO: Logging pods the kubelet thinks is on node capz-hs54n1-control-plane-68bd2 Apr 13 11:54:21.179: INFO: kube-controller-manager-capz-hs54n1-control-plane-68bd2 started at 2022-04-13 11:16:52 +0000 UTC (0+1 container statuses recorded) Apr 13 11:54:21.179: INFO: Container kube-controller-manager ready: true, restart count 0 Apr 13 11:54:21.179: INFO: calico-node-vd2hz started at 2022-04-13 11:16:44 +0000 UTC (3+1 container statuses recorded) Apr 13 11:54:21.179: INFO: Init container upgrade-ipam ready: true, restart count 0 Apr 13 11:54:21.179: INFO: Init container install-cni ready: true, restart count 0 Apr 13 11:54:21.179: INFO: Init container flexvol-driver ready: true, restart count 0 Apr 13 11:54:21.179: INFO: Container calico-node ready: true, restart count 0 Apr 13 11:54:21.179: INFO: coredns-64897985d-4m5jw started at 2022-04-13 11:17:11 +0000 UTC (0+1 container statuses recorded) Apr 13 11:54:21.179: INFO: Container coredns ready: true, restart count 0 Apr 13 11:54:21.179: INFO: coredns-64897985d-zwk5p started at 2022-04-13 11:17:11 +0000 UTC (0+1 container statuses recorded) Apr 13 11:54:21.179: INFO: Container coredns ready: true, restart count 0 Apr 13 11:54:21.179: INFO: kube-apiserver-capz-hs54n1-control-plane-68bd2 started at 2022-04-13 11:16:52 +0000 UTC (0+1 container statuses recorded) Apr 13 11:54:21.179: INFO: Container kube-apiserver ready: true, restart count 0 Apr 13 11:54:21.179: INFO: kube-scheduler-capz-hs54n1-control-plane-68bd2 started at 2022-04-13 11:16:52 +0000 UTC (0+1 container statuses recorded) Apr 13 11:54:21.179: INFO: Container kube-scheduler ready: true, restart count 0 Apr 13 11:54:21.179: INFO: etcd-capz-hs54n1-control-plane-68bd2 started at 2022-04-13 11:16:42 +0000 UTC (0+1 container statuses recorded) Apr 13 11:54:21.179: INFO: Container etcd ready: true, restart count 0 Apr 13 11:54:21.179: INFO: kube-proxy-h7826 started at 2022-04-13 11:16:52 +0000 UTC (0+1 container statuses recorded) Apr 13 11:54:21.179: INFO: Container kube-proxy ready: true, restart count 0 Apr 13 11:54:21.179: INFO: calico-kube-controllers-7c664f4648-svm75 started at 2022-04-13 11:17:11 +0000 UTC (0+1 container statuses recorded) Apr 13 11:54:21.179: INFO: Container calico-kube-controllers ready: true, restart count 0 Apr 13 11:54:21.411: INFO: Latency metrics for node capz-hs54n1-control-plane-68bd2 Apr 13 11:54:21.411: INFO: Logging node info for node capz-hs54n1-md-0-dld6m Apr 13 11:54:21.467: INFO: Node Info: &Node{ObjectMeta:{capz-hs54n1-md-0-dld6m bacd7732-be1c-4d56-930d-8b281a1cc84f 6433 0 2022-04-13 11:17:47 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D4s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-hs54n1-md-0-dld6m kubernetes.io/os:linux node.kubernetes.io/instance-type:Standard_D4s_v3 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[cluster.x-k8s.io/cluster-name:capz-hs54n1 cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-hs54n1-md-0-744dccd984-s4c9v cluster.x-k8s.io/owner-kind:MachineSet cluster.x-k8s.io/owner-name:capz-hs54n1-md-0-744dccd984 kubeadm.alpha.kubernetes.io/cri-socket:/run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.1.0.6/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.77.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-13 11:17:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-04-13 11:17:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}} } {manager Update v1 2022-04-13 11:17:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {calico-node Update v1 2022-04-13 11:18:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {Go-http-client Update v1 2022-04-13 11:18:18 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-hs54n1/providers/Microsoft.Compute/virtualMachines/capz-hs54n1-md-0-dld6m,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{133018140672 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16783433728 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{119716326407 0} {<nil>} 119716326407 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16678576128 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-04-13 11:18:15 +0000 UTC,LastTransitionTime:2022-04-13 11:18:15 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-13 11:53:58 +0000 UTC,LastTransitionTime:2022-04-13 11:17:47 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-13 11:53:58 +0000 UTC,LastTransitionTime:2022-04-13 11:17:47 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-13 11:53:58 +0000 UTC,LastTransitionTime:2022-04-13 11:17:47 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-13 11:53:58 +0000 UTC,LastTransitionTime:2022-04-13 11:18:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-hs54n1-md-0-dld6m,},NodeAddress{Type:InternalIP,Address:10.1.0.6,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:5c6036bf1292447c8cf7d207a56f3fc8,SystemUUID:cf020121-cbfa-8d44-ae71-ce7c27da4cce,BootID:15680fce-9b59-4640-9b97-79832a53692a,KernelVersion:5.13.0-1017-azure,OSImage:Ubuntu 20.04.4 LTS,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 k8s.gcr.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[docker.io/calico/cni@sha256:2219eae79544b098119a06a8bb5608867f9ac00471592a00e2347f3ae4bea687 docker.io/calico/cni:v3.22.1],SizeBytes:80514590,},ContainerImage{Names:[docker.io/calico/node@sha256:1f8ed83e5264b4206cce7e1def11bca0b3ea7d5f4eb9b0ca0dbfc8cb968ca57e docker.io/calico/node:v3.22.1],SizeBytes:69647221,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:c1f625d115fbd9a12eac615653fc81c0edb33b2b5a76d1e09d5daed11fa557c1 k8s.gcr.io/kube-proxy:v1.23.5],SizeBytes:39278412,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:ddf5bf7196eb534271f9e5d403f4da19838d5610bb5ca191001bde5f32b5492e k8s.gcr.io/kube-apiserver:v1.23.5],SizeBytes:32603217,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:cca0fb3532abedcc95c5f64268d54da9ecc56cc4817ff08d0128941cf2b0e1a4 k8s.gcr.io/kube-controller-manager:v1.23.5],SizeBytes:30174093,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:489efb65da9edc40bf0911f3e6371e5bb6b8ad8fde1d55193a6cc84c2ef36626 k8s.gcr.io/kube-scheduler:v1.23.5],SizeBytes:15131395,},ContainerImage{Names:[k8s.gcr.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e k8s.gcr.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[docker.io/calico/pod2daemon-flexvol@sha256:35802ba083546a7c5e8b5bf0ee7ffad7f8a468e8c2b3631e7e9647512c94041d docker.io/calico/pod2daemon-flexvol:v3.22.1],SizeBytes:8462620,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 13 11:54:21.467: INFO: Logging kubelet events for node capz-hs54n1-md-0-dld6m Apr 13 11:54:21.526: INFO: Logging pods the kubelet thinks is on node capz-hs54n1-md-0-dld6m Apr 13 11:54:21.607: INFO: kube-proxy-72wkm started at 2022-04-13 11:17:48 +0000 UTC (0+1 container statuses recorded) Apr 13 11:54:21.607: INFO: Container kube-proxy ready: true, restart count 0 Apr 13 11:54:21.607: INFO: calico-node-4gzds started at 2022-04-13 11:17:48 +0000 UTC (3+1 container statuses recorded) Apr 13 11:54:21.607: INFO: Init container upgrade-ipam ready: true, restart count 0 Apr 13 11:54:21.607: INFO: Init container install-cni ready: true, restart count 0 Apr 13 11:54:21.607: INFO: Init container flexvol-driver ready: true, restart count 0 Apr 13 11:54:21.607: INFO: Container calico-node ready: true, restart count 0 Apr 13 11:54:21.812: INFO: Latency metrics for node capz-hs54n1-md-0-dld6m Apr 13 11:54:21.812: INFO: Logging node info for node capz-hs54n1-md-0-sjk6p Apr 13 11:54:21.868: INFO: Node Info: &Node{ObjectMeta:{capz-hs54n1-md-0-sjk6p 875002cf-b2c0-4c34-8776-8ac665f54501 6431 0 2022-04-13 11:19:48 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D4s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-hs54n1-md-0-sjk6p kubernetes.io/os:linux node.kubernetes.io/instance-type:Standard_D4s_v3 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[cluster.x-k8s.io/cluster-name:capz-hs54n1 cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-hs54n1-md-0-744dccd984-dh5bh cluster.x-k8s.io/owner-kind:MachineSet cluster.x-k8s.io/owner-name:capz-hs54n1-md-0-744dccd984 kubeadm.alpha.kubernetes.io/cri-socket:/run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.1.0.4/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.89.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-13 11:19:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-04-13 11:19:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}} } {manager Update v1 2022-04-13 11:19:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {calico-node Update v1 2022-04-13 11:20:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {Go-http-client Update v1 2022-04-13 11:20:19 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-hs54n1/providers/Microsoft.Compute/virtualMachines/capz-hs54n1-md-0-sjk6p,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{133018140672 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16783433728 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{119716326407 0} {<nil>} 119716326407 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16678576128 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-04-13 11:20:17 +0000 UTC,LastTransitionTime:2022-04-13 11:20:17 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-13 11:53:57 +0000 UTC,LastTransitionTime:2022-04-13 11:19:48 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-13 11:53:57 +0000 UTC,LastTransitionTime:2022-04-13 11:19:48 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-13 11:53:57 +0000 UTC,LastTransitionTime:2022-04-13 11:19:48 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-13 11:53:57 +0000 UTC,LastTransitionTime:2022-04-13 11:20:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-hs54n1-md-0-sjk6p,},NodeAddress{Type:InternalIP,Address:10.1.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e848ba94d69346009f2ff42410d09b7f,SystemUUID:13b2c432-0228-724b-970d-4f6173f60b05,BootID:29cf5b75-f8b9-46c2-ab61-a5d28b2ed2d3,KernelVersion:5.13.0-1017-azure,OSImage:Ubuntu 20.04.4 LTS,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[capzci.azurecr.io/azuredisk-csi@sha256:61a2e32fbb4b6722027417b9fe2ca6be53958707c8544393ba4f6fddb5239705 capzci.azurecr.io/azuredisk-csi:v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635],SizeBytes:107990911,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 k8s.gcr.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[docker.io/calico/cni@sha256:2219eae79544b098119a06a8bb5608867f9ac00471592a00e2347f3ae4bea687 docker.io/calico/cni:v3.22.1],SizeBytes:80514590,},ContainerImage{Names:[docker.io/calico/node@sha256:1f8ed83e5264b4206cce7e1def11bca0b3ea7d5f4eb9b0ca0dbfc8cb968ca57e docker.io/calico/node:v3.22.1],SizeBytes:69647221,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner@sha256:542c9258a1441e4927883ea73425e21f9a14043a649686bf6b51700f34c64f8e mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v3.1.0],SizeBytes:59205633,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-resizer@sha256:ab6c2e18a4d943f2bf8688e1779622277a1d14c355c9d4bfc0d761d86c5108b3 mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.4.0],SizeBytes:56924121,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-attacher@sha256:19fbca01394f7ed80151731180cfde0a3367f038beae2a97cda7928034010057 mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v3.4.0],SizeBytes:56301028,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:c1f625d115fbd9a12eac615653fc81c0edb33b2b5a76d1e09d5daed11fa557c1 k8s.gcr.io/kube-proxy:v1.23.5],SizeBytes:39278412,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:ddf5bf7196eb534271f9e5d403f4da19838d5610bb5ca191001bde5f32b5492e k8s.gcr.io/kube-apiserver:v1.23.5],SizeBytes:32603217,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:cca0fb3532abedcc95c5f64268d54da9ecc56cc4817ff08d0128941cf2b0e1a4 k8s.gcr.io/kube-controller-manager:v1.23.5],SizeBytes:30174093,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:a889e925e15f9423f7842f1b769f64cbcf6a20b6956122836fc835cf22d9073f mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v5.0.1],SizeBytes:22192414,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:489efb65da9edc40bf0911f3e6371e5bb6b8ad8fde1d55193a6cc84c2ef36626 k8s.gcr.io/kube-scheduler:v1.23.5],SizeBytes:15131395,},ContainerImage{Names:[k8s.gcr.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e k8s.gcr.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[docker.io/calico/pod2daemon-flexvol@sha256:35802ba083546a7c5e8b5bf0ee7ffad7f8a468e8c2b3631e7e9647512c94041d docker.io/calico/pod2daemon-flexvol:v3.22.1],SizeBytes:8462620,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:c96a6255c42766f6b8bb1a7cda02b0060ab1b20b2e2dafcc64ec09e7646745a6 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.5.0],SizeBytes:8222208,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 13 11:54:21.868: INFO: Logging kubelet events for node capz-hs54n1-md-0-sjk6p Apr 13 11:54:21.924: INFO: Logging pods the kubelet thinks is on node capz-hs54n1-md-0-sjk6p Apr 13 11:54:22.005: INFO: calico-node-kz5c4 started at 2022-04-13 11:19:49 +0000 UTC (3+1 container statuses recorded) Apr 13 11:54:22.005: INFO: Init container upgrade-ipam ready: true, restart count 0 Apr 13 11:54:22.005: INFO: Init container install-cni ready: true, restart count 0 Apr 13 11:54:22.005: INFO: Init container flexvol-driver ready: true, restart count 0 Apr 13 11:54:22.005: INFO: Container calico-node ready: true, restart count 0 Apr 13 11:54:22.005: INFO: kube-proxy-5hpw8 started at 2022-04-13 11:19:49 +0000 UTC (0+1 container statuses recorded) Apr 13 11:54:22.006: INFO: Container kube-proxy ready: true, restart count 0 Apr 13 11:54:22.006: INFO: csi-azuredisk-controller-bd65dc78d-mlqpj started at 2022-04-13 11:22:33 +0000 UTC (0+6 container statuses recorded) Apr 13 11:54:22.006: INFO: Container azuredisk ready: true, restart count 0 Apr 13 11:54:22.006: INFO: Container csi-attacher ready: true, restart count 0 Apr 13 11:54:22.006: INFO: Container csi-provisioner ready: true, restart count 0 Apr 13 11:54:22.006: INFO: Container csi-resizer ready: true, restart count 0 Apr 13 11:54:22.006: INFO: Container csi-snapshotter ready: true, restart count 0 Apr 13 11:54:22.006: INFO: Container liveness-probe ready: true, restart count 0 Apr 13 11:54:22.217: INFO: Latency metrics for node capz-hs54n1-md-0-sjk6p Apr 13 11:54:22.217: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "azuredisk-5356" for this suite.
Find azuredisk-volume-tester-2bkfz mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=AzureDisk\sCSI\sDriver\sEnd\-to\-End\sTests\sPre\-Provisioned\s\[single\-az\]\sshould\suse\sa\spre\-provisioned\svolume\sand\smount\sit\sas\sreadOnly\sin\sa\spod\s\[disk\.csi\.azure\.com\]\[windows\]$'
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning_test.go:70 Expected <string>: to contain substring <string>: FileOpenFailure /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/pre_provisioned_read_only_volume_tester.go:60from junit_01.xml
�[1mSTEP�[0m: Creating a kubernetes client Apr 13 11:23:54.467: INFO: >>> kubeConfig: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig �[1mSTEP�[0m: Building a namespace api object, basename azuredisk Apr 13 11:23:54.858: INFO: No PodSecurityPolicies found; assuming PodSecurityPolicy is disabled. �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace �[1mSTEP�[0m: Successfully provisioned AzureDisk volume: "/subscriptions/===REDACTED===/resourceGroups/capz-hs54n1/providers/Microsoft.Compute/disks/pre-provisioned-readOnly" �[1mSTEP�[0m: setting up the PV �[1mSTEP�[0m: creating a PV �[1mSTEP�[0m: setting up the PVC �[1mSTEP�[0m: creating a PVC �[1mSTEP�[0m: waiting for PVC to be in phase "Bound" Apr 13 11:23:59.683: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-69kvg] to have phase Bound Apr 13 11:23:59.737: INFO: PersistentVolumeClaim pvc-69kvg found and phase=Bound (54.220042ms) �[1mSTEP�[0m: checking the PVC �[1mSTEP�[0m: validating provisioned PV �[1mSTEP�[0m: checking the PV �[1mSTEP�[0m: deploying the pod �[1mSTEP�[0m: checking that the pod's command exits with an error Apr 13 11:23:59.903: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-b7wv5" in namespace "azuredisk-8081" to be "Error status code" Apr 13 11:23:59.958: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 54.790603ms Apr 13 11:24:02.014: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 2.110868937s Apr 13 11:24:04.069: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 4.165871036s Apr 13 11:24:06.131: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 6.22735089s Apr 13 11:24:08.186: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 8.282755033s Apr 13 11:24:10.242: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 10.338496421s Apr 13 11:24:12.298: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 12.394541231s Apr 13 11:24:14.353: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 14.449467654s Apr 13 11:24:16.409: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 16.505442025s Apr 13 11:24:18.464: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 18.560423642s Apr 13 11:24:20.519: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 20.615494314s Apr 13 11:24:22.574: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 22.670544333s Apr 13 11:24:24.630: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 24.726565591s Apr 13 11:24:26.685: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 26.781780718s Apr 13 11:24:28.741: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 28.837624709s Apr 13 11:24:30.796: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 30.89326151s Apr 13 11:24:32.852: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 32.948878342s Apr 13 11:24:34.908: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 35.0051614s Apr 13 11:24:36.964: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 37.061033738s Apr 13 11:24:39.020: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 39.116619083s Apr 13 11:24:41.076: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 41.17238277s Apr 13 11:24:43.131: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 43.227538984s Apr 13 11:24:45.186: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 45.283192821s Apr 13 11:24:47.242: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 47.338405181s Apr 13 11:24:49.297: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 49.394074155s Apr 13 11:24:51.353: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 51.449862139s Apr 13 11:24:53.410: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 53.506542575s Apr 13 11:24:55.469: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 55.56581088s Apr 13 11:24:57.529: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 57.625882968s Apr 13 11:24:59.590: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 59.687014956s Apr 13 11:25:01.649: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.745709018s Apr 13 11:25:03.708: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.804756774s Apr 13 11:25:05.767: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.8633758s Apr 13 11:25:07.826: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m7.923018973s Apr 13 11:25:09.886: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m9.982470374s Apr 13 11:25:11.945: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.041348223s Apr 13 11:25:14.004: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.100868427s Apr 13 11:25:16.063: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.160158107s Apr 13 11:25:18.123: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.219688636s Apr 13 11:25:20.183: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.279347622s Apr 13 11:25:22.241: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.337953283s Apr 13 11:25:24.300: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.396426861s Apr 13 11:25:26.359: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.455373686s Apr 13 11:25:28.417: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.513933019s Apr 13 11:25:30.475: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.571584636s Apr 13 11:25:32.534: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.630694468s Apr 13 11:25:34.592: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.688767999s Apr 13 11:25:36.650: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.747020987s Apr 13 11:25:38.711: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.807991546s Apr 13 11:25:40.770: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.866579391s Apr 13 11:25:42.829: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.925419011s Apr 13 11:25:44.887: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.984073469s Apr 13 11:25:46.946: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m47.042454315s Apr 13 11:25:49.004: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m49.101075999s Apr 13 11:25:51.065: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m51.161894112s Apr 13 11:25:53.124: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m53.221291862s Apr 13 11:25:55.183: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m55.279884044s Apr 13 11:25:57.241: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m57.338030891s Apr 13 11:25:59.300: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m59.396774108s Apr 13 11:26:01.358: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m1.455273475s Apr 13 11:26:03.418: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m3.514554229s Apr 13 11:26:05.477: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m5.573986082s Apr 13 11:26:07.537: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m7.634115673s Apr 13 11:26:09.596: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m9.693289448s Apr 13 11:26:11.657: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m11.753764624s Apr 13 11:26:13.716: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m13.812679633s Apr 13 11:26:15.775: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m15.871891731s Apr 13 11:26:17.835: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m17.931534826s Apr 13 11:26:19.894: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m19.990678892s Apr 13 11:26:21.953: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.050175047s Apr 13 11:26:24.012: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.108624782s Apr 13 11:26:26.071: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.167919917s Apr 13 11:26:28.130: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.226967561s Apr 13 11:26:30.189: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.2862254s Apr 13 11:26:32.249: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.345407195s Apr 13 11:26:34.309: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.40553292s Apr 13 11:26:36.367: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.46399738s Apr 13 11:26:38.426: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.523187379s Apr 13 11:26:40.486: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.583117667s Apr 13 11:26:42.545: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.641371458s Apr 13 11:26:44.606: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.702369677s Apr 13 11:26:46.664: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.761260786s Apr 13 11:26:48.724: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.820851645s Apr 13 11:26:50.783: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.879529903s Apr 13 11:26:52.841: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.937998776s Apr 13 11:26:54.901: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.997941993s Apr 13 11:26:56.960: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m57.057186111s Apr 13 11:26:59.020: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m59.116834647s Apr 13 11:27:01.079: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m1.175696252s Apr 13 11:27:03.139: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m3.235322984s Apr 13 11:27:05.197: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m5.293722879s Apr 13 11:27:07.255: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m7.351697988s Apr 13 11:27:09.315: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m9.411658912s Apr 13 11:27:11.373: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m11.469911008s Apr 13 11:27:13.432: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m13.528911351s Apr 13 11:27:15.492: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m15.588847327s Apr 13 11:27:17.551: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m17.648150194s Apr 13 11:27:19.610: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m19.707100102s Apr 13 11:27:21.670: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m21.766509055s Apr 13 11:27:23.730: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m23.826477991s Apr 13 11:27:25.789: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m25.886108164s Apr 13 11:27:27.848: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m27.944679001s Apr 13 11:27:29.913: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.010316786s Apr 13 11:27:31.973: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.069460864s Apr 13 11:27:34.032: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.128825095s Apr 13 11:27:36.094: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.191030253s Apr 13 11:27:38.155: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.251734699s Apr 13 11:27:40.214: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.311087445s Apr 13 11:27:42.273: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.369944917s Apr 13 11:27:44.332: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.429075326s Apr 13 11:27:46.392: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.488438005s Apr 13 11:27:48.451: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.547782055s Apr 13 11:27:50.510: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.606993582s Apr 13 11:27:52.569: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.665463516s Apr 13 11:27:54.628: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.725050576s Apr 13 11:27:56.687: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.784144258s Apr 13 11:27:58.746: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.842665122s Apr 13 11:28:00.805: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.901595143s Apr 13 11:28:02.864: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.960499262s Apr 13 11:28:04.922: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m5.019227101s Apr 13 11:28:06.981: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m7.077953032s Apr 13 11:28:09.041: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m9.137827311s Apr 13 11:28:11.101: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m11.197366436s Apr 13 11:28:13.160: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m13.256876088s Apr 13 11:28:15.219: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m15.315950819s Apr 13 11:28:17.280: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m17.376786095s Apr 13 11:28:19.339: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m19.435952031s Apr 13 11:28:21.398: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m21.494504565s Apr 13 11:28:23.461: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m23.557766761s Apr 13 11:28:25.521: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m25.617378031s Apr 13 11:28:27.579: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m27.675559801s Apr 13 11:28:29.638: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m29.735244087s Apr 13 11:28:31.697: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m31.793570534s Apr 13 11:28:33.756: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m33.852627144s Apr 13 11:28:35.815: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m35.911346166s Apr 13 11:28:37.874: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m37.970527469s Apr 13 11:28:39.932: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.029124661s Apr 13 11:28:41.995: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.091324007s Apr 13 11:28:44.054: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.151115014s Apr 13 11:28:46.114: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.210794142s Apr 13 11:28:48.172: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.269153703s Apr 13 11:28:50.233: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.330212023s Apr 13 11:28:52.293: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.389411014s Apr 13 11:28:54.352: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.448822198s Apr 13 11:28:56.412: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.508337204s Apr 13 11:28:58.471: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.567893387s Apr 13 11:29:00.531: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.627350709s Apr 13 11:29:02.589: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 5m2.686078006s Apr 13 11:29:04.649: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 5m4.745472759s Apr 13 11:29:06.709: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 5m6.805540653s Apr 13 11:29:08.768: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 5m8.864972574s Apr 13 11:29:10.827: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 5m10.924219947s Apr 13 11:29:12.887: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 5m12.983439056s Apr 13 11:29:14.946: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 5m15.042512088s Apr 13 11:29:17.005: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 5m17.102145432s Apr 13 11:29:19.065: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 5m19.161526927s Apr 13 11:29:21.123: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 5m21.21999699s Apr 13 11:29:23.182: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 5m23.279001438s Apr 13 11:29:25.242: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 5m25.33844181s Apr 13 11:29:27.301: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 5m27.397607892s Apr 13 11:29:29.359: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 5m29.456190783s Apr 13 11:29:31.418: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 5m31.51470708s Apr 13 11:29:33.477: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 5m33.573505961s Apr 13 11:29:35.535: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 5m35.631991239s Apr 13 11:29:37.594: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 5m37.690807408s Apr 13 11:29:39.654: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 5m39.750522942s Apr 13 11:29:41.713: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 5m41.809741659s Apr 13 11:29:43.772: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 5m43.868960272s Apr 13 11:29:45.832: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 5m45.928699071s Apr 13 11:29:47.892: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 5m47.989260636s Apr 13 11:29:49.951: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 5m50.048223077s Apr 13 11:29:52.010: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 5m52.107075141s Apr 13 11:29:54.069: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 5m54.166168844s Apr 13 11:29:56.128: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 5m56.224993801s Apr 13 11:29:58.186: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 5m58.282963238s Apr 13 11:30:00.245: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 6m0.34185642s Apr 13 11:30:02.303: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 6m2.400297534s Apr 13 11:30:04.363: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 6m4.459942921s Apr 13 11:30:06.424: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 6m6.520965559s Apr 13 11:30:08.482: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 6m8.579293803s Apr 13 11:30:10.541: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 6m10.637780267s Apr 13 11:30:12.599: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 6m12.696245089s Apr 13 11:30:14.659: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 6m14.756018915s Apr 13 11:30:16.719: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 6m16.815614192s Apr 13 11:30:18.778: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 6m18.87494659s Apr 13 11:30:20.838: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 6m20.934654037s Apr 13 11:30:22.896: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 6m22.992996057s Apr 13 11:30:24.955: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 6m25.051932394s Apr 13 11:30:27.015: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 6m27.112211516s Apr 13 11:30:29.075: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 6m29.17171276s Apr 13 11:30:31.134: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 6m31.23125968s Apr 13 11:30:33.194: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 6m33.290571208s Apr 13 11:30:35.253: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 6m35.350102832s Apr 13 11:30:37.312: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 6m37.408639321s Apr 13 11:30:39.370: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 6m39.466921468s Apr 13 11:30:41.429: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 6m41.525989125s Apr 13 11:30:43.489: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 6m43.585512531s Apr 13 11:30:45.548: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 6m45.645121517s Apr 13 11:30:47.607: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 6m47.703846617s Apr 13 11:30:49.667: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 6m49.763550813s Apr 13 11:30:51.725: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 6m51.822192408s Apr 13 11:30:53.795: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 6m53.892286684s Apr 13 11:30:55.855: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 6m55.951899824s Apr 13 11:30:57.914: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 6m58.011044543s Apr 13 11:30:59.973: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 7m0.069865778s Apr 13 11:31:02.034: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 7m2.131246527s Apr 13 11:31:04.094: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 7m4.190910485s Apr 13 11:31:06.155: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 7m6.251924068s Apr 13 11:31:08.213: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 7m8.310181666s Apr 13 11:31:10.273: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 7m10.369808793s Apr 13 11:31:12.332: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 7m12.428989604s Apr 13 11:31:14.392: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 7m14.488370129s Apr 13 11:31:16.451: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 7m16.54791091s Apr 13 11:31:18.510: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 7m18.606925769s Apr 13 11:31:20.569: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 7m20.665430574s Apr 13 11:31:22.628: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 7m22.724522535s Apr 13 11:31:24.688: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 7m24.78433264s Apr 13 11:31:26.746: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 7m26.842352988s Apr 13 11:31:28.808: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 7m28.904985297s Apr 13 11:31:30.867: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 7m30.963857033s Apr 13 11:31:32.926: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 7m33.022697336s Apr 13 11:31:34.984: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 7m35.081043556s Apr 13 11:31:37.043: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 7m37.139957164s Apr 13 11:31:39.103: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 7m39.200125575s Apr 13 11:31:41.162: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 7m41.258804482s Apr 13 11:31:43.221: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 7m43.317634671s Apr 13 11:31:45.280: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 7m45.376824914s Apr 13 11:31:47.339: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 7m47.435991209s Apr 13 11:31:49.398: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 7m49.495238836s Apr 13 11:31:51.458: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 7m51.554622723s Apr 13 11:31:53.517: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 7m53.613633735s Apr 13 11:31:55.576: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 7m55.672955862s Apr 13 11:31:57.635: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 7m57.732160864s Apr 13 11:31:59.695: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 7m59.791601416s Apr 13 11:32:01.755: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 8m1.851669746s Apr 13 11:32:03.814: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 8m3.911038927s Apr 13 11:32:05.873: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 8m5.970212328s Apr 13 11:32:07.933: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 8m8.029544457s Apr 13 11:32:09.992: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 8m10.088386732s Apr 13 11:32:12.050: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 8m12.14713253s Apr 13 11:32:14.111: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 8m14.208142468s Apr 13 11:32:16.171: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 8m16.267451274s Apr 13 11:32:18.229: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 8m18.325750749s Apr 13 11:32:20.287: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 8m20.384113046s Apr 13 11:32:22.346: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 8m22.442508162s Apr 13 11:32:24.405: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 8m24.501562165s Apr 13 11:32:26.464: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 8m26.560704461s Apr 13 11:32:28.523: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 8m28.619965242s Apr 13 11:32:30.583: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 8m30.679521794s Apr 13 11:32:32.642: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 8m32.738520791s Apr 13 11:32:34.700: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 8m34.797223699s Apr 13 11:32:36.759: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 8m36.855444791s Apr 13 11:32:38.818: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 8m38.914969038s Apr 13 11:32:40.878: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 8m40.974652258s Apr 13 11:32:42.937: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 8m43.033618116s Apr 13 11:32:44.996: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 8m45.093215361s Apr 13 11:32:47.055: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 8m47.151886292s Apr 13 11:32:49.114: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 8m49.210993085s Apr 13 11:32:51.173: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 8m51.269560541s Apr 13 11:32:53.231: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 8m53.328010394s Apr 13 11:32:55.290: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 8m55.387303816s Apr 13 11:32:57.350: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 8m57.447124941s Apr 13 11:32:59.411: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Pending", Reason="", readiness=false. Elapsed: 8m59.508056858s Apr 13 11:33:01.472: INFO: Pod "azuredisk-volume-tester-b7wv5": Phase="Failed", Reason="", readiness=false. Elapsed: 9m1.568527708s �[1mSTEP�[0m: Saw pod failure Apr 13 11:33:01.472: INFO: Pod "azuredisk-volume-tester-b7wv5" satisfied condition "Error status code" �[1mSTEP�[0m: checking that pod logs contain expected message Apr 13 11:33:01.597: INFO: deleting Pod "azuredisk-8081"/"azuredisk-volume-tester-b7wv5" Apr 13 11:33:01.657: INFO: Pod azuredisk-volume-tester-b7wv5 has the following logs: �[1mSTEP�[0m: Deleting pod azuredisk-volume-tester-b7wv5 in namespace azuredisk-8081 Apr 13 11:33:01.722: INFO: deleting PVC "azuredisk-8081"/"pvc-69kvg" Apr 13 11:33:01.722: INFO: Deleting PersistentVolumeClaim "pvc-69kvg" Apr 13 11:33:01.779: INFO: Waiting up to 5m0s for PersistentVolumeClaim azuredisk-8081 to be removed Apr 13 11:33:01.835: INFO: Claim "azuredisk-8081" in namespace "pvc-69kvg" doesn't exist in the system �[1mSTEP�[0m: deleting PV "azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n" Apr 13 11:33:01.835: INFO: Deleting PersistentVolume "azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n" �[1mSTEP�[0m: waiting for claim's PV "azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n" to be deleted Apr 13 11:33:01.892: INFO: Waiting up to 10m0s for PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n to get deleted Apr 13 11:33:01.947: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (54.848293ms) Apr 13 11:33:07.003: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (5.111222479s) Apr 13 11:33:12.058: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (10.166285567s) Apr 13 11:33:17.114: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (15.222353874s) Apr 13 11:33:22.169: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (20.27763785s) Apr 13 11:33:27.225: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (25.333015545s) Apr 13 11:33:32.279: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (30.387690974s) Apr 13 11:33:37.335: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (35.443548813s) Apr 13 11:33:42.393: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (40.501655822s) Apr 13 11:33:47.449: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (45.557288964s) Apr 13 11:33:52.504: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (50.612628533s) Apr 13 11:33:57.560: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (55.667854221s) Apr 13 11:34:02.614: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (1m0.722763767s) Apr 13 11:34:07.670: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (1m5.778649246s) Apr 13 11:34:12.725: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (1m10.833050429s) Apr 13 11:34:17.780: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (1m15.887974487s) Apr 13 11:34:22.835: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (1m20.943711749s) Apr 13 11:34:27.891: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (1m25.998985326s) Apr 13 11:34:32.947: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (1m31.05482039s) Apr 13 11:34:38.002: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (1m36.11041198s) Apr 13 11:34:43.058: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (1m41.165899125s) Apr 13 11:34:48.114: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (1m46.22221702s) Apr 13 11:34:53.169: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (1m51.276887745s) Apr 13 11:34:58.224: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (1m56.331932156s) Apr 13 11:35:03.280: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (2m1.387963101s) Apr 13 11:35:08.335: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (2m6.443709184s) Apr 13 11:35:13.390: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (2m11.498685177s) Apr 13 11:35:18.447: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (2m16.55490246s) Apr 13 11:35:23.502: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (2m21.609841166s) Apr 13 11:35:28.558: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (2m26.66644069s) Apr 13 11:35:33.613: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (2m31.721304974s) Apr 13 11:35:38.670: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (2m36.778452726s) Apr 13 11:35:43.726: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (2m41.834531806s) Apr 13 11:35:48.783: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (2m46.891180052s) Apr 13 11:35:53.838: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (2m51.946624539s) Apr 13 11:35:58.895: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (2m57.003051479s) Apr 13 11:36:03.951: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (3m2.058916794s) Apr 13 11:36:09.006: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (3m7.114446274s) Apr 13 11:36:14.062: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (3m12.169833869s) Apr 13 11:36:19.118: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (3m17.226290354s) Apr 13 11:36:24.175: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (3m22.283310971s) Apr 13 11:36:29.230: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (3m27.337822629s) Apr 13 11:36:34.284: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (3m32.392396374s) Apr 13 11:36:39.339: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (3m37.446919192s) Apr 13 11:36:44.394: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (3m42.502325237s) Apr 13 11:36:49.449: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (3m47.557381134s) Apr 13 11:36:54.506: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (3m52.614563084s) Apr 13 11:36:59.563: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (3m57.671778614s) Apr 13 11:37:04.619: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (4m2.727491353s) Apr 13 11:37:09.674: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (4m7.782609477s) Apr 13 11:37:14.730: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (4m12.838228975s) Apr 13 11:37:19.787: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (4m17.895591336s) Apr 13 11:37:24.845: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (4m22.953210986s) Apr 13 11:37:29.901: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (4m28.009117418s) Apr 13 11:37:34.959: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (4m33.066999341s) Apr 13 11:37:40.014: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (4m38.122673636s) Apr 13 11:37:45.069: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (4m43.177754061s) Apr 13 11:37:50.124: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (4m48.232387514s) Apr 13 11:37:55.180: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (4m53.288691119s) Apr 13 11:38:00.237: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (4m58.345598984s) Apr 13 11:38:05.295: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (5m3.403327844s) Apr 13 11:38:10.353: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (5m8.461520148s) Apr 13 11:38:15.410: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (5m13.518501842s) Apr 13 11:38:20.466: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (5m18.574387295s) Apr 13 11:38:25.524: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (5m23.632313626s) Apr 13 11:38:30.580: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (5m28.68811814s) Apr 13 11:38:35.638: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (5m33.746600051s) Apr 13 11:38:40.697: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (5m38.80508672s) Apr 13 11:38:45.752: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (5m43.860288371s) Apr 13 11:38:50.806: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (5m48.914721354s) Apr 13 11:38:55.863: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (5m53.971466419s) Apr 13 11:39:00.920: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (5m59.028338493s) Apr 13 11:39:05.979: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n found and phase=Released (6m4.086859856s) Apr 13 11:39:11.032: INFO: PersistentVolume azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n was removed �[1mSTEP�[0m: Collecting events from namespace "azuredisk-8081". �[1mSTEP�[0m: Found 11 events. Apr 13 11:39:11.094: INFO: At 2022-04-13 11:23:59 +0000 UTC - event for azuredisk-volume-tester-b7wv5: {default-scheduler } Scheduled: Successfully assigned azuredisk-8081/azuredisk-volume-tester-b7wv5 to capz-hs54-hzrck Apr 13 11:39:11.094: INFO: At 2022-04-13 11:24:00 +0000 UTC - event for azuredisk-volume-tester-b7wv5: {attachdetach-controller } FailedAttachVolume: AttachVolume.Attach failed for volume "azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n" : CSINode capz-hs54-hzrck does not contain driver disk.csi.azure.com Apr 13 11:39:11.094: INFO: At 2022-04-13 11:24:18 +0000 UTC - event for azuredisk-volume-tester-b7wv5: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "azuredisk-8081-disk.csi.azure.com-preprovisioned-pv-7dn8n" Apr 13 11:39:11.094: INFO: At 2022-04-13 11:25:00 +0000 UTC - event for azuredisk-volume-tester-b7wv5: {kubelet capz-hs54-hzrck} Pulling: Pulling image "mcr.microsoft.com/windows/servercore:ltsc2022" Apr 13 11:39:11.094: INFO: At 2022-04-13 11:30:58 +0000 UTC - event for azuredisk-volume-tester-b7wv5: {kubelet capz-hs54-hzrck} Pulled: Successfully pulled image "mcr.microsoft.com/windows/servercore:ltsc2022" in 5m58.177309s Apr 13 11:39:11.094: INFO: At 2022-04-13 11:30:58 +0000 UTC - event for azuredisk-volume-tester-b7wv5: {kubelet capz-hs54-hzrck} Created: Created container volume-tester Apr 13 11:39:11.094: INFO: At 2022-04-13 11:32:58 +0000 UTC - event for azuredisk-volume-tester-b7wv5: {kubelet capz-hs54-hzrck} Failed: Error: context deadline exceeded Apr 13 11:39:11.094: INFO: At 2022-04-13 11:32:59 +0000 UTC - event for azuredisk-volume-tester-b7wv5: {kubelet capz-hs54-hzrck} Pulled: Container image "mcr.microsoft.com/windows/servercore:ltsc2022" already present on machine Apr 13 11:39:11.094: INFO: At 2022-04-13 11:33:04 +0000 UTC - event for azuredisk-volume-tester-b7wv5: {kubelet capz-hs54-hzrck} Started: Started container volume-tester Apr 13 11:39:11.094: INFO: At 2022-04-13 11:33:05 +0000 UTC - event for azuredisk-volume-tester-b7wv5: {kubelet capz-hs54-hzrck} Killing: Stopping container volume-tester Apr 13 11:39:11.094: INFO: At 2022-04-13 11:35:07 +0000 UTC - event for azuredisk-volume-tester-b7wv5: {kubelet capz-hs54-hzrck} FailedKillPod: error killing pod: failed to "KillPodSandbox" for "ec83eb50-51fe-42a0-ba33-79060bd35c6f" with KillPodSandboxError: "rpc error: code = DeadlineExceeded desc = context deadline exceeded" Apr 13 11:39:11.147: INFO: POD NODE PHASE GRACE CONDITIONS Apr 13 11:39:11.147: INFO: Apr 13 11:39:11.239: INFO: Logging node info for node capz-hs54-hzrck Apr 13 11:39:11.297: INFO: Node Info: &Node{ObjectMeta:{capz-hs54-hzrck a5e9a839-5870-4fdb-8bed-13237d6a5658 4122 0 2022-04-13 11:18:49 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D4s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-hs54-hzrck kubernetes.io/os:windows node.kubernetes.io/instance-type:Standard_D4s_v3 node.kubernetes.io/windows-build:10.0.20348 topology.disk.csi.azure.com/zone: topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[cluster.x-k8s.io/cluster-name:capz-hs54n1 cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-hs54n1-md-win-76c844c685-npvck cluster.x-k8s.io/owner-kind:MachineSet cluster.x-k8s.io/owner-name:capz-hs54n1-md-win-76c844c685 csi.volume.kubernetes.io/nodeid:{"disk.csi.azure.com":"capz-hs54-hzrck"} kubeadm.alpha.kubernetes.io/cri-socket:npipe:////./pipe/containerd-containerd node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.1.0.7/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.211.129 projectcalico.org/VXLANTunnelMACAddr:00:15:5d:3c:87:0d volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-13 11:18:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-04-13 11:18:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}} } {manager Update v1 2022-04-13 11:19:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {calico-node.exe Update v1 2022-04-13 11:20:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{},"f:projectcalico.org/VXLANTunnelMACAddr":{}}}} status} {Go-http-client Update v1 2022-04-13 11:24:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.disk.csi.azure.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-hs54n1/providers/Microsoft.Compute/virtualMachines/capz-hs54-hzrck,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{17179398144 0} {<nil>} 16776756Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{123221307598 0} {<nil>} 123221307598 DecimalSI},memory: {{17074540544 0} {<nil>} 16674356Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-13 11:36:31 +0000 UTC,LastTransitionTime:2022-04-13 11:18:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-13 11:36:31 +0000 UTC,LastTransitionTime:2022-04-13 11:18:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-13 11:36:31 +0000 UTC,LastTransitionTime:2022-04-13 11:18:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-13 11:36:31 +0000 UTC,LastTransitionTime:2022-04-13 11:20:01 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-hs54-hzrck,},NodeAddress{Type:InternalIP,Address:10.1.0.7,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:capz-hs54-hzrck,SystemUUID:2C25F09E-902D-412A-A706-61198C34AA62,BootID:,KernelVersion:10.0.20348.405,OSImage:Windows Server 2022 Datacenter,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:378d85bd8e7388a777d25009f8523d1e95a5f544f131eaada83171045d5b2c1e mcr.microsoft.com/windows/servercore:ltsc2022],SizeBytes:2226956779,},ContainerImage{Names:[docker.io/sigwindowstools/calico-install@sha256:141afecd724eb757ee41593cc73f35fb19a2ce13cad73179cf3b1cef81a637d1 docker.io/sigwindowstools/calico-install:v3.22.1-hostprocess],SizeBytes:148096127,},ContainerImage{Names:[capzci.azurecr.io/azuredisk-csi@sha256:61a2e32fbb4b6722027417b9fe2ca6be53958707c8544393ba4f6fddb5239705 capzci.azurecr.io/azuredisk-csi:v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635],SizeBytes:141765990,},ContainerImage{Names:[docker.io/sigwindowstools/calico-node@sha256:b8e6e2f190e58d6b61b7f2a19b0e2e17a377e5b9d7b9528e9b7953d9f9ab59bb docker.io/sigwindowstools/calico-node:v3.22.1-hostprocess],SizeBytes:128793648,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:dbec3a8166686b09b242176ab5b99e993da4126438bbce68147c3fd654f35662 mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.4.0],SizeBytes:125554391,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:c96a6255c42766f6b8bb1a7cda02b0060ab1b20b2e2dafcc64ec09e7646745a6 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.5.0],SizeBytes:124471446,},ContainerImage{Names:[ghcr.io/kubernetes-sigs/sig-windows/csi-proxy@sha256:96b4144986319a747ba599892454be2737aae6005d96b8e13ed481321ac3afba ghcr.io/kubernetes-sigs/sig-windows/csi-proxy:v1.0.2],SizeBytes:123925937,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:119397646,},},VolumesInUse:[kubernetes.io/csi/disk.csi.azure.com^/subscriptions/===REDACTED===/resourceGroups/capz-hs54n1/providers/Microsoft.Compute/disks/pre-provisioned-readOnly],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 13 11:39:11.298: INFO: Logging kubelet events for node capz-hs54-hzrck Apr 13 11:39:11.355: INFO: Logging pods the kubelet thinks is on node capz-hs54-hzrck Apr 13 11:39:11.481: INFO: kube-proxy-windows-vwkk8 started at 2022-04-13 11:18:50 +0000 UTC (0+1 container statuses recorded) Apr 13 11:39:11.482: INFO: Container kube-proxy ready: false, restart count 0 Apr 13 11:39:11.482: INFO: calico-node-windows-sxz8j started at 2022-04-13 11:18:50 +0000 UTC (1+2 container statuses recorded) Apr 13 11:39:11.482: INFO: Init container install-cni ready: true, restart count 0 Apr 13 11:39:11.482: INFO: Container calico-node-felix ready: true, restart count 1 Apr 13 11:39:11.482: INFO: Container calico-node-startup ready: true, restart count 0 Apr 13 11:39:11.482: INFO: csi-proxy-xtrv9 started at 2022-04-13 11:20:01 +0000 UTC (0+1 container statuses recorded) Apr 13 11:39:11.482: INFO: Container csi-proxy ready: true, restart count 0 Apr 13 11:39:11.482: INFO: csi-azuredisk-node-win-b9mdd started at 2022-04-13 11:22:33 +0000 UTC (1+3 container statuses recorded) Apr 13 11:39:11.482: INFO: Init container init ready: true, restart count 0 Apr 13 11:39:11.482: INFO: Container azuredisk ready: true, restart count 0 Apr 13 11:39:11.482: INFO: Container liveness-probe ready: true, restart count 0 Apr 13 11:39:11.482: INFO: Container node-driver-registrar ready: true, restart count 0 Apr 13 11:39:11.766: INFO: Latency metrics for node capz-hs54-hzrck Apr 13 11:39:11.766: INFO: Logging node info for node capz-hs54-xckjv Apr 13 11:39:11.822: INFO: Node Info: &Node{ObjectMeta:{capz-hs54-xckjv 77884b65-724c-46ed-89a8-7419438e7166 3432 0 2022-04-13 11:18:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D4s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-hs54-xckjv kubernetes.io/os:windows node.kubernetes.io/instance-type:Standard_D4s_v3 node.kubernetes.io/windows-build:10.0.20348 topology.disk.csi.azure.com/zone: topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[cluster.x-k8s.io/cluster-name:capz-hs54n1 cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-hs54n1-md-win-76c844c685-f8hnr cluster.x-k8s.io/owner-kind:MachineSet cluster.x-k8s.io/owner-name:capz-hs54n1-md-win-76c844c685 csi.volume.kubernetes.io/nodeid:{"disk.csi.azure.com":"capz-hs54-xckjv"} kubeadm.alpha.kubernetes.io/cri-socket:npipe:////./pipe/containerd-containerd node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.1.0.5/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.220.129 projectcalico.org/VXLANTunnelMACAddr:00:15:5d:4e:e7:92 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-13 11:18:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-04-13 11:19:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}} } {manager Update v1 2022-04-13 11:19:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {calico-node.exe Update v1 2022-04-13 11:20:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{},"f:projectcalico.org/VXLANTunnelMACAddr":{}}}} status} {Go-http-client Update v1 2022-04-13 11:23:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.disk.csi.azure.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-hs54n1/providers/Microsoft.Compute/virtualMachines/capz-hs54-xckjv,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{17179398144 0} {<nil>} 16776756Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{123221307598 0} {<nil>} 123221307598 DecimalSI},memory: {{17074540544 0} {<nil>} 16674356Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-13 11:34:14 +0000 UTC,LastTransitionTime:2022-04-13 11:18:57 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-13 11:34:14 +0000 UTC,LastTransitionTime:2022-04-13 11:18:57 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-13 11:34:14 +0000 UTC,LastTransitionTime:2022-04-13 11:18:57 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-13 11:34:14 +0000 UTC,LastTransitionTime:2022-04-13 11:19:59 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-hs54-xckjv,},NodeAddress{Type:InternalIP,Address:10.1.0.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:capz-hs54-xckjv,SystemUUID:B93D2ECE-A677-4F89-B39F-AD7A6A38C8C1,BootID:,KernelVersion:10.0.20348.405,OSImage:Windows Server 2022 Datacenter,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/sigwindowstools/calico-install@sha256:141afecd724eb757ee41593cc73f35fb19a2ce13cad73179cf3b1cef81a637d1 docker.io/sigwindowstools/calico-install:v3.22.1-hostprocess],SizeBytes:148096127,},ContainerImage{Names:[capzci.azurecr.io/azuredisk-csi@sha256:61a2e32fbb4b6722027417b9fe2ca6be53958707c8544393ba4f6fddb5239705 capzci.azurecr.io/azuredisk-csi:v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635],SizeBytes:141765990,},ContainerImage{Names:[docker.io/sigwindowstools/calico-node@sha256:b8e6e2f190e58d6b61b7f2a19b0e2e17a377e5b9d7b9528e9b7953d9f9ab59bb docker.io/sigwindowstools/calico-node:v3.22.1-hostprocess],SizeBytes:128793648,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:dbec3a8166686b09b242176ab5b99e993da4126438bbce68147c3fd654f35662 mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.4.0],SizeBytes:125554391,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:c96a6255c42766f6b8bb1a7cda02b0060ab1b20b2e2dafcc64ec09e7646745a6 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.5.0],SizeBytes:124471446,},ContainerImage{Names:[ghcr.io/kubernetes-sigs/sig-windows/csi-proxy@sha256:96b4144986319a747ba599892454be2737aae6005d96b8e13ed481321ac3afba ghcr.io/kubernetes-sigs/sig-windows/csi-proxy:v1.0.2],SizeBytes:123925937,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:119397646,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 13 11:39:11.822: INFO: Logging kubelet events for node capz-hs54-xckjv Apr 13 11:39:11.879: INFO: Logging pods the kubelet thinks is on node capz-hs54-xckjv Apr 13 11:39:11.984: INFO: calico-node-windows-2h4q8 started at 2022-04-13 11:18:58 +0000 UTC (1+2 container statuses recorded) Apr 13 11:39:11.984: INFO: Init container install-cni ready: true, restart count 0 Apr 13 11:39:11.984: INFO: Container calico-node-felix ready: true, restart count 1 Apr 13 11:39:11.984: INFO: Container calico-node-startup ready: true, restart count 0 Apr 13 11:39:11.984: INFO: kube-proxy-windows-bjgh6 started at 2022-04-13 11:18:58 +0000 UTC (0+1 container statuses recorded) Apr 13 11:39:11.984: INFO: Container kube-proxy ready: false, restart count 0 Apr 13 11:39:11.984: INFO: csi-proxy-r98hg started at 2022-04-13 11:19:59 +0000 UTC (0+1 container statuses recorded) Apr 13 11:39:11.984: INFO: Container csi-proxy ready: true, restart count 0 Apr 13 11:39:11.984: INFO: csi-azuredisk-node-win-796rw started at 2022-04-13 11:22:33 +0000 UTC (1+3 container statuses recorded) Apr 13 11:39:11.984: INFO: Init container init ready: true, restart count 0 Apr 13 11:39:11.984: INFO: Container azuredisk ready: true, restart count 0 Apr 13 11:39:11.984: INFO: Container liveness-probe ready: true, restart count 0 Apr 13 11:39:11.984: INFO: Container node-driver-registrar ready: true, restart count 0 Apr 13 11:39:12.230: INFO: Latency metrics for node capz-hs54-xckjv Apr 13 11:39:12.230: INFO: Logging node info for node capz-hs54n1-control-plane-68bd2 Apr 13 11:39:12.287: INFO: Node Info: &Node{ObjectMeta:{capz-hs54n1-control-plane-68bd2 f28d65d3-542d-49e9-b87f-c647072d5290 4023 0 2022-04-13 11:16:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:westus2-2 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-hs54n1-control-plane-68bd2 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/master: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:Standard_D2s_v3 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:westus2-2] map[cluster.x-k8s.io/cluster-name:capz-hs54n1 cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-hs54n1-control-plane-bqs28 cluster.x-k8s.io/owner-kind:KubeadmControlPlane cluster.x-k8s.io/owner-name:capz-hs54n1-control-plane kubeadm.alpha.kubernetes.io/cri-socket:/run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.0.4/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.31.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-13 11:16:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node-role.kubernetes.io/control-plane":{},"f:node-role.kubernetes.io/master":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {manager Update v1 2022-04-13 11:16:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {kube-controller-manager Update v1 2022-04-13 11:17:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:taints":{}}} } {Go-http-client Update v1 2022-04-13 11:17:21 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {calico-node Update v1 2022-04-13 11:17:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-hs54n1/providers/Microsoft.Compute/virtualMachines/capz-hs54n1-control-plane-68bd2,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{133018140672 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8340819968 0} {<nil>} 8145332Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{119716326407 0} {<nil>} 119716326407 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8235962368 0} {<nil>} 8042932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-04-13 11:17:24 +0000 UTC,LastTransitionTime:2022-04-13 11:17:24 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-13 11:38:18 +0000 UTC,LastTransitionTime:2022-04-13 11:16:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-13 11:38:18 +0000 UTC,LastTransitionTime:2022-04-13 11:16:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-13 11:38:18 +0000 UTC,LastTransitionTime:2022-04-13 11:16:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-13 11:38:18 +0000 UTC,LastTransitionTime:2022-04-13 11:17:11 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-hs54n1-control-plane-68bd2,},NodeAddress{Type:InternalIP,Address:10.0.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f4c83e8d7b3240c8a5c75a5a792bec20,SystemUUID:2a8d7cd8-919c-fe42-85fb-c1a96426087f,BootID:31b443cf-bfd2-4957-b372-05d446796761,KernelVersion:5.13.0-1017-azure,OSImage:Ubuntu 20.04.4 LTS,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 k8s.gcr.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[docker.io/calico/cni@sha256:2219eae79544b098119a06a8bb5608867f9ac00471592a00e2347f3ae4bea687 docker.io/calico/cni:v3.22.1],SizeBytes:80514590,},ContainerImage{Names:[docker.io/calico/node@sha256:1f8ed83e5264b4206cce7e1def11bca0b3ea7d5f4eb9b0ca0dbfc8cb968ca57e docker.io/calico/node:v3.22.1],SizeBytes:69647221,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:e42a0aba3637d123481cca14fd8314a482616593edf58f9594c9382e50498f9b docker.io/calico/kube-controllers:v3.22.1],SizeBytes:54948023,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:c1f625d115fbd9a12eac615653fc81c0edb33b2b5a76d1e09d5daed11fa557c1 k8s.gcr.io/kube-proxy:v1.23.5],SizeBytes:39278412,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:ddf5bf7196eb534271f9e5d403f4da19838d5610bb5ca191001bde5f32b5492e k8s.gcr.io/kube-apiserver:v1.23.5],SizeBytes:32603217,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:cca0fb3532abedcc95c5f64268d54da9ecc56cc4817ff08d0128941cf2b0e1a4 k8s.gcr.io/kube-controller-manager:v1.23.5],SizeBytes:30174093,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:489efb65da9edc40bf0911f3e6371e5bb6b8ad8fde1d55193a6cc84c2ef36626 k8s.gcr.io/kube-scheduler:v1.23.5],SizeBytes:15131395,},ContainerImage{Names:[k8s.gcr.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e k8s.gcr.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[docker.io/calico/pod2daemon-flexvol@sha256:35802ba083546a7c5e8b5bf0ee7ffad7f8a468e8c2b3631e7e9647512c94041d docker.io/calico/pod2daemon-flexvol:v3.22.1],SizeBytes:8462620,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 13 11:39:12.287: INFO: Logging kubelet events for node capz-hs54n1-control-plane-68bd2 Apr 13 11:39:12.343: INFO: Logging pods the kubelet thinks is on node capz-hs54n1-control-plane-68bd2 Apr 13 11:39:12.455: INFO: kube-proxy-h7826 started at 2022-04-13 11:16:52 +0000 UTC (0+1 container statuses recorded) Apr 13 11:39:12.455: INFO: Container kube-proxy ready: true, restart count 0 Apr 13 11:39:12.455: INFO: calico-kube-controllers-7c664f4648-svm75 started at 2022-04-13 11:17:11 +0000 UTC (0+1 container statuses recorded) Apr 13 11:39:12.455: INFO: Container calico-kube-controllers ready: true, restart count 0 Apr 13 11:39:12.456: INFO: kube-apiserver-capz-hs54n1-control-plane-68bd2 started at 2022-04-13 11:16:52 +0000 UTC (0+1 container statuses recorded) Apr 13 11:39:12.456: INFO: Container kube-apiserver ready: true, restart count 0 Apr 13 11:39:12.456: INFO: kube-scheduler-capz-hs54n1-control-plane-68bd2 started at 2022-04-13 11:16:52 +0000 UTC (0+1 container statuses recorded) Apr 13 11:39:12.456: INFO: Container kube-scheduler ready: true, restart count 0 Apr 13 11:39:12.456: INFO: etcd-capz-hs54n1-control-plane-68bd2 started at 2022-04-13 11:16:42 +0000 UTC (0+1 container statuses recorded) Apr 13 11:39:12.456: INFO: Container etcd ready: true, restart count 0 Apr 13 11:39:12.456: INFO: coredns-64897985d-zwk5p started at 2022-04-13 11:17:11 +0000 UTC (0+1 container statuses recorded) Apr 13 11:39:12.456: INFO: Container coredns ready: true, restart count 0 Apr 13 11:39:12.456: INFO: kube-controller-manager-capz-hs54n1-control-plane-68bd2 started at 2022-04-13 11:16:52 +0000 UTC (0+1 container statuses recorded) Apr 13 11:39:12.456: INFO: Container kube-controller-manager ready: true, restart count 0 Apr 13 11:39:12.456: INFO: calico-node-vd2hz started at 2022-04-13 11:16:44 +0000 UTC (3+1 container statuses recorded) Apr 13 11:39:12.456: INFO: Init container upgrade-ipam ready: true, restart count 0 Apr 13 11:39:12.456: INFO: Init container install-cni ready: true, restart count 0 Apr 13 11:39:12.456: INFO: Init container flexvol-driver ready: true, restart count 0 Apr 13 11:39:12.456: INFO: Container calico-node ready: true, restart count 0 Apr 13 11:39:12.456: INFO: coredns-64897985d-4m5jw started at 2022-04-13 11:17:11 +0000 UTC (0+1 container statuses recorded) Apr 13 11:39:12.456: INFO: Container coredns ready: true, restart count 0 Apr 13 11:39:12.698: INFO: Latency metrics for node capz-hs54n1-control-plane-68bd2 Apr 13 11:39:12.698: INFO: Logging node info for node capz-hs54n1-md-0-dld6m Apr 13 11:39:12.754: INFO: Node Info: &Node{ObjectMeta:{capz-hs54n1-md-0-dld6m bacd7732-be1c-4d56-930d-8b281a1cc84f 4076 0 2022-04-13 11:17:47 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D4s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-hs54n1-md-0-dld6m kubernetes.io/os:linux node.kubernetes.io/instance-type:Standard_D4s_v3 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[cluster.x-k8s.io/cluster-name:capz-hs54n1 cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-hs54n1-md-0-744dccd984-s4c9v cluster.x-k8s.io/owner-kind:MachineSet cluster.x-k8s.io/owner-name:capz-hs54n1-md-0-744dccd984 kubeadm.alpha.kubernetes.io/cri-socket:/run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.1.0.6/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.77.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-13 11:17:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-04-13 11:17:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}} } {manager Update v1 2022-04-13 11:17:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {calico-node Update v1 2022-04-13 11:18:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {Go-http-client Update v1 2022-04-13 11:18:18 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-hs54n1/providers/Microsoft.Compute/virtualMachines/capz-hs54n1-md-0-dld6m,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{133018140672 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16783433728 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{119716326407 0} {<nil>} 119716326407 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16678576128 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-04-13 11:18:15 +0000 UTC,LastTransitionTime:2022-04-13 11:18:15 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-13 11:38:40 +0000 UTC,LastTransitionTime:2022-04-13 11:17:47 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-13 11:38:40 +0000 UTC,LastTransitionTime:2022-04-13 11:17:47 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-13 11:38:40 +0000 UTC,LastTransitionTime:2022-04-13 11:17:47 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-13 11:38:40 +0000 UTC,LastTransitionTime:2022-04-13 11:18:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-hs54n1-md-0-dld6m,},NodeAddress{Type:InternalIP,Address:10.1.0.6,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:5c6036bf1292447c8cf7d207a56f3fc8,SystemUUID:cf020121-cbfa-8d44-ae71-ce7c27da4cce,BootID:15680fce-9b59-4640-9b97-79832a53692a,KernelVersion:5.13.0-1017-azure,OSImage:Ubuntu 20.04.4 LTS,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 k8s.gcr.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[docker.io/calico/cni@sha256:2219eae79544b098119a06a8bb5608867f9ac00471592a00e2347f3ae4bea687 docker.io/calico/cni:v3.22.1],SizeBytes:80514590,},ContainerImage{Names:[docker.io/calico/node@sha256:1f8ed83e5264b4206cce7e1def11bca0b3ea7d5f4eb9b0ca0dbfc8cb968ca57e docker.io/calico/node:v3.22.1],SizeBytes:69647221,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:c1f625d115fbd9a12eac615653fc81c0edb33b2b5a76d1e09d5daed11fa557c1 k8s.gcr.io/kube-proxy:v1.23.5],SizeBytes:39278412,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:ddf5bf7196eb534271f9e5d403f4da19838d5610bb5ca191001bde5f32b5492e k8s.gcr.io/kube-apiserver:v1.23.5],SizeBytes:32603217,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:cca0fb3532abedcc95c5f64268d54da9ecc56cc4817ff08d0128941cf2b0e1a4 k8s.gcr.io/kube-controller-manager:v1.23.5],SizeBytes:30174093,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:489efb65da9edc40bf0911f3e6371e5bb6b8ad8fde1d55193a6cc84c2ef36626 k8s.gcr.io/kube-scheduler:v1.23.5],SizeBytes:15131395,},ContainerImage{Names:[k8s.gcr.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e k8s.gcr.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[docker.io/calico/pod2daemon-flexvol@sha256:35802ba083546a7c5e8b5bf0ee7ffad7f8a468e8c2b3631e7e9647512c94041d docker.io/calico/pod2daemon-flexvol:v3.22.1],SizeBytes:8462620,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 13 11:39:12.754: INFO: Logging kubelet events for node capz-hs54n1-md-0-dld6m Apr 13 11:39:12.811: INFO: Logging pods the kubelet thinks is on node capz-hs54n1-md-0-dld6m Apr 13 11:39:12.891: INFO: kube-proxy-72wkm started at 2022-04-13 11:17:48 +0000 UTC (0+1 container statuses recorded) Apr 13 11:39:12.891: INFO: Container kube-proxy ready: true, restart count 0 Apr 13 11:39:12.891: INFO: calico-node-4gzds started at 2022-04-13 11:17:48 +0000 UTC (3+1 container statuses recorded) Apr 13 11:39:12.891: INFO: Init container upgrade-ipam ready: true, restart count 0 Apr 13 11:39:12.891: INFO: Init container install-cni ready: true, restart count 0 Apr 13 11:39:12.891: INFO: Init container flexvol-driver ready: true, restart count 0 Apr 13 11:39:12.891: INFO: Container calico-node ready: true, restart count 0 Apr 13 11:39:13.104: INFO: Latency metrics for node capz-hs54n1-md-0-dld6m Apr 13 11:39:13.104: INFO: Logging node info for node capz-hs54n1-md-0-sjk6p Apr 13 11:39:13.161: INFO: Node Info: &Node{ObjectMeta:{capz-hs54n1-md-0-sjk6p 875002cf-b2c0-4c34-8776-8ac665f54501 4072 0 2022-04-13 11:19:48 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D4s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:westus2 failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-hs54n1-md-0-sjk6p kubernetes.io/os:linux node.kubernetes.io/instance-type:Standard_D4s_v3 topology.kubernetes.io/region:westus2 topology.kubernetes.io/zone:0] map[cluster.x-k8s.io/cluster-name:capz-hs54n1 cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-hs54n1-md-0-744dccd984-dh5bh cluster.x-k8s.io/owner-kind:MachineSet cluster.x-k8s.io/owner-name:capz-hs54n1-md-0-744dccd984 kubeadm.alpha.kubernetes.io/cri-socket:/run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.1.0.4/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.89.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-13 11:19:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-04-13 11:19:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}} } {manager Update v1 2022-04-13 11:19:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {calico-node Update v1 2022-04-13 11:20:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {Go-http-client Update v1 2022-04-13 11:20:19 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-hs54n1/providers/Microsoft.Compute/virtualMachines/capz-hs54n1-md-0-sjk6p,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{133018140672 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16783433728 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{119716326407 0} {<nil>} 119716326407 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16678576128 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-04-13 11:20:17 +0000 UTC,LastTransitionTime:2022-04-13 11:20:17 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-13 11:38:38 +0000 UTC,LastTransitionTime:2022-04-13 11:19:48 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-13 11:38:38 +0000 UTC,LastTransitionTime:2022-04-13 11:19:48 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-13 11:38:38 +0000 UTC,LastTransitionTime:2022-04-13 11:19:48 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-13 11:38:38 +0000 UTC,LastTransitionTime:2022-04-13 11:20:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-hs54n1-md-0-sjk6p,},NodeAddress{Type:InternalIP,Address:10.1.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e848ba94d69346009f2ff42410d09b7f,SystemUUID:13b2c432-0228-724b-970d-4f6173f60b05,BootID:29cf5b75-f8b9-46c2-ab61-a5d28b2ed2d3,KernelVersion:5.13.0-1017-azure,OSImage:Ubuntu 20.04.4 LTS,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[capzci.azurecr.io/azuredisk-csi@sha256:61a2e32fbb4b6722027417b9fe2ca6be53958707c8544393ba4f6fddb5239705 capzci.azurecr.io/azuredisk-csi:v1.16.0-eb7e0710ddbc5984b82c0c8453e3a2427fa2a635],SizeBytes:107990911,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 k8s.gcr.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[docker.io/calico/cni@sha256:2219eae79544b098119a06a8bb5608867f9ac00471592a00e2347f3ae4bea687 docker.io/calico/cni:v3.22.1],SizeBytes:80514590,},ContainerImage{Names:[docker.io/calico/node@sha256:1f8ed83e5264b4206cce7e1def11bca0b3ea7d5f4eb9b0ca0dbfc8cb968ca57e docker.io/calico/node:v3.22.1],SizeBytes:69647221,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner@sha256:542c9258a1441e4927883ea73425e21f9a14043a649686bf6b51700f34c64f8e mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v3.1.0],SizeBytes:59205633,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-resizer@sha256:ab6c2e18a4d943f2bf8688e1779622277a1d14c355c9d4bfc0d761d86c5108b3 mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.4.0],SizeBytes:56924121,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-attacher@sha256:19fbca01394f7ed80151731180cfde0a3367f038beae2a97cda7928034010057 mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v3.4.0],SizeBytes:56301028,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:c1f625d115fbd9a12eac615653fc81c0edb33b2b5a76d1e09d5daed11fa557c1 k8s.gcr.io/kube-proxy:v1.23.5],SizeBytes:39278412,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:ddf5bf7196eb534271f9e5d403f4da19838d5610bb5ca191001bde5f32b5492e k8s.gcr.io/kube-apiserver:v1.23.5],SizeBytes:32603217,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:cca0fb3532abedcc95c5f64268d54da9ecc56cc4817ff08d0128941cf2b0e1a4 k8s.gcr.io/kube-controller-manager:v1.23.5],SizeBytes:30174093,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:a889e925e15f9423f7842f1b769f64cbcf6a20b6956122836fc835cf22d9073f mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v5.0.1],SizeBytes:22192414,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:489efb65da9edc40bf0911f3e6371e5bb6b8ad8fde1d55193a6cc84c2ef36626 k8s.gcr.io/kube-scheduler:v1.23.5],SizeBytes:15131395,},ContainerImage{Names:[k8s.gcr.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e k8s.gcr.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[docker.io/calico/pod2daemon-flexvol@sha256:35802ba083546a7c5e8b5bf0ee7ffad7f8a468e8c2b3631e7e9647512c94041d docker.io/calico/pod2daemon-flexvol:v3.22.1],SizeBytes:8462620,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:c96a6255c42766f6b8bb1a7cda02b0060ab1b20b2e2dafcc64ec09e7646745a6 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.5.0],SizeBytes:8222208,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 13 11:39:13.161: INFO: Logging kubelet events for node capz-hs54n1-md-0-sjk6p Apr 13 11:39:13.217: INFO: Logging pods the kubelet thinks is on node capz-hs54n1-md-0-sjk6p Apr 13 11:39:13.301: INFO: calico-node-kz5c4 started at 2022-04-13 11:19:49 +0000 UTC (3+1 container statuses recorded) Apr 13 11:39:13.301: INFO: Init container upgrade-ipam ready: true, restart count 0 Apr 13 11:39:13.301: INFO: Init container install-cni ready: true, restart count 0 Apr 13 11:39:13.301: INFO: Init container flexvol-driver ready: true, restart count 0 Apr 13 11:39:13.301: INFO: Container calico-node ready: true, restart count 0 Apr 13 11:39:13.301: INFO: kube-proxy-5hpw8 started at 2022-04-13 11:19:49 +0000 UTC (0+1 container statuses recorded) Apr 13 11:39:13.301: INFO: Container kube-proxy ready: true, restart count 0 Apr 13 11:39:13.301: INFO: csi-azuredisk-controller-bd65dc78d-mlqpj started at 2022-04-13 11:22:33 +0000 UTC (0+6 container statuses recorded) Apr 13 11:39:13.301: INFO: Container azuredisk ready: true, restart count 0 Apr 13 11:39:13.301: INFO: Container csi-attacher ready: true, restart count 0 Apr 13 11:39:13.301: INFO: Container csi-provisioner ready: true, restart count 0 Apr 13 11:39:13.301: INFO: Container csi-resizer ready: true, restart count 0 Apr 13 11:39:13.301: INFO: Container csi-snapshotter ready: true, restart count 0 Apr 13 11:39:13.301: INFO: Container liveness-probe ready: true, restart count 0 Apr 13 11:39:13.518: INFO: Latency metrics for node capz-hs54n1-md-0-sjk6p Apr 13 11:39:13.518: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "azuredisk-8081" for this suite.
Filter through log files | View test history on testgrid
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] Should create and attach a volume with basic perfProfile [enableBursting][disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should create a deployment object, write and read to it, delete the pod and write and read to it again [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should create a pod with multiple volumes [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should create a pod with volume mount subpath [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should create a statefulset object, write and read to it, delete the pod and write and read to it again [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should create a volume azuredisk with tag [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should create a volume on demand and mount it as readOnly in a pod [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should create a volume on demand and resize it [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should create a volume on demand with mount options [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should create multiple PV objects, bind to PVCs and attach all to a single pod [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should create multiple PV objects, bind to PVCs and attach all to different pods on the same node [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should delete PV with reclaimPolicy "Delete" [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should detach disk after pod deleted [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should retain PV with reclaimPolicy "Retain" [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Pre-Provisioned [single-az] should fail when maxShares is invalid [disk.csi.azure.com][windows]
AzureDisk CSI Driver End-to-End Tests Pre-Provisioned [single-az] should succeed when creating a shared disk [disk.csi.azure.com][windows]
AzureDisk CSI Driver End-to-End Tests Pre-Provisioned [single-az] should use a pre-provisioned volume and retain PV with reclaimPolicy "Retain" [disk.csi.azure.com][windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] Should create and attach a volume with basic perfProfile [enableBursting][disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] Should test pod failover with cordoning a node
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] Should test pod failover with cordoning a node using ZRS
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should clone a volume from an existing volume and read from it [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should clone a volume of larger size than the source volume and make sure the filesystem is appropriately adjusted [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should create a block volume on demand and dynamically resize it without detaching [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should create a deployment object, write and read to it, delete the pod and write and read to it again [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should create a pod with multiple volumes [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should create a pod with volume mount subpath [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should create a pod, write and read to it, take a volume snapshot, and create another pod from the snapshot [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should create a pod, write to its pv, take a volume snapshot, overwrite data in original pv, create another pod from the snapshot, and read unaltered original data from original pv[disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should create a raw block volume and a filesystem volume on demand and bind to the same pod [kubernetes.io/azure-disk] [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should create a raw block volume on demand [kubernetes.io/azure-disk] [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should create a statefulset object, write and read to it, delete the pod and write and read to it again [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should create a volume azuredisk with tag [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should create a volume on demand and dynamically resize it without detaching [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should create a volume on demand and mount it as readOnly in a pod [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should create a volume on demand and resize it [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should create a volume on demand with mount options [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should create multiple PV objects, bind to PVCs and attach all to a single pod [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should create multiple PV objects, bind to PVCs and attach all to different pods on the same node [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should delete PV with reclaimPolicy "Delete" [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should detach disk after pod deleted [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should receive FailedMount event with invalid mount options [kubernetes.io/azure-disk] [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should retain PV with reclaimPolicy "Retain" [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should succeed when attaching a shared block volume to multiple pods [disk.csi.azure.com][shared disk]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] Should test pod failover with cordoning a node
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] Should test pod failover with cordoning a node using ZRS
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should clone a volume from an existing volume and read from it [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should clone a volume of larger size than the source volume and make sure the filesystem is appropriately adjusted [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should create a block volume on demand and dynamically resize it without detaching [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should create a pod, write and read to it, take a volume snapshot, and create another pod from the snapshot [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should create a pod, write to its pv, take a volume snapshot, overwrite data in original pv, create another pod from the snapshot, and read unaltered original data from original pv[disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should create a raw block volume and a filesystem volume on demand and bind to the same pod [kubernetes.io/azure-disk] [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should create a raw block volume on demand [kubernetes.io/azure-disk] [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should create a volume on demand and dynamically resize it without detaching [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should receive FailedMount event with invalid mount options [kubernetes.io/azure-disk] [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should succeed when attaching a shared block volume to multiple pods [disk.csi.azure.com][shared disk]
AzureDisk CSI Driver End-to-End Tests Pre-Provisioned [single-az] should create an inline volume by in-tree driver [kubernetes.io/azure-disk]
AzureDisk CSI Driver End-to-End Tests Pre-Provisioned [single-az] should succeed when attaching a shared block volume to multiple pods [disk.csi.azure.com][shared disk]