Recent runs || View in Spyglass
PR | andyzhangx: chore: refine package patching in image build |
Result | FAILURE |
Tests | 2 failed / 19 succeeded |
Started | |
Elapsed | 1h32m |
Revision | f498f82678322a06e4e4dd6e0b9437be78dd85ce |
Refs |
1291 |
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=AzureDisk\sCSI\sDriver\sEnd\-to\-End\sTests\sDynamic\sProvisioning\s\[single\-az\]\sshould\screate\sa\svolume\son\sdemand\swith\smount\soptions\s\[kubernetes\.io\/azure\-disk\]\s\[disk\.csi\.azure\.com\]\s\[Windows\]$'
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:101 Unexpected error: <*errors.errorString | 0xc000947330>: { s: "pod \"azuredisk-volume-tester-q5dbd\" failed with status: {Phase:Failed Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 01:39:35 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 01:39:35 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 01:39:35 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 01:39:35 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:10.1.0.7 PodIP:192.168.108.67 PodIPs:[{IP:192.168.108.67}] StartTime:2022-04-21 01:39:35 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:volume-tester State:{Waiting:&ContainerStateWaiting{Reason:RunContainerError,Message:context deadline exceeded,} Running:nil Terminated:nil} LastTerminationState:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:0,Signal:0,Reason:,Message:,StartedAt:0001-01-01 00:00:00 +0000 UTC,FinishedAt:0001-01-01 00:00:00 +0000 UTC,ContainerID:containerd://cae3ee426b006d68600dfa1861b23fbae5aa5620abc5f7b2904bc5ce144005cd,}} Ready:false RestartCount:0 Image:mcr.microsoft.com/windows/servercore:ltsc2022 ImageID:mcr.microsoft.com/windows/servercore@sha256:378d85bd8e7388a777d25009f8523d1e95a5f544f131eaada83171045d5b2c1e ContainerID:containerd://cae3ee426b006d68600dfa1861b23fbae5aa5620abc5f7b2904bc5ce144005cd Started:0xc000af1048}] QOSClass:BestEffort EphemeralContainerStatuses:[]}", } pod "azuredisk-volume-tester-q5dbd" failed with status: {Phase:Failed Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 01:39:35 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 01:39:35 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 01:39:35 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 01:39:35 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:10.1.0.7 PodIP:192.168.108.67 PodIPs:[{IP:192.168.108.67}] StartTime:2022-04-21 01:39:35 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:volume-tester State:{Waiting:&ContainerStateWaiting{Reason:RunContainerError,Message:context deadline exceeded,} Running:nil Terminated:nil} LastTerminationState:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:0,Signal:0,Reason:,Message:,StartedAt:0001-01-01 00:00:00 +0000 UTC,FinishedAt:0001-01-01 00:00:00 +0000 UTC,ContainerID:containerd://cae3ee426b006d68600dfa1861b23fbae5aa5620abc5f7b2904bc5ce144005cd,}} Ready:false RestartCount:0 Image:mcr.microsoft.com/windows/servercore:ltsc2022 ImageID:mcr.microsoft.com/windows/servercore@sha256:378d85bd8e7388a777d25009f8523d1e95a5f544f131eaada83171045d5b2c1e ContainerID:containerd://cae3ee426b006d68600dfa1861b23fbae5aa5620abc5f7b2904bc5ce144005cd Started:0xc000af1048}] QOSClass:BestEffort EphemeralContainerStatuses:[]} occurred /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:807from junit_01.xml
�[1mSTEP�[0m: Creating a kubernetes client Apr 21 01:39:28.488: INFO: >>> kubeConfig: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig �[1mSTEP�[0m: Building a namespace api object, basename azuredisk Apr 21 01:39:29.193: INFO: No PodSecurityPolicies found; assuming PodSecurityPolicy is disabled. �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace Apr 21 01:39:30.223: INFO: >>> kubeConfig: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig �[1mSTEP�[0m: setting up the StorageClass �[1mSTEP�[0m: creating a StorageClass �[1mSTEP�[0m: setting up the PVC and PV �[1mSTEP�[0m: creating a PVC �[1mSTEP�[0m: waiting for PVC to be in phase "Bound" Apr 21 01:39:30.438: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-h48f7] to have phase Bound Apr 21 01:39:30.543: INFO: PersistentVolumeClaim pvc-h48f7 found but phase is Pending instead of Bound. Apr 21 01:39:32.648: INFO: PersistentVolumeClaim pvc-h48f7 found but phase is Pending instead of Bound. Apr 21 01:39:34.754: INFO: PersistentVolumeClaim pvc-h48f7 found and phase=Bound (4.31601872s) �[1mSTEP�[0m: checking the PVC �[1mSTEP�[0m: validating provisioned PV �[1mSTEP�[0m: checking the PV �[1mSTEP�[0m: setting up the pod �[1mSTEP�[0m: deploying the pod �[1mSTEP�[0m: checking that the pod's command exits with no error Apr 21 01:39:35.084: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-q5dbd" in namespace "azuredisk-8081" to be "Succeeded or Failed" Apr 21 01:39:35.188: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 103.758272ms Apr 21 01:39:37.295: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 2.211172743s Apr 21 01:39:39.401: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 4.317179685s Apr 21 01:39:41.507: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 6.422532983s Apr 21 01:39:43.612: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 8.527942526s Apr 21 01:39:45.718: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 10.633404802s Apr 21 01:39:47.825: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 12.740195129s Apr 21 01:39:49.931: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 14.846690396s Apr 21 01:39:52.037: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 16.952636371s Apr 21 01:39:54.143: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 19.058425234s Apr 21 01:39:56.249: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 21.164611603s Apr 21 01:39:58.356: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 23.27153775s Apr 21 01:40:00.462: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 25.377958444s Apr 21 01:40:02.568: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 27.483234985s Apr 21 01:40:04.674: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 29.589768278s Apr 21 01:40:06.780: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 31.695983375s Apr 21 01:40:08.886: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 33.801699219s Apr 21 01:40:10.991: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 35.906622282s Apr 21 01:40:13.095: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 38.011009513s Apr 21 01:40:15.200: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 40.115740124s Apr 21 01:40:17.313: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 42.228618315s Apr 21 01:40:19.426: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 44.341420545s Apr 21 01:40:21.539: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 46.454212369s Apr 21 01:40:23.653: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 48.568988762s Apr 21 01:40:25.770: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 50.685888426s Apr 21 01:40:27.884: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 52.800103822s Apr 21 01:40:29.996: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 54.911489154s Apr 21 01:40:32.107: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 57.023048339s Apr 21 01:40:34.221: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 59.136463378s Apr 21 01:40:36.333: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.248718263s Apr 21 01:40:38.446: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.361845934s Apr 21 01:40:40.559: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.474203708s Apr 21 01:40:42.671: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m7.587072931s Apr 21 01:40:44.784: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m9.699977029s Apr 21 01:40:46.897: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m11.812456561s Apr 21 01:40:49.009: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m13.924908148s Apr 21 01:40:51.121: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.037188081s Apr 21 01:40:53.235: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.150735033s Apr 21 01:40:55.347: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.26281519s Apr 21 01:40:57.460: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.375216297s Apr 21 01:40:59.572: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.487817153s Apr 21 01:41:01.685: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.60080461s Apr 21 01:41:03.800: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.715943356s Apr 21 01:41:05.915: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.830769027s Apr 21 01:41:08.028: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.943764875s Apr 21 01:41:10.140: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m35.055846645s Apr 21 01:41:12.254: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m37.169868133s Apr 21 01:41:14.366: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m39.282047985s Apr 21 01:41:16.478: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m41.394131146s Apr 21 01:41:18.592: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m43.507445856s Apr 21 01:41:20.704: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m45.620111579s Apr 21 01:41:22.818: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m47.733912918s Apr 21 01:41:24.932: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m49.847499525s Apr 21 01:41:27.045: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m51.960567563s Apr 21 01:41:29.157: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.072583831s Apr 21 01:41:31.269: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.185007547s Apr 21 01:41:33.381: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.296728674s Apr 21 01:41:35.494: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.409521236s Apr 21 01:41:37.607: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.522884501s Apr 21 01:41:39.719: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.634757761s Apr 21 01:41:41.831: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.747029076s Apr 21 01:41:43.944: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.859301583s Apr 21 01:41:46.055: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.971080424s Apr 21 01:41:48.167: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m13.082716951s Apr 21 01:41:50.280: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m15.195485373s Apr 21 01:41:52.393: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m17.308655529s Apr 21 01:41:54.506: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m19.42192064s Apr 21 01:41:56.619: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m21.534729809s Apr 21 01:41:58.732: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m23.647339806s Apr 21 01:42:00.845: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m25.760640867s Apr 21 01:42:02.957: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m27.872592448s Apr 21 01:42:05.069: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m29.984495634s Apr 21 01:42:07.181: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.096201228s Apr 21 01:42:09.292: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.208187984s Apr 21 01:42:11.405: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.320272496s Apr 21 01:42:13.517: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.432930169s Apr 21 01:42:15.631: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.546545975s Apr 21 01:42:17.744: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.65946368s Apr 21 01:42:19.858: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.773465186s Apr 21 01:42:21.970: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.885444305s Apr 21 01:42:24.082: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.997696556s Apr 21 01:42:26.194: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m51.10955382s Apr 21 01:42:28.307: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m53.222355186s Apr 21 01:42:30.418: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m55.333970671s Apr 21 01:42:32.531: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m57.44661568s Apr 21 01:42:34.643: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m59.558881699s Apr 21 01:42:36.755: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m1.670701539s Apr 21 01:42:38.868: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m3.783226433s Apr 21 01:42:40.980: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m5.895598963s Apr 21 01:42:43.093: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.008953631s Apr 21 01:42:45.205: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.120779627s Apr 21 01:42:47.318: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.233435795s Apr 21 01:42:49.430: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.345526102s Apr 21 01:42:51.543: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.45873423s Apr 21 01:42:53.656: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.571365826s Apr 21 01:42:55.770: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.68549286s Apr 21 01:42:57.886: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.80141228s Apr 21 01:42:59.998: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.913475146s Apr 21 01:43:02.110: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m27.025720757s Apr 21 01:43:04.222: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m29.137763667s Apr 21 01:43:06.337: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m31.252259795s Apr 21 01:43:08.449: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m33.364562838s Apr 21 01:43:10.561: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m35.476710071s Apr 21 01:43:12.674: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m37.589550792s Apr 21 01:43:14.786: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m39.701611192s Apr 21 01:43:16.898: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m41.814053034s Apr 21 01:43:19.009: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m43.925163906s Apr 21 01:43:21.124: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.040184438s Apr 21 01:43:23.237: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.152648935s Apr 21 01:43:25.349: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.265132167s Apr 21 01:43:27.462: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.378179434s Apr 21 01:43:29.576: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.49173711s Apr 21 01:43:31.689: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.604250562s Apr 21 01:43:33.802: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.717641184s Apr 21 01:43:35.916: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.831222396s Apr 21 01:43:38.028: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.943359993s Apr 21 01:43:40.139: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m5.055097941s Apr 21 01:43:42.251: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m7.167134547s Apr 21 01:43:44.365: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m9.280302931s Apr 21 01:43:46.477: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m11.393014422s Apr 21 01:43:48.591: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m13.506699855s Apr 21 01:43:50.704: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m15.619935387s Apr 21 01:43:52.819: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m17.734916085s Apr 21 01:43:54.932: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m19.847551806s Apr 21 01:43:57.044: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m21.959983791s Apr 21 01:43:59.156: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.071218582s Apr 21 01:44:01.268: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.18326333s Apr 21 01:44:03.380: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.295242663s Apr 21 01:44:05.493: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.40840639s Apr 21 01:44:07.606: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.521299485s Apr 21 01:44:09.723: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.639034592s Apr 21 01:44:11.836: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.751949219s Apr 21 01:44:13.949: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.86471664s Apr 21 01:44:16.061: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.976306481s Apr 21 01:44:18.173: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m43.088755601s Apr 21 01:44:20.286: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m45.201374315s Apr 21 01:44:22.399: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m47.314701664s Apr 21 01:44:24.511: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m49.426488324s Apr 21 01:44:26.623: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m51.53907455s Apr 21 01:44:28.736: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m53.651229767s Apr 21 01:44:30.849: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m55.764716654s Apr 21 01:44:32.962: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m57.877848299s Apr 21 01:44:35.074: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m59.990156555s Apr 21 01:44:37.187: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m2.102880058s Apr 21 01:44:39.298: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m4.213933977s Apr 21 01:44:41.410: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m6.325637732s Apr 21 01:44:43.523: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m8.438374592s Apr 21 01:44:45.635: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m10.550418481s Apr 21 01:44:47.747: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m12.662488458s Apr 21 01:44:49.859: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m14.774750392s Apr 21 01:44:51.972: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m16.887550773s Apr 21 01:44:54.085: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m19.000193212s Apr 21 01:44:56.196: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m21.111727829s Apr 21 01:44:58.309: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m23.224569826s Apr 21 01:45:00.422: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m25.337862047s Apr 21 01:45:02.534: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m27.450189802s Apr 21 01:45:04.648: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m29.563685676s Apr 21 01:45:06.761: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m31.676423398s Apr 21 01:45:08.873: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m33.788891361s Apr 21 01:45:10.986: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m35.901364925s Apr 21 01:45:13.099: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m38.01429139s Apr 21 01:45:15.210: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m40.126092546s Apr 21 01:45:17.322: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m42.238068803s Apr 21 01:45:19.434: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m44.349299835s Apr 21 01:45:21.545: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m46.461126123s Apr 21 01:45:23.659: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m48.574217501s Apr 21 01:45:25.774: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m50.689778818s Apr 21 01:45:27.886: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m52.80216001s Apr 21 01:45:29.998: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m54.914144486s Apr 21 01:45:32.110: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m57.025995997s Apr 21 01:45:34.222: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m59.138106414s Apr 21 01:45:36.339: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m1.254781488s Apr 21 01:45:38.452: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m3.367669754s Apr 21 01:45:40.564: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m5.479627712s Apr 21 01:45:42.676: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m7.591456845s Apr 21 01:45:44.788: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m9.70342668s Apr 21 01:45:46.900: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m11.815243322s Apr 21 01:45:49.011: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m13.926956596s Apr 21 01:45:51.128: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m16.043356621s Apr 21 01:45:53.239: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m18.155161093s Apr 21 01:45:55.352: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m20.267609063s Apr 21 01:45:57.465: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m22.380947128s Apr 21 01:45:59.577: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m24.492705659s Apr 21 01:46:01.690: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m26.605335481s Apr 21 01:46:03.802: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m28.717652761s Apr 21 01:46:05.914: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m30.829437445s Apr 21 01:46:08.026: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m32.941404064s Apr 21 01:46:10.138: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m35.05359001s Apr 21 01:46:12.252: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m37.167808271s Apr 21 01:46:14.365: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m39.280382725s Apr 21 01:46:16.478: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m41.393274155s Apr 21 01:46:18.590: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m43.506172186s Apr 21 01:46:20.703: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m45.618968525s Apr 21 01:46:22.815: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m47.730866812s Apr 21 01:46:24.928: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m49.843846884s Apr 21 01:46:27.040: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m51.95573154s Apr 21 01:46:29.152: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m54.068098502s Apr 21 01:46:31.265: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m56.180369354s Apr 21 01:46:33.377: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m58.292731315s Apr 21 01:46:35.490: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 7m0.405734905s Apr 21 01:46:37.603: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Pending", Reason="", readiness=false. Elapsed: 7m2.518550811s Apr 21 01:46:39.715: INFO: Pod "azuredisk-volume-tester-q5dbd": Phase="Failed", Reason="", readiness=false. Elapsed: 7m4.631105198s Apr 21 01:46:39.716: INFO: deleting Pod "azuredisk-8081"/"azuredisk-volume-tester-q5dbd" Apr 21 01:46:39.845: INFO: Pod azuredisk-volume-tester-q5dbd has the following logs: �[1mSTEP�[0m: Deleting pod azuredisk-volume-tester-q5dbd in namespace azuredisk-8081 Apr 21 01:46:39.976: INFO: deleting PVC "azuredisk-8081"/"pvc-h48f7" Apr 21 01:46:39.976: INFO: Deleting PersistentVolumeClaim "pvc-h48f7" �[1mSTEP�[0m: waiting for claim's PV "pvc-81fa0362-6d66-4c89-be03-3946897eb39d" to be deleted Apr 21 01:46:40.082: INFO: Waiting up to 10m0s for PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d to get deleted Apr 21 01:46:40.186: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (103.89033ms) Apr 21 01:46:45.295: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (5.212655303s) Apr 21 01:46:50.403: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (10.321317796s) Apr 21 01:46:55.510: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (15.4278191s) Apr 21 01:47:00.616: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (20.533442767s) Apr 21 01:47:05.721: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (25.639339345s) Apr 21 01:47:10.828: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (30.745803276s) Apr 21 01:47:15.933: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (35.850897226s) Apr 21 01:47:21.043: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (40.961298498s) Apr 21 01:47:26.148: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (46.065907389s) Apr 21 01:47:31.253: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (51.170675444s) Apr 21 01:47:36.358: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (56.275595639s) Apr 21 01:47:41.462: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (1m1.380218642s) Apr 21 01:47:46.567: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (1m6.484615811s) Apr 21 01:47:51.672: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (1m11.590319614s) Apr 21 01:47:56.778: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (1m16.695414543s) Apr 21 01:48:01.883: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (1m21.801006613s) Apr 21 01:48:06.989: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (1m26.906419422s) Apr 21 01:48:12.094: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (1m32.011718273s) Apr 21 01:48:17.199: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (1m37.116491108s) Apr 21 01:48:22.305: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (1m42.222751701s) Apr 21 01:48:27.410: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (1m47.327775682s) Apr 21 01:48:32.514: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (1m52.432099254s) Apr 21 01:48:37.621: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (1m57.539173401s) Apr 21 01:48:42.728: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (2m2.64590093s) Apr 21 01:48:47.835: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (2m7.752586853s) Apr 21 01:48:52.940: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (2m12.857520409s) Apr 21 01:48:58.045: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (2m17.962512856s) Apr 21 01:49:03.152: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (2m23.069458665s) Apr 21 01:49:08.256: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (2m28.174188488s) Apr 21 01:49:13.361: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (2m33.279263201s) Apr 21 01:49:18.469: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (2m38.387054398s) Apr 21 01:49:23.574: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (2m43.491693216s) Apr 21 01:49:28.680: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (2m48.597681661s) Apr 21 01:49:33.785: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (2m53.70287338s) Apr 21 01:49:38.890: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (2m58.808201525s) Apr 21 01:49:43.997: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (3m3.914539787s) Apr 21 01:49:49.102: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (3m9.019582203s) Apr 21 01:49:54.207: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (3m14.125225632s) Apr 21 01:49:59.315: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (3m19.232616998s) Apr 21 01:50:04.421: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (3m24.338835577s) Apr 21 01:50:09.525: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (3m29.443154915s) Apr 21 01:50:14.634: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (3m34.551488501s) Apr 21 01:50:19.742: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (3m39.66032336s) Apr 21 01:50:24.850: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (3m44.768011918s) Apr 21 01:50:29.955: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (3m49.872657612s) Apr 21 01:50:35.061: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (3m54.979126052s) Apr 21 01:50:40.170: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (4m0.087931721s) Apr 21 01:50:45.275: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (4m5.193000338s) Apr 21 01:50:50.381: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (4m10.298503815s) Apr 21 01:50:55.486: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (4m15.403862442s) Apr 21 01:51:00.595: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (4m20.512977847s) Apr 21 01:51:05.702: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (4m25.619893422s) Apr 21 01:51:10.807: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (4m30.725382386s) Apr 21 01:51:15.914: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (4m35.831591456s) Apr 21 01:51:21.019: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (4m40.936439064s) Apr 21 01:51:26.123: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (4m46.040996488s) Apr 21 01:51:31.228: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (4m51.146147682s) Apr 21 01:51:36.333: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (4m56.251010467s) Apr 21 01:51:41.438: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (5m1.356122721s) Apr 21 01:51:46.543: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (5m6.460960503s) Apr 21 01:51:51.648: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (5m11.566079025s) Apr 21 01:51:56.753: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (5m16.670960683s) Apr 21 01:52:01.859: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (5m21.776486198s) Apr 21 01:52:06.968: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (5m26.886249091s) Apr 21 01:52:12.073: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (5m31.991211482s) Apr 21 01:52:17.179: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (5m37.096691779s) Apr 21 01:52:22.285: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (5m42.202792758s) Apr 21 01:52:27.390: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (5m47.307931376s) Apr 21 01:52:32.495: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (5m52.413394992s) Apr 21 01:52:37.602: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (5m57.520352012s) Apr 21 01:52:42.708: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (6m2.625685624s) Apr 21 01:52:47.821: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (6m7.738993534s) Apr 21 01:52:52.928: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (6m12.845435237s) Apr 21 01:52:58.033: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (6m17.951021796s) Apr 21 01:53:03.138: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (6m23.055958893s) Apr 21 01:53:08.243: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (6m28.16058358s) Apr 21 01:53:13.348: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (6m33.266127507s) Apr 21 01:53:18.454: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (6m38.371482219s) Apr 21 01:53:23.558: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (6m43.475904055s) Apr 21 01:53:28.662: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (6m48.580356678s) Apr 21 01:53:33.767: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (6m53.684634967s) Apr 21 01:53:38.872: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (6m58.789845351s) Apr 21 01:53:43.978: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (7m3.895511882s) Apr 21 01:53:49.083: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d found and phase=Released (7m9.00059457s) Apr 21 01:53:54.188: INFO: PersistentVolume pvc-81fa0362-6d66-4c89-be03-3946897eb39d was removed Apr 21 01:53:54.188: INFO: Waiting up to 5m0s for PersistentVolumeClaim azuredisk-8081 to be removed Apr 21 01:53:54.293: INFO: Claim "azuredisk-8081" in namespace "pvc-h48f7" doesn't exist in the system Apr 21 01:53:54.293: INFO: deleting StorageClass azuredisk-8081-disk.csi.azure.com-dynamic-sc-cvw49 �[1mSTEP�[0m: Collecting events from namespace "azuredisk-8081". �[1mSTEP�[0m: Found 13 events. Apr 21 01:53:54.521: INFO: At 2022-04-21 01:39:30 +0000 UTC - event for pvc-h48f7: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "disk.csi.azure.com" or manually created by system administrator Apr 21 01:53:54.521: INFO: At 2022-04-21 01:39:30 +0000 UTC - event for pvc-h48f7: {disk.csi.azure.com_capz-ujkgt8-md-0-sz85g_c183a5fd-c785-40ee-87b5-9170bc5734ed } Provisioning: External provisioner is provisioning volume for claim "azuredisk-8081/pvc-h48f7" Apr 21 01:53:54.521: INFO: At 2022-04-21 01:39:33 +0000 UTC - event for pvc-h48f7: {disk.csi.azure.com_capz-ujkgt8-md-0-sz85g_c183a5fd-c785-40ee-87b5-9170bc5734ed } ProvisioningSucceeded: Successfully provisioned volume pvc-81fa0362-6d66-4c89-be03-3946897eb39d Apr 21 01:53:54.521: INFO: At 2022-04-21 01:39:35 +0000 UTC - event for azuredisk-volume-tester-q5dbd: {default-scheduler } Scheduled: Successfully assigned azuredisk-8081/azuredisk-volume-tester-q5dbd to capz-ujkg-4bwdk Apr 21 01:53:54.521: INFO: At 2022-04-21 01:39:42 +0000 UTC - event for azuredisk-volume-tester-q5dbd: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-81fa0362-6d66-4c89-be03-3946897eb39d" Apr 21 01:53:54.521: INFO: At 2022-04-21 01:40:18 +0000 UTC - event for azuredisk-volume-tester-q5dbd: {kubelet capz-ujkg-4bwdk} Pulling: Pulling image "mcr.microsoft.com/windows/servercore:ltsc2022" Apr 21 01:53:54.521: INFO: At 2022-04-21 01:44:37 +0000 UTC - event for azuredisk-volume-tester-q5dbd: {kubelet capz-ujkg-4bwdk} Pulled: Successfully pulled image "mcr.microsoft.com/windows/servercore:ltsc2022" in 4m18.9309026s Apr 21 01:53:54.521: INFO: At 2022-04-21 01:44:37 +0000 UTC - event for azuredisk-volume-tester-q5dbd: {kubelet capz-ujkg-4bwdk} Created: Created container volume-tester Apr 21 01:53:54.521: INFO: At 2022-04-21 01:46:37 +0000 UTC - event for azuredisk-volume-tester-q5dbd: {kubelet capz-ujkg-4bwdk} Failed: Error: context deadline exceeded Apr 21 01:53:54.521: INFO: At 2022-04-21 01:46:37 +0000 UTC - event for azuredisk-volume-tester-q5dbd: {kubelet capz-ujkg-4bwdk} Pulled: Container image "mcr.microsoft.com/windows/servercore:ltsc2022" already present on machine Apr 21 01:53:54.521: INFO: At 2022-04-21 01:46:42 +0000 UTC - event for azuredisk-volume-tester-q5dbd: {kubelet capz-ujkg-4bwdk} Started: Started container volume-tester Apr 21 01:53:54.521: INFO: At 2022-04-21 01:46:43 +0000 UTC - event for azuredisk-volume-tester-q5dbd: {kubelet capz-ujkg-4bwdk} Killing: Stopping container volume-tester Apr 21 01:53:54.521: INFO: At 2022-04-21 01:48:44 +0000 UTC - event for azuredisk-volume-tester-q5dbd: {kubelet capz-ujkg-4bwdk} FailedKillPod: error killing pod: failed to "KillPodSandbox" for "6dcb0d58-27f5-4a26-af48-0cccd2225328" with KillPodSandboxError: "rpc error: code = DeadlineExceeded desc = context deadline exceeded" Apr 21 01:53:54.625: INFO: POD NODE PHASE GRACE CONDITIONS Apr 21 01:53:54.625: INFO: Apr 21 01:53:54.802: INFO: Logging node info for node capz-ujkg-4bwdk Apr 21 01:53:54.917: INFO: Node Info: &Node{ObjectMeta:{capz-ujkg-4bwdk 50f9e109-c370-4829-afcf-e5dfa6ef4aaf 3779 0 2022-04-21 01:33:36 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D4s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:uksouth failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-ujkg-4bwdk kubernetes.io/os:windows node.kubernetes.io/instance-type:Standard_D4s_v3 node.kubernetes.io/windows-build:10.0.20348 topology.disk.csi.azure.com/zone: topology.kubernetes.io/region:uksouth topology.kubernetes.io/zone:0] map[cluster.x-k8s.io/cluster-name:capz-ujkgt8 cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-ujkgt8-md-win-bf87d9d9-fhcvl cluster.x-k8s.io/owner-kind:MachineSet cluster.x-k8s.io/owner-name:capz-ujkgt8-md-win-bf87d9d9 csi.volume.kubernetes.io/nodeid:{"disk.csi.azure.com":"capz-ujkg-4bwdk"} kubeadm.alpha.kubernetes.io/cri-socket:npipe:////./pipe/containerd-containerd node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.1.0.7/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.108.65 projectcalico.org/VXLANTunnelMACAddr:00:15:5d:f8:e5:6a volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-21 01:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-04-21 01:33:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}} } {manager Update v1 2022-04-21 01:33:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {calico-node.exe Update v1 2022-04-21 01:35:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{},"f:projectcalico.org/VXLANTunnelMACAddr":{}}}} status} {Go-http-client Update v1 2022-04-21 01:39:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.disk.csi.azure.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-ujkgt8/providers/Microsoft.Compute/virtualMachines/capz-ujkg-4bwdk,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{17179398144 0} {<nil>} 16776756Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{123221307598 0} {<nil>} 123221307598 DecimalSI},memory: {{17074540544 0} {<nil>} 16674356Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-21 01:50:18 +0000 UTC,LastTransitionTime:2022-04-21 01:33:36 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-21 01:50:18 +0000 UTC,LastTransitionTime:2022-04-21 01:33:36 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-21 01:50:18 +0000 UTC,LastTransitionTime:2022-04-21 01:33:36 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-21 01:50:18 +0000 UTC,LastTransitionTime:2022-04-21 01:34:47 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-ujkg-4bwdk,},NodeAddress{Type:InternalIP,Address:10.1.0.7,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:capz-ujkg-4bwdk,SystemUUID:D3C5B8BB-F68E-46A6-9228-F3B907888DB1,BootID:,KernelVersion:10.0.20348.405,OSImage:Windows Server 2022 Datacenter,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:378d85bd8e7388a777d25009f8523d1e95a5f544f131eaada83171045d5b2c1e mcr.microsoft.com/windows/servercore:ltsc2022],SizeBytes:2226956779,},ContainerImage{Names:[docker.io/sigwindowstools/calico-install@sha256:141afecd724eb757ee41593cc73f35fb19a2ce13cad73179cf3b1cef81a637d1 docker.io/sigwindowstools/calico-install:v3.22.1-hostprocess],SizeBytes:148096127,},ContainerImage{Names:[capzci.azurecr.io/azuredisk-csi@sha256:8b61f82e22ddf844b45a1d609d1fe1d82eea0b4c89033366003f33d6224360af capzci.azurecr.io/azuredisk-csi:v1.17.0-05b24144f3393ee540257657394c2033ec7f1f49],SizeBytes:141767120,},ContainerImage{Names:[docker.io/sigwindowstools/calico-node@sha256:b8e6e2f190e58d6b61b7f2a19b0e2e17a377e5b9d7b9528e9b7953d9f9ab59bb docker.io/sigwindowstools/calico-node:v3.22.1-hostprocess],SizeBytes:128793648,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:dbec3a8166686b09b242176ab5b99e993da4126438bbce68147c3fd654f35662 mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.4.0],SizeBytes:125554391,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:c96a6255c42766f6b8bb1a7cda02b0060ab1b20b2e2dafcc64ec09e7646745a6 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.5.0],SizeBytes:124471446,},ContainerImage{Names:[ghcr.io/kubernetes-sigs/sig-windows/csi-proxy@sha256:96b4144986319a747ba599892454be2737aae6005d96b8e13ed481321ac3afba ghcr.io/kubernetes-sigs/sig-windows/csi-proxy:v1.0.2],SizeBytes:123925937,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:119397646,},ContainerImage{Names:[docker.io/sigwindowstools/kube-proxy@sha256:0f8a44b795d1824358f24cc56f0024d18a39ae044656686596d8b7fa6d78e1fa docker.io/sigwindowstools/kube-proxy:v1.23.5-calico-hostprocess],SizeBytes:116337721,},},VolumesInUse:[kubernetes.io/csi/disk.csi.azure.com^/subscriptions/===REDACTED===/resourceGroups/capz-ujkgt8/providers/Microsoft.Compute/disks/pvc-81fa0362-6d66-4c89-be03-3946897eb39d],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 21 01:53:54.917: INFO: Logging kubelet events for node capz-ujkg-4bwdk Apr 21 01:53:55.027: INFO: Logging pods the kubelet thinks is on node capz-ujkg-4bwdk Apr 21 01:53:55.220: INFO: calico-node-windows-ht75d started at 2022-04-21 01:33:36 +0000 UTC (1+2 container statuses recorded) Apr 21 01:53:55.220: INFO: Init container install-cni ready: true, restart count 0 Apr 21 01:53:55.220: INFO: Container calico-node-felix ready: true, restart count 1 Apr 21 01:53:55.220: INFO: Container calico-node-startup ready: true, restart count 0 Apr 21 01:53:55.220: INFO: kube-proxy-windows-nz9gl started at 2022-04-21 01:33:36 +0000 UTC (0+1 container statuses recorded) Apr 21 01:53:55.220: INFO: Container kube-proxy ready: true, restart count 0 Apr 21 01:53:55.220: INFO: csi-proxy-89w5b started at 2022-04-21 01:34:48 +0000 UTC (0+1 container statuses recorded) Apr 21 01:53:55.220: INFO: Container csi-proxy ready: true, restart count 0 Apr 21 01:53:55.220: INFO: csi-azuredisk-node-win-xfpks started at 2022-04-21 01:38:16 +0000 UTC (1+3 container statuses recorded) Apr 21 01:53:55.220: INFO: Init container init ready: true, restart count 0 Apr 21 01:53:55.220: INFO: Container azuredisk ready: true, restart count 0 Apr 21 01:53:55.220: INFO: Container liveness-probe ready: true, restart count 0 Apr 21 01:53:55.220: INFO: Container node-driver-registrar ready: true, restart count 0 Apr 21 01:53:55.673: INFO: Latency metrics for node capz-ujkg-4bwdk Apr 21 01:53:55.673: INFO: Logging node info for node capz-ujkg-m5lz7 Apr 21 01:53:55.789: INFO: Node Info: &Node{ObjectMeta:{capz-ujkg-m5lz7 ac24d73d-d479-4130-8c3c-9b78780c4e4b 3679 0 2022-04-21 01:34:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D4s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:uksouth failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-ujkg-m5lz7 kubernetes.io/os:windows node.kubernetes.io/instance-type:Standard_D4s_v3 node.kubernetes.io/windows-build:10.0.20348 topology.disk.csi.azure.com/zone: topology.kubernetes.io/region:uksouth topology.kubernetes.io/zone:0] map[cluster.x-k8s.io/cluster-name:capz-ujkgt8 cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-ujkgt8-md-win-bf87d9d9-87lvs cluster.x-k8s.io/owner-kind:MachineSet cluster.x-k8s.io/owner-name:capz-ujkgt8-md-win-bf87d9d9 csi.volume.kubernetes.io/nodeid:{"disk.csi.azure.com":"capz-ujkg-m5lz7"} kubeadm.alpha.kubernetes.io/cri-socket:npipe:////./pipe/containerd-containerd node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.1.0.6/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.2.1 projectcalico.org/VXLANTunnelMACAddr:00:15:5d:51:b4:51 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-21 01:34:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-04-21 01:34:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}} } {manager Update v1 2022-04-21 01:34:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {calico-node.exe Update v1 2022-04-21 01:36:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{},"f:projectcalico.org/VXLANTunnelMACAddr":{}}}} status} {Go-http-client Update v1 2022-04-21 01:41:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.disk.csi.azure.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-ujkgt8/providers/Microsoft.Compute/virtualMachines/capz-ujkg-m5lz7,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{17179398144 0} {<nil>} 16776756Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{123221307598 0} {<nil>} 123221307598 DecimalSI},memory: {{17074540544 0} {<nil>} 16674356Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-21 01:51:55 +0000 UTC,LastTransitionTime:2022-04-21 01:34:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-21 01:51:55 +0000 UTC,LastTransitionTime:2022-04-21 01:34:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-21 01:51:55 +0000 UTC,LastTransitionTime:2022-04-21 01:34:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-21 01:51:55 +0000 UTC,LastTransitionTime:2022-04-21 01:35:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-ujkg-m5lz7,},NodeAddress{Type:InternalIP,Address:10.1.0.6,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:capz-ujkg-m5lz7,SystemUUID:0BDE507E-D417-4F6E-9D2C-3CDB1935E3ED,BootID:,KernelVersion:10.0.20348.405,OSImage:Windows Server 2022 Datacenter,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/sigwindowstools/calico-install@sha256:141afecd724eb757ee41593cc73f35fb19a2ce13cad73179cf3b1cef81a637d1 docker.io/sigwindowstools/calico-install:v3.22.1-hostprocess],SizeBytes:148096127,},ContainerImage{Names:[capzci.azurecr.io/azuredisk-csi@sha256:8b61f82e22ddf844b45a1d609d1fe1d82eea0b4c89033366003f33d6224360af capzci.azurecr.io/azuredisk-csi:v1.17.0-05b24144f3393ee540257657394c2033ec7f1f49],SizeBytes:141767120,},ContainerImage{Names:[docker.io/sigwindowstools/calico-node@sha256:b8e6e2f190e58d6b61b7f2a19b0e2e17a377e5b9d7b9528e9b7953d9f9ab59bb docker.io/sigwindowstools/calico-node:v3.22.1-hostprocess],SizeBytes:128793648,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:dbec3a8166686b09b242176ab5b99e993da4126438bbce68147c3fd654f35662 mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.4.0],SizeBytes:125554391,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:c96a6255c42766f6b8bb1a7cda02b0060ab1b20b2e2dafcc64ec09e7646745a6 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.5.0],SizeBytes:124471446,},ContainerImage{Names:[ghcr.io/kubernetes-sigs/sig-windows/csi-proxy@sha256:96b4144986319a747ba599892454be2737aae6005d96b8e13ed481321ac3afba ghcr.io/kubernetes-sigs/sig-windows/csi-proxy:v1.0.2],SizeBytes:123925937,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:119397646,},ContainerImage{Names:[docker.io/sigwindowstools/kube-proxy@sha256:0f8a44b795d1824358f24cc56f0024d18a39ae044656686596d8b7fa6d78e1fa docker.io/sigwindowstools/kube-proxy:v1.23.5-calico-hostprocess],SizeBytes:116337721,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 21 01:53:55.789: INFO: Logging kubelet events for node capz-ujkg-m5lz7 Apr 21 01:53:55.897: INFO: Logging pods the kubelet thinks is on node capz-ujkg-m5lz7 Apr 21 01:53:56.074: INFO: csi-azuredisk-node-win-lw24r started at 2022-04-21 01:38:16 +0000 UTC (1+3 container statuses recorded) Apr 21 01:53:56.074: INFO: Init container init ready: true, restart count 0 Apr 21 01:53:56.075: INFO: Container azuredisk ready: true, restart count 0 Apr 21 01:53:56.075: INFO: Container liveness-probe ready: true, restart count 0 Apr 21 01:53:56.075: INFO: Container node-driver-registrar ready: true, restart count 0 Apr 21 01:53:56.075: INFO: kube-proxy-windows-877k8 started at 2022-04-21 01:34:33 +0000 UTC (0+1 container statuses recorded) Apr 21 01:53:56.075: INFO: Container kube-proxy ready: true, restart count 0 Apr 21 01:53:56.075: INFO: calico-node-windows-db82c started at 2022-04-21 01:34:33 +0000 UTC (1+2 container statuses recorded) Apr 21 01:53:56.075: INFO: Init container install-cni ready: true, restart count 0 Apr 21 01:53:56.075: INFO: Container calico-node-felix ready: true, restart count 1 Apr 21 01:53:56.075: INFO: Container calico-node-startup ready: true, restart count 0 Apr 21 01:53:56.075: INFO: csi-proxy-c4m28 started at 2022-04-21 01:35:55 +0000 UTC (0+1 container statuses recorded) Apr 21 01:53:56.075: INFO: Container csi-proxy ready: true, restart count 0 Apr 21 01:53:56.512: INFO: Latency metrics for node capz-ujkg-m5lz7 Apr 21 01:53:56.512: INFO: Logging node info for node capz-ujkgt8-control-plane-cl47z Apr 21 01:53:56.625: INFO: Node Info: &Node{ObjectMeta:{capz-ujkgt8-control-plane-cl47z dc255ec7-fbcb-44e8-bb61-aaa9aab6cdc6 3927 0 2022-04-21 01:32:01 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:uksouth failure-domain.beta.kubernetes.io/zone:uksouth-3 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-ujkgt8-control-plane-cl47z kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/master: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:Standard_D2s_v3 topology.kubernetes.io/region:uksouth topology.kubernetes.io/zone:uksouth-3] map[cluster.x-k8s.io/cluster-name:capz-ujkgt8 cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-ujkgt8-control-plane-s2kbx cluster.x-k8s.io/owner-kind:KubeadmControlPlane cluster.x-k8s.io/owner-name:capz-ujkgt8-control-plane kubeadm.alpha.kubernetes.io/cri-socket:/run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.0.4/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.189.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{manager Update v1 2022-04-21 01:32:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {Go-http-client Update v1 2022-04-21 01:32:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node-role.kubernetes.io/control-plane":{},"f:node-role.kubernetes.io/master":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-04-21 01:32:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:taints":{}}} } {Go-http-client Update v1 2022-04-21 01:32:42 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {calico-node Update v1 2022-04-21 01:32:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-ujkgt8/providers/Microsoft.Compute/virtualMachines/capz-ujkgt8-control-plane-cl47z,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{133018140672 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8340819968 0} {<nil>} 8145332Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{119716326407 0} {<nil>} 119716326407 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8235962368 0} {<nil>} 8042932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-04-21 01:32:45 +0000 UTC,LastTransitionTime:2022-04-21 01:32:45 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-21 01:53:37 +0000 UTC,LastTransitionTime:2022-04-21 01:31:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-21 01:53:37 +0000 UTC,LastTransitionTime:2022-04-21 01:31:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-21 01:53:37 +0000 UTC,LastTransitionTime:2022-04-21 01:31:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-21 01:53:37 +0000 UTC,LastTransitionTime:2022-04-21 01:32:31 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-ujkgt8-control-plane-cl47z,},NodeAddress{Type:InternalIP,Address:10.0.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:063b7120719c45629aafc0b2be24d1f6,SystemUUID:46aa3756-68fa-3141-a1c3-ff86f0e9917b,BootID:e19fd082-4950-4ed0-87a3-bcd4e17b5f63,KernelVersion:5.13.0-1017-azure,OSImage:Ubuntu 20.04.4 LTS,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 k8s.gcr.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[docker.io/calico/cni@sha256:2219eae79544b098119a06a8bb5608867f9ac00471592a00e2347f3ae4bea687 docker.io/calico/cni:v3.22.1],SizeBytes:80514590,},ContainerImage{Names:[docker.io/calico/node@sha256:1f8ed83e5264b4206cce7e1def11bca0b3ea7d5f4eb9b0ca0dbfc8cb968ca57e docker.io/calico/node:v3.22.1],SizeBytes:69647221,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:e42a0aba3637d123481cca14fd8314a482616593edf58f9594c9382e50498f9b docker.io/calico/kube-controllers:v3.22.1],SizeBytes:54948023,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:c1f625d115fbd9a12eac615653fc81c0edb33b2b5a76d1e09d5daed11fa557c1 k8s.gcr.io/kube-proxy:v1.23.5],SizeBytes:39278412,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:ddf5bf7196eb534271f9e5d403f4da19838d5610bb5ca191001bde5f32b5492e k8s.gcr.io/kube-apiserver:v1.23.5],SizeBytes:32603217,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:cca0fb3532abedcc95c5f64268d54da9ecc56cc4817ff08d0128941cf2b0e1a4 k8s.gcr.io/kube-controller-manager:v1.23.5],SizeBytes:30174093,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:489efb65da9edc40bf0911f3e6371e5bb6b8ad8fde1d55193a6cc84c2ef36626 k8s.gcr.io/kube-scheduler:v1.23.5],SizeBytes:15131395,},ContainerImage{Names:[k8s.gcr.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e k8s.gcr.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[docker.io/calico/pod2daemon-flexvol@sha256:35802ba083546a7c5e8b5bf0ee7ffad7f8a468e8c2b3631e7e9647512c94041d docker.io/calico/pod2daemon-flexvol:v3.22.1],SizeBytes:8462620,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 21 01:53:56.625: INFO: Logging kubelet events for node capz-ujkgt8-control-plane-cl47z Apr 21 01:53:56.733: INFO: Logging pods the kubelet thinks is on node capz-ujkgt8-control-plane-cl47z Apr 21 01:53:56.940: INFO: calico-kube-controllers-7c664f4648-czpdv started at 2022-04-21 01:32:32 +0000 UTC (0+1 container statuses recorded) Apr 21 01:53:56.941: INFO: Container calico-kube-controllers ready: true, restart count 0 Apr 21 01:53:56.941: INFO: etcd-capz-ujkgt8-control-plane-cl47z started at 2022-04-21 01:32:11 +0000 UTC (0+1 container statuses recorded) Apr 21 01:53:56.941: INFO: Container etcd ready: true, restart count 0 Apr 21 01:53:56.941: INFO: kube-apiserver-capz-ujkgt8-control-plane-cl47z started at 2022-04-21 01:31:52 +0000 UTC (0+1 container statuses recorded) Apr 21 01:53:56.941: INFO: Container kube-apiserver ready: true, restart count 0 Apr 21 01:53:56.941: INFO: kube-scheduler-capz-ujkgt8-control-plane-cl47z started at 2022-04-21 01:31:52 +0000 UTC (0+1 container statuses recorded) Apr 21 01:53:56.941: INFO: Container kube-scheduler ready: true, restart count 0 Apr 21 01:53:56.941: INFO: calico-node-2zdkr started at 2022-04-21 01:32:12 +0000 UTC (3+1 container statuses recorded) Apr 21 01:53:56.941: INFO: Init container upgrade-ipam ready: true, restart count 0 Apr 21 01:53:56.941: INFO: Init container install-cni ready: true, restart count 0 Apr 21 01:53:56.941: INFO: Init container flexvol-driver ready: true, restart count 0 Apr 21 01:53:56.941: INFO: Container calico-node ready: true, restart count 0 Apr 21 01:53:56.941: INFO: kube-controller-manager-capz-ujkgt8-control-plane-cl47z started at 2022-04-21 01:32:11 +0000 UTC (0+1 container statuses recorded) Apr 21 01:53:56.941: INFO: Container kube-controller-manager ready: true, restart count 0 Apr 21 01:53:56.941: INFO: kube-proxy-rq6jc started at 2022-04-21 01:32:12 +0000 UTC (0+1 container statuses recorded) Apr 21 01:53:56.941: INFO: Container kube-proxy ready: true, restart count 0 Apr 21 01:53:56.942: INFO: coredns-64897985d-j7h97 started at 2022-04-21 01:32:32 +0000 UTC (0+1 container statuses recorded) Apr 21 01:53:56.942: INFO: Container coredns ready: true, restart count 0 Apr 21 01:53:56.942: INFO: coredns-64897985d-h98fm started at 2022-04-21 01:32:32 +0000 UTC (0+1 container statuses recorded) Apr 21 01:53:56.942: INFO: Container coredns ready: true, restart count 0 Apr 21 01:53:57.362: INFO: Latency metrics for node capz-ujkgt8-control-plane-cl47z Apr 21 01:53:57.362: INFO: Logging node info for node capz-ujkgt8-md-0-b6278 Apr 21 01:53:57.472: INFO: Node Info: &Node{ObjectMeta:{capz-ujkgt8-md-0-b6278 cdb62964-9f61-46e3-a31f-d50bee6da5b3 3271 0 2022-04-21 01:33:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D4s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:uksouth failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-ujkgt8-md-0-b6278 kubernetes.io/os:linux node.kubernetes.io/instance-type:Standard_D4s_v3 topology.kubernetes.io/region:uksouth topology.kubernetes.io/zone:0] map[cluster.x-k8s.io/cluster-name:capz-ujkgt8 cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-ujkgt8-md-0-8685f8f496-plvfz cluster.x-k8s.io/owner-kind:MachineSet cluster.x-k8s.io/owner-name:capz-ujkgt8-md-0-8685f8f496 kubeadm.alpha.kubernetes.io/cri-socket:/run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.1.0.5/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.164.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-21 01:33:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {manager Update v1 2022-04-21 01:33:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {kube-controller-manager Update v1 2022-04-21 01:33:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}} } {calico-node Update v1 2022-04-21 01:33:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {Go-http-client Update v1 2022-04-21 01:33:49 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-ujkgt8/providers/Microsoft.Compute/virtualMachines/capz-ujkgt8-md-0-b6278,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{133018140672 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16783433728 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{119716326407 0} {<nil>} 119716326407 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16678576128 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-04-21 01:33:45 +0000 UTC,LastTransitionTime:2022-04-21 01:33:45 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-21 01:49:08 +0000 UTC,LastTransitionTime:2022-04-21 01:33:19 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-21 01:49:08 +0000 UTC,LastTransitionTime:2022-04-21 01:33:19 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-21 01:49:08 +0000 UTC,LastTransitionTime:2022-04-21 01:33:19 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-21 01:49:08 +0000 UTC,LastTransitionTime:2022-04-21 01:33:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-ujkgt8-md-0-b6278,},NodeAddress{Type:InternalIP,Address:10.1.0.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:803104d15f4a4263a1112d9167377c90,SystemUUID:ea1d1216-8797-6846-b6c8-015d470de973,BootID:a82f8760-8259-44a3-a69e-9afa51a10a4e,KernelVersion:5.13.0-1017-azure,OSImage:Ubuntu 20.04.4 LTS,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 k8s.gcr.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[docker.io/calico/cni@sha256:2219eae79544b098119a06a8bb5608867f9ac00471592a00e2347f3ae4bea687 docker.io/calico/cni:v3.22.1],SizeBytes:80514590,},ContainerImage{Names:[docker.io/calico/node@sha256:1f8ed83e5264b4206cce7e1def11bca0b3ea7d5f4eb9b0ca0dbfc8cb968ca57e docker.io/calico/node:v3.22.1],SizeBytes:69647221,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:c1f625d115fbd9a12eac615653fc81c0edb33b2b5a76d1e09d5daed11fa557c1 k8s.gcr.io/kube-proxy:v1.23.5],SizeBytes:39278412,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:ddf5bf7196eb534271f9e5d403f4da19838d5610bb5ca191001bde5f32b5492e k8s.gcr.io/kube-apiserver:v1.23.5],SizeBytes:32603217,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:cca0fb3532abedcc95c5f64268d54da9ecc56cc4817ff08d0128941cf2b0e1a4 k8s.gcr.io/kube-controller-manager:v1.23.5],SizeBytes:30174093,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:489efb65da9edc40bf0911f3e6371e5bb6b8ad8fde1d55193a6cc84c2ef36626 k8s.gcr.io/kube-scheduler:v1.23.5],SizeBytes:15131395,},ContainerImage{Names:[k8s.gcr.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e k8s.gcr.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[docker.io/calico/pod2daemon-flexvol@sha256:35802ba083546a7c5e8b5bf0ee7ffad7f8a468e8c2b3631e7e9647512c94041d docker.io/calico/pod2daemon-flexvol:v3.22.1],SizeBytes:8462620,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 21 01:53:57.472: INFO: Logging kubelet events for node capz-ujkgt8-md-0-b6278 Apr 21 01:53:57.581: INFO: Logging pods the kubelet thinks is on node capz-ujkgt8-md-0-b6278 Apr 21 01:53:57.724: INFO: kube-proxy-f8vsn started at 2022-04-21 01:33:19 +0000 UTC (0+1 container statuses recorded) Apr 21 01:53:57.724: INFO: Container kube-proxy ready: true, restart count 0 Apr 21 01:53:57.724: INFO: calico-node-p2n8g started at 2022-04-21 01:33:19 +0000 UTC (3+1 container statuses recorded) Apr 21 01:53:57.724: INFO: Init container upgrade-ipam ready: true, restart count 0 Apr 21 01:53:57.724: INFO: Init container install-cni ready: true, restart count 0 Apr 21 01:53:57.724: INFO: Init container flexvol-driver ready: true, restart count 0 Apr 21 01:53:57.724: INFO: Container calico-node ready: true, restart count 0 Apr 21 01:53:58.129: INFO: Latency metrics for node capz-ujkgt8-md-0-b6278 Apr 21 01:53:58.129: INFO: Logging node info for node capz-ujkgt8-md-0-sz85g Apr 21 01:53:58.240: INFO: Node Info: &Node{ObjectMeta:{capz-ujkgt8-md-0-sz85g 6297b725-1dd1-45ad-bdc0-488f88f104eb 3317 0 2022-04-21 01:33:04 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D4s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:uksouth failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-ujkgt8-md-0-sz85g kubernetes.io/os:linux node.kubernetes.io/instance-type:Standard_D4s_v3 topology.kubernetes.io/region:uksouth topology.kubernetes.io/zone:0] map[cluster.x-k8s.io/cluster-name:capz-ujkgt8 cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-ujkgt8-md-0-8685f8f496-4s79c cluster.x-k8s.io/owner-kind:MachineSet cluster.x-k8s.io/owner-name:capz-ujkgt8-md-0-8685f8f496 kubeadm.alpha.kubernetes.io/cri-socket:/run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.1.0.4/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.88.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-21 01:33:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-04-21 01:33:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}} } {manager Update v1 2022-04-21 01:33:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {calico-node Update v1 2022-04-21 01:33:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {Go-http-client Update v1 2022-04-21 01:33:35 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-ujkgt8/providers/Microsoft.Compute/virtualMachines/capz-ujkgt8-md-0-sz85g,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{133018140672 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16783433728 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{119716326407 0} {<nil>} 119716326407 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16678576128 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-04-21 01:33:29 +0000 UTC,LastTransitionTime:2022-04-21 01:33:29 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-21 01:49:25 +0000 UTC,LastTransitionTime:2022-04-21 01:33:04 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-21 01:49:25 +0000 UTC,LastTransitionTime:2022-04-21 01:33:04 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-21 01:49:25 +0000 UTC,LastTransitionTime:2022-04-21 01:33:04 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-21 01:49:25 +0000 UTC,LastTransitionTime:2022-04-21 01:33:24 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-ujkgt8-md-0-sz85g,},NodeAddress{Type:InternalIP,Address:10.1.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:5dea6b2b8d384d79aca166e53fc43ab8,SystemUUID:7932c715-ed1f-4443-ab3d-9a8dd2cb8fc8,BootID:d3183c24-32e3-43d9-8c3f-27f506ecdaca,KernelVersion:5.13.0-1017-azure,OSImage:Ubuntu 20.04.4 LTS,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[capzci.azurecr.io/azuredisk-csi@sha256:8b61f82e22ddf844b45a1d609d1fe1d82eea0b4c89033366003f33d6224360af capzci.azurecr.io/azuredisk-csi:v1.17.0-05b24144f3393ee540257657394c2033ec7f1f49],SizeBytes:99251114,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 k8s.gcr.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[docker.io/calico/cni@sha256:2219eae79544b098119a06a8bb5608867f9ac00471592a00e2347f3ae4bea687 docker.io/calico/cni:v3.22.1],SizeBytes:80514590,},ContainerImage{Names:[docker.io/calico/node@sha256:1f8ed83e5264b4206cce7e1def11bca0b3ea7d5f4eb9b0ca0dbfc8cb968ca57e docker.io/calico/node:v3.22.1],SizeBytes:69647221,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner@sha256:542c9258a1441e4927883ea73425e21f9a14043a649686bf6b51700f34c64f8e mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v3.1.0],SizeBytes:59205633,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-resizer@sha256:ab6c2e18a4d943f2bf8688e1779622277a1d14c355c9d4bfc0d761d86c5108b3 mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.4.0],SizeBytes:56924121,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-attacher@sha256:19fbca01394f7ed80151731180cfde0a3367f038beae2a97cda7928034010057 mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v3.4.0],SizeBytes:56301028,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:c1f625d115fbd9a12eac615653fc81c0edb33b2b5a76d1e09d5daed11fa557c1 k8s.gcr.io/kube-proxy:v1.23.5],SizeBytes:39278412,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:ddf5bf7196eb534271f9e5d403f4da19838d5610bb5ca191001bde5f32b5492e k8s.gcr.io/kube-apiserver:v1.23.5],SizeBytes:32603217,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:cca0fb3532abedcc95c5f64268d54da9ecc56cc4817ff08d0128941cf2b0e1a4 k8s.gcr.io/kube-controller-manager:v1.23.5],SizeBytes:30174093,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:a889e925e15f9423f7842f1b769f64cbcf6a20b6956122836fc835cf22d9073f mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v5.0.1],SizeBytes:22192414,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:489efb65da9edc40bf0911f3e6371e5bb6b8ad8fde1d55193a6cc84c2ef36626 k8s.gcr.io/kube-scheduler:v1.23.5],SizeBytes:15131395,},ContainerImage{Names:[k8s.gcr.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e k8s.gcr.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[docker.io/calico/pod2daemon-flexvol@sha256:35802ba083546a7c5e8b5bf0ee7ffad7f8a468e8c2b3631e7e9647512c94041d docker.io/calico/pod2daemon-flexvol:v3.22.1],SizeBytes:8462620,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:c96a6255c42766f6b8bb1a7cda02b0060ab1b20b2e2dafcc64ec09e7646745a6 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.5.0],SizeBytes:8222208,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 21 01:53:58.241: INFO: Logging kubelet events for node capz-ujkgt8-md-0-sz85g Apr 21 01:53:58.350: INFO: Logging pods the kubelet thinks is on node capz-ujkgt8-md-0-sz85g Apr 21 01:53:58.509: INFO: kube-proxy-httdl started at 2022-04-21 01:33:05 +0000 UTC (0+1 container statuses recorded) Apr 21 01:53:58.509: INFO: Container kube-proxy ready: true, restart count 0 Apr 21 01:53:58.509: INFO: calico-node-jfr6j started at 2022-04-21 01:33:05 +0000 UTC (3+1 container statuses recorded) Apr 21 01:53:58.509: INFO: Init container upgrade-ipam ready: true, restart count 0 Apr 21 01:53:58.509: INFO: Init container install-cni ready: true, restart count 0 Apr 21 01:53:58.509: INFO: Init container flexvol-driver ready: true, restart count 0 Apr 21 01:53:58.509: INFO: Container calico-node ready: true, restart count 0 Apr 21 01:53:58.509: INFO: csi-azuredisk-controller-5f5b9cc587-sglc7 started at 2022-04-21 01:38:16 +0000 UTC (0+6 container statuses recorded) Apr 21 01:53:58.509: INFO: Container azuredisk ready: true, restart count 0 Apr 21 01:53:58.509: INFO: Container csi-attacher ready: true, restart count 0 Apr 21 01:53:58.509: INFO: Container csi-provisioner ready: true, restart count 0 Apr 21 01:53:58.509: INFO: Container csi-resizer ready: true, restart count 0 Apr 21 01:53:58.509: INFO: Container csi-snapshotter ready: true, restart count 0 Apr 21 01:53:58.509: INFO: Container liveness-probe ready: true, restart count 0 Apr 21 01:53:58.918: INFO: Latency metrics for node capz-ujkgt8-md-0-sz85g Apr 21 01:53:58.919: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "azuredisk-8081" for this suite.
Find azuredisk-volume-tester-q5dbd mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=AzureDisk\sCSI\sDriver\sEnd\-to\-End\sTests\sPre\-Provisioned\s\[single\-az\]\sshould\ssucceed\swhen\sreattaching\sa\sdisk\sto\sa\snew\snode\son\sDanglingAttachError\s\[disk\.csi\.azure\.com\]$'
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning_test.go:249 Unexpected error: <*errors.errorString | 0xc000d26380>: { s: "pod \"azuredisk-volume-tester-gkrnd\" failed with status: {Phase:Failed Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 02:31:07 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 02:31:07 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 02:31:07 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 02:31:07 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:10.1.0.6 PodIP:192.168.2.3 PodIPs:[{IP:192.168.2.3}] StartTime:2022-04-21 02:31:07 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:volume-tester State:{Waiting:&ContainerStateWaiting{Reason:RunContainerError,Message:context deadline exceeded,} Running:nil Terminated:nil} LastTerminationState:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:0,Signal:0,Reason:,Message:,StartedAt:0001-01-01 00:00:00 +0000 UTC,FinishedAt:0001-01-01 00:00:00 +0000 UTC,ContainerID:containerd://622532d747fed8ebe1d46c17db821f86d06e8aa0d246b47b0eb6fd160ad068ac,}} Ready:false RestartCount:0 Image:mcr.microsoft.com/windows/servercore:ltsc2022 ImageID:mcr.microsoft.com/windows/servercore@sha256:378d85bd8e7388a777d25009f8523d1e95a5f544f131eaada83171045d5b2c1e ContainerID:containerd://622532d747fed8ebe1d46c17db821f86d06e8aa0d246b47b0eb6fd160ad068ac Started:0xc000c93c08}] QOSClass:BestEffort EphemeralContainerStatuses:[]}", } pod "azuredisk-volume-tester-gkrnd" failed with status: {Phase:Failed Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 02:31:07 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 02:31:07 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 02:31:07 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-tester]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-04-21 02:31:07 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:10.1.0.6 PodIP:192.168.2.3 PodIPs:[{IP:192.168.2.3}] StartTime:2022-04-21 02:31:07 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:volume-tester State:{Waiting:&ContainerStateWaiting{Reason:RunContainerError,Message:context deadline exceeded,} Running:nil Terminated:nil} LastTerminationState:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:0,Signal:0,Reason:,Message:,StartedAt:0001-01-01 00:00:00 +0000 UTC,FinishedAt:0001-01-01 00:00:00 +0000 UTC,ContainerID:containerd://622532d747fed8ebe1d46c17db821f86d06e8aa0d246b47b0eb6fd160ad068ac,}} Ready:false RestartCount:0 Image:mcr.microsoft.com/windows/servercore:ltsc2022 ImageID:mcr.microsoft.com/windows/servercore@sha256:378d85bd8e7388a777d25009f8523d1e95a5f544f131eaada83171045d5b2c1e ContainerID:containerd://622532d747fed8ebe1d46c17db821f86d06e8aa0d246b47b0eb6fd160ad068ac Started:0xc000c93c08}] QOSClass:BestEffort EphemeralContainerStatuses:[]} occurred /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/testsuites/testsuites.go:807from junit_01.xml
�[1mSTEP�[0m: Creating a kubernetes client Apr 21 02:30:53.527: INFO: >>> kubeConfig: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig �[1mSTEP�[0m: Building a namespace api object, basename azuredisk �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace �[1mSTEP�[0m: Successfully provisioned a shared disk volume: "/subscriptions/===REDACTED===/resourceGroups/capz-ujkgt8/providers/Microsoft.Compute/disks/reattach-disk-multiple-nodes" �[1mSTEP�[0m: setting up the PV �[1mSTEP�[0m: creating a PV �[1mSTEP�[0m: setting up the PVC �[1mSTEP�[0m: creating a PVC �[1mSTEP�[0m: waiting for PVC to be in phase "Bound" Apr 21 02:30:58.052: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-964br] to have phase Bound Apr 21 02:30:58.156: INFO: PersistentVolumeClaim pvc-964br found and phase=Bound (103.829238ms) �[1mSTEP�[0m: checking the PVC �[1mSTEP�[0m: validating provisioned PV �[1mSTEP�[0m: checking the PV �[1mSTEP�[0m: attaching disk to node#0 �[1mSTEP�[0m: deploying the pod �[1mSTEP�[0m: checking that the pod's command exits with no error Apr 21 02:31:07.603: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-gkrnd" in namespace "azuredisk-1853" to be "Succeeded or Failed" Apr 21 02:31:07.706: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 103.242847ms Apr 21 02:31:09.810: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 2.207435967s Apr 21 02:31:11.914: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 4.311175398s Apr 21 02:31:14.018: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 6.415172859s Apr 21 02:31:16.122: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 8.519436291s Apr 21 02:31:18.226: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 10.623790962s Apr 21 02:31:20.331: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 12.728830053s Apr 21 02:31:22.438: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 14.834964025s Apr 21 02:31:24.542: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 16.939341333s Apr 21 02:31:26.648: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 19.045028863s Apr 21 02:31:28.754: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 21.151141652s Apr 21 02:31:30.859: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 23.255951491s Apr 21 02:31:32.963: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 25.360808501s Apr 21 02:31:35.069: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 27.466600581s Apr 21 02:31:37.173: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 29.570778471s Apr 21 02:31:39.279: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 31.676506122s Apr 21 02:31:41.384: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 33.781696981s Apr 21 02:31:43.489: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 35.886586129s Apr 21 02:31:45.594: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 37.991775577s Apr 21 02:31:47.703: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 40.100490682s Apr 21 02:31:49.810: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 42.207508975s Apr 21 02:31:51.919: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 44.316518505s Apr 21 02:31:54.027: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 46.4239071s Apr 21 02:31:56.134: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 48.531437821s Apr 21 02:31:58.241: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 50.638777298s Apr 21 02:32:00.350: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 52.747180762s Apr 21 02:32:02.458: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 54.854986061s Apr 21 02:32:04.565: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 56.962781765s Apr 21 02:32:06.674: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 59.071861186s Apr 21 02:32:08.782: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m1.179828717s Apr 21 02:32:10.892: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m3.289080895s Apr 21 02:32:12.999: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m5.396488813s Apr 21 02:32:15.108: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m7.505162317s Apr 21 02:32:17.217: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m9.613892345s Apr 21 02:32:19.325: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m11.72189185s Apr 21 02:32:21.434: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m13.830896138s Apr 21 02:32:23.543: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m15.939937662s Apr 21 02:32:25.651: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.048516251s Apr 21 02:32:27.759: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.156160434s Apr 21 02:32:29.866: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.263565838s Apr 21 02:32:31.978: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.375113858s Apr 21 02:32:34.086: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.483630478s Apr 21 02:32:36.194: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.590970465s Apr 21 02:32:38.303: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.70055562s Apr 21 02:32:40.412: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.808989478s Apr 21 02:32:42.520: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.917383143s Apr 21 02:32:44.628: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m37.025291908s Apr 21 02:32:46.737: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m39.13388403s Apr 21 02:32:48.846: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m41.243493628s Apr 21 02:32:50.954: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m43.351226785s Apr 21 02:32:53.061: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m45.458848409s Apr 21 02:32:55.178: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m47.575209759s Apr 21 02:32:57.288: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m49.685803232s Apr 21 02:32:59.398: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m51.795560129s Apr 21 02:33:01.505: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m53.902701245s Apr 21 02:33:03.613: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.010466321s Apr 21 02:33:05.722: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.119157248s Apr 21 02:33:07.831: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.228205805s Apr 21 02:33:09.939: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.336070387s Apr 21 02:33:12.047: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.444694217s Apr 21 02:33:14.155: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.552279596s Apr 21 02:33:16.263: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.660114198s Apr 21 02:33:18.372: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.769422984s Apr 21 02:33:20.481: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.878055043s Apr 21 02:33:22.590: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.986990225s Apr 21 02:33:24.697: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m17.094574637s Apr 21 02:33:26.805: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m19.201980394s Apr 21 02:33:28.913: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m21.310250081s Apr 21 02:33:31.020: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m23.417008307s Apr 21 02:33:33.128: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m25.524955857s Apr 21 02:33:35.236: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m27.632931268s Apr 21 02:33:37.346: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m29.743555114s Apr 21 02:33:39.455: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m31.852417478s Apr 21 02:33:41.562: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m33.95971494s Apr 21 02:33:43.670: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.067813165s Apr 21 02:33:45.783: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.180653632s Apr 21 02:33:47.893: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.289954947s Apr 21 02:33:50.000: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.397596786s Apr 21 02:33:52.108: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.50519051s Apr 21 02:33:54.216: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.613767272s Apr 21 02:33:56.324: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.72166784s Apr 21 02:33:58.433: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.830108258s Apr 21 02:34:00.541: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.938848786s Apr 21 02:34:02.648: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m55.045819683s Apr 21 02:34:04.757: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m57.154458038s Apr 21 02:34:06.866: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m59.263280749s Apr 21 02:34:08.975: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m1.37261401s Apr 21 02:34:11.083: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m3.480611981s Apr 21 02:34:13.192: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m5.589303427s Apr 21 02:34:15.302: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m7.698985662s Apr 21 02:34:17.411: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m9.808318479s Apr 21 02:34:19.519: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m11.916235148s Apr 21 02:34:21.634: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.031813722s Apr 21 02:34:23.743: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.140695205s Apr 21 02:34:25.853: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.250337206s Apr 21 02:34:27.961: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.358674912s Apr 21 02:34:30.070: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.467042477s Apr 21 02:34:32.178: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.575480422s Apr 21 02:34:34.286: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.682890387s Apr 21 02:34:36.393: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.790596074s Apr 21 02:34:38.501: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.898294611s Apr 21 02:34:40.608: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m33.005799614s Apr 21 02:34:42.716: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m35.11300817s Apr 21 02:34:44.824: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m37.221464021s Apr 21 02:34:46.932: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m39.329824186s Apr 21 02:34:49.054: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m41.451001197s Apr 21 02:34:51.162: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m43.559386812s Apr 21 02:34:53.270: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m45.666969104s Apr 21 02:34:55.379: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m47.776436391s Apr 21 02:34:57.487: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m49.883943428s Apr 21 02:34:59.594: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m51.991330737s Apr 21 02:35:01.702: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.098985742s Apr 21 02:35:03.810: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.207131858s Apr 21 02:35:05.917: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.314579718s Apr 21 02:35:08.024: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.421114362s Apr 21 02:35:10.131: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.528638361s Apr 21 02:35:12.240: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.637413167s Apr 21 02:35:14.347: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.744459223s Apr 21 02:35:16.454: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.851731866s Apr 21 02:35:18.563: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.960556259s Apr 21 02:35:20.672: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m13.069387209s Apr 21 02:35:22.780: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m15.177611371s Apr 21 02:35:24.889: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m17.286196854s Apr 21 02:35:26.997: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m19.394410678s Apr 21 02:35:29.109: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m21.506039722s Apr 21 02:35:31.217: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m23.614196714s Apr 21 02:35:33.325: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m25.722365122s Apr 21 02:35:35.433: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m27.830097985s Apr 21 02:35:37.540: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m29.937164446s Apr 21 02:35:39.649: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.046040095s Apr 21 02:35:41.757: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.154297533s Apr 21 02:35:43.864: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.261781771s Apr 21 02:35:45.974: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.371001393s Apr 21 02:35:48.082: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.4792529s Apr 21 02:35:50.190: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.586929348s Apr 21 02:35:52.297: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.694057455s Apr 21 02:35:54.404: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.801541333s Apr 21 02:35:56.512: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.908901712s Apr 21 02:35:58.620: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m51.017686198s Apr 21 02:36:00.728: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m53.12527824s Apr 21 02:36:02.836: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m55.232958657s Apr 21 02:36:04.943: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m57.340583271s Apr 21 02:36:07.051: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m59.448367713s Apr 21 02:36:09.159: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m1.556787454s Apr 21 02:36:11.268: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m3.664927086s Apr 21 02:36:13.376: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m5.773013328s Apr 21 02:36:15.484: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m7.881519904s Apr 21 02:36:17.591: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m9.988755824s Apr 21 02:36:19.700: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m12.09745656s Apr 21 02:36:21.807: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m14.20411165s Apr 21 02:36:23.915: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m16.312503602s Apr 21 02:36:26.023: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m18.42016832s Apr 21 02:36:28.131: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m20.528127027s Apr 21 02:36:30.240: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m22.636920689s Apr 21 02:36:32.347: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m24.744282987s Apr 21 02:36:34.454: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m26.851774084s Apr 21 02:36:36.562: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m28.959310164s Apr 21 02:36:38.669: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m31.066017876s Apr 21 02:36:40.777: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m33.174194228s Apr 21 02:36:42.885: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m35.282148774s Apr 21 02:36:44.992: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m37.389552924s Apr 21 02:36:47.106: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m39.503630712s Apr 21 02:36:49.214: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m41.611431511s Apr 21 02:36:51.321: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m43.718840623s Apr 21 02:36:53.430: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m45.827258792s Apr 21 02:36:55.550: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m47.947155521s Apr 21 02:36:57.658: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m50.055032903s Apr 21 02:36:59.767: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m52.164552523s Apr 21 02:37:01.876: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m54.272907832s Apr 21 02:37:03.983: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m56.380593308s Apr 21 02:37:06.091: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m58.4880595s Apr 21 02:37:08.198: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m0.595782216s Apr 21 02:37:10.310: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m2.707346841s Apr 21 02:37:12.418: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m4.815579536s Apr 21 02:37:14.527: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m6.923950087s Apr 21 02:37:16.634: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m9.031443057s Apr 21 02:37:18.741: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m11.138642897s Apr 21 02:37:20.850: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m13.247016514s Apr 21 02:37:22.957: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m15.354272422s Apr 21 02:37:25.065: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m17.462264699s Apr 21 02:37:27.173: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m19.570260747s Apr 21 02:37:29.281: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m21.678786397s Apr 21 02:37:31.390: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m23.78691045s Apr 21 02:37:33.497: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m25.894861451s Apr 21 02:37:35.606: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m28.002955093s Apr 21 02:37:37.713: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m30.110495925s Apr 21 02:37:39.821: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m32.218557466s Apr 21 02:37:41.928: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m34.325661532s Apr 21 02:37:44.036: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m36.433336402s Apr 21 02:37:46.143: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m38.540233255s Apr 21 02:37:48.252: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m40.649377484s Apr 21 02:37:50.360: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m42.75776025s Apr 21 02:37:52.468: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m44.865331016s Apr 21 02:37:54.575: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m46.972687881s Apr 21 02:37:56.684: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m49.081290785s Apr 21 02:37:58.793: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m51.189967654s Apr 21 02:38:00.901: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m53.298080185s Apr 21 02:38:03.008: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m55.405620945s Apr 21 02:38:05.117: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m57.514373408s Apr 21 02:38:07.230: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 6m59.627233884s Apr 21 02:38:09.338: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 7m1.735126399s Apr 21 02:38:11.445: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 7m3.842599216s Apr 21 02:38:13.554: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 7m5.951229563s Apr 21 02:38:15.662: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 7m8.059232545s Apr 21 02:38:17.772: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 7m10.169853593s Apr 21 02:38:19.883: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 7m12.280607996s Apr 21 02:38:21.991: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Pending", Reason="", readiness=false. Elapsed: 7m14.388262635s Apr 21 02:38:24.098: INFO: Pod "azuredisk-volume-tester-gkrnd": Phase="Failed", Reason="", readiness=false. Elapsed: 7m16.495850692s Apr 21 02:38:24.105: INFO: deleting Pod "azuredisk-1853"/"azuredisk-volume-tester-gkrnd" Apr 21 02:38:24.231: INFO: Pod azuredisk-volume-tester-gkrnd has the following logs: �[1mSTEP�[0m: Deleting pod azuredisk-volume-tester-gkrnd in namespace azuredisk-1853 Apr 21 02:38:24.574: INFO: deleting PVC "azuredisk-1853"/"pvc-964br" Apr 21 02:38:24.574: INFO: Deleting PersistentVolumeClaim "pvc-964br" Apr 21 02:38:24.682: INFO: Waiting up to 5m0s for PersistentVolumeClaim azuredisk-1853 to be removed Apr 21 02:38:24.784: INFO: Claim "azuredisk-1853" in namespace "pvc-964br" doesn't exist in the system �[1mSTEP�[0m: deleting PV "azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s" Apr 21 02:38:24.784: INFO: Deleting PersistentVolume "azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s" �[1mSTEP�[0m: waiting for claim's PV "azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s" to be deleted Apr 21 02:38:24.890: INFO: Waiting up to 10m0s for PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s to get deleted Apr 21 02:38:24.993: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (103.085338ms) Apr 21 02:38:30.097: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (5.207424001s) Apr 21 02:38:35.205: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (10.315018872s) Apr 21 02:38:40.310: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (15.419790213s) Apr 21 02:38:45.417: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (20.526910693s) Apr 21 02:38:50.524: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (25.63464507s) Apr 21 02:38:55.629: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (30.738831967s) Apr 21 02:39:00.734: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (35.843842015s) Apr 21 02:39:05.839: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (40.948763602s) Apr 21 02:39:10.944: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (46.053686519s) Apr 21 02:39:16.048: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (51.157912276s) Apr 21 02:39:21.152: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (56.262153625s) Apr 21 02:39:26.257: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (1m1.366677032s) Apr 21 02:39:31.361: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (1m6.471606213s) Apr 21 02:39:36.467: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (1m11.57706494s) Apr 21 02:39:41.572: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (1m16.682363405s) Apr 21 02:39:46.676: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (1m21.786424668s) Apr 21 02:39:51.780: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (1m26.890562094s) Apr 21 02:39:56.887: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (1m31.996915084s) Apr 21 02:40:01.992: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (1m37.102374209s) Apr 21 02:40:07.097: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (1m42.207156016s) Apr 21 02:40:12.202: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (1m47.312368855s) Apr 21 02:40:17.308: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (1m52.418026159s) Apr 21 02:40:22.413: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (1m57.523280437s) Apr 21 02:40:27.517: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (2m2.627225933s) Apr 21 02:40:32.622: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (2m7.732601101s) Apr 21 02:40:37.727: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (2m12.837386685s) Apr 21 02:40:42.833: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (2m17.943406107s) Apr 21 02:40:47.941: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (2m23.050891417s) Apr 21 02:40:53.045: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (2m28.155252739s) Apr 21 02:40:58.151: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (2m33.261396095s) Apr 21 02:41:03.256: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (2m38.36589949s) Apr 21 02:41:08.361: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (2m43.471491028s) Apr 21 02:41:13.465: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (2m48.575277769s) Apr 21 02:41:18.569: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (2m53.679308717s) Apr 21 02:41:23.673: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (2m58.783243616s) Apr 21 02:41:28.777: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (3m3.887274229s) Apr 21 02:41:33.888: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (3m8.998068587s) Apr 21 02:41:38.992: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (3m14.102663176s) Apr 21 02:41:44.097: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (3m19.206946858s) Apr 21 02:41:49.203: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (3m24.313495315s) Apr 21 02:41:54.309: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (3m29.41887189s) Apr 21 02:41:59.416: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (3m34.526338094s) Apr 21 02:42:04.523: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (3m39.633117239s) Apr 21 02:42:09.628: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (3m44.73818601s) Apr 21 02:42:14.735: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (3m49.845191121s) Apr 21 02:42:19.842: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (3m54.951684474s) Apr 21 02:42:24.951: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (4m0.061051038s) Apr 21 02:42:30.058: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (4m5.167865614s) Apr 21 02:42:35.166: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (4m10.275805912s) Apr 21 02:42:40.273: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (4m15.383386362s) Apr 21 02:42:45.377: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (4m20.487267372s) Apr 21 02:42:50.485: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (4m25.595642149s) Apr 21 02:42:55.593: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (4m30.703320542s) Apr 21 02:43:00.698: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (4m35.807951654s) Apr 21 02:43:05.802: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (4m40.912048007s) Apr 21 02:43:10.907: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (4m46.016863268s) Apr 21 02:43:16.011: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (4m51.121189711s) Apr 21 02:43:21.117: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (4m56.226809675s) Apr 21 02:43:26.221: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (5m1.331476488s) Apr 21 02:43:31.327: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (5m6.436931416s) Apr 21 02:43:36.431: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (5m11.541463533s) Apr 21 02:43:41.535: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (5m16.64563498s) Apr 21 02:43:46.640: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (5m21.750251849s) Apr 21 02:43:51.745: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (5m26.85538542s) Apr 21 02:43:56.850: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (5m31.960459266s) Apr 21 02:44:01.956: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (5m37.066654554s) Apr 21 02:44:07.061: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (5m42.171212237s) Apr 21 02:44:12.166: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (5m47.275765168s) Apr 21 02:44:17.270: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (5m52.380244192s) Apr 21 02:44:22.375: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (5m57.48517049s) Apr 21 02:44:27.482: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s found and phase=Released (6m2.59179416s) Apr 21 02:44:32.586: INFO: PersistentVolume azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s was removed �[1mSTEP�[0m: Collecting events from namespace "azuredisk-1853". �[1mSTEP�[0m: Found 11 events. Apr 21 02:44:32.698: INFO: At 2022-04-21 02:31:07 +0000 UTC - event for azuredisk-volume-tester-gkrnd: {default-scheduler } Scheduled: Successfully assigned azuredisk-1853/azuredisk-volume-tester-gkrnd to capz-ujkg-m5lz7 Apr 21 02:44:32.698: INFO: At 2022-04-21 02:31:12 +0000 UTC - event for azuredisk-volume-tester-gkrnd: {attachdetach-controller } FailedAttachVolume: AttachVolume.Attach failed for volume "azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s" : rpc error: code = Unknown desc = Attach volume /subscriptions/===REDACTED===/resourceGroups/capz-ujkgt8/providers/Microsoft.Compute/disks/reattach-disk-multiple-nodes to instance capz-ujkg-m5lz7 failed with disk(/subscriptions/===REDACTED===/resourceGroups/capz-ujkgt8/providers/Microsoft.Compute/disks/reattach-disk-multiple-nodes) already attached to node(/subscriptions/===REDACTED===/resourceGroups/capz-ujkgt8/providers/Microsoft.Compute/virtualMachines/capz-ujkg-4bwdk), could not be attached to node(capz-ujkg-m5lz7) Apr 21 02:44:32.698: INFO: At 2022-04-21 02:31:17 +0000 UTC - event for azuredisk-volume-tester-gkrnd: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "azuredisk-1853-disk.csi.azure.com-preprovisioned-pv-4hd4s" Apr 21 02:44:32.698: INFO: At 2022-04-21 02:31:49 +0000 UTC - event for azuredisk-volume-tester-gkrnd: {kubelet capz-ujkg-m5lz7} Pulling: Pulling image "mcr.microsoft.com/windows/servercore:ltsc2022" Apr 21 02:44:32.698: INFO: At 2022-04-21 02:36:22 +0000 UTC - event for azuredisk-volume-tester-gkrnd: {kubelet capz-ujkg-m5lz7} Pulled: Successfully pulled image "mcr.microsoft.com/windows/servercore:ltsc2022" in 4m32.480331s Apr 21 02:44:32.698: INFO: At 2022-04-21 02:36:22 +0000 UTC - event for azuredisk-volume-tester-gkrnd: {kubelet capz-ujkg-m5lz7} Created: Created container volume-tester Apr 21 02:44:32.698: INFO: At 2022-04-21 02:38:22 +0000 UTC - event for azuredisk-volume-tester-gkrnd: {kubelet capz-ujkg-m5lz7} Failed: Error: context deadline exceeded Apr 21 02:44:32.698: INFO: At 2022-04-21 02:38:23 +0000 UTC - event for azuredisk-volume-tester-gkrnd: {kubelet capz-ujkg-m5lz7} Pulled: Container image "mcr.microsoft.com/windows/servercore:ltsc2022" already present on machine Apr 21 02:44:32.698: INFO: At 2022-04-21 02:38:27 +0000 UTC - event for azuredisk-volume-tester-gkrnd: {kubelet capz-ujkg-m5lz7} Started: Started container volume-tester Apr 21 02:44:32.698: INFO: At 2022-04-21 02:38:28 +0000 UTC - event for azuredisk-volume-tester-gkrnd: {kubelet capz-ujkg-m5lz7} Killing: Stopping container volume-tester Apr 21 02:44:32.698: INFO: At 2022-04-21 02:40:29 +0000 UTC - event for azuredisk-volume-tester-gkrnd: {kubelet capz-ujkg-m5lz7} FailedKillPod: error killing pod: failed to "KillPodSandbox" for "133e3bdd-f6af-4d85-b23d-ddbf3d45adcb" with KillPodSandboxError: "rpc error: code = DeadlineExceeded desc = context deadline exceeded" Apr 21 02:44:32.802: INFO: POD NODE PHASE GRACE CONDITIONS Apr 21 02:44:32.802: INFO: Apr 21 02:44:32.941: INFO: Logging node info for node capz-ujkg-4bwdk Apr 21 02:44:33.051: INFO: Node Info: &Node{ObjectMeta:{capz-ujkg-4bwdk 50f9e109-c370-4829-afcf-e5dfa6ef4aaf 12501 0 2022-04-21 01:33:36 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D4s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:uksouth failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-ujkg-4bwdk kubernetes.io/os:windows node.kubernetes.io/instance-type:Standard_D4s_v3 node.kubernetes.io/windows-build:10.0.20348 topology.disk.csi.azure.com/zone: topology.kubernetes.io/region:uksouth topology.kubernetes.io/zone:0] map[cluster.x-k8s.io/cluster-name:capz-ujkgt8 cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-ujkgt8-md-win-bf87d9d9-fhcvl cluster.x-k8s.io/owner-kind:MachineSet cluster.x-k8s.io/owner-name:capz-ujkgt8-md-win-bf87d9d9 csi.volume.kubernetes.io/nodeid:{"disk.csi.azure.com":"capz-ujkg-4bwdk"} kubeadm.alpha.kubernetes.io/cri-socket:npipe:////./pipe/containerd-containerd node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.1.0.7/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.108.65 projectcalico.org/VXLANTunnelMACAddr:00:15:5d:f8:e5:6a volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-21 01:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {manager Update v1 2022-04-21 01:33:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {calico-node.exe Update v1 2022-04-21 01:35:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{},"f:projectcalico.org/VXLANTunnelMACAddr":{}}}} status} {Go-http-client Update v1 2022-04-21 01:39:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.disk.csi.azure.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2022-04-21 02:31:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}} }]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-ujkgt8/providers/Microsoft.Compute/virtualMachines/capz-ujkg-4bwdk,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{17179398144 0} {<nil>} 16776756Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{123221307598 0} {<nil>} 123221307598 DecimalSI},memory: {{17074540544 0} {<nil>} 16674356Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-21 02:40:29 +0000 UTC,LastTransitionTime:2022-04-21 01:33:36 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-21 02:40:29 +0000 UTC,LastTransitionTime:2022-04-21 01:33:36 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-21 02:40:29 +0000 UTC,LastTransitionTime:2022-04-21 01:33:36 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-21 02:40:29 +0000 UTC,LastTransitionTime:2022-04-21 01:34:47 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-ujkg-4bwdk,},NodeAddress{Type:InternalIP,Address:10.1.0.7,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:capz-ujkg-4bwdk,SystemUUID:D3C5B8BB-F68E-46A6-9228-F3B907888DB1,BootID:,KernelVersion:10.0.20348.405,OSImage:Windows Server 2022 Datacenter,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:378d85bd8e7388a777d25009f8523d1e95a5f544f131eaada83171045d5b2c1e mcr.microsoft.com/windows/servercore:ltsc2022],SizeBytes:2226956779,},ContainerImage{Names:[docker.io/sigwindowstools/calico-install@sha256:141afecd724eb757ee41593cc73f35fb19a2ce13cad73179cf3b1cef81a637d1 docker.io/sigwindowstools/calico-install:v3.22.1-hostprocess],SizeBytes:148096127,},ContainerImage{Names:[capzci.azurecr.io/azuredisk-csi@sha256:8b61f82e22ddf844b45a1d609d1fe1d82eea0b4c89033366003f33d6224360af capzci.azurecr.io/azuredisk-csi:v1.17.0-05b24144f3393ee540257657394c2033ec7f1f49],SizeBytes:141767120,},ContainerImage{Names:[docker.io/sigwindowstools/calico-node@sha256:b8e6e2f190e58d6b61b7f2a19b0e2e17a377e5b9d7b9528e9b7953d9f9ab59bb docker.io/sigwindowstools/calico-node:v3.22.1-hostprocess],SizeBytes:128793648,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:dbec3a8166686b09b242176ab5b99e993da4126438bbce68147c3fd654f35662 mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.4.0],SizeBytes:125554391,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:c96a6255c42766f6b8bb1a7cda02b0060ab1b20b2e2dafcc64ec09e7646745a6 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.5.0],SizeBytes:124471446,},ContainerImage{Names:[ghcr.io/kubernetes-sigs/sig-windows/csi-proxy@sha256:96b4144986319a747ba599892454be2737aae6005d96b8e13ed481321ac3afba ghcr.io/kubernetes-sigs/sig-windows/csi-proxy:v1.0.2],SizeBytes:123925937,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:119397646,},ContainerImage{Names:[docker.io/sigwindowstools/kube-proxy@sha256:0f8a44b795d1824358f24cc56f0024d18a39ae044656686596d8b7fa6d78e1fa docker.io/sigwindowstools/kube-proxy:v1.23.5-calico-hostprocess],SizeBytes:116337721,},},VolumesInUse:[kubernetes.io/csi/disk.csi.azure.com^/subscriptions/===REDACTED===/resourceGroups/capz-ujkgt8/providers/Microsoft.Compute/disks/pvc-81fa0362-6d66-4c89-be03-3946897eb39d],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 21 02:44:33.051: INFO: Logging kubelet events for node capz-ujkg-4bwdk Apr 21 02:44:33.154: INFO: Logging pods the kubelet thinks is on node capz-ujkg-4bwdk Apr 21 02:44:33.324: INFO: calico-node-windows-ht75d started at 2022-04-21 01:33:36 +0000 UTC (1+2 container statuses recorded) Apr 21 02:44:33.324: INFO: Init container install-cni ready: true, restart count 0 Apr 21 02:44:33.324: INFO: Container calico-node-felix ready: true, restart count 1 Apr 21 02:44:33.324: INFO: Container calico-node-startup ready: true, restart count 0 Apr 21 02:44:33.324: INFO: kube-proxy-windows-nz9gl started at 2022-04-21 01:33:36 +0000 UTC (0+1 container statuses recorded) Apr 21 02:44:33.325: INFO: Container kube-proxy ready: true, restart count 0 Apr 21 02:44:33.325: INFO: csi-proxy-89w5b started at 2022-04-21 01:34:48 +0000 UTC (0+1 container statuses recorded) Apr 21 02:44:33.325: INFO: Container csi-proxy ready: true, restart count 0 Apr 21 02:44:33.326: INFO: csi-azuredisk-node-win-xfpks started at 2022-04-21 01:38:16 +0000 UTC (1+3 container statuses recorded) Apr 21 02:44:33.326: INFO: Init container init ready: true, restart count 0 Apr 21 02:44:33.327: INFO: Container azuredisk ready: true, restart count 0 Apr 21 02:44:33.327: INFO: Container liveness-probe ready: true, restart count 0 Apr 21 02:44:33.327: INFO: Container node-driver-registrar ready: true, restart count 0 Apr 21 02:44:33.793: INFO: Latency metrics for node capz-ujkg-4bwdk Apr 21 02:44:33.794: INFO: Logging node info for node capz-ujkg-m5lz7 Apr 21 02:44:33.906: INFO: Node Info: &Node{ObjectMeta:{capz-ujkg-m5lz7 ac24d73d-d479-4130-8c3c-9b78780c4e4b 13060 0 2022-04-21 01:34:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D4s_v3 beta.kubernetes.io/os:windows failure-domain.beta.kubernetes.io/region:uksouth failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-ujkg-m5lz7 kubernetes.io/os:windows node.kubernetes.io/instance-type:Standard_D4s_v3 node.kubernetes.io/windows-build:10.0.20348 topology.disk.csi.azure.com/zone: topology.kubernetes.io/region:uksouth topology.kubernetes.io/zone:0] map[cluster.x-k8s.io/cluster-name:capz-ujkgt8 cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-ujkgt8-md-win-bf87d9d9-87lvs cluster.x-k8s.io/owner-kind:MachineSet cluster.x-k8s.io/owner-name:capz-ujkgt8-md-win-bf87d9d9 csi.volume.kubernetes.io/nodeid:{"disk.csi.azure.com":"capz-ujkg-m5lz7"} kubeadm.alpha.kubernetes.io/cri-socket:npipe:////./pipe/containerd-containerd node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.1.0.6/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.2.1 projectcalico.org/VXLANTunnelMACAddr:00:15:5d:51:b4:51 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-21 01:34:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:node.kubernetes.io/windows-build":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-04-21 01:34:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}} } {manager Update v1 2022-04-21 01:34:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {calico-node.exe Update v1 2022-04-21 01:36:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{},"f:projectcalico.org/VXLANTunnelMACAddr":{}}}} status} {Go-http-client Update v1 2022-04-21 02:31:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.disk.csi.azure.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-ujkgt8/providers/Microsoft.Compute/virtualMachines/capz-ujkg-m5lz7,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{136912564224 0} {<nil>} 133703676Ki BinarySI},memory: {{17179398144 0} {<nil>} 16776756Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{123221307598 0} {<nil>} 123221307598 DecimalSI},memory: {{17074540544 0} {<nil>} 16674356Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-21 02:41:49 +0000 UTC,LastTransitionTime:2022-04-21 01:34:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-21 02:41:49 +0000 UTC,LastTransitionTime:2022-04-21 01:34:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-21 02:41:49 +0000 UTC,LastTransitionTime:2022-04-21 01:34:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-21 02:41:49 +0000 UTC,LastTransitionTime:2022-04-21 01:35:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-ujkg-m5lz7,},NodeAddress{Type:InternalIP,Address:10.1.0.6,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:capz-ujkg-m5lz7,SystemUUID:0BDE507E-D417-4F6E-9D2C-3CDB1935E3ED,BootID:,KernelVersion:10.0.20348.405,OSImage:Windows Server 2022 Datacenter,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:windows,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[mcr.microsoft.com/windows/servercore@sha256:378d85bd8e7388a777d25009f8523d1e95a5f544f131eaada83171045d5b2c1e mcr.microsoft.com/windows/servercore:ltsc2022],SizeBytes:2226956779,},ContainerImage{Names:[docker.io/sigwindowstools/calico-install@sha256:141afecd724eb757ee41593cc73f35fb19a2ce13cad73179cf3b1cef81a637d1 docker.io/sigwindowstools/calico-install:v3.22.1-hostprocess],SizeBytes:148096127,},ContainerImage{Names:[capzci.azurecr.io/azuredisk-csi@sha256:8b61f82e22ddf844b45a1d609d1fe1d82eea0b4c89033366003f33d6224360af capzci.azurecr.io/azuredisk-csi:v1.17.0-05b24144f3393ee540257657394c2033ec7f1f49],SizeBytes:141767120,},ContainerImage{Names:[docker.io/sigwindowstools/calico-node@sha256:b8e6e2f190e58d6b61b7f2a19b0e2e17a377e5b9d7b9528e9b7953d9f9ab59bb docker.io/sigwindowstools/calico-node:v3.22.1-hostprocess],SizeBytes:128793648,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:dbec3a8166686b09b242176ab5b99e993da4126438bbce68147c3fd654f35662 mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.4.0],SizeBytes:125554391,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:c96a6255c42766f6b8bb1a7cda02b0060ab1b20b2e2dafcc64ec09e7646745a6 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.5.0],SizeBytes:124471446,},ContainerImage{Names:[ghcr.io/kubernetes-sigs/sig-windows/csi-proxy@sha256:96b4144986319a747ba599892454be2737aae6005d96b8e13ed481321ac3afba ghcr.io/kubernetes-sigs/sig-windows/csi-proxy:v1.0.2],SizeBytes:123925937,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:119397646,},ContainerImage{Names:[docker.io/sigwindowstools/kube-proxy@sha256:0f8a44b795d1824358f24cc56f0024d18a39ae044656686596d8b7fa6d78e1fa docker.io/sigwindowstools/kube-proxy:v1.23.5-calico-hostprocess],SizeBytes:116337721,},},VolumesInUse:[kubernetes.io/csi/disk.csi.azure.com^/subscriptions/===REDACTED===/resourceGroups/capz-ujkgt8/providers/Microsoft.Compute/disks/reattach-disk-multiple-nodes],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 21 02:44:33.906: INFO: Logging kubelet events for node capz-ujkg-m5lz7 Apr 21 02:44:34.012: INFO: Logging pods the kubelet thinks is on node capz-ujkg-m5lz7 Apr 21 02:44:34.186: INFO: kube-proxy-windows-877k8 started at 2022-04-21 01:34:33 +0000 UTC (0+1 container statuses recorded) Apr 21 02:44:34.186: INFO: Container kube-proxy ready: true, restart count 0 Apr 21 02:44:34.186: INFO: calico-node-windows-db82c started at 2022-04-21 01:34:33 +0000 UTC (1+2 container statuses recorded) Apr 21 02:44:34.186: INFO: Init container install-cni ready: true, restart count 0 Apr 21 02:44:34.186: INFO: Container calico-node-felix ready: true, restart count 1 Apr 21 02:44:34.186: INFO: Container calico-node-startup ready: true, restart count 0 Apr 21 02:44:34.186: INFO: csi-proxy-c4m28 started at 2022-04-21 01:35:55 +0000 UTC (0+1 container statuses recorded) Apr 21 02:44:34.186: INFO: Container csi-proxy ready: true, restart count 0 Apr 21 02:44:34.186: INFO: csi-azuredisk-node-win-lw24r started at 2022-04-21 01:38:16 +0000 UTC (1+3 container statuses recorded) Apr 21 02:44:34.186: INFO: Init container init ready: true, restart count 0 Apr 21 02:44:34.186: INFO: Container azuredisk ready: true, restart count 0 Apr 21 02:44:34.186: INFO: Container liveness-probe ready: true, restart count 0 Apr 21 02:44:34.186: INFO: Container node-driver-registrar ready: true, restart count 0 Apr 21 02:44:34.624: INFO: Latency metrics for node capz-ujkg-m5lz7 Apr 21 02:44:34.624: INFO: Logging node info for node capz-ujkgt8-control-plane-cl47z Apr 21 02:44:34.736: INFO: Node Info: &Node{ObjectMeta:{capz-ujkgt8-control-plane-cl47z dc255ec7-fbcb-44e8-bb61-aaa9aab6cdc6 12366 0 2022-04-21 01:32:01 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D2s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:uksouth failure-domain.beta.kubernetes.io/zone:uksouth-3 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-ujkgt8-control-plane-cl47z kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/master: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:Standard_D2s_v3 topology.kubernetes.io/region:uksouth topology.kubernetes.io/zone:uksouth-3] map[cluster.x-k8s.io/cluster-name:capz-ujkgt8 cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-ujkgt8-control-plane-s2kbx cluster.x-k8s.io/owner-kind:KubeadmControlPlane cluster.x-k8s.io/owner-name:capz-ujkgt8-control-plane kubeadm.alpha.kubernetes.io/cri-socket:/run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.0.4/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.189.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{manager Update v1 2022-04-21 01:32:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {Go-http-client Update v1 2022-04-21 01:32:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node-role.kubernetes.io/control-plane":{},"f:node-role.kubernetes.io/master":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-04-21 01:32:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:taints":{}}} } {Go-http-client Update v1 2022-04-21 01:32:42 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {calico-node Update v1 2022-04-21 01:32:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-ujkgt8/providers/Microsoft.Compute/virtualMachines/capz-ujkgt8-control-plane-cl47z,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{133018140672 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8340819968 0} {<nil>} 8145332Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{4 0} {<nil>} 4 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{119716326407 0} {<nil>} 119716326407 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8235962368 0} {<nil>} 8042932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-04-21 01:32:45 +0000 UTC,LastTransitionTime:2022-04-21 01:32:45 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-21 02:39:33 +0000 UTC,LastTransitionTime:2022-04-21 01:31:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-21 02:39:33 +0000 UTC,LastTransitionTime:2022-04-21 01:31:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-21 02:39:33 +0000 UTC,LastTransitionTime:2022-04-21 01:31:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-21 02:39:33 +0000 UTC,LastTransitionTime:2022-04-21 01:32:31 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-ujkgt8-control-plane-cl47z,},NodeAddress{Type:InternalIP,Address:10.0.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:063b7120719c45629aafc0b2be24d1f6,SystemUUID:46aa3756-68fa-3141-a1c3-ff86f0e9917b,BootID:e19fd082-4950-4ed0-87a3-bcd4e17b5f63,KernelVersion:5.13.0-1017-azure,OSImage:Ubuntu 20.04.4 LTS,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 k8s.gcr.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[docker.io/calico/cni@sha256:2219eae79544b098119a06a8bb5608867f9ac00471592a00e2347f3ae4bea687 docker.io/calico/cni:v3.22.1],SizeBytes:80514590,},ContainerImage{Names:[docker.io/calico/node@sha256:1f8ed83e5264b4206cce7e1def11bca0b3ea7d5f4eb9b0ca0dbfc8cb968ca57e docker.io/calico/node:v3.22.1],SizeBytes:69647221,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:e42a0aba3637d123481cca14fd8314a482616593edf58f9594c9382e50498f9b docker.io/calico/kube-controllers:v3.22.1],SizeBytes:54948023,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:c1f625d115fbd9a12eac615653fc81c0edb33b2b5a76d1e09d5daed11fa557c1 k8s.gcr.io/kube-proxy:v1.23.5],SizeBytes:39278412,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:ddf5bf7196eb534271f9e5d403f4da19838d5610bb5ca191001bde5f32b5492e k8s.gcr.io/kube-apiserver:v1.23.5],SizeBytes:32603217,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:cca0fb3532abedcc95c5f64268d54da9ecc56cc4817ff08d0128941cf2b0e1a4 k8s.gcr.io/kube-controller-manager:v1.23.5],SizeBytes:30174093,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:489efb65da9edc40bf0911f3e6371e5bb6b8ad8fde1d55193a6cc84c2ef36626 k8s.gcr.io/kube-scheduler:v1.23.5],SizeBytes:15131395,},ContainerImage{Names:[k8s.gcr.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e k8s.gcr.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[docker.io/calico/pod2daemon-flexvol@sha256:35802ba083546a7c5e8b5bf0ee7ffad7f8a468e8c2b3631e7e9647512c94041d docker.io/calico/pod2daemon-flexvol:v3.22.1],SizeBytes:8462620,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 21 02:44:34.737: INFO: Logging kubelet events for node capz-ujkgt8-control-plane-cl47z Apr 21 02:44:34.839: INFO: Logging pods the kubelet thinks is on node capz-ujkgt8-control-plane-cl47z Apr 21 02:44:35.029: INFO: kube-proxy-rq6jc started at 2022-04-21 01:32:12 +0000 UTC (0+1 container statuses recorded) Apr 21 02:44:35.029: INFO: Container kube-proxy ready: true, restart count 0 Apr 21 02:44:35.029: INFO: coredns-64897985d-j7h97 started at 2022-04-21 01:32:32 +0000 UTC (0+1 container statuses recorded) Apr 21 02:44:35.029: INFO: Container coredns ready: true, restart count 0 Apr 21 02:44:35.029: INFO: coredns-64897985d-h98fm started at 2022-04-21 01:32:32 +0000 UTC (0+1 container statuses recorded) Apr 21 02:44:35.029: INFO: Container coredns ready: true, restart count 0 Apr 21 02:44:35.029: INFO: kube-controller-manager-capz-ujkgt8-control-plane-cl47z started at 2022-04-21 01:32:11 +0000 UTC (0+1 container statuses recorded) Apr 21 02:44:35.029: INFO: Container kube-controller-manager ready: true, restart count 0 Apr 21 02:44:35.029: INFO: kube-apiserver-capz-ujkgt8-control-plane-cl47z started at 2022-04-21 01:31:52 +0000 UTC (0+1 container statuses recorded) Apr 21 02:44:35.029: INFO: Container kube-apiserver ready: true, restart count 0 Apr 21 02:44:35.029: INFO: kube-scheduler-capz-ujkgt8-control-plane-cl47z started at 2022-04-21 01:31:52 +0000 UTC (0+1 container statuses recorded) Apr 21 02:44:35.029: INFO: Container kube-scheduler ready: true, restart count 0 Apr 21 02:44:35.029: INFO: calico-node-2zdkr started at 2022-04-21 01:32:12 +0000 UTC (3+1 container statuses recorded) Apr 21 02:44:35.029: INFO: Init container upgrade-ipam ready: true, restart count 0 Apr 21 02:44:35.029: INFO: Init container install-cni ready: true, restart count 0 Apr 21 02:44:35.029: INFO: Init container flexvol-driver ready: true, restart count 0 Apr 21 02:44:35.029: INFO: Container calico-node ready: true, restart count 0 Apr 21 02:44:35.029: INFO: calico-kube-controllers-7c664f4648-czpdv started at 2022-04-21 01:32:32 +0000 UTC (0+1 container statuses recorded) Apr 21 02:44:35.029: INFO: Container calico-kube-controllers ready: true, restart count 0 Apr 21 02:44:35.029: INFO: etcd-capz-ujkgt8-control-plane-cl47z started at 2022-04-21 01:32:11 +0000 UTC (0+1 container statuses recorded) Apr 21 02:44:35.029: INFO: Container etcd ready: true, restart count 0 Apr 21 02:44:35.470: INFO: Latency metrics for node capz-ujkgt8-control-plane-cl47z Apr 21 02:44:35.470: INFO: Logging node info for node capz-ujkgt8-md-0-b6278 Apr 21 02:44:35.582: INFO: Node Info: &Node{ObjectMeta:{capz-ujkgt8-md-0-b6278 cdb62964-9f61-46e3-a31f-d50bee6da5b3 12451 0 2022-04-21 01:33:19 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D4s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:uksouth failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-ujkgt8-md-0-b6278 kubernetes.io/os:linux node.kubernetes.io/instance-type:Standard_D4s_v3 topology.kubernetes.io/region:uksouth topology.kubernetes.io/zone:0] map[cluster.x-k8s.io/cluster-name:capz-ujkgt8 cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-ujkgt8-md-0-8685f8f496-plvfz cluster.x-k8s.io/owner-kind:MachineSet cluster.x-k8s.io/owner-name:capz-ujkgt8-md-0-8685f8f496 kubeadm.alpha.kubernetes.io/cri-socket:/run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.1.0.5/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.164.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-21 01:33:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {manager Update v1 2022-04-21 01:33:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {kube-controller-manager Update v1 2022-04-21 01:33:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}} } {calico-node Update v1 2022-04-21 01:33:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {Go-http-client Update v1 2022-04-21 01:33:49 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-ujkgt8/providers/Microsoft.Compute/virtualMachines/capz-ujkgt8-md-0-b6278,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{133018140672 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16783433728 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{119716326407 0} {<nil>} 119716326407 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16678576128 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-04-21 01:33:45 +0000 UTC,LastTransitionTime:2022-04-21 01:33:45 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-21 02:40:09 +0000 UTC,LastTransitionTime:2022-04-21 01:33:19 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-21 02:40:09 +0000 UTC,LastTransitionTime:2022-04-21 01:33:19 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-21 02:40:09 +0000 UTC,LastTransitionTime:2022-04-21 01:33:19 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-21 02:40:09 +0000 UTC,LastTransitionTime:2022-04-21 01:33:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-ujkgt8-md-0-b6278,},NodeAddress{Type:InternalIP,Address:10.1.0.5,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:803104d15f4a4263a1112d9167377c90,SystemUUID:ea1d1216-8797-6846-b6c8-015d470de973,BootID:a82f8760-8259-44a3-a69e-9afa51a10a4e,KernelVersion:5.13.0-1017-azure,OSImage:Ubuntu 20.04.4 LTS,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 k8s.gcr.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[docker.io/calico/cni@sha256:2219eae79544b098119a06a8bb5608867f9ac00471592a00e2347f3ae4bea687 docker.io/calico/cni:v3.22.1],SizeBytes:80514590,},ContainerImage{Names:[docker.io/calico/node@sha256:1f8ed83e5264b4206cce7e1def11bca0b3ea7d5f4eb9b0ca0dbfc8cb968ca57e docker.io/calico/node:v3.22.1],SizeBytes:69647221,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:c1f625d115fbd9a12eac615653fc81c0edb33b2b5a76d1e09d5daed11fa557c1 k8s.gcr.io/kube-proxy:v1.23.5],SizeBytes:39278412,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:ddf5bf7196eb534271f9e5d403f4da19838d5610bb5ca191001bde5f32b5492e k8s.gcr.io/kube-apiserver:v1.23.5],SizeBytes:32603217,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:cca0fb3532abedcc95c5f64268d54da9ecc56cc4817ff08d0128941cf2b0e1a4 k8s.gcr.io/kube-controller-manager:v1.23.5],SizeBytes:30174093,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:489efb65da9edc40bf0911f3e6371e5bb6b8ad8fde1d55193a6cc84c2ef36626 k8s.gcr.io/kube-scheduler:v1.23.5],SizeBytes:15131395,},ContainerImage{Names:[k8s.gcr.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e k8s.gcr.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[docker.io/calico/pod2daemon-flexvol@sha256:35802ba083546a7c5e8b5bf0ee7ffad7f8a468e8c2b3631e7e9647512c94041d docker.io/calico/pod2daemon-flexvol:v3.22.1],SizeBytes:8462620,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 21 02:44:35.582: INFO: Logging kubelet events for node capz-ujkgt8-md-0-b6278 Apr 21 02:44:35.685: INFO: Logging pods the kubelet thinks is on node capz-ujkgt8-md-0-b6278 Apr 21 02:44:35.828: INFO: kube-proxy-f8vsn started at 2022-04-21 01:33:19 +0000 UTC (0+1 container statuses recorded) Apr 21 02:44:35.829: INFO: Container kube-proxy ready: true, restart count 0 Apr 21 02:44:35.829: INFO: calico-node-p2n8g started at 2022-04-21 01:33:19 +0000 UTC (3+1 container statuses recorded) Apr 21 02:44:35.829: INFO: Init container upgrade-ipam ready: true, restart count 0 Apr 21 02:44:35.829: INFO: Init container install-cni ready: true, restart count 0 Apr 21 02:44:35.829: INFO: Init container flexvol-driver ready: true, restart count 0 Apr 21 02:44:35.829: INFO: Container calico-node ready: true, restart count 0 Apr 21 02:44:36.234: INFO: Latency metrics for node capz-ujkgt8-md-0-b6278 Apr 21 02:44:36.234: INFO: Logging node info for node capz-ujkgt8-md-0-sz85g Apr 21 02:44:36.346: INFO: Node Info: &Node{ObjectMeta:{capz-ujkgt8-md-0-sz85g 6297b725-1dd1-45ad-bdc0-488f88f104eb 12493 0 2022-04-21 01:33:04 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:Standard_D4s_v3 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:uksouth failure-domain.beta.kubernetes.io/zone:0 kubernetes.io/arch:amd64 kubernetes.io/hostname:capz-ujkgt8-md-0-sz85g kubernetes.io/os:linux node.kubernetes.io/instance-type:Standard_D4s_v3 topology.kubernetes.io/region:uksouth topology.kubernetes.io/zone:0] map[cluster.x-k8s.io/cluster-name:capz-ujkgt8 cluster.x-k8s.io/cluster-namespace:default cluster.x-k8s.io/machine:capz-ujkgt8-md-0-8685f8f496-4s79c cluster.x-k8s.io/owner-kind:MachineSet cluster.x-k8s.io/owner-name:capz-ujkgt8-md-0-8685f8f496 kubeadm.alpha.kubernetes.io/cri-socket:/run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.1.0.4/16 projectcalico.org/IPv4VXLANTunnelAddr:192.168.88.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{Go-http-client Update v1 2022-04-21 01:33:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubeadm.alpha.kubernetes.io/cri-socket":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-04-21 01:33:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}}} } {manager Update v1 2022-04-21 01:33:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:cluster.x-k8s.io/cluster-name":{},"f:cluster.x-k8s.io/cluster-namespace":{},"f:cluster.x-k8s.io/machine":{},"f:cluster.x-k8s.io/owner-kind":{},"f:cluster.x-k8s.io/owner-name":{}}}} } {calico-node Update v1 2022-04-21 01:33:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4VXLANTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {Go-http-client Update v1 2022-04-21 01:33:35 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:azure:///subscriptions/===REDACTED===/resourceGroups/capz-ujkgt8/providers/Microsoft.Compute/virtualMachines/capz-ujkgt8-md-0-sz85g,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{133018140672 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16783433728 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-azure-disk: {{8 0} {<nil>} 8 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{119716326407 0} {<nil>} 119716326407 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16678576128 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-04-21 01:33:29 +0000 UTC,LastTransitionTime:2022-04-21 01:33:29 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-21 02:40:27 +0000 UTC,LastTransitionTime:2022-04-21 01:33:04 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-21 02:40:27 +0000 UTC,LastTransitionTime:2022-04-21 01:33:04 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-21 02:40:27 +0000 UTC,LastTransitionTime:2022-04-21 01:33:04 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-21 02:40:27 +0000 UTC,LastTransitionTime:2022-04-21 01:33:24 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:capz-ujkgt8-md-0-sz85g,},NodeAddress{Type:InternalIP,Address:10.1.0.4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:5dea6b2b8d384d79aca166e53fc43ab8,SystemUUID:7932c715-ed1f-4443-ab3d-9a8dd2cb8fc8,BootID:d3183c24-32e3-43d9-8c3f-27f506ecdaca,KernelVersion:5.13.0-1017-azure,OSImage:Ubuntu 20.04.4 LTS,ContainerRuntimeVersion:containerd://1.6.1,KubeletVersion:v1.23.5,KubeProxyVersion:v1.23.5,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[capzci.azurecr.io/azuredisk-csi@sha256:8b61f82e22ddf844b45a1d609d1fe1d82eea0b4c89033366003f33d6224360af capzci.azurecr.io/azuredisk-csi:v1.17.0-05b24144f3393ee540257657394c2033ec7f1f49],SizeBytes:99251114,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 k8s.gcr.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[docker.io/calico/cni@sha256:2219eae79544b098119a06a8bb5608867f9ac00471592a00e2347f3ae4bea687 docker.io/calico/cni:v3.22.1],SizeBytes:80514590,},ContainerImage{Names:[docker.io/calico/node@sha256:1f8ed83e5264b4206cce7e1def11bca0b3ea7d5f4eb9b0ca0dbfc8cb968ca57e docker.io/calico/node:v3.22.1],SizeBytes:69647221,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner@sha256:542c9258a1441e4927883ea73425e21f9a14043a649686bf6b51700f34c64f8e mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v3.1.0],SizeBytes:59205633,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-resizer@sha256:ab6c2e18a4d943f2bf8688e1779622277a1d14c355c9d4bfc0d761d86c5108b3 mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.4.0],SizeBytes:56924121,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-attacher@sha256:19fbca01394f7ed80151731180cfde0a3367f038beae2a97cda7928034010057 mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v3.4.0],SizeBytes:56301028,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:c1f625d115fbd9a12eac615653fc81c0edb33b2b5a76d1e09d5daed11fa557c1 k8s.gcr.io/kube-proxy:v1.23.5],SizeBytes:39278412,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver@sha256:ddf5bf7196eb534271f9e5d403f4da19838d5610bb5ca191001bde5f32b5492e k8s.gcr.io/kube-apiserver:v1.23.5],SizeBytes:32603217,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager@sha256:cca0fb3532abedcc95c5f64268d54da9ecc56cc4817ff08d0128941cf2b0e1a4 k8s.gcr.io/kube-controller-manager:v1.23.5],SizeBytes:30174093,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter@sha256:a889e925e15f9423f7842f1b769f64cbcf6a20b6956122836fc835cf22d9073f mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v5.0.1],SizeBytes:22192414,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler@sha256:489efb65da9edc40bf0911f3e6371e5bb6b8ad8fde1d55193a6cc84c2ef36626 k8s.gcr.io/kube-scheduler:v1.23.5],SizeBytes:15131395,},ContainerImage{Names:[k8s.gcr.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e k8s.gcr.io/coredns/coredns:v1.8.6],SizeBytes:13585107,},ContainerImage{Names:[docker.io/calico/pod2daemon-flexvol@sha256:35802ba083546a7c5e8b5bf0ee7ffad7f8a468e8c2b3631e7e9647512c94041d docker.io/calico/pod2daemon-flexvol:v3.22.1],SizeBytes:8462620,},ContainerImage{Names:[mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:c96a6255c42766f6b8bb1a7cda02b0060ab1b20b2e2dafcc64ec09e7646745a6 mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.5.0],SizeBytes:8222208,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Apr 21 02:44:36.346: INFO: Logging kubelet events for node capz-ujkgt8-md-0-sz85g Apr 21 02:44:36.450: INFO: Logging pods the kubelet thinks is on node capz-ujkgt8-md-0-sz85g Apr 21 02:44:36.604: INFO: csi-azuredisk-controller-5f5b9cc587-sglc7 started at 2022-04-21 01:38:16 +0000 UTC (0+6 container statuses recorded) Apr 21 02:44:36.604: INFO: Container azuredisk ready: true, restart count 0 Apr 21 02:44:36.604: INFO: Container csi-attacher ready: true, restart count 0 Apr 21 02:44:36.604: INFO: Container csi-provisioner ready: true, restart count 0 Apr 21 02:44:36.604: INFO: Container csi-resizer ready: true, restart count 0 Apr 21 02:44:36.604: INFO: Container csi-snapshotter ready: true, restart count 0 Apr 21 02:44:36.605: INFO: Container liveness-probe ready: true, restart count 0 Apr 21 02:44:36.605: INFO: kube-proxy-httdl started at 2022-04-21 01:33:05 +0000 UTC (0+1 container statuses recorded) Apr 21 02:44:36.605: INFO: Container kube-proxy ready: true, restart count 0 Apr 21 02:44:36.605: INFO: calico-node-jfr6j started at 2022-04-21 01:33:05 +0000 UTC (3+1 container statuses recorded) Apr 21 02:44:36.605: INFO: Init container upgrade-ipam ready: true, restart count 0 Apr 21 02:44:36.605: INFO: Init container install-cni ready: true, restart count 0 Apr 21 02:44:36.605: INFO: Init container flexvol-driver ready: true, restart count 0 Apr 21 02:44:36.605: INFO: Container calico-node ready: true, restart count 0 Apr 21 02:44:37.006: INFO: Latency metrics for node capz-ujkgt8-md-0-sz85g Apr 21 02:44:37.006: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "azuredisk-1853" for this suite.
Find azuredisk-volume-tester-gkrnd mentions in log files | View test history on testgrid
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] Should create and attach a volume with basic perfProfile [enableBursting][disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should create a block volume on demand and dynamically resize it without detaching [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should create a deployment object, write and read to it, delete the pod and write and read to it again [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should create a pod with multiple volumes [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should create a pod with volume mount subpath [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should create a statefulset object, write and read to it, delete the pod and write and read to it again [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should create a volume azuredisk with tag [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should create a volume on demand and dynamically resize it without detaching [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should create a volume on demand and mount it as readOnly in a pod [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should create a volume on demand and resize it [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should create multiple PV objects, bind to PVCs and attach all to a single pod [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should create multiple PV objects, bind to PVCs and attach all to different pods on the same node [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should delete PV with reclaimPolicy "Delete" [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should detach disk after pod deleted [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should retain PV with reclaimPolicy "Retain" [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Pre-Provisioned [single-az] should fail when maxShares is invalid [disk.csi.azure.com][windows]
AzureDisk CSI Driver End-to-End Tests Pre-Provisioned [single-az] should succeed when creating a shared disk [disk.csi.azure.com][windows]
AzureDisk CSI Driver End-to-End Tests Pre-Provisioned [single-az] should use a pre-provisioned volume and mount it as readOnly in a pod [disk.csi.azure.com][windows]
AzureDisk CSI Driver End-to-End Tests Pre-Provisioned [single-az] should use a pre-provisioned volume and retain PV with reclaimPolicy "Retain" [disk.csi.azure.com][windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] Should create and attach a volume with basic perfProfile [enableBursting][disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] Should test pod failover with cordoning a node
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] Should test pod failover with cordoning a node using ZRS
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should clone a volume from an existing volume and read from it [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should clone a volume of larger size than the source volume and make sure the filesystem is appropriately adjusted [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should create a block volume on demand and dynamically resize it without detaching [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should create a deployment object, write and read to it, delete the pod and write and read to it again [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should create a pod with multiple volumes [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should create a pod with volume mount subpath [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should create a pod, write and read to it, take a volume snapshot, and create another pod from the snapshot [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should create a pod, write to its pv, take a volume snapshot, overwrite data in original pv, create another pod from the snapshot, and read unaltered original data from original pv[disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should create a raw block volume and a filesystem volume on demand and bind to the same pod [kubernetes.io/azure-disk] [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should create a raw block volume on demand [kubernetes.io/azure-disk] [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should create a statefulset object, write and read to it, delete the pod and write and read to it again [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should create a volume azuredisk with tag [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should create a volume on demand and dynamically resize it without detaching [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should create a volume on demand and mount it as readOnly in a pod [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should create a volume on demand and resize it [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should create a volume on demand with mount options [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should create multiple PV objects, bind to PVCs and attach all to a single pod [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should create multiple PV objects, bind to PVCs and attach all to different pods on the same node [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should delete PV with reclaimPolicy "Delete" [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should detach disk after pod deleted [disk.csi.azure.com] [Windows]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should receive FailedMount event with invalid mount options [kubernetes.io/azure-disk] [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should retain PV with reclaimPolicy "Retain" [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [multi-az] should succeed when attaching a shared block volume to multiple pods [disk.csi.azure.com][shared disk]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] Should test pod failover with cordoning a node
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] Should test pod failover with cordoning a node using ZRS
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should clone a volume from an existing volume and read from it [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should clone a volume of larger size than the source volume and make sure the filesystem is appropriately adjusted [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should create a pod, write and read to it, take a volume snapshot, and create another pod from the snapshot [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should create a pod, write to its pv, take a volume snapshot, overwrite data in original pv, create another pod from the snapshot, and read unaltered original data from original pv[disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should create a raw block volume and a filesystem volume on demand and bind to the same pod [kubernetes.io/azure-disk] [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should create a raw block volume on demand [kubernetes.io/azure-disk] [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should receive FailedMount event with invalid mount options [kubernetes.io/azure-disk] [disk.csi.azure.com]
AzureDisk CSI Driver End-to-End Tests Dynamic Provisioning [single-az] should succeed when attaching a shared block volume to multiple pods [disk.csi.azure.com][shared disk]
AzureDisk CSI Driver End-to-End Tests Pre-Provisioned [single-az] should create an inline volume by in-tree driver [kubernetes.io/azure-disk]
AzureDisk CSI Driver End-to-End Tests Pre-Provisioned [single-az] should succeed when attaching a shared block volume to multiple pods [disk.csi.azure.com][shared disk]