This job view page is being replaced by Spyglass soon. Check out the new job view.
Resultsuccess
Tests 0 failed / 12 succeeded
Started2022-09-08 09:27
Elapsed51m58s
Revision
uploadercrier

No Test Failures!


Show 12 Passed Tests

Show 47 Skipped Tests

Error lines from build-log.txt

... skipping 715 lines ...
certificate.cert-manager.io "selfsigned-cert" deleted
# Create secret for AzureClusterIdentity
./hack/create-identity-secret.sh
make[2]: Entering directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure'
make[2]: Nothing to be done for 'kubectl'.
make[2]: Leaving directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure'
Error from server (NotFound): secrets "cluster-identity-secret" not found
secret/cluster-identity-secret created
secret/cluster-identity-secret labeled
# Create customized cloud provider configs
./hack/create-custom-cloud-provider-config.sh
make[2]: Entering directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure'
make[2]: Nothing to be done for 'kubectl'.
... skipping 141 lines ...
# Wait for the kubeconfig to become available.
timeout --foreground 300 bash -c "while ! /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/hack/tools/bin/kubectl-v1.22.4 get secrets | grep capz-puhmj3-kubeconfig; do sleep 1; done"
capz-puhmj3-kubeconfig                 cluster.x-k8s.io/secret   1      1s
# Get kubeconfig and store it locally.
/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/hack/tools/bin/kubectl-v1.22.4 get secrets capz-puhmj3-kubeconfig -o json | jq -r .data.value | base64 --decode > ./kubeconfig
timeout --foreground 600 bash -c "while ! /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/hack/tools/bin/kubectl-v1.22.4 --kubeconfig=./kubeconfig get nodes | grep control-plane; do sleep 1; done"
error: the server doesn't have a resource type "nodes"
capz-puhmj3-control-plane-kjzkz   NotReady   control-plane   5s    v1.26.0-alpha.0.439+8287e21228e9b1
run "/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/hack/tools/bin/kubectl-v1.22.4 --kubeconfig=./kubeconfig ..." to work with the new target cluster
make[1]: Leaving directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure'
Waiting for 1 control plane machine(s), 2 worker machine(s), and  windows machine(s) to become Ready
node/capz-puhmj3-control-plane-kjzkz condition met
node/capz-puhmj3-md-0-cljzs condition met
... skipping 62 lines ...
Dynamic Provisioning [single-az] 
  should create a volume on demand with mount options [kubernetes.io/azure-disk] [disk.csi.azure.com] [Windows]
  /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/dynamic_provisioning_test.go:101
STEP: Creating a kubernetes client
Sep  8 09:47:23.700: INFO: >>> kubeConfig: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig
STEP: Building a namespace api object, basename azuredisk
Sep  8 09:47:24.085: INFO: Error listing PodSecurityPolicies; assuming PodSecurityPolicy is disabled: the server could not find the requested resource
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
2022/09/08 09:47:24 Check driver pods if restarts ...
check the driver pods if restarts ...
======================================================================================
2022/09/08 09:47:24 Check successfully
Sep  8 09:47:24.597: INFO: >>> kubeConfig: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying the pod
STEP: checking that the pod's command exits with no error
Sep  8 09:47:24.764: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-jw65s" in namespace "azuredisk-8081" to be "Succeeded or Failed"
Sep  8 09:47:24.818: INFO: Pod "azuredisk-volume-tester-jw65s": Phase="Pending", Reason="", readiness=false. Elapsed: 53.581364ms
Sep  8 09:47:26.872: INFO: Pod "azuredisk-volume-tester-jw65s": Phase="Pending", Reason="", readiness=false. Elapsed: 2.107823052s
Sep  8 09:47:28.926: INFO: Pod "azuredisk-volume-tester-jw65s": Phase="Pending", Reason="", readiness=false. Elapsed: 4.162077749s
Sep  8 09:47:30.981: INFO: Pod "azuredisk-volume-tester-jw65s": Phase="Pending", Reason="", readiness=false. Elapsed: 6.216684759s
Sep  8 09:47:33.035: INFO: Pod "azuredisk-volume-tester-jw65s": Phase="Pending", Reason="", readiness=false. Elapsed: 8.27066151s
Sep  8 09:47:35.089: INFO: Pod "azuredisk-volume-tester-jw65s": Phase="Pending", Reason="", readiness=false. Elapsed: 10.324448673s
... skipping 4 lines ...
Sep  8 09:47:45.357: INFO: Pod "azuredisk-volume-tester-jw65s": Phase="Pending", Reason="", readiness=false. Elapsed: 20.593010269s
Sep  8 09:47:47.411: INFO: Pod "azuredisk-volume-tester-jw65s": Phase="Pending", Reason="", readiness=false. Elapsed: 22.646311285s
Sep  8 09:47:49.468: INFO: Pod "azuredisk-volume-tester-jw65s": Phase="Pending", Reason="", readiness=false. Elapsed: 24.703766359s
Sep  8 09:47:51.526: INFO: Pod "azuredisk-volume-tester-jw65s": Phase="Running", Reason="", readiness=false. Elapsed: 26.761305648s
Sep  8 09:47:53.585: INFO: Pod "azuredisk-volume-tester-jw65s": Phase="Succeeded", Reason="", readiness=false. Elapsed: 28.820804476s
STEP: Saw pod success
Sep  8 09:47:53.585: INFO: Pod "azuredisk-volume-tester-jw65s" satisfied condition "Succeeded or Failed"
Sep  8 09:47:53.585: INFO: deleting Pod "azuredisk-8081"/"azuredisk-volume-tester-jw65s"
Sep  8 09:47:53.650: INFO: Pod azuredisk-volume-tester-jw65s has the following logs: hello world

STEP: Deleting pod azuredisk-volume-tester-jw65s in namespace azuredisk-8081
STEP: validating provisioned PV
STEP: checking the PV
... skipping 97 lines ...
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying the pod
STEP: checking that the pod has 'FailedMount' event
Sep  8 09:48:50.150: INFO: deleting Pod "azuredisk-5466"/"azuredisk-volume-tester-n9rm8"
Sep  8 09:48:50.204: INFO: Error getting logs for pod azuredisk-volume-tester-n9rm8: the server rejected our request for an unknown reason (get pods azuredisk-volume-tester-n9rm8)
STEP: Deleting pod azuredisk-volume-tester-n9rm8 in namespace azuredisk-5466
STEP: validating provisioned PV
STEP: checking the PV
Sep  8 09:48:50.366: INFO: deleting PVC "azuredisk-5466"/"pvc-xw6tp"
Sep  8 09:48:50.366: INFO: Deleting PersistentVolumeClaim "pvc-xw6tp"
STEP: waiting for claim's PV "pvc-8195a53e-d977-417e-85e6-e7912d0ad021" to be deleted
... skipping 57 lines ...
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying the pod
STEP: checking that the pod's command exits with no error
Sep  8 09:51:13.111: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-5n6jd" in namespace "azuredisk-2790" to be "Succeeded or Failed"
Sep  8 09:51:13.165: INFO: Pod "azuredisk-volume-tester-5n6jd": Phase="Pending", Reason="", readiness=false. Elapsed: 54.09915ms
Sep  8 09:51:15.219: INFO: Pod "azuredisk-volume-tester-5n6jd": Phase="Pending", Reason="", readiness=false. Elapsed: 2.108287946s
Sep  8 09:51:17.274: INFO: Pod "azuredisk-volume-tester-5n6jd": Phase="Pending", Reason="", readiness=false. Elapsed: 4.163569737s
Sep  8 09:51:19.329: INFO: Pod "azuredisk-volume-tester-5n6jd": Phase="Pending", Reason="", readiness=false. Elapsed: 6.2181326s
Sep  8 09:51:21.383: INFO: Pod "azuredisk-volume-tester-5n6jd": Phase="Pending", Reason="", readiness=false. Elapsed: 8.272451931s
Sep  8 09:51:23.438: INFO: Pod "azuredisk-volume-tester-5n6jd": Phase="Pending", Reason="", readiness=false. Elapsed: 10.327158795s
Sep  8 09:51:25.492: INFO: Pod "azuredisk-volume-tester-5n6jd": Phase="Pending", Reason="", readiness=false. Elapsed: 12.381489708s
Sep  8 09:51:27.546: INFO: Pod "azuredisk-volume-tester-5n6jd": Phase="Pending", Reason="", readiness=false. Elapsed: 14.435610003s
Sep  8 09:51:29.601: INFO: Pod "azuredisk-volume-tester-5n6jd": Phase="Pending", Reason="", readiness=false. Elapsed: 16.490032342s
Sep  8 09:51:31.658: INFO: Pod "azuredisk-volume-tester-5n6jd": Phase="Pending", Reason="", readiness=false. Elapsed: 18.547106119s
Sep  8 09:51:33.715: INFO: Pod "azuredisk-volume-tester-5n6jd": Phase="Pending", Reason="", readiness=false. Elapsed: 20.603987709s
Sep  8 09:51:35.772: INFO: Pod "azuredisk-volume-tester-5n6jd": Phase="Succeeded", Reason="", readiness=false. Elapsed: 22.660903034s
STEP: Saw pod success
Sep  8 09:51:35.772: INFO: Pod "azuredisk-volume-tester-5n6jd" satisfied condition "Succeeded or Failed"
Sep  8 09:51:35.772: INFO: deleting Pod "azuredisk-2790"/"azuredisk-volume-tester-5n6jd"
Sep  8 09:51:35.834: INFO: Pod azuredisk-volume-tester-5n6jd has the following logs: e2e-test

STEP: Deleting pod azuredisk-volume-tester-5n6jd in namespace azuredisk-2790
STEP: validating provisioned PV
STEP: checking the PV
... skipping 39 lines ...
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying the pod
STEP: checking that the pod's command exits with an error
Sep  8 09:52:12.607: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-72kj5" in namespace "azuredisk-5356" to be "Error status code"
Sep  8 09:52:12.660: INFO: Pod "azuredisk-volume-tester-72kj5": Phase="Pending", Reason="", readiness=false. Elapsed: 52.819213ms
Sep  8 09:52:14.714: INFO: Pod "azuredisk-volume-tester-72kj5": Phase="Pending", Reason="", readiness=false. Elapsed: 2.106226295s
Sep  8 09:52:16.767: INFO: Pod "azuredisk-volume-tester-72kj5": Phase="Pending", Reason="", readiness=false. Elapsed: 4.159520518s
Sep  8 09:52:18.820: INFO: Pod "azuredisk-volume-tester-72kj5": Phase="Pending", Reason="", readiness=false. Elapsed: 6.21289394s
Sep  8 09:52:20.875: INFO: Pod "azuredisk-volume-tester-72kj5": Phase="Pending", Reason="", readiness=false. Elapsed: 8.267453s
Sep  8 09:52:22.929: INFO: Pod "azuredisk-volume-tester-72kj5": Phase="Pending", Reason="", readiness=false. Elapsed: 10.321079436s
Sep  8 09:52:24.983: INFO: Pod "azuredisk-volume-tester-72kj5": Phase="Pending", Reason="", readiness=false. Elapsed: 12.375565375s
Sep  8 09:52:27.037: INFO: Pod "azuredisk-volume-tester-72kj5": Phase="Pending", Reason="", readiness=false. Elapsed: 14.429862918s
Sep  8 09:52:29.092: INFO: Pod "azuredisk-volume-tester-72kj5": Phase="Pending", Reason="", readiness=false. Elapsed: 16.484265946s
Sep  8 09:52:31.150: INFO: Pod "azuredisk-volume-tester-72kj5": Phase="Pending", Reason="", readiness=false. Elapsed: 18.542780531s
Sep  8 09:52:33.206: INFO: Pod "azuredisk-volume-tester-72kj5": Phase="Pending", Reason="", readiness=false. Elapsed: 20.598935375s
Sep  8 09:52:35.264: INFO: Pod "azuredisk-volume-tester-72kj5": Phase="Pending", Reason="", readiness=false. Elapsed: 22.656215924s
Sep  8 09:52:37.320: INFO: Pod "azuredisk-volume-tester-72kj5": Phase="Failed", Reason="", readiness=false. Elapsed: 24.712138536s
STEP: Saw pod failure
Sep  8 09:52:37.320: INFO: Pod "azuredisk-volume-tester-72kj5" satisfied condition "Error status code"
STEP: checking that pod logs contain expected message
Sep  8 09:52:37.384: INFO: deleting Pod "azuredisk-5356"/"azuredisk-volume-tester-72kj5"
Sep  8 09:52:37.439: INFO: Pod azuredisk-volume-tester-72kj5 has the following logs: touch: /mnt/test-1/data: Read-only file system

STEP: Deleting pod azuredisk-volume-tester-72kj5 in namespace azuredisk-5356
STEP: validating provisioned PV
... skipping 379 lines ...
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying the pod
STEP: checking that the pod's command exits with no error
Sep  8 10:00:31.551: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-fkq8w" in namespace "azuredisk-59" to be "Succeeded or Failed"
Sep  8 10:00:31.604: INFO: Pod "azuredisk-volume-tester-fkq8w": Phase="Pending", Reason="", readiness=false. Elapsed: 53.421409ms
Sep  8 10:00:33.678: INFO: Pod "azuredisk-volume-tester-fkq8w": Phase="Pending", Reason="", readiness=false. Elapsed: 2.126674325s
Sep  8 10:00:35.736: INFO: Pod "azuredisk-volume-tester-fkq8w": Phase="Pending", Reason="", readiness=false. Elapsed: 4.184617646s
Sep  8 10:00:37.794: INFO: Pod "azuredisk-volume-tester-fkq8w": Phase="Pending", Reason="", readiness=false. Elapsed: 6.242719959s
Sep  8 10:00:39.850: INFO: Pod "azuredisk-volume-tester-fkq8w": Phase="Pending", Reason="", readiness=false. Elapsed: 8.299346209s
Sep  8 10:00:41.908: INFO: Pod "azuredisk-volume-tester-fkq8w": Phase="Pending", Reason="", readiness=false. Elapsed: 10.35744834s
... skipping 8 lines ...
Sep  8 10:01:00.423: INFO: Pod "azuredisk-volume-tester-fkq8w": Phase="Pending", Reason="", readiness=false. Elapsed: 28.872116263s
Sep  8 10:01:02.480: INFO: Pod "azuredisk-volume-tester-fkq8w": Phase="Pending", Reason="", readiness=false. Elapsed: 30.928775704s
Sep  8 10:01:04.538: INFO: Pod "azuredisk-volume-tester-fkq8w": Phase="Pending", Reason="", readiness=false. Elapsed: 32.987515479s
Sep  8 10:01:06.596: INFO: Pod "azuredisk-volume-tester-fkq8w": Phase="Pending", Reason="", readiness=false. Elapsed: 35.045471616s
Sep  8 10:01:08.654: INFO: Pod "azuredisk-volume-tester-fkq8w": Phase="Succeeded", Reason="", readiness=false. Elapsed: 37.102866894s
STEP: Saw pod success
Sep  8 10:01:08.654: INFO: Pod "azuredisk-volume-tester-fkq8w" satisfied condition "Succeeded or Failed"
Sep  8 10:01:08.654: INFO: deleting Pod "azuredisk-59"/"azuredisk-volume-tester-fkq8w"
Sep  8 10:01:08.718: INFO: Pod azuredisk-volume-tester-fkq8w has the following logs: hello world
hello world
hello world

STEP: Deleting pod azuredisk-volume-tester-fkq8w in namespace azuredisk-59
... skipping 73 lines ...
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying the pod
STEP: checking that the pod's command exits with no error
Sep  8 10:02:21.620: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-j5pwd" in namespace "azuredisk-2546" to be "Succeeded or Failed"
Sep  8 10:02:21.673: INFO: Pod "azuredisk-volume-tester-j5pwd": Phase="Pending", Reason="", readiness=false. Elapsed: 52.779545ms
Sep  8 10:02:23.727: INFO: Pod "azuredisk-volume-tester-j5pwd": Phase="Pending", Reason="", readiness=false. Elapsed: 2.106508124s
Sep  8 10:02:25.782: INFO: Pod "azuredisk-volume-tester-j5pwd": Phase="Pending", Reason="", readiness=false. Elapsed: 4.161303359s
Sep  8 10:02:27.837: INFO: Pod "azuredisk-volume-tester-j5pwd": Phase="Pending", Reason="", readiness=false. Elapsed: 6.216982169s
Sep  8 10:02:29.891: INFO: Pod "azuredisk-volume-tester-j5pwd": Phase="Pending", Reason="", readiness=false. Elapsed: 8.270579896s
Sep  8 10:02:31.946: INFO: Pod "azuredisk-volume-tester-j5pwd": Phase="Pending", Reason="", readiness=false. Elapsed: 10.325323904s
... skipping 5 lines ...
Sep  8 10:02:44.269: INFO: Pod "azuredisk-volume-tester-j5pwd": Phase="Pending", Reason="", readiness=false. Elapsed: 22.649124798s
Sep  8 10:02:46.323: INFO: Pod "azuredisk-volume-tester-j5pwd": Phase="Pending", Reason="", readiness=false. Elapsed: 24.702686981s
Sep  8 10:02:48.378: INFO: Pod "azuredisk-volume-tester-j5pwd": Phase="Pending", Reason="", readiness=false. Elapsed: 26.757508928s
Sep  8 10:02:50.435: INFO: Pod "azuredisk-volume-tester-j5pwd": Phase="Pending", Reason="", readiness=false. Elapsed: 28.814632635s
Sep  8 10:02:52.492: INFO: Pod "azuredisk-volume-tester-j5pwd": Phase="Succeeded", Reason="", readiness=false. Elapsed: 30.872113425s
STEP: Saw pod success
Sep  8 10:02:52.492: INFO: Pod "azuredisk-volume-tester-j5pwd" satisfied condition "Succeeded or Failed"
Sep  8 10:02:52.492: INFO: deleting Pod "azuredisk-2546"/"azuredisk-volume-tester-j5pwd"
Sep  8 10:02:52.557: INFO: Pod azuredisk-volume-tester-j5pwd has the following logs: 100+0 records in
100+0 records out
104857600 bytes (100.0MB) copied, 0.057857 seconds, 1.7GB/s
hello world

... skipping 117 lines ...
STEP: creating a PVC
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: deploying the pod
STEP: checking that the pod's command exits with no error
Sep  8 10:03:41.711: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-wzp2w" in namespace "azuredisk-8582" to be "Succeeded or Failed"
Sep  8 10:03:41.769: INFO: Pod "azuredisk-volume-tester-wzp2w": Phase="Pending", Reason="", readiness=false. Elapsed: 58.940204ms
Sep  8 10:03:43.826: INFO: Pod "azuredisk-volume-tester-wzp2w": Phase="Pending", Reason="", readiness=false. Elapsed: 2.115467772s
Sep  8 10:03:45.885: INFO: Pod "azuredisk-volume-tester-wzp2w": Phase="Pending", Reason="", readiness=false. Elapsed: 4.174457855s
Sep  8 10:03:47.945: INFO: Pod "azuredisk-volume-tester-wzp2w": Phase="Pending", Reason="", readiness=false. Elapsed: 6.233959604s
Sep  8 10:03:50.003: INFO: Pod "azuredisk-volume-tester-wzp2w": Phase="Pending", Reason="", readiness=false. Elapsed: 8.292913728s
Sep  8 10:03:52.062: INFO: Pod "azuredisk-volume-tester-wzp2w": Phase="Pending", Reason="", readiness=false. Elapsed: 10.351793368s
... skipping 8 lines ...
Sep  8 10:04:10.622: INFO: Pod "azuredisk-volume-tester-wzp2w": Phase="Pending", Reason="", readiness=false. Elapsed: 28.911566714s
Sep  8 10:04:12.682: INFO: Pod "azuredisk-volume-tester-wzp2w": Phase="Pending", Reason="", readiness=false. Elapsed: 30.971187532s
Sep  8 10:04:14.741: INFO: Pod "azuredisk-volume-tester-wzp2w": Phase="Pending", Reason="", readiness=false. Elapsed: 33.030126113s
Sep  8 10:04:16.800: INFO: Pod "azuredisk-volume-tester-wzp2w": Phase="Running", Reason="", readiness=false. Elapsed: 35.08907887s
Sep  8 10:04:18.859: INFO: Pod "azuredisk-volume-tester-wzp2w": Phase="Succeeded", Reason="", readiness=false. Elapsed: 37.148388175s
STEP: Saw pod success
Sep  8 10:04:18.859: INFO: Pod "azuredisk-volume-tester-wzp2w" satisfied condition "Succeeded or Failed"
Sep  8 10:04:18.859: INFO: deleting Pod "azuredisk-8582"/"azuredisk-volume-tester-wzp2w"
Sep  8 10:04:18.917: INFO: Pod azuredisk-volume-tester-wzp2w has the following logs: hello world

STEP: Deleting pod azuredisk-volume-tester-wzp2w in namespace azuredisk-8582
STEP: validating provisioned PV
STEP: checking the PV
... skipping 424 lines ...

    test case is only available for CSI drivers

    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/suite_test.go:304
------------------------------
Pre-Provisioned [single-az] 
  should fail when maxShares is invalid [disk.csi.azure.com][windows]
  /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning_test.go:164
STEP: Creating a kubernetes client
Sep  8 10:08:34.773: INFO: >>> kubeConfig: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig
STEP: Building a namespace api object, basename azuredisk
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
... skipping 3 lines ...

S [SKIPPING] [0.529 seconds]
Pre-Provisioned
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning_test.go:37
  [single-az]
  /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning_test.go:69
    should fail when maxShares is invalid [disk.csi.azure.com][windows] [It]
    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning_test.go:164

    test case is only available for CSI drivers

    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/suite_test.go:304
------------------------------
... skipping 242 lines ...
I0908 09:41:54.966444       1 tlsconfig.go:200] "Loaded serving cert" certName="Generated self signed cert" certDetail="\"localhost@1662630113\" [serving] validServingFor=[127.0.0.1,127.0.0.1,localhost] issuer=\"localhost-ca@1662630113\" (2022-09-08 08:41:53 +0000 UTC to 2023-09-08 08:41:53 +0000 UTC (now=2022-09-08 09:41:54.966416493 +0000 UTC))"
I0908 09:41:54.966650       1 named_certificates.go:53] "Loaded SNI cert" index=0 certName="self-signed loopback" certDetail="\"apiserver-loopback-client@1662630114\" [serving] validServingFor=[apiserver-loopback-client] issuer=\"apiserver-loopback-client-ca@1662630114\" (2022-09-08 08:41:53 +0000 UTC to 2023-09-08 08:41:53 +0000 UTC (now=2022-09-08 09:41:54.966625192 +0000 UTC))"
I0908 09:41:54.966678       1 secure_serving.go:210] Serving securely on 127.0.0.1:10257
I0908 09:41:54.966908       1 leaderelection.go:248] attempting to acquire leader lease kube-system/kube-controller-manager...
I0908 09:41:54.967313       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"
I0908 09:41:54.967463       1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt"
E0908 09:41:59.968006       1 leaderelection.go:330] error retrieving resource lock kube-system/kube-controller-manager: Get "https://10.0.0.4:6443/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager?timeout=5s": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
I0908 09:41:59.968045       1 leaderelection.go:253] failed to acquire lease kube-system/kube-controller-manager
I0908 09:42:03.231728       1 leaderelection.go:258] successfully acquired lease kube-system/kube-controller-manager
I0908 09:42:03.231925       1 event.go:294] "Event occurred" object="kube-system/kube-controller-manager" fieldPath="" kind="Lease" apiVersion="coordination.k8s.io/v1" type="Normal" reason="LeaderElection" message="capz-puhmj3-control-plane-kjzkz_d982c891-ab9d-4dbe-a491-e88663f9eef4 became leader"
W0908 09:42:03.262562       1 plugins.go:131] WARNING: azure built-in cloud provider is now deprecated. The Azure provider is deprecated and will be removed in a future release. Please use https://github.com/kubernetes-sigs/cloud-provider-azure
I0908 09:42:03.269234       1 azure_auth.go:232] Using AzurePublicCloud environment
I0908 09:42:03.269289       1 azure_auth.go:117] azure: using client_id+client_secret to retrieve access token
I0908 09:42:03.269455       1 azure_interfaceclient.go:63] Azure InterfacesClient (read ops) using rate limit config: QPS=1, bucket=5
... skipping 29 lines ...
I0908 09:42:03.270695       1 reflector.go:221] Starting reflector *v1.Node (14h45m2.058519871s) from vendor/k8s.io/client-go/informers/factory.go:134
I0908 09:42:03.271577       1 reflector.go:257] Listing and watching *v1.Node from vendor/k8s.io/client-go/informers/factory.go:134
I0908 09:42:03.270785       1 reflector.go:221] Starting reflector *v1.ServiceAccount (14h45m2.058519871s) from vendor/k8s.io/client-go/informers/factory.go:134
I0908 09:42:03.273589       1 reflector.go:257] Listing and watching *v1.ServiceAccount from vendor/k8s.io/client-go/informers/factory.go:134
I0908 09:42:03.270880       1 reflector.go:221] Starting reflector *v1.Secret (14h45m2.058519871s) from vendor/k8s.io/client-go/informers/factory.go:134
I0908 09:42:03.273881       1 reflector.go:257] Listing and watching *v1.Secret from vendor/k8s.io/client-go/informers/factory.go:134
W0908 09:42:03.290266       1 azure_config.go:53] Failed to get cloud-config from secret: failed to get secret azure-cloud-provider: secrets "azure-cloud-provider" is forbidden: User "system:serviceaccount:kube-system:azure-cloud-provider" cannot get resource "secrets" in API group "" in the namespace "kube-system", skip initializing from secret
I0908 09:42:03.290290       1 controllermanager.go:573] Starting "statefulset"
I0908 09:42:03.295944       1 controllermanager.go:602] Started "statefulset"
I0908 09:42:03.295965       1 controllermanager.go:573] Starting "csrsigning"
I0908 09:42:03.296224       1 stateful_set.go:152] Starting stateful set controller
I0908 09:42:03.296240       1 shared_informer.go:273] Waiting for caches to sync for stateful set
I0908 09:42:03.314466       1 dynamic_serving_content.go:113] "Loaded a new cert/key pair" name="csr-controller::/etc/kubernetes/pki/ca.crt::/etc/kubernetes/pki/ca.key"
... skipping 188 lines ...
I0908 09:42:06.236057       1 plugins.go:646] "Loaded volume plugin" pluginName="kubernetes.io/rbd"
I0908 09:42:06.236072       1 plugins.go:646] "Loaded volume plugin" pluginName="kubernetes.io/aws-ebs"
I0908 09:42:06.236088       1 plugins.go:646] "Loaded volume plugin" pluginName="kubernetes.io/gce-pd"
I0908 09:42:06.236103       1 plugins.go:646] "Loaded volume plugin" pluginName="kubernetes.io/azure-disk"
I0908 09:42:06.236136       1 plugins.go:646] "Loaded volume plugin" pluginName="kubernetes.io/azure-file"
I0908 09:42:06.236156       1 plugins.go:646] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
I0908 09:42:06.236185       1 csi_plugin.go:257] Cast from VolumeHost to KubeletVolumeHost failed. Skipping CSINode initialization, not running on kubelet
I0908 09:42:06.236199       1 plugins.go:646] "Loaded volume plugin" pluginName="kubernetes.io/csi"
I0908 09:42:06.236294       1 controllermanager.go:602] Started "persistentvolume-binder"
I0908 09:42:06.236439       1 controllermanager.go:573] Starting "serviceaccount"
I0908 09:42:06.236393       1 pv_controller_base.go:318] Starting persistent volume controller
I0908 09:42:06.236508       1 shared_informer.go:273] Waiting for caches to sync for persistent volume
I0908 09:42:06.385359       1 controllermanager.go:602] Started "serviceaccount"
... skipping 20 lines ...
I0908 09:42:07.135445       1 plugins.go:646] "Loaded volume plugin" pluginName="kubernetes.io/aws-ebs"
I0908 09:42:07.135477       1 plugins.go:646] "Loaded volume plugin" pluginName="kubernetes.io/gce-pd"
I0908 09:42:07.135575       1 plugins.go:646] "Loaded volume plugin" pluginName="kubernetes.io/azure-disk"
I0908 09:42:07.135694       1 plugins.go:646] "Loaded volume plugin" pluginName="kubernetes.io/vsphere-volume"
I0908 09:42:07.135739       1 plugins.go:646] "Loaded volume plugin" pluginName="kubernetes.io/fc"
I0908 09:42:07.135758       1 plugins.go:646] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
I0908 09:42:07.135778       1 csi_plugin.go:257] Cast from VolumeHost to KubeletVolumeHost failed. Skipping CSINode initialization, not running on kubelet
I0908 09:42:07.135794       1 plugins.go:646] "Loaded volume plugin" pluginName="kubernetes.io/csi"
I0908 09:42:07.135868       1 controllermanager.go:602] Started "attachdetach"
I0908 09:42:07.135885       1 controllermanager.go:573] Starting "csrapproving"
I0908 09:42:07.135990       1 attach_detach_controller.go:328] Starting attach detach controller
I0908 09:42:07.136001       1 shared_informer.go:273] Waiting for caches to sync for attach detach
I0908 09:42:07.185681       1 controllermanager.go:602] Started "csrapproving"
... skipping 275 lines ...
I0908 09:42:08.285982       1 shared_informer.go:303] caches populated
I0908 09:42:08.286007       1 shared_informer.go:280] Caches are synced for garbage collector
I0908 09:42:08.286117       1 garbagecollector.go:163] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0908 09:42:10.418964       1 taint_manager.go:466] "Noticed node update" node={nodeName:capz-puhmj3-control-plane-kjzkz}
I0908 09:42:10.419339       1 taint_manager.go:471] "Updating known taints on node" node="capz-puhmj3-control-plane-kjzkz" taints=[]
I0908 09:42:10.418972       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-puhmj3-control-plane-kjzkz"
W0908 09:42:10.419560       1 actual_state_of_world.go:541] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="capz-puhmj3-control-plane-kjzkz" does not exist
I0908 09:42:10.419007       1 controller.go:690] Syncing backends for all LB services.
I0908 09:42:10.419582       1 controller.go:728] Running updateLoadBalancerHosts(len(services)==0, workers==1)
I0908 09:42:10.419596       1 controller.go:753] Finished updateLoadBalancerHosts
I0908 09:42:10.419601       1 controller.go:694] Successfully updated 0 out of 0 load balancers to direct traffic to the updated set of nodes
I0908 09:42:10.419781       1 controller.go:686] It took 0.000773675 seconds to finish syncNodes
I0908 09:42:10.419040       1 topologycache.go:183] Ignoring node capz-puhmj3-control-plane-kjzkz because it is not ready: [{MemoryPressure False 2022-09-08 09:41:42 +0000 UTC 2022-09-08 09:41:42 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2022-09-08 09:41:42 +0000 UTC 2022-09-08 09:41:42 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2022-09-08 09:41:42 +0000 UTC 2022-09-08 09:41:42 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready False 2022-09-08 09:41:42 +0000 UTC 2022-09-08 09:41:42 +0000 UTC KubeletNotReady [container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful, container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized, CSINode is not yet initialized]}]
I0908 09:42:10.419804       1 topologycache.go:215] Insufficient node info for topology hints (0 zones, %!s(int64=0) CPU, true)
I0908 09:42:10.440020       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-puhmj3-control-plane-kjzkz"
I0908 09:42:10.451857       1 ttl_controller.go:275] "Changed ttl annotation" node="capz-puhmj3-control-plane-kjzkz" new_ttl="0s"
I0908 09:42:10.453420       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-puhmj3-control-plane-kjzkz"
I0908 09:42:10.460903       1 ttl_controller.go:275] "Changed ttl annotation" node="capz-puhmj3-control-plane-kjzkz" new_ttl="0s"
I0908 09:42:10.721180       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-puhmj3-control-plane-kjzkz"
... skipping 28 lines ...
I0908 09:42:11.630259       1 disruption.go:479] addPod called on pod "coredns-84994b8c4-fkfsd"
I0908 09:42:11.630276       1 disruption.go:570] No PodDisruptionBudgets found for pod coredns-84994b8c4-fkfsd, PodDisruptionBudget controller will avoid syncing.
I0908 09:42:11.630281       1 disruption.go:482] No matching pdb for pod "coredns-84994b8c4-fkfsd"
I0908 09:42:11.630316       1 pvc_protection_controller.go:380] "Enqueuing PVCs for Pod" pod="kube-system/coredns-84994b8c4-fkfsd" podUID=c507b17c-3c60-4d8b-a1dc-370a245bba88
I0908 09:42:11.630368       1 taint_manager.go:431] "Noticed pod update" pod="kube-system/coredns-84994b8c4-fkfsd"
I0908 09:42:11.639370       1 deployment_controller.go:585] "Finished syncing deployment" deployment="kube-system/coredns" duration="64.931382ms"
I0908 09:42:11.639403       1 deployment_controller.go:497] "Error syncing deployment" deployment="kube-system/coredns" err="Operation cannot be fulfilled on deployments.apps \"coredns\": the object has been modified; please apply your changes to the latest version and try again"
I0908 09:42:11.639434       1 deployment_controller.go:583] "Started syncing deployment" deployment="kube-system/coredns" startTime="2022-09-08 09:42:11.639419772 +0000 UTC m=+18.677572576"
I0908 09:42:11.640078       1 deployment_util.go:775] Deployment "coredns" timed out (false) [last progress check: 2022-09-08 09:42:11 +0000 UTC - now: 2022-09-08 09:42:11.640069752 +0000 UTC m=+18.678222456]
I0908 09:42:11.653361       1 endpointslicemirroring_controller.go:278] syncEndpoints("kube-system/kube-dns")
I0908 09:42:11.653389       1 endpointslicemirroring_controller.go:313] kube-system/kube-dns Service now has selector, cleaning up any mirrored EndpointSlices
I0908 09:42:11.653409       1 endpointslicemirroring_controller.go:275] Finished syncing EndpointSlices for "kube-system/kube-dns" Endpoints. (57.798µs)
I0908 09:42:11.654667       1 replica_set.go:394] Pod coredns-84994b8c4-shl7w created: &v1.Pod{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"coredns-84994b8c4-shl7w", GenerateName:"coredns-84994b8c4-", Namespace:"kube-system", SelfLink:"", UID:"277a9b23-fc18-4486-80f7-303c96c88e5e", ResourceVersion:"308", Generation:0, CreationTimestamp:time.Date(2022, time.September, 8, 9, 42, 11, 0, time.Local), DeletionTimestamp:<nil>, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-dns", "pod-template-hash":"84994b8c4"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference{v1.OwnerReference{APIVersion:"apps/v1", Kind:"ReplicaSet", Name:"coredns-84994b8c4", UID:"9a3d57ee-ffb4-4ee5-81ae-742675b45065", Controller:(*bool)(0xc0005296d0), BlockOwnerDeletion:(*bool)(0xc0005296d1)}}, Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kube-controller-manager", Operation:"Update", APIVersion:"v1", Time:time.Date(2022, time.September, 8, 9, 42, 11, 0, time.Local), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc000e22be8), Subresource:""}}}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"config-volume", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(0xc0015ca640), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"kube-api-access-jdp4m", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(0xc0004e1f80), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"coredns", Image:"registry.k8s.io/coredns/coredns:v1.9.3", Command:[]string(nil), Args:[]string{"-conf", "/etc/coredns/Corefile"}, WorkingDir:"", Ports:[]v1.ContainerPort{v1.ContainerPort{Name:"dns", HostPort:0, ContainerPort:53, Protocol:"UDP", HostIP:""}, v1.ContainerPort{Name:"dns-tcp", HostPort:0, ContainerPort:53, Protocol:"TCP", HostIP:""}, v1.ContainerPort{Name:"metrics", HostPort:0, ContainerPort:9153, Protocol:"TCP", HostIP:""}}, EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar(nil), Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:178257920, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"170Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:100, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:73400320, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"70Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"config-volume", ReadOnly:true, MountPath:"/etc/coredns", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-jdp4m", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(0xc0015ca800), ReadinessProbe:(*v1.Probe)(0xc0015ca880), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0xc001a0f200), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0xc000529830), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"Default", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"coredns", DeprecatedServiceAccount:"coredns", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:false, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0xc0005715e0), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(0xc000e22c30), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"CriticalAddonsOnly", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node-role.kubernetes.io/control-plane", Operator:"", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node.kubernetes.io/not-ready", Operator:"Exists", Value:"", Effect:"NoExecute", TolerationSeconds:(*int64)(0xc0005298b0)}, v1.Toleration{Key:"node.kubernetes.io/unreachable", Operator:"Exists", Value:"", Effect:"NoExecute", TolerationSeconds:(*int64)(0xc0005298f0)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-cluster-critical", Priority:(*int32)(0xc0005298f8), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(0xc0005298fc), PreemptionPolicy:(*v1.PreemptionPolicy)(0xc001b866c0), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil), OS:(*v1.PodOS)(nil), HostUsers:(*bool)(nil)}, Status:v1.PodStatus{Phase:"Pending", Conditions:[]v1.PodCondition(nil), Message:"", Reason:"", NominatedNodeName:"", HostIP:"", PodIP:"", PodIPs:[]v1.PodIP(nil), StartTime:<nil>, InitContainerStatuses:[]v1.ContainerStatus(nil), ContainerStatuses:[]v1.ContainerStatus(nil), QOSClass:"Burstable", EphemeralContainerStatuses:[]v1.ContainerStatus(nil)}}.
... skipping 323 lines ...
I0908 09:42:35.365598       1 endpointslice_controller.go:319] Finished syncing service "kube-system/metrics-server" endpoint slices. (124.325µs)
I0908 09:42:35.377222       1 replica_set.go:667] Finished syncing ReplicaSet "kube-system/metrics-server-76f7667fbf" (26.290872ms)
I0908 09:42:35.377433       1 controller_utils.go:189] Controller expectations fulfilled &controller.ControlleeExpectations{add:0, del:0, key:"kube-system/metrics-server-76f7667fbf", timestamp:time.Time{wall:0xc0be8c22d4eea8b9, ext:42389337785, loc:(*time.Location)(0x6f12040)}}
I0908 09:42:35.377608       1 replica_set_utils.go:59] Updating status for : kube-system/metrics-server-76f7667fbf, replicas 0->1 (need 1), fullyLabeledReplicas 0->1, readyReplicas 0->0, availableReplicas 0->0, sequence No: 0->1
I0908 09:42:35.378012       1 deployment_controller.go:288] "ReplicaSet updated" replicaSet="kube-system/metrics-server-76f7667fbf"
I0908 09:42:35.383074       1 deployment_controller.go:585] "Finished syncing deployment" deployment="kube-system/metrics-server" duration="55.947331ms"
I0908 09:42:35.383269       1 deployment_controller.go:497] "Error syncing deployment" deployment="kube-system/metrics-server" err="Operation cannot be fulfilled on deployments.apps \"metrics-server\": the object has been modified; please apply your changes to the latest version and try again"
I0908 09:42:35.383405       1 deployment_controller.go:583] "Started syncing deployment" deployment="kube-system/metrics-server" startTime="2022-09-08 09:42:35.383387161 +0000 UTC m=+42.421539865"
I0908 09:42:35.384081       1 deployment_util.go:775] Deployment "metrics-server" timed out (false) [last progress check: 2022-09-08 09:42:35 +0000 UTC - now: 2022-09-08 09:42:35.384072001 +0000 UTC m=+42.422224705]
I0908 09:42:35.388591       1 pvc_protection_controller.go:380] "Enqueuing PVCs for Pod" pod="kube-system/metrics-server-76f7667fbf-6gk8w" podUID=37e07ae7-14d4-4220-b71e-81012f7bb451
I0908 09:42:35.388934       1 replica_set.go:457] Pod metrics-server-76f7667fbf-6gk8w updated, objectMeta {Name:metrics-server-76f7667fbf-6gk8w GenerateName:metrics-server-76f7667fbf- Namespace:kube-system SelfLink: UID:37e07ae7-14d4-4220-b71e-81012f7bb451 ResourceVersion:425 Generation:0 CreationTimestamp:2022-09-08 09:42:35 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[k8s-app:metrics-server pod-template-hash:76f7667fbf] Annotations:map[] OwnerReferences:[{APIVersion:apps/v1 Kind:ReplicaSet Name:metrics-server-76f7667fbf UID:3a414fe4-cc41-41b3-88ab-360cc3470f32 Controller:0xc0026a6aae BlockOwnerDeletion:0xc0026a6aaf}] Finalizers:[] ManagedFields:[{Manager:kube-controller-manager Operation:Update APIVersion:v1 Time:2022-09-08 09:42:35 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"3a414fe4-cc41-41b3-88ab-360cc3470f32\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"metrics-server\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:livenessProbe":{".":{},"f:failureThreshold":{},"f:httpGet":{".":{},"f:path":{},"f:port":{},"f:scheme":{}},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:name":{},"f:ports":{".":{},"k:{\"containerPort\":4443,\"protocol\":\"TCP\"}":{".":{},"f:containerPort":{},"f:name":{},"f:protocol":{}}},"f:readinessProbe":{".":{},"f:failureThreshold":{},"f:httpGet":{".":{},"f:path":{},"f:port":{},"f:scheme":{}},"f:initialDelaySeconds":{},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:resources":{".":{},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:securityContext":{".":{},"f:readOnlyRootFilesystem":{},"f:runAsNonRoot":{},"f:runAsUser":{}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/tmp\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:nodeSelector":{},"f:priorityClassName":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:serviceAccount":{},"f:serviceAccountName":{},"f:terminationGracePeriodSeconds":{},"f:tolerations":{},"f:volumes":{".":{},"k:{\"name\":\"tmp-dir\"}":{".":{},"f:emptyDir":{},"f:name":{}}}}} Subresource:}]} -> {Name:metrics-server-76f7667fbf-6gk8w GenerateName:metrics-server-76f7667fbf- Namespace:kube-system SelfLink: UID:37e07ae7-14d4-4220-b71e-81012f7bb451 ResourceVersion:430 Generation:0 CreationTimestamp:2022-09-08 09:42:35 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[k8s-app:metrics-server pod-template-hash:76f7667fbf] Annotations:map[] OwnerReferences:[{APIVersion:apps/v1 Kind:ReplicaSet Name:metrics-server-76f7667fbf UID:3a414fe4-cc41-41b3-88ab-360cc3470f32 Controller:0xc0026453ae BlockOwnerDeletion:0xc0026453af}] Finalizers:[] ManagedFields:[{Manager:kube-controller-manager Operation:Update APIVersion:v1 Time:2022-09-08 09:42:35 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"3a414fe4-cc41-41b3-88ab-360cc3470f32\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"metrics-server\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:livenessProbe":{".":{},"f:failureThreshold":{},"f:httpGet":{".":{},"f:path":{},"f:port":{},"f:scheme":{}},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:name":{},"f:ports":{".":{},"k:{\"containerPort\":4443,\"protocol\":\"TCP\"}":{".":{},"f:containerPort":{},"f:name":{},"f:protocol":{}}},"f:readinessProbe":{".":{},"f:failureThreshold":{},"f:httpGet":{".":{},"f:path":{},"f:port":{},"f:scheme":{}},"f:initialDelaySeconds":{},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:resources":{".":{},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:securityContext":{".":{},"f:readOnlyRootFilesystem":{},"f:runAsNonRoot":{},"f:runAsUser":{}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/tmp\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:nodeSelector":{},"f:priorityClassName":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:serviceAccount":{},"f:serviceAccountName":{},"f:terminationGracePeriodSeconds":{},"f:tolerations":{},"f:volumes":{".":{},"k:{\"name\":\"tmp-dir\"}":{".":{},"f:emptyDir":{},"f:name":{}}}}} Subresource:} {Manager:kube-scheduler Operation:Update APIVersion:v1 Time:2022-09-08 09:42:35 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:status":{"f:conditions":{".":{},"k:{\"type\":\"PodScheduled\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} Subresource:status}]}.
I0908 09:42:35.389226       1 disruption.go:494] updatePod called on pod "metrics-server-76f7667fbf-6gk8w"
I0908 09:42:35.389397       1 disruption.go:570] No PodDisruptionBudgets found for pod metrics-server-76f7667fbf-6gk8w, PodDisruptionBudget controller will avoid syncing.
I0908 09:42:35.389508       1 disruption.go:497] No matching pdb for pod "metrics-server-76f7667fbf-6gk8w"
I0908 09:42:35.392156       1 deployment_controller.go:585] "Finished syncing deployment" deployment="kube-system/metrics-server" duration="8.752988ms"
I0908 09:42:35.392333       1 deployment_controller.go:583] "Started syncing deployment" deployment="kube-system/metrics-server" startTime="2022-09-08 09:42:35.392315085 +0000 UTC m=+42.430467889"
I0908 09:42:35.392773       1 deployment_util.go:775] Deployment "metrics-server" timed out (false) [last progress check: 2022-09-08 09:42:35 +0000 UTC - now: 2022-09-08 09:42:35.392767077 +0000 UTC m=+42.430919781]
I0908 09:42:35.393165       1 deployment_controller.go:183] "Updating deployment" deployment="kube-system/metrics-server"
I0908 09:42:35.400796       1 replica_set_utils.go:59] Updating status for : kube-system/metrics-server-76f7667fbf, replicas 0->1 (need 1), fullyLabeledReplicas 0->1, readyReplicas 0->0, availableReplicas 0->0, sequence No: 1->1
I0908 09:42:35.406820       1 deployment_controller.go:585] "Finished syncing deployment" deployment="kube-system/metrics-server" duration="14.48736ms"
I0908 09:42:35.406856       1 deployment_controller.go:497] "Error syncing deployment" deployment="kube-system/metrics-server" err="Operation cannot be fulfilled on deployments.apps \"metrics-server\": the object has been modified; please apply your changes to the latest version and try again"
I0908 09:42:35.406887       1 deployment_controller.go:583] "Started syncing deployment" deployment="kube-system/metrics-server" startTime="2022-09-08 09:42:35.40687276 +0000 UTC m=+42.445025464"
I0908 09:42:35.407375       1 deployment_util.go:775] Deployment "metrics-server" timed out (false) [last progress check: 2022-09-08 09:42:35 +0000 UTC - now: 2022-09-08 09:42:35.40736586 +0000 UTC m=+42.445518564]
I0908 09:42:35.407416       1 progress.go:195] Queueing up deployment "metrics-server" for a progress check after 599s
I0908 09:42:35.407435       1 deployment_controller.go:585] "Finished syncing deployment" deployment="kube-system/metrics-server" duration="552.912µs"
I0908 09:42:35.415548       1 deployment_controller.go:583] "Started syncing deployment" deployment="kube-system/metrics-server" startTime="2022-09-08 09:42:35.415518326 +0000 UTC m=+42.453671030"
I0908 09:42:35.416160       1 deployment_util.go:775] Deployment "metrics-server" timed out (false) [last progress check: 2022-09-08 09:42:35 +0000 UTC - now: 2022-09-08 09:42:35.416151955 +0000 UTC m=+42.454304659]
... skipping 22 lines ...
I0908 09:42:37.159070       1 event.go:294] "Event occurred" object="kube-system/calico-kube-controllers" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set calico-kube-controllers-755ff8d7b5 to 1"
I0908 09:42:37.162198       1 deployment_controller.go:183] "Updating deployment" deployment="kube-system/calico-kube-controllers"
I0908 09:42:37.162795       1 deployment_util.go:775] Deployment "calico-kube-controllers" timed out (false) [last progress check: 2022-09-08 09:42:37.158262718 +0000 UTC m=+44.196415522 - now: 2022-09-08 09:42:37.162785328 +0000 UTC m=+44.200938132]
I0908 09:42:37.167362       1 replica_set.go:394] Pod calico-kube-controllers-755ff8d7b5-fqg7l created: &v1.Pod{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"calico-kube-controllers-755ff8d7b5-fqg7l", GenerateName:"calico-kube-controllers-755ff8d7b5-", Namespace:"kube-system", SelfLink:"", UID:"673c9697-dfbd-4190-b450-a8815130fc8f", ResourceVersion:"492", Generation:0, CreationTimestamp:time.Date(2022, time.September, 8, 9, 42, 37, 0, time.Local), DeletionTimestamp:<nil>, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"calico-kube-controllers", "pod-template-hash":"755ff8d7b5"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference{v1.OwnerReference{APIVersion:"apps/v1", Kind:"ReplicaSet", Name:"calico-kube-controllers-755ff8d7b5", UID:"7c0861ae-a0da-49a6-ba70-93a704772612", Controller:(*bool)(0xc000f47dce), BlockOwnerDeletion:(*bool)(0xc000f47dcf)}}, Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kube-controller-manager", Operation:"Update", APIVersion:"v1", Time:time.Date(2022, time.September, 8, 9, 42, 37, 0, time.Local), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc001b7dd28), Subresource:""}}}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"kube-api-access-tlm5q", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(0xc002501e20), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"calico-kube-controllers", Image:"docker.io/calico/kube-controllers:v3.23.0", Command:[]string(nil), Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"ENABLED_CONTROLLERS", Value:"node", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"DATASTORE_TYPE", Value:"kubernetes", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-api-access-tlm5q", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(0xc000bb5500), ReadinessProbe:(*v1.Probe)(0xc000bb5540), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0xc00124d160), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"calico-kube-controllers", DeprecatedServiceAccount:"calico-kube-controllers", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:false, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0xc00034f650), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"CriticalAddonsOnly", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node-role.kubernetes.io/master", Operator:"", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node-role.kubernetes.io/control-plane", Operator:"", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node.kubernetes.io/not-ready", Operator:"Exists", Value:"", Effect:"NoExecute", TolerationSeconds:(*int64)(0xc00124d1d0)}, v1.Toleration{Key:"node.kubernetes.io/unreachable", Operator:"Exists", Value:"", Effect:"NoExecute", TolerationSeconds:(*int64)(0xc00124d1f0)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-cluster-critical", Priority:(*int32)(0xc00124d1f8), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(0xc00124d1fc), PreemptionPolicy:(*v1.PreemptionPolicy)(0xc001bd54c0), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil), OS:(*v1.PodOS)(nil), HostUsers:(*bool)(nil)}, Status:v1.PodStatus{Phase:"Pending", Conditions:[]v1.PodCondition(nil), Message:"", Reason:"", NominatedNodeName:"", HostIP:"", PodIP:"", PodIPs:[]v1.PodIP(nil), StartTime:<nil>, InitContainerStatuses:[]v1.ContainerStatus(nil), ContainerStatuses:[]v1.ContainerStatus(nil), QOSClass:"BestEffort", EphemeralContainerStatuses:[]v1.ContainerStatus(nil)}}.
I0908 09:42:37.168265       1 controller_utils.go:240] Lowered expectations &controller.ControlleeExpectations{add:0, del:0, key:"kube-system/calico-kube-controllers-755ff8d7b5", timestamp:time.Time{wall:0xc0be8c2349735094, ext:44196704916, loc:(*time.Location)(0x6f12040)}}
I0908 09:42:37.168040       1 deployment_controller.go:585] "Finished syncing deployment" deployment="kube-system/calico-kube-controllers" duration="13.193538ms"
I0908 09:42:37.168632       1 deployment_controller.go:497] "Error syncing deployment" deployment="kube-system/calico-kube-controllers" err="Operation cannot be fulfilled on deployments.apps \"calico-kube-controllers\": the object has been modified; please apply your changes to the latest version and try again"
I0908 09:42:37.168796       1 deployment_controller.go:583] "Started syncing deployment" deployment="kube-system/calico-kube-controllers" startTime="2022-09-08 09:42:37.168777309 +0000 UTC m=+44.206930013"
I0908 09:42:37.169035       1 controller_utils.go:581] Controller calico-kube-controllers-755ff8d7b5 created pod calico-kube-controllers-755ff8d7b5-fqg7l
I0908 09:42:37.169087       1 replica_set_utils.go:59] Updating status for : kube-system/calico-kube-controllers-755ff8d7b5, replicas 0->0 (need 1), fullyLabeledReplicas 0->0, readyReplicas 0->0, availableReplicas 0->0, sequence No: 0->1
I0908 09:42:37.169409       1 deployment_util.go:775] Deployment "calico-kube-controllers" timed out (false) [last progress check: 2022-09-08 09:42:37 +0000 UTC - now: 2022-09-08 09:42:37.169404197 +0000 UTC m=+44.207556901]
I0908 09:42:37.168084       1 pvc_protection_controller.go:380] "Enqueuing PVCs for Pod" pod="kube-system/calico-kube-controllers-755ff8d7b5-fqg7l" podUID=673c9697-dfbd-4190-b450-a8815130fc8f
I0908 09:42:37.168137       1 taint_manager.go:431] "Noticed pod update" pod="kube-system/calico-kube-controllers-755ff8d7b5-fqg7l"
... skipping 100 lines ...
I0908 09:42:37.760876       1 reflector.go:221] Starting reflector *v1.PartialObjectMetadata (12h38m19.145862688s) from vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:90
I0908 09:42:37.760886       1 reflector.go:257] Listing and watching *v1.PartialObjectMetadata from vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:90
I0908 09:42:37.862758       1 resource_quota_monitor.go:283] quota monitor not synced: crd.projectcalico.org/v1, Resource=networkpolicies
I0908 09:42:37.960692       1 shared_informer.go:303] caches populated
I0908 09:42:37.960904       1 shared_informer.go:280] Caches are synced for resource quota
I0908 09:42:37.961000       1 resource_quota_controller.go:462] synced quota controller
W0908 09:42:38.296701       1 garbagecollector.go:752] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
I0908 09:42:38.296990       1 garbagecollector.go:220] syncing garbage collector with updated resources from discovery (attempt 1): added: [crd.projectcalico.org/v1, Resource=bgpconfigurations crd.projectcalico.org/v1, Resource=bgppeers crd.projectcalico.org/v1, Resource=blockaffinities crd.projectcalico.org/v1, Resource=caliconodestatuses crd.projectcalico.org/v1, Resource=clusterinformations crd.projectcalico.org/v1, Resource=felixconfigurations crd.projectcalico.org/v1, Resource=globalnetworkpolicies crd.projectcalico.org/v1, Resource=globalnetworksets crd.projectcalico.org/v1, Resource=hostendpoints crd.projectcalico.org/v1, Resource=ipamblocks crd.projectcalico.org/v1, Resource=ipamconfigs crd.projectcalico.org/v1, Resource=ipamhandles crd.projectcalico.org/v1, Resource=ippools crd.projectcalico.org/v1, Resource=ipreservations crd.projectcalico.org/v1, Resource=kubecontrollersconfigurations crd.projectcalico.org/v1, Resource=networkpolicies crd.projectcalico.org/v1, Resource=networksets], removed: []
I0908 09:42:38.297004       1 garbagecollector.go:226] reset restmapper
E0908 09:42:38.307279       1 memcache.go:206] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request
E0908 09:42:38.309055       1 memcache.go:104] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0908 09:42:38.309639       1 graph_builder.go:176] using a shared informer for resource "crd.projectcalico.org/v1, Resource=clusterinformations", kind "crd.projectcalico.org/v1, Kind=ClusterInformation"
I0908 09:42:38.309710       1 graph_builder.go:176] using a shared informer for resource "crd.projectcalico.org/v1, Resource=ipamconfigs", kind "crd.projectcalico.org/v1, Kind=IPAMConfig"
... skipping 213 lines ...
I0908 09:42:52.858267       1 replica_set.go:457] Pod metrics-server-76f7667fbf-6gk8w updated, objectMeta {Name:metrics-server-76f7667fbf-6gk8w GenerateName:metrics-server-76f7667fbf- Namespace:kube-system SelfLink: UID:37e07ae7-14d4-4220-b71e-81012f7bb451 ResourceVersion:555 Generation:0 CreationTimestamp:2022-09-08 09:42:35 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[k8s-app:metrics-server pod-template-hash:76f7667fbf] Annotations:map[] OwnerReferences:[{APIVersion:apps/v1 Kind:ReplicaSet Name:metrics-server-76f7667fbf UID:3a414fe4-cc41-41b3-88ab-360cc3470f32 Controller:0xc002154a6e BlockOwnerDeletion:0xc002154a6f}] Finalizers:[] ManagedFields:[{Manager:kube-controller-manager Operation:Update APIVersion:v1 Time:2022-09-08 09:42:35 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"3a414fe4-cc41-41b3-88ab-360cc3470f32\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"metrics-server\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:livenessProbe":{".":{},"f:failureThreshold":{},"f:httpGet":{".":{},"f:path":{},"f:port":{},"f:scheme":{}},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:name":{},"f:ports":{".":{},"k:{\"containerPort\":4443,\"protocol\":\"TCP\"}":{".":{},"f:containerPort":{},"f:name":{},"f:protocol":{}}},"f:readinessProbe":{".":{},"f:failureThreshold":{},"f:httpGet":{".":{},"f:path":{},"f:port":{},"f:scheme":{}},"f:initialDelaySeconds":{},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:resources":{".":{},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:securityContext":{".":{},"f:readOnlyRootFilesystem":{},"f:runAsNonRoot":{},"f:runAsUser":{}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/tmp\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:nodeSelector":{},"f:priorityClassName":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:serviceAccount":{},"f:serviceAccountName":{},"f:terminationGracePeriodSeconds":{},"f:tolerations":{},"f:volumes":{".":{},"k:{\"name\":\"tmp-dir\"}":{".":{},"f:emptyDir":{},"f:name":{}}}}} Subresource:} {Manager:kube-scheduler Operation:Update APIVersion:v1 Time:2022-09-08 09:42:35 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:status":{"f:conditions":{".":{},"k:{\"type\":\"PodScheduled\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} Subresource:status}]} -> {Name:metrics-server-76f7667fbf-6gk8w GenerateName:metrics-server-76f7667fbf- Namespace:kube-system SelfLink: UID:37e07ae7-14d4-4220-b71e-81012f7bb451 ResourceVersion:563 Generation:0 CreationTimestamp:2022-09-08 09:42:35 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[k8s-app:metrics-server pod-template-hash:76f7667fbf] Annotations:map[] OwnerReferences:[{APIVersion:apps/v1 Kind:ReplicaSet Name:metrics-server-76f7667fbf UID:3a414fe4-cc41-41b3-88ab-360cc3470f32 Controller:0xc0024d231e BlockOwnerDeletion:0xc0024d231f}] Finalizers:[] ManagedFields:[{Manager:kube-controller-manager Operation:Update APIVersion:v1 Time:2022-09-08 09:42:35 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"3a414fe4-cc41-41b3-88ab-360cc3470f32\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"metrics-server\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:livenessProbe":{".":{},"f:failureThreshold":{},"f:httpGet":{".":{},"f:path":{},"f:port":{},"f:scheme":{}},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:name":{},"f:ports":{".":{},"k:{\"containerPort\":4443,\"protocol\":\"TCP\"}":{".":{},"f:containerPort":{},"f:name":{},"f:protocol":{}}},"f:readinessProbe":{".":{},"f:failureThreshold":{},"f:httpGet":{".":{},"f:path":{},"f:port":{},"f:scheme":{}},"f:initialDelaySeconds":{},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:resources":{".":{},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:securityContext":{".":{},"f:readOnlyRootFilesystem":{},"f:runAsNonRoot":{},"f:runAsUser":{}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/tmp\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:nodeSelector":{},"f:priorityClassName":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:serviceAccount":{},"f:serviceAccountName":{},"f:terminationGracePeriodSeconds":{},"f:tolerations":{},"f:volumes":{".":{},"k:{\"name\":\"tmp-dir\"}":{".":{},"f:emptyDir":{},"f:name":{}}}}} Subresource:} {Manager:kube-scheduler Operation:Update APIVersion:v1 Time:2022-09-08 09:42:35 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:status":{"f:conditions":{".":{},"k:{\"type\":\"PodScheduled\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} Subresource:status} {Manager:kubelet Operation:Update APIVersion:v1 Time:2022-09-08 09:42:52 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:startTime":{}}} Subresource:status}]}.
I0908 09:42:52.858372       1 disruption.go:494] updatePod called on pod "metrics-server-76f7667fbf-6gk8w"
I0908 09:42:52.858414       1 controller_utils.go:189] Controller expectations fulfilled &controller.ControlleeExpectations{add:0, del:0, key:"kube-system/metrics-server-76f7667fbf", timestamp:time.Time{wall:0xc0be8c22d4eea8b9, ext:42389337785, loc:(*time.Location)(0x6f12040)}}
I0908 09:42:52.858450       1 disruption.go:570] No PodDisruptionBudgets found for pod metrics-server-76f7667fbf-6gk8w, PodDisruptionBudget controller will avoid syncing.
I0908 09:42:52.858456       1 disruption.go:497] No matching pdb for pod "metrics-server-76f7667fbf-6gk8w"
I0908 09:42:52.858480       1 replica_set.go:667] Finished syncing ReplicaSet "kube-system/metrics-server-76f7667fbf" (71.199µs)
I0908 09:42:57.731930       1 node_lifecycle_controller.go:1084] ReadyCondition for Node capz-puhmj3-control-plane-kjzkz transitioned from &NodeCondition{Type:Ready,Status:False,LastHeartbeatTime:2022-09-08 09:42:22 +0000 UTC,LastTransitionTime:2022-09-08 09:41:42 +0000 UTC,Reason:KubeletNotReady,Message:container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized,} to &NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-09-08 09:42:52 +0000 UTC,LastTransitionTime:2022-09-08 09:42:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,}
I0908 09:42:57.732035       1 node_lifecycle_controller.go:1092] Node capz-puhmj3-control-plane-kjzkz ReadyCondition updated. Updating timestamp.
I0908 09:42:57.732061       1 node_lifecycle_controller.go:938] Node capz-puhmj3-control-plane-kjzkz is healthy again, removing all taints
I0908 09:42:57.732080       1 node_lifecycle_controller.go:1236] Controller detected that some Nodes are Ready. Exiting master disruption mode.
I0908 09:43:00.976942       1 httplog.go:131] "HTTP" verb="GET" URI="/healthz" latency="108.4µs" userAgent="kube-probe/1.26+" audit-ID="" srcIP="127.0.0.1:42898" resp=200
I0908 09:43:02.251720       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-puhmj3-control-plane-kjzkz"
I0908 09:43:02.282415       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-puhmj3-control-plane-kjzkz"
... skipping 93 lines ...
I0908 09:43:08.709991       1 replica_set.go:457] Pod calico-kube-controllers-755ff8d7b5-fqg7l updated, objectMeta {Name:calico-kube-controllers-755ff8d7b5-fqg7l GenerateName:calico-kube-controllers-755ff8d7b5- Namespace:kube-system SelfLink: UID:673c9697-dfbd-4190-b450-a8815130fc8f ResourceVersion:561 Generation:0 CreationTimestamp:2022-09-08 09:42:37 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[k8s-app:calico-kube-controllers pod-template-hash:755ff8d7b5] Annotations:map[] OwnerReferences:[{APIVersion:apps/v1 Kind:ReplicaSet Name:calico-kube-controllers-755ff8d7b5 UID:7c0861ae-a0da-49a6-ba70-93a704772612 Controller:0xc00268188e BlockOwnerDeletion:0xc00268188f}] Finalizers:[] ManagedFields:[{Manager:kube-controller-manager Operation:Update APIVersion:v1 Time:2022-09-08 09:42:37 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"7c0861ae-a0da-49a6-ba70-93a704772612\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"calico-kube-controllers\"}":{".":{},"f:env":{".":{},"k:{\"name\":\"DATASTORE_TYPE\"}":{".":{},"f:name":{},"f:value":{}},"k:{\"name\":\"ENABLED_CONTROLLERS\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:livenessProbe":{".":{},"f:exec":{".":{},"f:command":{}},"f:failureThreshold":{},"f:initialDelaySeconds":{},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:name":{},"f:readinessProbe":{".":{},"f:exec":{".":{},"f:command":{}},"f:failureThreshold":{},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:nodeSelector":{},"f:priorityClassName":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:serviceAccount":{},"f:serviceAccountName":{},"f:terminationGracePeriodSeconds":{},"f:tolerations":{}}} Subresource:} {Manager:kube-scheduler Operation:Update APIVersion:v1 Time:2022-09-08 09:42:37 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:status":{"f:conditions":{".":{},"k:{\"type\":\"PodScheduled\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} Subresource:status} {Manager:kubelet Operation:Update APIVersion:v1 Time:2022-09-08 09:42:52 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:startTime":{}}} Subresource:status}]} -> {Name:calico-kube-controllers-755ff8d7b5-fqg7l GenerateName:calico-kube-controllers-755ff8d7b5- Namespace:kube-system SelfLink: UID:673c9697-dfbd-4190-b450-a8815130fc8f ResourceVersion:641 Generation:0 CreationTimestamp:2022-09-08 09:42:37 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[k8s-app:calico-kube-controllers pod-template-hash:755ff8d7b5] Annotations:map[cni.projectcalico.org/containerID:fa15a7e3ad4a33fbb6f851fc83607ee1e550b5e07d5970a30a81f03f81588f5d cni.projectcalico.org/podIP:192.168.243.4/32 cni.projectcalico.org/podIPs:192.168.243.4/32] OwnerReferences:[{APIVersion:apps/v1 Kind:ReplicaSet Name:calico-kube-controllers-755ff8d7b5 UID:7c0861ae-a0da-49a6-ba70-93a704772612 Controller:0xc00296f477 BlockOwnerDeletion:0xc00296f478}] Finalizers:[] ManagedFields:[{Manager:kube-controller-manager Operation:Update APIVersion:v1 Time:2022-09-08 09:42:37 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"7c0861ae-a0da-49a6-ba70-93a704772612\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"calico-kube-controllers\"}":{".":{},"f:env":{".":{},"k:{\"name\":\"DATASTORE_TYPE\"}":{".":{},"f:name":{},"f:value":{}},"k:{\"name\":\"ENABLED_CONTROLLERS\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:livenessProbe":{".":{},"f:exec":{".":{},"f:command":{}},"f:failureThreshold":{},"f:initialDelaySeconds":{},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:name":{},"f:readinessProbe":{".":{},"f:exec":{".":{},"f:command":{}},"f:failureThreshold":{},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:nodeSelector":{},"f:priorityClassName":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:serviceAccount":{},"f:serviceAccountName":{},"f:terminationGracePeriodSeconds":{},"f:tolerations":{}}} Subresource:} {Manager:kube-scheduler Operation:Update APIVersion:v1 Time:2022-09-08 09:42:37 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:status":{"f:conditions":{".":{},"k:{\"type\":\"PodScheduled\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} Subresource:status} {Manager:kubelet Operation:Update APIVersion:v1 Time:2022-09-08 09:42:52 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:startTime":{}}} Subresource:status} {Manager:Go-http-client Operation:Update APIVersion:v1 Time:2022-09-08 09:43:08 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:annotations":{".":{},"f:cni.projectcalico.org/containerID":{},"f:cni.projectcalico.org/podIP":{},"f:cni.projectcalico.org/podIPs":{}}}} Subresource:status}]}.
I0908 09:43:08.710151       1 controller_utils.go:189] Controller expectations fulfilled &controller.ControlleeExpectations{add:0, del:0, key:"kube-system/calico-kube-controllers-755ff8d7b5", timestamp:time.Time{wall:0xc0be8c2349735094, ext:44196704916, loc:(*time.Location)(0x6f12040)}}
I0908 09:43:08.710226       1 replica_set.go:667] Finished syncing ReplicaSet "kube-system/calico-kube-controllers-755ff8d7b5" (82.4µs)
I0908 09:43:08.710249       1 disruption.go:494] updatePod called on pod "calico-kube-controllers-755ff8d7b5-fqg7l"
I0908 09:43:08.710265       1 disruption.go:499] updatePod "calico-kube-controllers-755ff8d7b5-fqg7l" -> PDB "calico-kube-controllers"
I0908 09:43:08.710305       1 disruption.go:659] Finished syncing PodDisruptionBudget "kube-system/calico-kube-controllers" (24µs)
W0908 09:43:08.862212       1 garbagecollector.go:752] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
I0908 09:43:09.529606       1 endpointslice_controller.go:319] Finished syncing service "kube-system/kube-dns" endpoint slices. (340.202µs)
I0908 09:43:10.537417       1 endpoints_controller.go:528] Update endpoints for kube-system/metrics-server, ready: 0 not ready: 1
I0908 09:43:10.537894       1 disruption.go:494] updatePod called on pod "metrics-server-76f7667fbf-6gk8w"
I0908 09:43:10.538098       1 disruption.go:570] No PodDisruptionBudgets found for pod metrics-server-76f7667fbf-6gk8w, PodDisruptionBudget controller will avoid syncing.
I0908 09:43:10.538203       1 disruption.go:497] No matching pdb for pod "metrics-server-76f7667fbf-6gk8w"
I0908 09:43:10.538339       1 replica_set.go:457] Pod metrics-server-76f7667fbf-6gk8w updated, objectMeta {Name:metrics-server-76f7667fbf-6gk8w GenerateName:metrics-server-76f7667fbf- Namespace:kube-system SelfLink: UID:37e07ae7-14d4-4220-b71e-81012f7bb451 ResourceVersion:612 Generation:0 CreationTimestamp:2022-09-08 09:42:35 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[k8s-app:metrics-server pod-template-hash:76f7667fbf] Annotations:map[cni.projectcalico.org/containerID:0926e03cfc287f1bf142c8a7b6a7a231c15331ad6ebd52314f398eb1ee2cbbe0 cni.projectcalico.org/podIP:192.168.243.2/32 cni.projectcalico.org/podIPs:192.168.243.2/32] OwnerReferences:[{APIVersion:apps/v1 Kind:ReplicaSet Name:metrics-server-76f7667fbf UID:3a414fe4-cc41-41b3-88ab-360cc3470f32 Controller:0xc00279c587 BlockOwnerDeletion:0xc00279c588}] Finalizers:[] ManagedFields:[{Manager:kube-controller-manager Operation:Update APIVersion:v1 Time:2022-09-08 09:42:35 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"3a414fe4-cc41-41b3-88ab-360cc3470f32\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"metrics-server\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:livenessProbe":{".":{},"f:failureThreshold":{},"f:httpGet":{".":{},"f:path":{},"f:port":{},"f:scheme":{}},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:name":{},"f:ports":{".":{},"k:{\"containerPort\":4443,\"protocol\":\"TCP\"}":{".":{},"f:containerPort":{},"f:name":{},"f:protocol":{}}},"f:readinessProbe":{".":{},"f:failureThreshold":{},"f:httpGet":{".":{},"f:path":{},"f:port":{},"f:scheme":{}},"f:initialDelaySeconds":{},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:resources":{".":{},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:securityContext":{".":{},"f:readOnlyRootFilesystem":{},"f:runAsNonRoot":{},"f:runAsUser":{}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/tmp\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:nodeSelector":{},"f:priorityClassName":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:serviceAccount":{},"f:serviceAccountName":{},"f:terminationGracePeriodSeconds":{},"f:tolerations":{},"f:volumes":{".":{},"k:{\"name\":\"tmp-dir\"}":{".":{},"f:emptyDir":{},"f:name":{}}}}} Subresource:} {Manager:kube-scheduler Operation:Update APIVersion:v1 Time:2022-09-08 09:42:35 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:status":{"f:conditions":{".":{},"k:{\"type\":\"PodScheduled\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} Subresource:status} {Manager:kubelet Operation:Update APIVersion:v1 Time:2022-09-08 09:42:52 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:startTime":{}}} Subresource:status} {Manager:Go-http-client Operation:Update APIVersion:v1 Time:2022-09-08 09:43:05 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:annotations":{".":{},"f:cni.projectcalico.org/containerID":{},"f:cni.projectcalico.org/podIP":{},"f:cni.projectcalico.org/podIPs":{}}}} Subresource:status}]} -> {Name:metrics-server-76f7667fbf-6gk8w GenerateName:metrics-server-76f7667fbf- Namespace:kube-system SelfLink: UID:37e07ae7-14d4-4220-b71e-81012f7bb451 ResourceVersion:650 Generation:0 CreationTimestamp:2022-09-08 09:42:35 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[k8s-app:metrics-server pod-template-hash:76f7667fbf] Annotations:map[cni.projectcalico.org/containerID:0926e03cfc287f1bf142c8a7b6a7a231c15331ad6ebd52314f398eb1ee2cbbe0 cni.projectcalico.org/podIP:192.168.243.2/32 cni.projectcalico.org/podIPs:192.168.243.2/32] OwnerReferences:[{APIVersion:apps/v1 Kind:ReplicaSet Name:metrics-server-76f7667fbf UID:3a414fe4-cc41-41b3-88ab-360cc3470f32 Controller:0xc0026a60c7 BlockOwnerDeletion:0xc0026a60c8}] Finalizers:[] ManagedFields:[{Manager:kube-controller-manager Operation:Update APIVersion:v1 Time:2022-09-08 09:42:35 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"3a414fe4-cc41-41b3-88ab-360cc3470f32\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"metrics-server\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:livenessProbe":{".":{},"f:failureThreshold":{},"f:httpGet":{".":{},"f:path":{},"f:port":{},"f:scheme":{}},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:name":{},"f:ports":{".":{},"k:{\"containerPort\":4443,\"protocol\":\"TCP\"}":{".":{},"f:containerPort":{},"f:name":{},"f:protocol":{}}},"f:readinessProbe":{".":{},"f:failureThreshold":{},"f:httpGet":{".":{},"f:path":{},"f:port":{},"f:scheme":{}},"f:initialDelaySeconds":{},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:resources":{".":{},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:securityContext":{".":{},"f:readOnlyRootFilesystem":{},"f:runAsNonRoot":{},"f:runAsUser":{}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/tmp\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:nodeSelector":{},"f:priorityClassName":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:serviceAccount":{},"f:serviceAccountName":{},"f:terminationGracePeriodSeconds":{},"f:tolerations":{},"f:volumes":{".":{},"k:{\"name\":\"tmp-dir\"}":{".":{},"f:emptyDir":{},"f:name":{}}}}} Subresource:} {Manager:kube-scheduler Operation:Update APIVersion:v1 Time:2022-09-08 09:42:35 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:status":{"f:conditions":{".":{},"k:{\"type\":\"PodScheduled\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} Subresource:status} {Manager:Go-http-client Operation:Update APIVersion:v1 Time:2022-09-08 09:43:05 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:annotations":{".":{},"f:cni.projectcalico.org/containerID":{},"f:cni.projectcalico.org/podIP":{},"f:cni.projectcalico.org/podIPs":{}}}} Subresource:status} {Manager:kubelet Operation:Update APIVersion:v1 Time:2022-09-08 09:43:10 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"192.168.243.2\"}":{".":{},"f:ip":{}}},"f:startTime":{}}} Subresource:status}]}.
... skipping 179 lines ...
I0908 09:44:56.517175       1 controller.go:753] Finished updateLoadBalancerHosts
I0908 09:44:56.517254       1 controller.go:694] Successfully updated 0 out of 0 load balancers to direct traffic to the updated set of nodes
I0908 09:44:56.517353       1 controller.go:686] It took 0.000409697 seconds to finish syncNodes
I0908 09:44:56.517550       1 taint_manager.go:466] "Noticed node update" node={nodeName:capz-puhmj3-md-0-cljzs}
I0908 09:44:56.517616       1 taint_manager.go:471] "Updating known taints on node" node="capz-puhmj3-md-0-cljzs" taints=[]
I0908 09:44:56.517719       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-puhmj3-md-0-cljzs"
W0908 09:44:56.517873       1 actual_state_of_world.go:541] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="capz-puhmj3-md-0-cljzs" does not exist
I0908 09:44:56.518031       1 topologycache.go:179] Ignoring node capz-puhmj3-control-plane-kjzkz because it has an excluded label
I0908 09:44:56.518158       1 topologycache.go:183] Ignoring node capz-puhmj3-md-0-cljzs because it is not ready: [{MemoryPressure False 2022-09-08 09:44:56 +0000 UTC 2022-09-08 09:44:56 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2022-09-08 09:44:56 +0000 UTC 2022-09-08 09:44:56 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2022-09-08 09:44:56 +0000 UTC 2022-09-08 09:44:56 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready False 2022-09-08 09:44:56 +0000 UTC 2022-09-08 09:44:56 +0000 UTC KubeletNotReady [container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized, failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "capz-puhmj3-md-0-cljzs" not found]}]
I0908 09:44:56.518373       1 topologycache.go:215] Insufficient node info for topology hints (0 zones, %!s(int64=0) CPU, true)
I0908 09:44:56.519306       1 controller_utils.go:189] Controller expectations fulfilled &controller.ControlleeExpectations{add:0, del:0, key:"kube-system/kube-proxy", timestamp:time.Time{wall:0xc0be8c1e6c6616aa, ext:24783040682, loc:(*time.Location)(0x6f12040)}}
I0908 09:44:56.519355       1 controller_utils.go:189] Controller expectations fulfilled &controller.ControlleeExpectations{add:0, del:0, key:"kube-system/calico-node", timestamp:time.Time{wall:0xc0be8c2af6eee9b4, ext:74959779764, loc:(*time.Location)(0x6f12040)}}
I0908 09:44:56.520078       1 controller_utils.go:223] Setting expectations &controller.ControlleeExpectations{add:1, del:0, key:"kube-system/kube-proxy", timestamp:time.Time{wall:0xc0be8c461effb2ef, ext:183558226671, loc:(*time.Location)(0x6f12040)}}
I0908 09:44:56.520258       1 daemon_controller.go:974] Nodes needing daemon pods for daemon set kube-proxy: [capz-puhmj3-md-0-cljzs], creating 1
I0908 09:44:56.520401       1 controller_utils.go:223] Setting expectations &controller.ControlleeExpectations{add:1, del:0, key:"kube-system/calico-node", timestamp:time.Time{wall:0xc0be8c461efee7cf, ext:183558174771, loc:(*time.Location)(0x6f12040)}}
... skipping 166 lines ...
I0908 09:45:05.283471       1 certificate_controller.go:167] Finished syncing certificate request "csr-6sr2g" (900ns)
I0908 09:45:05.283523       1 certificate_controller.go:81] Updating certificate request csr-6sr2g
I0908 09:45:05.283552       1 certificate_controller.go:167] Finished syncing certificate request "csr-6sr2g" (1.3µs)
I0908 09:45:05.283601       1 certificate_controller.go:81] Updating certificate request csr-6sr2g
I0908 09:45:05.283617       1 certificate_controller.go:167] Finished syncing certificate request "csr-6sr2g" (700ns)
I0908 09:45:05.430044       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-puhmj3-md-0-tjm9d"
W0908 09:45:05.430263       1 actual_state_of_world.go:541] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="capz-puhmj3-md-0-tjm9d" does not exist
I0908 09:45:05.430282       1 taint_manager.go:466] "Noticed node update" node={nodeName:capz-puhmj3-md-0-tjm9d}
I0908 09:45:05.430445       1 taint_manager.go:471] "Updating known taints on node" node="capz-puhmj3-md-0-tjm9d" taints=[]
I0908 09:45:05.430345       1 controller.go:690] Syncing backends for all LB services.
I0908 09:45:05.430642       1 controller.go:728] Running updateLoadBalancerHosts(len(services)==0, workers==1)
I0908 09:45:05.430736       1 controller.go:753] Finished updateLoadBalancerHosts
I0908 09:45:05.430812       1 controller.go:694] Successfully updated 0 out of 0 load balancers to direct traffic to the updated set of nodes
I0908 09:45:05.430885       1 controller.go:686] It took 0.000575397 seconds to finish syncNodes
I0908 09:45:05.430361       1 topologycache.go:179] Ignoring node capz-puhmj3-control-plane-kjzkz because it has an excluded label
I0908 09:45:05.431075       1 topologycache.go:183] Ignoring node capz-puhmj3-md-0-cljzs because it is not ready: [{MemoryPressure False 2022-09-08 09:44:56 +0000 UTC 2022-09-08 09:44:56 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2022-09-08 09:44:56 +0000 UTC 2022-09-08 09:44:56 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2022-09-08 09:44:56 +0000 UTC 2022-09-08 09:44:56 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready False 2022-09-08 09:44:56 +0000 UTC 2022-09-08 09:44:56 +0000 UTC KubeletNotReady [container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized, failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "capz-puhmj3-md-0-cljzs" not found]}]
I0908 09:45:05.431230       1 topologycache.go:183] Ignoring node capz-puhmj3-md-0-tjm9d because it is not ready: [{MemoryPressure False 2022-09-08 09:45:05 +0000 UTC 2022-09-08 09:45:05 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2022-09-08 09:45:05 +0000 UTC 2022-09-08 09:45:05 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2022-09-08 09:45:05 +0000 UTC 2022-09-08 09:45:05 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready False 2022-09-08 09:45:05 +0000 UTC 2022-09-08 09:45:05 +0000 UTC KubeletNotReady [container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful, container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized, CSINode is not yet initialized]}]
I0908 09:45:05.431345       1 topologycache.go:215] Insufficient node info for topology hints (0 zones, %!s(int64=0) CPU, true)
I0908 09:45:05.432062       1 controller_utils.go:189] Controller expectations fulfilled &controller.ControlleeExpectations{add:0, del:0, key:"kube-system/kube-proxy", timestamp:time.Time{wall:0xc0be8c469ef591b4, ext:185557562804, loc:(*time.Location)(0x6f12040)}}
I0908 09:45:05.432244       1 controller_utils.go:223] Setting expectations &controller.ControlleeExpectations{add:1, del:0, key:"kube-system/kube-proxy", timestamp:time.Time{wall:0xc0be8c4859c3724a, ext:192470391882, loc:(*time.Location)(0x6f12040)}}
I0908 09:45:05.432349       1 daemon_controller.go:974] Nodes needing daemon pods for daemon set kube-proxy: [capz-puhmj3-md-0-tjm9d], creating 1
I0908 09:45:05.433561       1 controller_utils.go:189] Controller expectations fulfilled &controller.ControlleeExpectations{add:0, del:0, key:"kube-system/calico-node", timestamp:time.Time{wall:0xc0be8c46b6d3aa30, ext:185957994132, loc:(*time.Location)(0x6f12040)}}
I0908 09:45:05.436637       1 controller_utils.go:223] Setting expectations &controller.ControlleeExpectations{add:1, del:0, key:"kube-system/calico-node", timestamp:time.Time{wall:0xc0be8c485a066fcf, ext:192474782259, loc:(*time.Location)(0x6f12040)}}
... skipping 312 lines ...
I0908 09:45:27.348084       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-puhmj3-md-0-cljzs"
I0908 09:45:27.348584       1 controller_utils.go:205] "Added taint to node" taint=[] node="capz-puhmj3-md-0-cljzs"
I0908 09:45:27.349209       1 controller.go:690] Syncing backends for all LB services.
I0908 09:45:27.349355       1 controller.go:728] Running updateLoadBalancerHosts(len(services)==0, workers==1)
I0908 09:45:27.349443       1 controller.go:753] Finished updateLoadBalancerHosts
I0908 09:45:27.349542       1 controller.go:694] Successfully updated 0 out of 0 load balancers to direct traffic to the updated set of nodes
I0908 09:45:27.349316       1 topologycache.go:183] Ignoring node capz-puhmj3-md-0-tjm9d because it is not ready: [{MemoryPressure False 2022-09-08 09:45:15 +0000 UTC 2022-09-08 09:45:05 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2022-09-08 09:45:15 +0000 UTC 2022-09-08 09:45:05 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2022-09-08 09:45:15 +0000 UTC 2022-09-08 09:45:05 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready False 2022-09-08 09:45:15 +0000 UTC 2022-09-08 09:45:05 +0000 UTC KubeletNotReady container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized}]
I0908 09:45:27.349780       1 topologycache.go:179] Ignoring node capz-puhmj3-control-plane-kjzkz because it has an excluded label
I0908 09:45:27.349589       1 controller.go:686] It took 0.000382097 seconds to finish syncNodes
I0908 09:45:27.349923       1 topologycache.go:215] Insufficient node info for topology hints (1 zones, %!s(int64=2000) CPU, true)
I0908 09:45:27.360865       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-puhmj3-md-0-cljzs"
I0908 09:45:27.361541       1 controller_utils.go:217] "Made sure that node has no taint" node="capz-puhmj3-md-0-cljzs" taint=[&Taint{Key:node.kubernetes.io/not-ready,Value:,Effect:NoSchedule,TimeAdded:<nil>,}]
I0908 09:45:27.747275       1 gc_controller.go:221] GC'ing orphaned
I0908 09:45:27.747304       1 gc_controller.go:290] GC'ing unscheduled pods which are terminating.
I0908 09:45:27.761657       1 node_lifecycle_controller.go:1084] ReadyCondition for Node capz-puhmj3-md-0-cljzs transitioned from &NodeCondition{Type:Ready,Status:False,LastHeartbeatTime:2022-09-08 09:45:17 +0000 UTC,LastTransitionTime:2022-09-08 09:44:56 +0000 UTC,Reason:KubeletNotReady,Message:container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized,} to &NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-09-08 09:45:27 +0000 UTC,LastTransitionTime:2022-09-08 09:45:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,}
I0908 09:45:27.761748       1 node_lifecycle_controller.go:1092] Node capz-puhmj3-md-0-cljzs ReadyCondition updated. Updating timestamp.
I0908 09:45:27.778063       1 node_lifecycle_controller.go:938] Node capz-puhmj3-md-0-cljzs is healthy again, removing all taints
I0908 09:45:27.778178       1 node_lifecycle_controller.go:1259] Controller detected that zone westus2::0 is now in state Normal.
I0908 09:45:27.778862       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-puhmj3-md-0-cljzs"
I0908 09:45:27.778950       1 taint_manager.go:466] "Noticed node update" node={nodeName:capz-puhmj3-md-0-cljzs}
I0908 09:45:27.778965       1 taint_manager.go:471] "Updating known taints on node" node="capz-puhmj3-md-0-cljzs" taints=[]
... skipping 51 lines ...
I0908 09:45:36.283933       1 controller_utils.go:205] "Added taint to node" taint=[] node="capz-puhmj3-md-0-tjm9d"
I0908 09:45:36.297749       1 controller_utils.go:217] "Made sure that node has no taint" node="capz-puhmj3-md-0-tjm9d" taint=[&Taint{Key:node.kubernetes.io/not-ready,Value:,Effect:NoSchedule,TimeAdded:<nil>,}]
I0908 09:45:36.298323       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-puhmj3-md-0-tjm9d"
I0908 09:45:37.671043       1 reflector.go:281] vendor/k8s.io/client-go/informers/factory.go:134: forcing resync
I0908 09:45:37.676189       1 reflector.go:281] vendor/k8s.io/client-go/informers/factory.go:134: forcing resync
I0908 09:45:37.748002       1 pv_controller_base.go:612] resyncing PV controller
I0908 09:45:37.779521       1 node_lifecycle_controller.go:1084] ReadyCondition for Node capz-puhmj3-md-0-tjm9d transitioned from &NodeCondition{Type:Ready,Status:False,LastHeartbeatTime:2022-09-08 09:45:15 +0000 UTC,LastTransitionTime:2022-09-08 09:45:05 +0000 UTC,Reason:KubeletNotReady,Message:container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized,} to &NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-09-08 09:45:36 +0000 UTC,LastTransitionTime:2022-09-08 09:45:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,}
I0908 09:45:37.779574       1 node_lifecycle_controller.go:1092] Node capz-puhmj3-md-0-tjm9d ReadyCondition updated. Updating timestamp.
I0908 09:45:37.815015       1 node_lifecycle_controller.go:938] Node capz-puhmj3-md-0-tjm9d is healthy again, removing all taints
I0908 09:45:37.815724       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-puhmj3-md-0-tjm9d"
I0908 09:45:37.816004       1 taint_manager.go:466] "Noticed node update" node={nodeName:capz-puhmj3-md-0-tjm9d}
I0908 09:45:37.816100       1 taint_manager.go:471] "Updating known taints on node" node="capz-puhmj3-md-0-tjm9d" taints=[]
I0908 09:45:37.816192       1 taint_manager.go:492] "All taints were removed from the node. Cancelling all evictions..." node="capz-puhmj3-md-0-tjm9d"
... skipping 175 lines ...
I0908 09:45:44.150332       1 controller_utils.go:581] Controller csi-azuredisk-controller-6dbf65647f created pod csi-azuredisk-controller-6dbf65647f-4klvp
I0908 09:45:44.150941       1 event.go:294] "Event occurred" object="kube-system/csi-azuredisk-controller-6dbf65647f" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: csi-azuredisk-controller-6dbf65647f-4klvp"
I0908 09:45:44.151206       1 disruption.go:479] addPod called on pod "csi-azuredisk-controller-6dbf65647f-4klvp"
I0908 09:45:44.151242       1 disruption.go:570] No PodDisruptionBudgets found for pod csi-azuredisk-controller-6dbf65647f-4klvp, PodDisruptionBudget controller will avoid syncing.
I0908 09:45:44.151248       1 disruption.go:482] No matching pdb for pod "csi-azuredisk-controller-6dbf65647f-4klvp"
I0908 09:45:44.151267       1 pvc_protection_controller.go:380] "Enqueuing PVCs for Pod" pod="kube-system/csi-azuredisk-controller-6dbf65647f-4klvp" podUID=b6699403-f35a-433a-93bb-03dcced00db2
I0908 09:45:44.151321       1 replica_set.go:394] Pod csi-azuredisk-controller-6dbf65647f-4klvp created: &v1.Pod{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"csi-azuredisk-controller-6dbf65647f-4klvp", GenerateName:"csi-azuredisk-controller-6dbf65647f-", Namespace:"kube-system", SelfLink:"", UID:"b6699403-f35a-433a-93bb-03dcced00db2", ResourceVersion:"1065", Generation:0, CreationTimestamp:time.Date(2022, time.September, 8, 9, 45, 44, 0, time.Local), DeletionTimestamp:<nil>, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"csi-azuredisk-controller", "pod-template-hash":"6dbf65647f"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference{v1.OwnerReference{APIVersion:"apps/v1", Kind:"ReplicaSet", Name:"csi-azuredisk-controller-6dbf65647f", UID:"79a3f8cc-38c2-4569-8b90-512a6ff89e3e", Controller:(*bool)(0xc000c9f72e), BlockOwnerDeletion:(*bool)(0xc000c9f72f)}}, Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kube-controller-manager", Operation:"Update", APIVersion:"v1", Time:time.Date(2022, time.September, 8, 9, 45, 44, 0, time.Local), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0026690c8), Subresource:""}}}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"socket-dir", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(0xc0026690e0), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"azure-cred", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc0026690f8), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"kube-api-access-jjhzf", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(0xc0025fb740), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"csi-provisioner", Image:"mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v3.2.0", Command:[]string(nil), Args:[]string{"--feature-gates=Topology=true", "--csi-address=$(ADDRESS)", "--v=2", "--timeout=15s", "--leader-election", "--leader-election-namespace=kube-system", "--worker-threads=40", "--extra-create-metadata=true", "--strict-topology=true"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"ADDRESS", Value:"/csi/csi.sock", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:524288000, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"500Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-jjhzf", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}, v1.Container{Name:"csi-attacher", Image:"mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v3.5.0", Command:[]string(nil), Args:[]string{"-v=2", "-csi-address=$(ADDRESS)", "-timeout=600s", "-leader-election", "--leader-election-namespace=kube-system", "-worker-threads=500"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"ADDRESS", Value:"/csi/csi.sock", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:524288000, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"500Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-jjhzf", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}, v1.Container{Name:"csi-snapshotter", Image:"mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v5.0.1", Command:[]string(nil), Args:[]string{"-csi-address=$(ADDRESS)", "-leader-election", "--leader-election-namespace=kube-system", "--v=2"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"ADDRESS", Value:"/csi/csi.sock", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:104857600, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-jjhzf", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}, v1.Container{Name:"csi-resizer", Image:"mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.5.0", Command:[]string(nil), Args:[]string{"-csi-address=$(ADDRESS)", "-v=2", "-leader-election", "--leader-election-namespace=kube-system", "-handle-volume-inuse-error=false", "-feature-gates=RecoverVolumeExpansionFailure=true", "-timeout=240s"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"ADDRESS", Value:"/csi/csi.sock", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:524288000, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"500Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-jjhzf", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}, v1.Container{Name:"liveness-probe", Image:"mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.7.0", Command:[]string(nil), Args:[]string{"--csi-address=/csi/csi.sock", "--probe-timeout=3s", "--health-port=29602", "--v=2"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar(nil), Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:104857600, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-jjhzf", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}, v1.Container{Name:"azuredisk", Image:"mcr.microsoft.com/k8s/csi/azuredisk-csi:latest", Command:[]string(nil), Args:[]string{"--v=5", "--endpoint=$(CSI_ENDPOINT)", "--metrics-address=0.0.0.0:29604", "--user-agent-suffix=OSS-kubectl", "--disable-avset-nodes=false", "--allow-empty-cloud-config=false"}, WorkingDir:"", Ports:[]v1.ContainerPort{v1.ContainerPort{Name:"healthz", HostPort:29602, ContainerPort:29602, Protocol:"TCP", HostIP:""}, v1.ContainerPort{Name:"metrics", HostPort:29604, ContainerPort:29604, Protocol:"TCP", HostIP:""}}, EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"AZURE_CREDENTIAL_FILE", Value:"", ValueFrom:(*v1.EnvVarSource)(0xc0025fb880)}, v1.EnvVar{Name:"CSI_ENDPOINT", Value:"unix:///csi/csi.sock", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:524288000, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"500Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"azure-cred", ReadOnly:false, MountPath:"/etc/kubernetes/", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-jjhzf", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(0xc00145e980), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0xc000d90190), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"csi-azuredisk-controller-sa", DeprecatedServiceAccount:"csi-azuredisk-controller-sa", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0xc0001ea9a0), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"node-role.kubernetes.io/master", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node-role.kubernetes.io/controlplane", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node-role.kubernetes.io/control-plane", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node.kubernetes.io/not-ready", Operator:"Exists", Value:"", Effect:"NoExecute", TolerationSeconds:(*int64)(0xc000d90200)}, v1.Toleration{Key:"node.kubernetes.io/unreachable", Operator:"Exists", Value:"", Effect:"NoExecute", TolerationSeconds:(*int64)(0xc000d904d0)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-cluster-critical", Priority:(*int32)(0xc000d904d8), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(0xc000d904dc), PreemptionPolicy:(*v1.PreemptionPolicy)(0xc001c22660), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil), OS:(*v1.PodOS)(nil), HostUsers:(*bool)(nil)}, Status:v1.PodStatus{Phase:"Pending", Conditions:[]v1.PodCondition(nil), Message:"", Reason:"", NominatedNodeName:"", HostIP:"", PodIP:"", PodIPs:[]v1.PodIP(nil), StartTime:<nil>, InitContainerStatuses:[]v1.ContainerStatus(nil), ContainerStatuses:[]v1.ContainerStatus(nil), QOSClass:"Burstable", EphemeralContainerStatuses:[]v1.ContainerStatus(nil)}}.
I0908 09:45:44.151945       1 controller_utils.go:240] Lowered expectations &controller.ControlleeExpectations{add:1, del:0, key:"kube-system/csi-azuredisk-controller-6dbf65647f", timestamp:time.Time{wall:0xc0be8c5207e2b71c, ext:231170451228, loc:(*time.Location)(0x6f12040)}}
I0908 09:45:44.152010       1 taint_manager.go:431] "Noticed pod update" pod="kube-system/csi-azuredisk-controller-6dbf65647f-4klvp"
I0908 09:45:44.164804       1 replica_set.go:457] Pod csi-azuredisk-controller-6dbf65647f-4klvp updated, objectMeta {Name:csi-azuredisk-controller-6dbf65647f-4klvp GenerateName:csi-azuredisk-controller-6dbf65647f- Namespace:kube-system SelfLink: UID:b6699403-f35a-433a-93bb-03dcced00db2 ResourceVersion:1065 Generation:0 CreationTimestamp:2022-09-08 09:45:44 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[app:csi-azuredisk-controller pod-template-hash:6dbf65647f] Annotations:map[] OwnerReferences:[{APIVersion:apps/v1 Kind:ReplicaSet Name:csi-azuredisk-controller-6dbf65647f UID:79a3f8cc-38c2-4569-8b90-512a6ff89e3e Controller:0xc000c9f72e BlockOwnerDeletion:0xc000c9f72f}] Finalizers:[] ManagedFields:[{Manager:kube-controller-manager Operation:Update APIVersion:v1 Time:2022-09-08 09:45:44 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"79a3f8cc-38c2-4569-8b90-512a6ff89e3e\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"azuredisk\"}":{".":{},"f:args":{},"f:env":{".":{},"k:{\"name\":\"AZURE_CREDENTIAL_FILE\"}":{".":{},"f:name":{},"f:valueFrom":{".":{},"f:configMapKeyRef":{}}},"k:{\"name\":\"CSI_ENDPOINT\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:livenessProbe":{".":{},"f:failureThreshold":{},"f:httpGet":{".":{},"f:path":{},"f:port":{},"f:scheme":{}},"f:initialDelaySeconds":{},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:name":{},"f:ports":{".":{},"k:{\"containerPort\":29602,\"protocol\":\"TCP\"}":{".":{},"f:containerPort":{},"f:hostPort":{},"f:name":{},"f:protocol":{}},"k:{\"containerPort\":29604,\"protocol\":\"TCP\"}":{".":{},"f:containerPort":{},"f:hostPort":{},"f:name":{},"f:protocol":{}}},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}},"k:{\"mountPath\":\"/etc/kubernetes/\"}":{".":{},"f:mountPath":{},"f:name":{}}}},"k:{\"name\":\"csi-attacher\"}":{".":{},"f:args":{},"f:env":{".":{},"k:{\"name\":\"ADDRESS\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}}}},"k:{\"name\":\"csi-provisioner\"}":{".":{},"f:args":{},"f:env":{".":{},"k:{\"name\":\"ADDRESS\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}}}},"k:{\"name\":\"csi-resizer\"}":{".":{},"f:args":{},"f:env":{".":{},"k:{\"name\":\"ADDRESS\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}}}},"k:{\"name\":\"csi-snapshotter\"}":{".":{},"f:args":{},"f:env":{".":{},"k:{\"name\":\"ADDRESS\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}}}},"k:{\"name\":\"liveness-probe\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:hostNetwork":{},"f:nodeSelector":{},"f:priorityClassName":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:serviceAccount":{},"f:serviceAccountName":{},"f:terminationGracePeriodSeconds":{},"f:tolerations":{},"f:volumes":{".":{},"k:{\"name\":\"azure-cred\"}":{".":{},"f:hostPath":{".":{},"f:path":{},"f:type":{}},"f:name":{}},"k:{\"name\":\"socket-dir\"}":{".":{},"f:emptyDir":{},"f:name":{}}}}} Subresource:}]} -> {Name:csi-azuredisk-controller-6dbf65647f-4klvp GenerateName:csi-azuredisk-controller-6dbf65647f- Namespace:kube-system SelfLink: UID:b6699403-f35a-433a-93bb-03dcced00db2 ResourceVersion:1066 Generation:0 CreationTimestamp:2022-09-08 09:45:44 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[app:csi-azuredisk-controller pod-template-hash:6dbf65647f] Annotations:map[] OwnerReferences:[{APIVersion:apps/v1 Kind:ReplicaSet Name:csi-azuredisk-controller-6dbf65647f UID:79a3f8cc-38c2-4569-8b90-512a6ff89e3e Controller:0xc0010f0c47 BlockOwnerDeletion:0xc0010f0c48}] Finalizers:[] ManagedFields:[{Manager:kube-controller-manager Operation:Update APIVersion:v1 Time:2022-09-08 09:45:44 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"79a3f8cc-38c2-4569-8b90-512a6ff89e3e\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"azuredisk\"}":{".":{},"f:args":{},"f:env":{".":{},"k:{\"name\":\"AZURE_CREDENTIAL_FILE\"}":{".":{},"f:name":{},"f:valueFrom":{".":{},"f:configMapKeyRef":{}}},"k:{\"name\":\"CSI_ENDPOINT\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:livenessProbe":{".":{},"f:failureThreshold":{},"f:httpGet":{".":{},"f:path":{},"f:port":{},"f:scheme":{}},"f:initialDelaySeconds":{},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:name":{},"f:ports":{".":{},"k:{\"containerPort\":29602,\"protocol\":\"TCP\"}":{".":{},"f:containerPort":{},"f:hostPort":{},"f:name":{},"f:protocol":{}},"k:{\"containerPort\":29604,\"protocol\":\"TCP\"}":{".":{},"f:containerPort":{},"f:hostPort":{},"f:name":{},"f:protocol":{}}},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}},"k:{\"mountPath\":\"/etc/kubernetes/\"}":{".":{},"f:mountPath":{},"f:name":{}}}},"k:{\"name\":\"csi-attacher\"}":{".":{},"f:args":{},"f:env":{".":{},"k:{\"name\":\"ADDRESS\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}}}},"k:{\"name\":\"csi-provisioner\"}":{".":{},"f:args":{},"f:env":{".":{},"k:{\"name\":\"ADDRESS\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}}}},"k:{\"name\":\"csi-resizer\"}":{".":{},"f:args":{},"f:env":{".":{},"k:{\"name\":\"ADDRESS\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}}}},"k:{\"name\":\"csi-snapshotter\"}":{".":{},"f:args":{},"f:env":{".":{},"k:{\"name\":\"ADDRESS\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}}}},"k:{\"name\":\"liveness-probe\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:hostNetwork":{},"f:nodeSelector":{},"f:priorityClassName":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:serviceAccount":{},"f:serviceAccountName":{},"f:terminationGracePeriodSeconds":{},"f:tolerations":{},"f:volumes":{".":{},"k:{\"name\":\"azure-cred\"}":{".":{},"f:hostPath":{".":{},"f:path":{},"f:type":{}},"f:name":{}},"k:{\"name\":\"socket-dir\"}":{".":{},"f:emptyDir":{},"f:name":{}}}}} Subresource:}]}.
I0908 09:45:44.164925       1 disruption.go:494] updatePod called on pod "csi-azuredisk-controller-6dbf65647f-4klvp"
I0908 09:45:44.164957       1 disruption.go:570] No PodDisruptionBudgets found for pod csi-azuredisk-controller-6dbf65647f-4klvp, PodDisruptionBudget controller will avoid syncing.
I0908 09:45:44.164964       1 disruption.go:497] No matching pdb for pod "csi-azuredisk-controller-6dbf65647f-4klvp"
I0908 09:45:44.165084       1 taint_manager.go:431] "Noticed pod update" pod="kube-system/csi-azuredisk-controller-6dbf65647f-4klvp"
I0908 09:45:44.165098       1 taint_manager.go:431] "Noticed pod update" pod="kube-system/csi-azuredisk-controller-6dbf65647f-xvmsr"
I0908 09:45:44.165132       1 replica_set.go:394] Pod csi-azuredisk-controller-6dbf65647f-xvmsr created: &v1.Pod{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"csi-azuredisk-controller-6dbf65647f-xvmsr", GenerateName:"csi-azuredisk-controller-6dbf65647f-", Namespace:"kube-system", SelfLink:"", UID:"40693dc8-ab7e-48c6-9266-3666808d046e", ResourceVersion:"1067", Generation:0, CreationTimestamp:time.Date(2022, time.September, 8, 9, 45, 44, 0, time.Local), DeletionTimestamp:<nil>, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"csi-azuredisk-controller", "pod-template-hash":"6dbf65647f"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference{v1.OwnerReference{APIVersion:"apps/v1", Kind:"ReplicaSet", Name:"csi-azuredisk-controller-6dbf65647f", UID:"79a3f8cc-38c2-4569-8b90-512a6ff89e3e", Controller:(*bool)(0xc0010f13d7), BlockOwnerDeletion:(*bool)(0xc0010f13d8)}}, Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kube-controller-manager", Operation:"Update", APIVersion:"v1", Time:time.Date(2022, time.September, 8, 9, 45, 44, 0, time.Local), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc001be4360), Subresource:""}}}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"socket-dir", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(0xc001be4378), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"azure-cred", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc001be44b0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"kube-api-access-b86sv", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(0xc002ca19c0), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"csi-provisioner", Image:"mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v3.2.0", Command:[]string(nil), Args:[]string{"--feature-gates=Topology=true", "--csi-address=$(ADDRESS)", "--v=2", "--timeout=15s", "--leader-election", "--leader-election-namespace=kube-system", "--worker-threads=40", "--extra-create-metadata=true", "--strict-topology=true"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"ADDRESS", Value:"/csi/csi.sock", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:524288000, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"500Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-b86sv", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}, v1.Container{Name:"csi-attacher", Image:"mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v3.5.0", Command:[]string(nil), Args:[]string{"-v=2", "-csi-address=$(ADDRESS)", "-timeout=600s", "-leader-election", "--leader-election-namespace=kube-system", "-worker-threads=500"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"ADDRESS", Value:"/csi/csi.sock", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:524288000, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"500Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-b86sv", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}, v1.Container{Name:"csi-snapshotter", Image:"mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v5.0.1", Command:[]string(nil), Args:[]string{"-csi-address=$(ADDRESS)", "-leader-election", "--leader-election-namespace=kube-system", "--v=2"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"ADDRESS", Value:"/csi/csi.sock", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:104857600, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-b86sv", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}, v1.Container{Name:"csi-resizer", Image:"mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.5.0", Command:[]string(nil), Args:[]string{"-csi-address=$(ADDRESS)", "-v=2", "-leader-election", "--leader-election-namespace=kube-system", "-handle-volume-inuse-error=false", "-feature-gates=RecoverVolumeExpansionFailure=true", "-timeout=240s"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"ADDRESS", Value:"/csi/csi.sock", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:524288000, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"500Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-b86sv", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}, v1.Container{Name:"liveness-probe", Image:"mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.7.0", Command:[]string(nil), Args:[]string{"--csi-address=/csi/csi.sock", "--probe-timeout=3s", "--health-port=29602", "--v=2"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar(nil), Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:104857600, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-b86sv", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}, v1.Container{Name:"azuredisk", Image:"mcr.microsoft.com/k8s/csi/azuredisk-csi:latest", Command:[]string(nil), Args:[]string{"--v=5", "--endpoint=$(CSI_ENDPOINT)", "--metrics-address=0.0.0.0:29604", "--user-agent-suffix=OSS-kubectl", "--disable-avset-nodes=false", "--allow-empty-cloud-config=false"}, WorkingDir:"", Ports:[]v1.ContainerPort{v1.ContainerPort{Name:"healthz", HostPort:29602, ContainerPort:29602, Protocol:"TCP", HostIP:""}, v1.ContainerPort{Name:"metrics", HostPort:29604, ContainerPort:29604, Protocol:"TCP", HostIP:""}}, EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"AZURE_CREDENTIAL_FILE", Value:"", ValueFrom:(*v1.EnvVarSource)(0xc002ca1ae0)}, v1.EnvVar{Name:"CSI_ENDPOINT", Value:"unix:///csi/csi.sock", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:524288000, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"500Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"azure-cred", ReadOnly:false, MountPath:"/etc/kubernetes/", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-b86sv", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(0xc000bb5500), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0xc0010f18d0), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"csi-azuredisk-controller-sa", DeprecatedServiceAccount:"csi-azuredisk-controller-sa", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0xc00055d500), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"node-role.kubernetes.io/master", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node-role.kubernetes.io/controlplane", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node-role.kubernetes.io/control-plane", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node.kubernetes.io/not-ready", Operator:"Exists", Value:"", Effect:"NoExecute", TolerationSeconds:(*int64)(0xc0010f1940)}, v1.Toleration{Key:"node.kubernetes.io/unreachable", Operator:"Exists", Value:"", Effect:"NoExecute", TolerationSeconds:(*int64)(0xc0010f1960)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-cluster-critical", Priority:(*int32)(0xc0010f1968), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(0xc0010f196c), PreemptionPolicy:(*v1.PreemptionPolicy)(0xc0010e3cd0), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil), OS:(*v1.PodOS)(nil), HostUsers:(*bool)(nil)}, Status:v1.PodStatus{Phase:"Pending", Conditions:[]v1.PodCondition(nil), Message:"", Reason:"", NominatedNodeName:"", HostIP:"", PodIP:"", PodIPs:[]v1.PodIP(nil), StartTime:<nil>, InitContainerStatuses:[]v1.ContainerStatus(nil), ContainerStatuses:[]v1.ContainerStatus(nil), QOSClass:"Burstable", EphemeralContainerStatuses:[]v1.ContainerStatus(nil)}}.
I0908 09:45:44.165610       1 controller_utils.go:240] Lowered expectations &controller.ControlleeExpectations{add:0, del:0, key:"kube-system/csi-azuredisk-controller-6dbf65647f", timestamp:time.Time{wall:0xc0be8c5207e2b71c, ext:231170451228, loc:(*time.Location)(0x6f12040)}}
I0908 09:45:44.165632       1 disruption.go:479] addPod called on pod "csi-azuredisk-controller-6dbf65647f-xvmsr"
I0908 09:45:44.165657       1 disruption.go:570] No PodDisruptionBudgets found for pod csi-azuredisk-controller-6dbf65647f-xvmsr, PodDisruptionBudget controller will avoid syncing.
I0908 09:45:44.165663       1 disruption.go:482] No matching pdb for pod "csi-azuredisk-controller-6dbf65647f-xvmsr"
I0908 09:45:44.165682       1 pvc_protection_controller.go:380] "Enqueuing PVCs for Pod" pod="kube-system/csi-azuredisk-controller-6dbf65647f-xvmsr" podUID=40693dc8-ab7e-48c6-9266-3666808d046e
I0908 09:45:44.165883       1 deployment_controller.go:585] "Finished syncing deployment" deployment="kube-system/csi-azuredisk-controller" duration="40.799239ms"
I0908 09:45:44.165907       1 deployment_controller.go:497] "Error syncing deployment" deployment="kube-system/csi-azuredisk-controller" err="Operation cannot be fulfilled on deployments.apps \"csi-azuredisk-controller\": the object has been modified; please apply your changes to the latest version and try again"
I0908 09:45:44.165936       1 deployment_controller.go:583] "Started syncing deployment" deployment="kube-system/csi-azuredisk-controller" startTime="2022-09-08 09:45:44.165922227 +0000 UTC m=+231.204075031"
I0908 09:45:44.170192       1 controller_utils.go:581] Controller csi-azuredisk-controller-6dbf65647f created pod csi-azuredisk-controller-6dbf65647f-xvmsr
I0908 09:45:44.170280       1 replica_set_utils.go:59] Updating status for : kube-system/csi-azuredisk-controller-6dbf65647f, replicas 0->0 (need 2), fullyLabeledReplicas 0->0, readyReplicas 0->0, availableReplicas 0->0, sequence No: 0->1
I0908 09:45:44.170621       1 event.go:294] "Event occurred" object="kube-system/csi-azuredisk-controller-6dbf65647f" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: csi-azuredisk-controller-6dbf65647f-xvmsr"
I0908 09:45:44.171369       1 deployment_util.go:775] Deployment "csi-azuredisk-controller" timed out (false) [last progress check: 2022-09-08 09:45:44 +0000 UTC - now: 2022-09-08 09:45:44.171360479 +0000 UTC m=+231.209513183]
I0908 09:45:44.189167       1 disruption.go:494] updatePod called on pod "csi-azuredisk-controller-6dbf65647f-xvmsr"
... skipping 112 lines ...
I0908 09:45:48.713563       1 disruption.go:497] No matching pdb for pod "csi-snapshot-controller-84ccd6c756-gm62f"
I0908 09:45:48.719134       1 deployment_controller.go:288] "ReplicaSet updated" replicaSet="kube-system/csi-snapshot-controller-84ccd6c756"
I0908 09:45:48.719236       1 replica_set.go:667] Finished syncing ReplicaSet "kube-system/csi-snapshot-controller-84ccd6c756" (19.787673ms)
I0908 09:45:48.719284       1 controller_utils.go:189] Controller expectations fulfilled &controller.ControlleeExpectations{add:0, del:0, key:"kube-system/csi-snapshot-controller-84ccd6c756", timestamp:time.Time{wall:0xc0be8c5326f59039, ext:235691780153, loc:(*time.Location)(0x6f12040)}}
I0908 09:45:48.719425       1 replica_set.go:667] Finished syncing ReplicaSet "kube-system/csi-snapshot-controller-84ccd6c756" (150.598µs)
I0908 09:45:48.726654       1 deployment_controller.go:585] "Finished syncing deployment" deployment="kube-system/csi-snapshot-controller" duration="78.813197ms"
I0908 09:45:48.726691       1 deployment_controller.go:497] "Error syncing deployment" deployment="kube-system/csi-snapshot-controller" err="Operation cannot be fulfilled on deployments.apps \"csi-snapshot-controller\": the object has been modified; please apply your changes to the latest version and try again"
I0908 09:45:48.726747       1 deployment_controller.go:583] "Started syncing deployment" deployment="kube-system/csi-snapshot-controller" startTime="2022-09-08 09:45:48.726729911 +0000 UTC m=+235.764882715"
I0908 09:45:48.734198       1 replica_set.go:457] Pod csi-snapshot-controller-84ccd6c756-bclfm updated, objectMeta {Name:csi-snapshot-controller-84ccd6c756-bclfm GenerateName:csi-snapshot-controller-84ccd6c756- Namespace:kube-system SelfLink: UID:9512e956-3196-4cde-aec0-e0e1d5ccad7d ResourceVersion:1133 Generation:0 CreationTimestamp:2022-09-08 09:45:48 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[app:csi-snapshot-controller pod-template-hash:84ccd6c756] Annotations:map[] OwnerReferences:[{APIVersion:apps/v1 Kind:ReplicaSet Name:csi-snapshot-controller-84ccd6c756 UID:b29bec2b-061c-423f-be71-72fc3c6c9dff Controller:0xc001dce487 BlockOwnerDeletion:0xc001dce488}] Finalizers:[] ManagedFields:[{Manager:kube-controller-manager Operation:Update APIVersion:v1 Time:2022-09-08 09:45:48 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"b29bec2b-061c-423f-be71-72fc3c6c9dff\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"csi-snapshot-controller\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:nodeSelector":{},"f:priorityClassName":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:serviceAccount":{},"f:serviceAccountName":{},"f:terminationGracePeriodSeconds":{},"f:tolerations":{}}} Subresource:}]} -> {Name:csi-snapshot-controller-84ccd6c756-bclfm GenerateName:csi-snapshot-controller-84ccd6c756- Namespace:kube-system SelfLink: UID:9512e956-3196-4cde-aec0-e0e1d5ccad7d ResourceVersion:1138 Generation:0 CreationTimestamp:2022-09-08 09:45:48 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[app:csi-snapshot-controller pod-template-hash:84ccd6c756] Annotations:map[] OwnerReferences:[{APIVersion:apps/v1 Kind:ReplicaSet Name:csi-snapshot-controller-84ccd6c756 UID:b29bec2b-061c-423f-be71-72fc3c6c9dff Controller:0xc001f1759e BlockOwnerDeletion:0xc001f1759f}] Finalizers:[] ManagedFields:[{Manager:kube-controller-manager Operation:Update APIVersion:v1 Time:2022-09-08 09:45:48 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"b29bec2b-061c-423f-be71-72fc3c6c9dff\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"csi-snapshot-controller\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:nodeSelector":{},"f:priorityClassName":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:serviceAccount":{},"f:serviceAccountName":{},"f:terminationGracePeriodSeconds":{},"f:tolerations":{}}} Subresource:} {Manager:kubelet Operation:Update APIVersion:v1 Time:2022-09-08 09:45:48 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:startTime":{}}} Subresource:status}]}.
I0908 09:45:48.734360       1 controller_utils.go:189] Controller expectations fulfilled &controller.ControlleeExpectations{add:0, del:0, key:"kube-system/csi-snapshot-controller-84ccd6c756", timestamp:time.Time{wall:0xc0be8c5326f59039, ext:235691780153, loc:(*time.Location)(0x6f12040)}}
I0908 09:45:48.734969       1 replica_set.go:667] Finished syncing ReplicaSet "kube-system/csi-snapshot-controller-84ccd6c756" (611.893µs)
I0908 09:45:48.735016       1 disruption.go:494] updatePod called on pod "csi-snapshot-controller-84ccd6c756-bclfm"
I0908 09:45:48.735044       1 disruption.go:570] No PodDisruptionBudgets found for pod csi-snapshot-controller-84ccd6c756-bclfm, PodDisruptionBudget controller will avoid syncing.
... skipping 552 lines ...
I0908 09:48:25.842449       1 pv_controller.go:619] synchronizing PersistentVolume[pvc-eaba5162-8ec1-4daf-8a9b-0db3e92890e5]: claim azuredisk-8081/pvc-d2494 not found
I0908 09:48:25.846917       1 pv_controller_base.go:726] storeObjectUpdate updating volume "pvc-eaba5162-8ec1-4daf-8a9b-0db3e92890e5" with version 1655
I0908 09:48:25.847331       1 pv_protection_controller.go:198] Got event on PV pvc-eaba5162-8ec1-4daf-8a9b-0db3e92890e5
I0908 09:48:25.847407       1 pv_controller.go:551] synchronizing PersistentVolume[pvc-eaba5162-8ec1-4daf-8a9b-0db3e92890e5]: phase: Released, bound to: "azuredisk-8081/pvc-d2494 (uid: eaba5162-8ec1-4daf-8a9b-0db3e92890e5)", boundByController: false
I0908 09:48:25.847465       1 pv_controller.go:585] synchronizing PersistentVolume[pvc-eaba5162-8ec1-4daf-8a9b-0db3e92890e5]: volume is bound to claim azuredisk-8081/pvc-d2494
I0908 09:48:25.847491       1 pv_controller.go:619] synchronizing PersistentVolume[pvc-eaba5162-8ec1-4daf-8a9b-0db3e92890e5]: claim azuredisk-8081/pvc-d2494 not found
I0908 09:48:25.854708       1 pv_protection_controller.go:173] Error removing protection finalizer from PV pvc-eaba5162-8ec1-4daf-8a9b-0db3e92890e5: Operation cannot be fulfilled on persistentvolumes "pvc-eaba5162-8ec1-4daf-8a9b-0db3e92890e5": the object has been modified; please apply your changes to the latest version and try again
I0908 09:48:25.854730       1 pv_protection_controller.go:124] Finished processing PV pvc-eaba5162-8ec1-4daf-8a9b-0db3e92890e5 (12.6956ms)
E0908 09:48:25.854743       1 pv_protection_controller.go:114] PV pvc-eaba5162-8ec1-4daf-8a9b-0db3e92890e5 failed with : Operation cannot be fulfilled on persistentvolumes "pvc-eaba5162-8ec1-4daf-8a9b-0db3e92890e5": the object has been modified; please apply your changes to the latest version and try again
I0908 09:48:25.854786       1 pv_protection_controller.go:121] Processing PV pvc-eaba5162-8ec1-4daf-8a9b-0db3e92890e5
I0908 09:48:25.858091       1 pv_controller_base.go:238] volume "pvc-eaba5162-8ec1-4daf-8a9b-0db3e92890e5" deleted
I0908 09:48:25.858177       1 pv_controller_base.go:589] deletion of claim "azuredisk-8081/pvc-d2494" was already processed
I0908 09:48:25.859267       1 pv_protection_controller.go:176] Removed protection finalizer from PV pvc-eaba5162-8ec1-4daf-8a9b-0db3e92890e5
I0908 09:48:25.859284       1 pv_protection_controller.go:124] Finished processing PV pvc-eaba5162-8ec1-4daf-8a9b-0db3e92890e5 (4.471365ms)
I0908 09:48:25.860564       1 pv_protection_controller.go:121] Processing PV pvc-eaba5162-8ec1-4daf-8a9b-0db3e92890e5
... skipping 1170 lines ...
I0908 09:53:09.081517       1 pv_controller.go:619] synchronizing PersistentVolume[pvc-264a4f24-b744-4ddf-bc0c-7db0ac3bdc79]: claim azuredisk-5356/pvc-fw7bb not found
I0908 09:53:09.086774       1 pv_controller_base.go:726] storeObjectUpdate updating volume "pvc-264a4f24-b744-4ddf-bc0c-7db0ac3bdc79" with version 2575
I0908 09:53:09.087030       1 pv_controller.go:551] synchronizing PersistentVolume[pvc-264a4f24-b744-4ddf-bc0c-7db0ac3bdc79]: phase: Released, bound to: "azuredisk-5356/pvc-fw7bb (uid: 264a4f24-b744-4ddf-bc0c-7db0ac3bdc79)", boundByController: false
I0908 09:53:09.087185       1 pv_controller.go:585] synchronizing PersistentVolume[pvc-264a4f24-b744-4ddf-bc0c-7db0ac3bdc79]: volume is bound to claim azuredisk-5356/pvc-fw7bb
I0908 09:53:09.087326       1 pv_controller.go:619] synchronizing PersistentVolume[pvc-264a4f24-b744-4ddf-bc0c-7db0ac3bdc79]: claim azuredisk-5356/pvc-fw7bb not found
I0908 09:53:09.086826       1 pv_protection_controller.go:198] Got event on PV pvc-264a4f24-b744-4ddf-bc0c-7db0ac3bdc79
I0908 09:53:09.089339       1 pv_protection_controller.go:173] Error removing protection finalizer from PV pvc-264a4f24-b744-4ddf-bc0c-7db0ac3bdc79: Operation cannot be fulfilled on persistentvolumes "pvc-264a4f24-b744-4ddf-bc0c-7db0ac3bdc79": the object has been modified; please apply your changes to the latest version and try again
I0908 09:53:09.089359       1 pv_protection_controller.go:124] Finished processing PV pvc-264a4f24-b744-4ddf-bc0c-7db0ac3bdc79 (8.320048ms)
E0908 09:53:09.089372       1 pv_protection_controller.go:114] PV pvc-264a4f24-b744-4ddf-bc0c-7db0ac3bdc79 failed with : Operation cannot be fulfilled on persistentvolumes "pvc-264a4f24-b744-4ddf-bc0c-7db0ac3bdc79": the object has been modified; please apply your changes to the latest version and try again
I0908 09:53:09.089579       1 pv_protection_controller.go:121] Processing PV pvc-264a4f24-b744-4ddf-bc0c-7db0ac3bdc79
I0908 09:53:09.106611       1 pv_protection_controller.go:176] Removed protection finalizer from PV pvc-264a4f24-b744-4ddf-bc0c-7db0ac3bdc79
I0908 09:53:09.106635       1 pv_protection_controller.go:124] Finished processing PV pvc-264a4f24-b744-4ddf-bc0c-7db0ac3bdc79 (17.042795ms)
I0908 09:53:09.106654       1 pv_protection_controller.go:121] Processing PV pvc-264a4f24-b744-4ddf-bc0c-7db0ac3bdc79
I0908 09:53:09.106665       1 pv_protection_controller.go:129] PV pvc-264a4f24-b744-4ddf-bc0c-7db0ac3bdc79 not found, ignoring
I0908 09:53:09.106670       1 pv_protection_controller.go:124] Finished processing PV pvc-264a4f24-b744-4ddf-bc0c-7db0ac3bdc79 (11.2µs)
... skipping 1543 lines ...
I0908 09:57:32.469532       1 pv_controller.go:1788] provisionClaimOperationExternal [azuredisk-1353/pvc-slrfj] started, class: "azuredisk-1353-kubernetes.io-azure-disk-dynamic-sc-4bnv4"
I0908 09:57:32.469885       1 deployment_controller.go:288] "ReplicaSet updated" replicaSet="azuredisk-1353/azuredisk-volume-tester-8sdxb-544588c466"
I0908 09:57:32.470049       1 replica_set.go:667] Finished syncing ReplicaSet "azuredisk-1353/azuredisk-volume-tester-8sdxb-544588c466" (6.193663ms)
I0908 09:57:32.470093       1 controller_utils.go:189] Controller expectations fulfilled &controller.ControlleeExpectations{add:0, del:0, key:"azuredisk-1353/azuredisk-volume-tester-8sdxb-544588c466", timestamp:time.Time{wall:0xc0be8d031aacd907, ext:939485688071, loc:(*time.Location)(0x6f12040)}}
I0908 09:57:32.470202       1 replica_set.go:667] Finished syncing ReplicaSet "azuredisk-1353/azuredisk-volume-tester-8sdxb-544588c466" (129.499µs)
I0908 09:57:32.472808       1 deployment_controller.go:585] "Finished syncing deployment" deployment="azuredisk-1353/azuredisk-volume-tester-8sdxb" duration="30.337022ms"
I0908 09:57:32.473045       1 deployment_controller.go:497] "Error syncing deployment" deployment="azuredisk-1353/azuredisk-volume-tester-8sdxb" err="Operation cannot be fulfilled on deployments.apps \"azuredisk-volume-tester-8sdxb\": the object has been modified; please apply your changes to the latest version and try again"
I0908 09:57:32.473218       1 deployment_controller.go:583] "Started syncing deployment" deployment="azuredisk-1353/azuredisk-volume-tester-8sdxb" startTime="2022-09-08 09:57:32.473194517 +0000 UTC m=+939.511347321"
I0908 09:57:32.476128       1 pv_controller_base.go:726] storeObjectUpdate updating claim "azuredisk-1353/pvc-slrfj" with version 3416
I0908 09:57:32.476317       1 pv_controller.go:255] synchronizing PersistentVolumeClaim[azuredisk-1353/pvc-slrfj]: phase: Pending, bound to: "", bindCompleted: false, boundByController: false
I0908 09:57:32.476345       1 pv_controller.go:350] synchronizing unbound PersistentVolumeClaim[azuredisk-1353/pvc-slrfj]: no volume found
I0908 09:57:32.476364       1 pv_controller.go:1535] provisionClaim[azuredisk-1353/pvc-slrfj]: started
I0908 09:57:32.476374       1 pv_controller.go:1851] scheduleOperation[provision-azuredisk-1353/pvc-slrfj[54222e4e-0adb-4680-afee-0e1f24ca5919]]
... skipping 240 lines ...
I0908 09:57:53.708224       1 replica_set.go:667] Finished syncing ReplicaSet "azuredisk-1353/azuredisk-volume-tester-8sdxb-544588c466" (704.997µs)
I0908 09:57:53.712930       1 deployment_controller.go:183] "Updating deployment" deployment="azuredisk-1353/azuredisk-volume-tester-8sdxb"
I0908 09:57:53.713432       1 deployment_controller.go:585] "Finished syncing deployment" deployment="azuredisk-1353/azuredisk-volume-tester-8sdxb" duration="5.457069ms"
I0908 09:57:53.713560       1 deployment_controller.go:583] "Started syncing deployment" deployment="azuredisk-1353/azuredisk-volume-tester-8sdxb" startTime="2022-09-08 09:57:53.71352005 +0000 UTC m=+960.751672754"
I0908 09:57:53.713911       1 progress.go:195] Queueing up deployment "azuredisk-volume-tester-8sdxb" for a progress check after 596s
I0908 09:57:53.713938       1 deployment_controller.go:585] "Finished syncing deployment" deployment="azuredisk-1353/azuredisk-volume-tester-8sdxb" duration="408.397µs"
I0908 09:57:53.769064       1 reconciler.go:420] "Multi-Attach error: volume is already used by pods" pods=[azuredisk-1353/azuredisk-volume-tester-8sdxb-544588c466-vldw8] attachedTo=[capz-puhmj3-md-0-cljzs] volume={VolumeToAttach:{MultiAttachErrorReported:false VolumeName:kubernetes.io/csi/disk.csi.azure.com^/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/capz-puhmj3/providers/Microsoft.Compute/disks/pvc-54222e4e-0adb-4680-afee-0e1f24ca5919 VolumeSpec:0xc0025b0c30 NodeName:capz-puhmj3-md-0-tjm9d ScheduledPods:[&Pod{ObjectMeta:{azuredisk-volume-tester-8sdxb-544588c466-gcwk5 azuredisk-volume-tester-8sdxb-544588c466- azuredisk-1353  fa99da6c-38e2-4ff7-b16b-fa0a5919fefc 3533 0 2022-09-08 09:57:53 +0000 UTC <nil> <nil> map[app:azuredisk-volume-tester-2050257992909156333 pod-template-hash:544588c466] map[] [{apps/v1 ReplicaSet azuredisk-volume-tester-8sdxb-544588c466 02a14390-43c9-4450-a715-7cadb73b6a14 0xc00238be6e 0xc00238be6f}] [] [{kube-controller-manager Update v1 2022-09-08 09:57:53 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"02a14390-43c9-4450-a715-7cadb73b6a14\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"volume-tester\"}":{".":{},"f:args":{},"f:command":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/mnt/test-1\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:nodeSelector":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{},"f:volumes":{".":{},"k:{\"name\":\"test-volume-1\"}":{".":{},"f:name":{},"f:persistentVolumeClaim":{".":{},"f:claimName":{}}}}}} }]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:test-volume-1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-slrfj,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},Volume{Name:kube-api-access-48btx,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:volume-tester,Image:k8s.gcr.io/e2e-test-images/busybox:1.29-2,Command:[/bin/sh],Args:[-c echo 'hello world' >> /mnt/test-1/data && while true; do sleep 3600; done],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:test-volume-1,ReadOnly:false,MountPath:/mnt/test-1,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:kube-api-access-48btx,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*30,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{kubernetes.io/os: linux,},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:capz-puhmj3-md-0-tjm9d,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,HostUsers:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-09-08 09:57:53 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:,PodIP:,StartTime:<nil>,ContainerStatuses:[]ContainerStatus{},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},}]}}
I0908 09:57:53.769156       1 event.go:294] "Event occurred" object="azuredisk-1353/azuredisk-volume-tester-8sdxb-544588c466-gcwk5" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="FailedAttachVolume" message="Multi-Attach error for volume \"pvc-54222e4e-0adb-4680-afee-0e1f24ca5919\" Volume is already used by pod(s) azuredisk-volume-tester-8sdxb-544588c466-vldw8"
I0908 09:57:58.702925       1 reflector.go:559] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:90: Watch close - *v1.PartialObjectMetadata total 10 items received
I0908 09:58:00.974956       1 httplog.go:131] "HTTP" verb="GET" URI="/healthz" latency="181.999µs" userAgent="kube-probe/1.26+" audit-ID="" srcIP="127.0.0.1:40230" resp=200
I0908 09:58:01.383079       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-puhmj3-md-0-tjm9d"
I0908 09:58:01.669384       1 reflector.go:559] vendor/k8s.io/client-go/informers/factory.go:134: Watch close - *v1.Service total 11 items received
I0908 09:58:02.672333       1 reflector.go:559] vendor/k8s.io/client-go/informers/factory.go:134: Watch close - *v1.Role total 10 items received
I0908 09:58:02.938735       1 node_lifecycle_controller.go:1092] Node capz-puhmj3-md-0-tjm9d ReadyCondition updated. Updating timestamp.
... skipping 4473 lines ...
I0908 10:08:38.802170       1 namespace_controller.go:180] Finished syncing namespace "azuredisk-6720" (113.760281ms)
2022/09/08 10:08:39 ===================================================

JUnit report was created: /logs/artifacts/junit_01.xml

Ran 12 of 59 Specs in 1275.608 seconds
SUCCESS! -- 12 Passed | 0 Failed | 0 Pending | 47 Skipped

You're using deprecated Ginkgo functionality:
=============================================
Ginkgo 2.0 is under active development and will introduce several new features, improvements, and a small handful of breaking changes.
A release candidate for 2.0 is now available and 2.0 should GA in Fall 2021.  Please give the RC a try and send us feedback!
  - To learn more, view the migration guide at https://github.com/onsi/ginkgo/blob/ver2/docs/MIGRATING_TO_V2.md
... skipping 45 lines ...
INFO: Creating log watcher for controller capz-system/capz-controller-manager, pod capz-controller-manager-858df9cd95-tblhs, container manager
STEP: Dumping workload cluster default/capz-puhmj3 logs
Sep  8 10:10:10.236: INFO: Collecting logs for Linux node capz-puhmj3-control-plane-kjzkz in cluster capz-puhmj3 in namespace default

Sep  8 10:11:10.239: INFO: Collecting boot logs for AzureMachine capz-puhmj3-control-plane-kjzkz

Failed to get logs for machine capz-puhmj3-control-plane-xrh8d, cluster default/capz-puhmj3: open /etc/azure-ssh/azure-ssh: no such file or directory
Sep  8 10:11:11.312: INFO: Collecting logs for Linux node capz-puhmj3-md-0-cljzs in cluster capz-puhmj3 in namespace default

Sep  8 10:12:11.313: INFO: Collecting boot logs for AzureMachine capz-puhmj3-md-0-cljzs

Failed to get logs for machine capz-puhmj3-md-0-5dc6d69d5b-lsjsv, cluster default/capz-puhmj3: open /etc/azure-ssh/azure-ssh: no such file or directory
Sep  8 10:12:11.633: INFO: Collecting logs for Linux node capz-puhmj3-md-0-tjm9d in cluster capz-puhmj3 in namespace default

Sep  8 10:13:11.636: INFO: Collecting boot logs for AzureMachine capz-puhmj3-md-0-tjm9d

Failed to get logs for machine capz-puhmj3-md-0-5dc6d69d5b-z2psq, cluster default/capz-puhmj3: open /etc/azure-ssh/azure-ssh: no such file or directory
STEP: Dumping workload cluster default/capz-puhmj3 kube-system pod logs
STEP: Creating log watcher for controller kube-system/coredns-84994b8c4-fkfsd, container coredns
STEP: Fetching kube-system pod logs took 636.728069ms
STEP: Collecting events for Pod kube-system/calico-node-gthlc
STEP: Collecting events for Pod kube-system/metrics-server-76f7667fbf-6gk8w
STEP: Collecting events for Pod kube-system/calico-kube-controllers-755ff8d7b5-fqg7l
... skipping 20 lines ...
STEP: Creating log watcher for controller kube-system/csi-snapshot-controller-84ccd6c756-gm62f, container csi-snapshot-controller
STEP: Collecting events for Pod kube-system/csi-snapshot-controller-84ccd6c756-gm62f
STEP: Creating log watcher for controller kube-system/csi-azuredisk-controller-6dbf65647f-xvmsr, container azuredisk
STEP: Creating log watcher for controller kube-system/etcd-capz-puhmj3-control-plane-kjzkz, container etcd
STEP: Collecting events for Pod kube-system/csi-azuredisk-controller-6dbf65647f-xvmsr
STEP: Collecting events for Pod kube-system/etcd-capz-puhmj3-control-plane-kjzkz
STEP: failed to find events of Pod "etcd-capz-puhmj3-control-plane-kjzkz"
STEP: Creating log watcher for controller kube-system/csi-azuredisk-node-2lhvl, container liveness-probe
STEP: Creating log watcher for controller kube-system/kube-apiserver-capz-puhmj3-control-plane-kjzkz, container kube-apiserver
STEP: Creating log watcher for controller kube-system/csi-azuredisk-node-2lhvl, container node-driver-registrar
STEP: Collecting events for Pod kube-system/kube-apiserver-capz-puhmj3-control-plane-kjzkz
STEP: failed to find events of Pod "kube-apiserver-capz-puhmj3-control-plane-kjzkz"
STEP: Creating log watcher for controller kube-system/csi-azuredisk-node-2lhvl, container azuredisk
STEP: Collecting events for Pod kube-system/csi-azuredisk-node-2lhvl
STEP: Collecting events for Pod kube-system/kube-proxy-9sv44
STEP: Creating log watcher for controller kube-system/kube-controller-manager-capz-puhmj3-control-plane-kjzkz, container kube-controller-manager
STEP: Creating log watcher for controller kube-system/calico-node-qpswz, container calico-node
STEP: Creating log watcher for controller kube-system/csi-azuredisk-node-gqg79, container liveness-probe
STEP: Collecting events for Pod kube-system/kube-controller-manager-capz-puhmj3-control-plane-kjzkz
STEP: failed to find events of Pod "kube-controller-manager-capz-puhmj3-control-plane-kjzkz"
STEP: Creating log watcher for controller kube-system/kube-proxy-wzd2x, container kube-proxy
STEP: Creating log watcher for controller kube-system/csi-azuredisk-node-gqg79, container node-driver-registrar
STEP: Collecting events for Pod kube-system/kube-proxy-wzd2x
STEP: Creating log watcher for controller kube-system/kube-proxy-2twbl, container kube-proxy
STEP: Creating log watcher for controller kube-system/csi-azuredisk-node-gqg79, container azuredisk
STEP: Collecting events for Pod kube-system/kube-proxy-2twbl
... skipping 6 lines ...
STEP: Creating log watcher for controller kube-system/csi-azuredisk-node-r4qfg, container liveness-probe
STEP: Creating log watcher for controller kube-system/kube-proxy-9sv44, container kube-proxy
STEP: Creating log watcher for controller kube-system/csi-snapshot-controller-84ccd6c756-bclfm, container csi-snapshot-controller
STEP: Creating log watcher for controller kube-system/metrics-server-76f7667fbf-6gk8w, container metrics-server
STEP: Collecting events for Pod kube-system/csi-snapshot-controller-84ccd6c756-bclfm
STEP: Creating log watcher for controller kube-system/csi-azuredisk-node-r4qfg, container node-driver-registrar
STEP: failed to find events of Pod "kube-scheduler-capz-puhmj3-control-plane-kjzkz"
STEP: Fetching activity logs took 4.626794714s
================ REDACTING LOGS ================
All sensitive variables are redacted
cluster.cluster.x-k8s.io "capz-puhmj3" deleted
/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/hack/tools/bin/kind-v0.14.0 delete cluster --name=capz || true
Deleting cluster "capz" ...
... skipping 12 lines ...