This job view page is being replaced by Spyglass soon. Check out the new job view.
Resultsuccess
Tests 0 failed / 6 succeeded
Started2022-09-03 05:37
Elapsed38m37s
Revision
uploadercrier
uploadercrier

No Test Failures!


Show 6 Passed Tests

Show 28 Skipped Tests

Error lines from build-log.txt

... skipping 627 lines ...
certificate.cert-manager.io "selfsigned-cert" deleted
# Create secret for AzureClusterIdentity
./hack/create-identity-secret.sh
make[2]: Entering directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure'
make[2]: Nothing to be done for 'kubectl'.
make[2]: Leaving directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure'
Error from server (NotFound): secrets "cluster-identity-secret" not found
secret/cluster-identity-secret created
secret/cluster-identity-secret labeled
# Create customized cloud provider configs
./hack/create-custom-cloud-provider-config.sh
make[2]: Entering directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure'
make[2]: Nothing to be done for 'kubectl'.
... skipping 137 lines ...
# Wait for the kubeconfig to become available.
timeout --foreground 300 bash -c "while ! /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/hack/tools/bin/kubectl-v1.22.4 get secrets | grep capz-qnu7s3-kubeconfig; do sleep 1; done"
capz-qnu7s3-kubeconfig                 cluster.x-k8s.io/secret   1      0s
# Get kubeconfig and store it locally.
/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/hack/tools/bin/kubectl-v1.22.4 get secrets capz-qnu7s3-kubeconfig -o json | jq -r .data.value | base64 --decode > ./kubeconfig
timeout --foreground 600 bash -c "while ! /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/hack/tools/bin/kubectl-v1.22.4 --kubeconfig=./kubeconfig get nodes | grep control-plane; do sleep 1; done"
error: the server doesn't have a resource type "nodes"
capz-qnu7s3-control-plane-6hptv   NotReady   control-plane   9s    v1.24.5-rc.0.5+41673068c87afe
run "/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/hack/tools/bin/kubectl-v1.22.4 --kubeconfig=./kubeconfig ..." to work with the new target cluster
make[1]: Leaving directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure'
Waiting for 1 control plane machine(s), 2 worker machine(s), and  windows machine(s) to become Ready
node/capz-qnu7s3-control-plane-6hptv condition met
node/capz-qnu7s3-md-0-wvhqp condition met
... skipping 122 lines ...
Sep  3 05:58:16.021: INFO: PersistentVolumeClaim pvc-hdpbs found but phase is Pending instead of Bound.
Sep  3 05:58:18.126: INFO: PersistentVolumeClaim pvc-hdpbs found and phase=Bound (25.346506326s)
STEP: checking the PVC
STEP: validating provisioned PV
STEP: checking the PV
STEP: deploying the pod
STEP: checking that the pods command exits with no error
Sep  3 05:58:18.435: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-b4sbr" in namespace "azurefile-2540" to be "Succeeded or Failed"
Sep  3 05:58:18.537: INFO: Pod "azurefile-volume-tester-b4sbr": Phase="Pending", Reason="", readiness=false. Elapsed: 101.679966ms
Sep  3 05:58:20.646: INFO: Pod "azurefile-volume-tester-b4sbr": Phase="Pending", Reason="", readiness=false. Elapsed: 2.211182531s
Sep  3 05:58:22.757: INFO: Pod "azurefile-volume-tester-b4sbr": Phase="Running", Reason="", readiness=false. Elapsed: 4.321963878s
Sep  3 05:58:24.865: INFO: Pod "azurefile-volume-tester-b4sbr": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.430213865s
STEP: Saw pod success
Sep  3 05:58:24.865: INFO: Pod "azurefile-volume-tester-b4sbr" satisfied condition "Succeeded or Failed"
Sep  3 05:58:24.865: INFO: deleting Pod "azurefile-2540"/"azurefile-volume-tester-b4sbr"
Sep  3 05:58:24.986: INFO: Pod azurefile-volume-tester-b4sbr has the following logs: hello world

STEP: Deleting pod azurefile-volume-tester-b4sbr in namespace azurefile-2540
Sep  3 05:58:25.110: INFO: deleting PVC "azurefile-2540"/"pvc-hdpbs"
Sep  3 05:58:25.110: INFO: Deleting PersistentVolumeClaim "pvc-hdpbs"
... skipping 157 lines ...
Sep  3 06:00:23.190: INFO: PersistentVolumeClaim pvc-qnwsv found but phase is Pending instead of Bound.
Sep  3 06:00:25.294: INFO: PersistentVolumeClaim pvc-qnwsv found and phase=Bound (25.34825715s)
STEP: checking the PVC
STEP: validating provisioned PV
STEP: checking the PV
STEP: deploying the pod
STEP: checking that the pods command exits with an error
Sep  3 06:00:25.601: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-qj4pq" in namespace "azurefile-2790" to be "Error status code"
Sep  3 06:00:25.703: INFO: Pod "azurefile-volume-tester-qj4pq": Phase="Pending", Reason="", readiness=false. Elapsed: 102.067439ms
Sep  3 06:00:27.811: INFO: Pod "azurefile-volume-tester-qj4pq": Phase="Pending", Reason="", readiness=false. Elapsed: 2.210365113s
Sep  3 06:00:29.920: INFO: Pod "azurefile-volume-tester-qj4pq": Phase="Failed", Reason="", readiness=false. Elapsed: 4.318852004s
STEP: Saw pod failure
Sep  3 06:00:29.920: INFO: Pod "azurefile-volume-tester-qj4pq" satisfied condition "Error status code"
STEP: checking that pod logs contain expected message
Sep  3 06:00:30.031: INFO: deleting Pod "azurefile-2790"/"azurefile-volume-tester-qj4pq"
Sep  3 06:00:30.135: INFO: Pod azurefile-volume-tester-qj4pq has the following logs: touch: /mnt/test-1/data: Read-only file system

STEP: Deleting pod azurefile-volume-tester-qj4pq in namespace azurefile-2790
Sep  3 06:00:30.249: INFO: deleting PVC "azurefile-2790"/"pvc-qnwsv"
... skipping 181 lines ...
Sep  3 06:02:31.813: INFO: PersistentVolumeClaim pvc-pvmht found but phase is Pending instead of Bound.
Sep  3 06:02:33.916: INFO: PersistentVolumeClaim pvc-pvmht found and phase=Bound (2.205616525s)
STEP: checking the PVC
STEP: validating provisioned PV
STEP: checking the PV
STEP: deploying the pod
STEP: checking that the pods command exits with no error
Sep  3 06:02:34.225: INFO: Waiting up to 15m0s for pod "azurefile-volume-tester-zg7nx" in namespace "azurefile-4538" to be "Succeeded or Failed"
Sep  3 06:02:34.327: INFO: Pod "azurefile-volume-tester-zg7nx": Phase="Pending", Reason="", readiness=false. Elapsed: 102.307523ms
Sep  3 06:02:36.434: INFO: Pod "azurefile-volume-tester-zg7nx": Phase="Running", Reason="", readiness=true. Elapsed: 2.209733947s
Sep  3 06:02:38.542: INFO: Pod "azurefile-volume-tester-zg7nx": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.316935408s
STEP: Saw pod success
Sep  3 06:02:38.542: INFO: Pod "azurefile-volume-tester-zg7nx" satisfied condition "Succeeded or Failed"
STEP: resizing the pvc
STEP: sleep 30s waiting for resize complete
STEP: checking the resizing result
STEP: checking the resizing PV result
STEP: checking the resizing azurefile result
Sep  3 06:03:09.915: INFO: deleting Pod "azurefile-4538"/"azurefile-volume-tester-zg7nx"
... skipping 867 lines ...
I0903 05:51:39.518973       1 tlsconfig.go:200] "Loaded serving cert" certName="Generated self signed cert" certDetail="\"localhost@1662184298\" [serving] validServingFor=[127.0.0.1,127.0.0.1,localhost] issuer=\"localhost-ca@1662184298\" (2022-09-03 04:51:38 +0000 UTC to 2023-09-03 04:51:38 +0000 UTC (now=2022-09-03 05:51:39.518951192 +0000 UTC))"
I0903 05:51:39.519166       1 named_certificates.go:53] "Loaded SNI cert" index=0 certName="self-signed loopback" certDetail="\"apiserver-loopback-client@1662184299\" [serving] validServingFor=[apiserver-loopback-client] issuer=\"apiserver-loopback-client-ca@1662184299\" (2022-09-03 04:51:38 +0000 UTC to 2023-09-03 04:51:38 +0000 UTC (now=2022-09-03 05:51:39.519144189 +0000 UTC))"
I0903 05:51:39.523818       1 secure_serving.go:210] Serving securely on 127.0.0.1:10257
I0903 05:51:39.524117       1 leaderelection.go:248] attempting to acquire leader lease kube-system/kube-controller-manager...
I0903 05:51:39.524844       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"
I0903 05:51:39.525083       1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt"
E0903 05:51:41.674499       1 leaderelection.go:330] error retrieving resource lock kube-system/kube-controller-manager: leases.coordination.k8s.io "kube-controller-manager" is forbidden: User "system:kube-controller-manager" cannot get resource "leases" in API group "coordination.k8s.io" in the namespace "kube-system"
I0903 05:51:41.674522       1 leaderelection.go:253] failed to acquire lease kube-system/kube-controller-manager
I0903 05:51:43.835128       1 leaderelection.go:258] successfully acquired lease kube-system/kube-controller-manager
I0903 05:51:43.835331       1 event.go:294] "Event occurred" object="kube-system/kube-controller-manager" fieldPath="" kind="Lease" apiVersion="coordination.k8s.io/v1" type="Normal" reason="LeaderElection" message="capz-qnu7s3-control-plane-6hptv_6439601b-4f67-40d6-b53f-96613755c38e became leader"
I0903 05:51:43.958223       1 request.go:533] Waited for 97.493397ms due to client-side throttling, not priority and fairness, request: GET:https://10.0.0.4:6443/apis/flowcontrol.apiserver.k8s.io/v1beta2
W0903 05:51:43.959756       1 plugins.go:132] WARNING: azure built-in cloud provider is now deprecated. The Azure provider is deprecated and will be removed in a future release. Please use https://github.com/kubernetes-sigs/cloud-provider-azure
I0903 05:51:43.960336       1 azure_auth.go:232] Using AzurePublicCloud environment
I0903 05:51:43.960383       1 azure_auth.go:117] azure: using client_id+client_secret to retrieve access token
... skipping 30 lines ...
I0903 05:51:43.961769       1 reflector.go:255] Listing and watching *v1.Secret from vendor/k8s.io/client-go/informers/factory.go:134
I0903 05:51:43.962024       1 reflector.go:219] Starting reflector *v1.Node (20h10m2.928587579s) from vendor/k8s.io/client-go/informers/factory.go:134
I0903 05:51:43.962042       1 reflector.go:255] Listing and watching *v1.Node from vendor/k8s.io/client-go/informers/factory.go:134
I0903 05:51:43.962192       1 shared_informer.go:255] Waiting for caches to sync for tokens
I0903 05:51:43.965219       1 reflector.go:219] Starting reflector *v1.ServiceAccount (20h10m2.928587579s) from vendor/k8s.io/client-go/informers/factory.go:134
I0903 05:51:43.965374       1 reflector.go:255] Listing and watching *v1.ServiceAccount from vendor/k8s.io/client-go/informers/factory.go:134
W0903 05:51:43.981297       1 azure_config.go:53] Failed to get cloud-config from secret: failed to get secret azure-cloud-provider: secrets "azure-cloud-provider" is forbidden: User "system:serviceaccount:kube-system:azure-cloud-provider" cannot get resource "secrets" in API group "" in the namespace "kube-system", skip initializing from secret
I0903 05:51:43.981318       1 controllermanager.go:564] Starting "endpointslicemirroring"
I0903 05:51:43.986523       1 controllermanager.go:593] Started "endpointslicemirroring"
I0903 05:51:43.986545       1 controllermanager.go:564] Starting "daemonset"
I0903 05:51:43.986754       1 endpointslicemirroring_controller.go:212] Starting EndpointSliceMirroring controller
I0903 05:51:43.986769       1 shared_informer.go:255] Waiting for caches to sync for endpoint_slice_mirroring
I0903 05:51:43.991736       1 controllermanager.go:593] Started "daemonset"
... skipping 11 lines ...
I0903 05:51:44.015139       1 plugins.go:634] "Loaded volume plugin" pluginName="kubernetes.io/vsphere-volume"
I0903 05:51:44.015243       1 plugins.go:634] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
I0903 05:51:44.015397       1 plugins.go:634] "Loaded volume plugin" pluginName="kubernetes.io/rbd"
I0903 05:51:44.015502       1 plugins.go:634] "Loaded volume plugin" pluginName="kubernetes.io/storageos"
I0903 05:51:44.015613       1 plugins.go:634] "Loaded volume plugin" pluginName="kubernetes.io/fc"
I0903 05:51:44.015707       1 plugins.go:634] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
I0903 05:51:44.015870       1 csi_plugin.go:262] Cast from VolumeHost to KubeletVolumeHost failed. Skipping CSINode initialization, not running on kubelet
I0903 05:51:44.015969       1 plugins.go:634] "Loaded volume plugin" pluginName="kubernetes.io/csi"
I0903 05:51:44.017031       1 controllermanager.go:593] Started "attachdetach"
I0903 05:51:44.017162       1 controllermanager.go:564] Starting "persistentvolume-expander"
I0903 05:51:44.017907       1 attach_detach_controller.go:328] Starting attach detach controller
I0903 05:51:44.018042       1 shared_informer.go:255] Waiting for caches to sync for attach detach
I0903 05:51:44.027192       1 plugins.go:634] "Loaded volume plugin" pluginName="kubernetes.io/rbd"
... skipping 116 lines ...
I0903 05:51:46.866804       1 plugins.go:634] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
I0903 05:51:46.866822       1 plugins.go:634] "Loaded volume plugin" pluginName="kubernetes.io/rbd"
I0903 05:51:46.866836       1 plugins.go:634] "Loaded volume plugin" pluginName="kubernetes.io/azure-file"
I0903 05:51:46.866853       1 plugins.go:634] "Loaded volume plugin" pluginName="kubernetes.io/flocker"
I0903 05:51:46.866872       1 plugins.go:634] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
I0903 05:51:46.866890       1 plugins.go:634] "Loaded volume plugin" pluginName="kubernetes.io/storageos"
I0903 05:51:46.866955       1 csi_plugin.go:262] Cast from VolumeHost to KubeletVolumeHost failed. Skipping CSINode initialization, not running on kubelet
I0903 05:51:46.867061       1 plugins.go:634] "Loaded volume plugin" pluginName="kubernetes.io/csi"
I0903 05:51:46.867246       1 controllermanager.go:593] Started "persistentvolume-binder"
I0903 05:51:46.867296       1 controllermanager.go:564] Starting "endpoint"
I0903 05:51:46.867361       1 pv_controller_base.go:311] Starting persistent volume controller
I0903 05:51:46.867379       1 shared_informer.go:255] Waiting for caches to sync for persistent volume
I0903 05:51:47.015406       1 controllermanager.go:593] Started "endpoint"
... skipping 94 lines ...
I0903 05:51:47.835369       1 resource_quota_controller.go:439] syncing resource quota controller with updated resources from discovery: added: [/v1, Resource=configmaps /v1, Resource=endpoints /v1, Resource=events /v1, Resource=limitranges /v1, Resource=persistentvolumeclaims /v1, Resource=pods /v1, Resource=podtemplates /v1, Resource=replicationcontrollers /v1, Resource=resourcequotas /v1, Resource=secrets /v1, Resource=serviceaccounts /v1, Resource=services apps/v1, Resource=controllerrevisions apps/v1, Resource=daemonsets apps/v1, Resource=deployments apps/v1, Resource=replicasets apps/v1, Resource=statefulsets autoscaling/v2, Resource=horizontalpodautoscalers batch/v1, Resource=cronjobs batch/v1, Resource=jobs coordination.k8s.io/v1, Resource=leases discovery.k8s.io/v1, Resource=endpointslices events.k8s.io/v1, Resource=events networking.k8s.io/v1, Resource=ingresses networking.k8s.io/v1, Resource=networkpolicies policy/v1, Resource=poddisruptionbudgets rbac.authorization.k8s.io/v1, Resource=rolebindings rbac.authorization.k8s.io/v1, Resource=roles storage.k8s.io/v1, Resource=csistoragecapacities], removed: []
I0903 05:51:47.970624       1 controllermanager.go:593] Started "deployment"
I0903 05:51:47.972294       1 controllermanager.go:564] Starting "horizontalpodautoscaling"
I0903 05:51:47.972565       1 deployment_controller.go:153] "Starting controller" controller="deployment"
I0903 05:51:47.972728       1 shared_informer.go:255] Waiting for caches to sync for deployment
I0903 05:51:47.981536       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-qnu7s3-control-plane-6hptv"
W0903 05:51:47.981565       1 actual_state_of_world.go:541] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="capz-qnu7s3-control-plane-6hptv" does not exist
I0903 05:51:47.981597       1 topologycache.go:183] Ignoring node capz-qnu7s3-control-plane-6hptv because it is not ready: [{MemoryPressure False 2022-09-03 05:51:27 +0000 UTC 2022-09-03 05:51:27 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2022-09-03 05:51:27 +0000 UTC 2022-09-03 05:51:27 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2022-09-03 05:51:27 +0000 UTC 2022-09-03 05:51:27 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready False 2022-09-03 05:51:27 +0000 UTC 2022-09-03 05:51:27 +0000 UTC KubeletNotReady [container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful, container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized, CSINode is not yet initialized, missing node capacity for resources: ephemeral-storage]}]
I0903 05:51:47.981653       1 topologycache.go:215] Insufficient node info for topology hints (0 zones, %!s(int64=0) CPU, true)
I0903 05:51:47.981739       1 controller.go:697] Ignoring node capz-qnu7s3-control-plane-6hptv with Ready condition status False
I0903 05:51:47.981749       1 controller.go:272] Triggering nodeSync
I0903 05:51:47.988004       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-qnu7s3-control-plane-6hptv"
I0903 05:51:48.025741       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-qnu7s3-control-plane-6hptv"
I0903 05:51:48.062402       1 request.go:533] Waited for 80.893258ms due to client-side throttling, not priority and fairness, request: GET:https://10.0.0.4:6443/api/v1/namespaces/kube-system/serviceaccounts/ttl-controller
... skipping 321 lines ...
I0903 05:51:49.025184       1 deployment_controller.go:215] "ReplicaSet added" replicaSet="kube-system/coredns-6d4b75cb6d"
I0903 05:51:49.025699       1 event.go:294] "Event occurred" object="kube-system/coredns" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-6d4b75cb6d to 2"
I0903 05:51:49.043615       1 deployment_util.go:774] Deployment "coredns" timed out (false) [last progress check: 2022-09-03 05:51:49.025367856 +0000 UTC m=+10.984346605 - now: 2022-09-03 05:51:49.043606429 +0000 UTC m=+11.002585178]
I0903 05:51:49.043991       1 deployment_controller.go:176] "Updating deployment" deployment="kube-system/coredns"
I0903 05:51:49.050348       1 daemon_controller.go:226] Adding daemon set kube-proxy
I0903 05:51:49.054409       1 deployment_controller.go:578] "Finished syncing deployment" deployment="kube-system/coredns" duration="80.967212ms"
I0903 05:51:49.054442       1 deployment_controller.go:490] "Error syncing deployment" deployment="kube-system/coredns" err="Operation cannot be fulfilled on deployments.apps \"coredns\": the object has been modified; please apply your changes to the latest version and try again"
I0903 05:51:49.054471       1 deployment_controller.go:576] "Started syncing deployment" deployment="kube-system/coredns" startTime="2022-09-03 05:51:49.054459494 +0000 UTC m=+11.013438243"
I0903 05:51:49.055034       1 deployment_util.go:774] Deployment "coredns" timed out (false) [last progress check: 2022-09-03 05:51:49 +0000 UTC - now: 2022-09-03 05:51:49.055026887 +0000 UTC m=+11.014005736]
I0903 05:51:49.060350       1 deployment_controller.go:176] "Updating deployment" deployment="kube-system/coredns"
I0903 05:51:49.060577       1 deployment_controller.go:578] "Finished syncing deployment" deployment="kube-system/coredns" duration="6.106524ms"
I0903 05:51:49.060606       1 deployment_controller.go:576] "Started syncing deployment" deployment="kube-system/coredns" startTime="2022-09-03 05:51:49.060594018 +0000 UTC m=+11.019572867"
I0903 05:51:49.061166       1 deployment_util.go:774] Deployment "coredns" timed out (false) [last progress check: 2022-09-03 05:51:49 +0000 UTC - now: 2022-09-03 05:51:49.061158511 +0000 UTC m=+11.020137260]
... skipping 254 lines ...
I0903 05:51:52.622874       1 deployment_util.go:774] Deployment "metrics-server" timed out (false) [last progress check: 2022-09-03 05:51:52.61542317 +0000 UTC m=+14.574401919 - now: 2022-09-03 05:51:52.622866565 +0000 UTC m=+14.581845414]
I0903 05:51:52.628772       1 deployment_controller.go:281] "ReplicaSet updated" replicaSet="kube-system/metrics-server-7d674f87b8"
I0903 05:51:52.629053       1 replica_set.go:667] Finished syncing ReplicaSet "kube-system/metrics-server-7d674f87b8" (14.530596ms)
I0903 05:51:52.629538       1 controller_utils.go:189] Controller expectations fulfilled &controller.ControlleeExpectations{add:0, del:0, key:"kube-system/metrics-server-7d674f87b8", timestamp:time.Time{wall:0xc0bcd8be24a36bf4, ext:14573668529, loc:(*time.Location)(0x7249da0)}}
I0903 05:51:52.629734       1 replica_set_utils.go:59] Updating status for : kube-system/metrics-server-7d674f87b8, replicas 0->1 (need 1), fullyLabeledReplicas 0->1, readyReplicas 0->0, availableReplicas 0->0, sequence No: 1->1
I0903 05:51:52.634612       1 deployment_controller.go:578] "Finished syncing deployment" deployment="kube-system/metrics-server" duration="24.25756ms"
I0903 05:51:52.634827       1 deployment_controller.go:490] "Error syncing deployment" deployment="kube-system/metrics-server" err="Operation cannot be fulfilled on deployments.apps \"metrics-server\": the object has been modified; please apply your changes to the latest version and try again"
I0903 05:51:52.635035       1 deployment_controller.go:576] "Started syncing deployment" deployment="kube-system/metrics-server" startTime="2022-09-03 05:51:52.635019395 +0000 UTC m=+14.593998144"
I0903 05:51:52.635613       1 deployment_util.go:774] Deployment "metrics-server" timed out (false) [last progress check: 2022-09-03 05:51:52 +0000 UTC - now: 2022-09-03 05:51:52.635605087 +0000 UTC m=+14.594583836]
I0903 05:51:52.635968       1 pvc_protection_controller.go:380] "Enqueuing PVCs for Pod" pod="kube-system/metrics-server-7d674f87b8-8wwpw" podUID=81168c0b-91f9-407e-9ccc-064aeb62505e
I0903 05:51:52.635997       1 replica_set.go:457] Pod metrics-server-7d674f87b8-8wwpw updated, objectMeta {Name:metrics-server-7d674f87b8-8wwpw GenerateName:metrics-server-7d674f87b8- Namespace:kube-system SelfLink: UID:81168c0b-91f9-407e-9ccc-064aeb62505e ResourceVersion:392 Generation:0 CreationTimestamp:2022-09-03 05:51:52 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[k8s-app:metrics-server pod-template-hash:7d674f87b8] Annotations:map[] OwnerReferences:[{APIVersion:apps/v1 Kind:ReplicaSet Name:metrics-server-7d674f87b8 UID:c295278f-6dad-4823-9b28-efc330c6cb87 Controller:0xc00249910e BlockOwnerDeletion:0xc00249910f}] Finalizers:[] ZZZ_DeprecatedClusterName: ManagedFields:[{Manager:kube-controller-manager Operation:Update APIVersion:v1 Time:2022-09-03 05:51:52 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"c295278f-6dad-4823-9b28-efc330c6cb87\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"metrics-server\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:livenessProbe":{".":{},"f:failureThreshold":{},"f:httpGet":{".":{},"f:path":{},"f:port":{},"f:scheme":{}},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:name":{},"f:ports":{".":{},"k:{\"containerPort\":4443,\"protocol\":\"TCP\"}":{".":{},"f:containerPort":{},"f:name":{},"f:protocol":{}}},"f:readinessProbe":{".":{},"f:failureThreshold":{},"f:httpGet":{".":{},"f:path":{},"f:port":{},"f:scheme":{}},"f:initialDelaySeconds":{},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:resources":{".":{},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:securityContext":{".":{},"f:readOnlyRootFilesystem":{},"f:runAsNonRoot":{},"f:runAsUser":{}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/tmp\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:nodeSelector":{},"f:priorityClassName":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:serviceAccount":{},"f:serviceAccountName":{},"f:terminationGracePeriodSeconds":{},"f:tolerations":{},"f:volumes":{".":{},"k:{\"name\":\"tmp-dir\"}":{".":{},"f:emptyDir":{},"f:name":{}}}}} Subresource:}]} -> {Name:metrics-server-7d674f87b8-8wwpw GenerateName:metrics-server-7d674f87b8- Namespace:kube-system SelfLink: UID:81168c0b-91f9-407e-9ccc-064aeb62505e ResourceVersion:398 Generation:0 CreationTimestamp:2022-09-03 05:51:52 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[k8s-app:metrics-server pod-template-hash:7d674f87b8] Annotations:map[] OwnerReferences:[{APIVersion:apps/v1 Kind:ReplicaSet Name:metrics-server-7d674f87b8 UID:c295278f-6dad-4823-9b28-efc330c6cb87 Controller:0xc002460917 BlockOwnerDeletion:0xc002460918}] Finalizers:[] ZZZ_DeprecatedClusterName: ManagedFields:[{Manager:kube-controller-manager Operation:Update APIVersion:v1 Time:2022-09-03 05:51:52 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"c295278f-6dad-4823-9b28-efc330c6cb87\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"metrics-server\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:livenessProbe":{".":{},"f:failureThreshold":{},"f:httpGet":{".":{},"f:path":{},"f:port":{},"f:scheme":{}},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:name":{},"f:ports":{".":{},"k:{\"containerPort\":4443,\"protocol\":\"TCP\"}":{".":{},"f:containerPort":{},"f:name":{},"f:protocol":{}}},"f:readinessProbe":{".":{},"f:failureThreshold":{},"f:httpGet":{".":{},"f:path":{},"f:port":{},"f:scheme":{}},"f:initialDelaySeconds":{},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:resources":{".":{},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:securityContext":{".":{},"f:readOnlyRootFilesystem":{},"f:runAsNonRoot":{},"f:runAsUser":{}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/tmp\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:nodeSelector":{},"f:priorityClassName":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:serviceAccount":{},"f:serviceAccountName":{},"f:terminationGracePeriodSeconds":{},"f:tolerations":{},"f:volumes":{".":{},"k:{\"name\":\"tmp-dir\"}":{".":{},"f:emptyDir":{},"f:name":{}}}}} Subresource:} {Manager:kube-scheduler Operation:Update APIVersion:v1 Time:2022-09-03 05:51:52 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:status":{"f:conditions":{".":{},"k:{\"type\":\"PodScheduled\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} Subresource:status}]}.
I0903 05:51:52.636088       1 disruption.go:427] updatePod called on pod "metrics-server-7d674f87b8-8wwpw"
I0903 05:51:52.636745       1 disruption.go:490] No PodDisruptionBudgets found for pod metrics-server-7d674f87b8-8wwpw, PodDisruptionBudget controller will avoid syncing.
... skipping 75 lines ...
I0903 05:51:55.079038       1 disruption.go:430] No matching pdb for pod "calico-kube-controllers-7867496574-8fdcf"
I0903 05:51:55.090636       1 deployment_controller.go:281] "ReplicaSet updated" replicaSet="kube-system/calico-kube-controllers-7867496574"
I0903 05:51:55.090927       1 replica_set.go:667] Finished syncing ReplicaSet "kube-system/calico-kube-controllers-7867496574" (34.312572ms)
I0903 05:51:55.091078       1 controller_utils.go:189] Controller expectations fulfilled &controller.ControlleeExpectations{add:0, del:0, key:"kube-system/calico-kube-controllers-7867496574", timestamp:time.Time{wall:0xc0bcd8bec367488a, ext:17016079175, loc:(*time.Location)(0x7249da0)}}
I0903 05:51:55.091302       1 replica_set_utils.go:59] Updating status for : kube-system/calico-kube-controllers-7867496574, replicas 0->1 (need 1), fullyLabeledReplicas 0->1, readyReplicas 0->0, availableReplicas 0->0, sequence No: 1->1
I0903 05:51:55.091656       1 deployment_controller.go:578] "Finished syncing deployment" deployment="kube-system/calico-kube-controllers" duration="46.329188ms"
I0903 05:51:55.091825       1 deployment_controller.go:490] "Error syncing deployment" deployment="kube-system/calico-kube-controllers" err="Operation cannot be fulfilled on deployments.apps \"calico-kube-controllers\": the object has been modified; please apply your changes to the latest version and try again"
I0903 05:51:55.091955       1 deployment_controller.go:576] "Started syncing deployment" deployment="kube-system/calico-kube-controllers" startTime="2022-09-03 05:51:55.091938591 +0000 UTC m=+17.050917340"
I0903 05:51:55.092451       1 deployment_util.go:774] Deployment "calico-kube-controllers" timed out (false) [last progress check: 2022-09-03 05:51:55 +0000 UTC - now: 2022-09-03 05:51:55.092444583 +0000 UTC m=+17.051423332]
I0903 05:51:55.096851       1 deployment_controller.go:281] "ReplicaSet updated" replicaSet="kube-system/calico-kube-controllers-7867496574"
I0903 05:51:55.100368       1 deployment_controller.go:176] "Updating deployment" deployment="kube-system/calico-kube-controllers"
I0903 05:51:55.100630       1 deployment_controller.go:578] "Finished syncing deployment" deployment="kube-system/calico-kube-controllers" duration="8.680366ms"
I0903 05:51:55.100788       1 deployment_controller.go:576] "Started syncing deployment" deployment="kube-system/calico-kube-controllers" startTime="2022-09-03 05:51:55.100772655 +0000 UTC m=+17.059751504"
... skipping 291 lines ...
I0903 05:52:10.472579       1 replica_set.go:457] Pod metrics-server-7d674f87b8-8wwpw updated, objectMeta {Name:metrics-server-7d674f87b8-8wwpw GenerateName:metrics-server-7d674f87b8- Namespace:kube-system SelfLink: UID:81168c0b-91f9-407e-9ccc-064aeb62505e ResourceVersion:543 Generation:0 CreationTimestamp:2022-09-03 05:51:52 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[k8s-app:metrics-server pod-template-hash:7d674f87b8] Annotations:map[] OwnerReferences:[{APIVersion:apps/v1 Kind:ReplicaSet Name:metrics-server-7d674f87b8 UID:c295278f-6dad-4823-9b28-efc330c6cb87 Controller:0xc00220401e BlockOwnerDeletion:0xc00220401f}] Finalizers:[] ZZZ_DeprecatedClusterName: ManagedFields:[{Manager:kube-controller-manager Operation:Update APIVersion:v1 Time:2022-09-03 05:51:52 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"c295278f-6dad-4823-9b28-efc330c6cb87\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"metrics-server\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:livenessProbe":{".":{},"f:failureThreshold":{},"f:httpGet":{".":{},"f:path":{},"f:port":{},"f:scheme":{}},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:name":{},"f:ports":{".":{},"k:{\"containerPort\":4443,\"protocol\":\"TCP\"}":{".":{},"f:containerPort":{},"f:name":{},"f:protocol":{}}},"f:readinessProbe":{".":{},"f:failureThreshold":{},"f:httpGet":{".":{},"f:path":{},"f:port":{},"f:scheme":{}},"f:initialDelaySeconds":{},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:resources":{".":{},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:securityContext":{".":{},"f:readOnlyRootFilesystem":{},"f:runAsNonRoot":{},"f:runAsUser":{}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/tmp\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:nodeSelector":{},"f:priorityClassName":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:serviceAccount":{},"f:serviceAccountName":{},"f:terminationGracePeriodSeconds":{},"f:tolerations":{},"f:volumes":{".":{},"k:{\"name\":\"tmp-dir\"}":{".":{},"f:emptyDir":{},"f:name":{}}}}} Subresource:} {Manager:kube-scheduler Operation:Update APIVersion:v1 Time:2022-09-03 05:51:52 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:status":{"f:conditions":{".":{},"k:{\"type\":\"PodScheduled\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} Subresource:status}]} -> {Name:metrics-server-7d674f87b8-8wwpw GenerateName:metrics-server-7d674f87b8- Namespace:kube-system SelfLink: UID:81168c0b-91f9-407e-9ccc-064aeb62505e ResourceVersion:552 Generation:0 CreationTimestamp:2022-09-03 05:51:52 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[k8s-app:metrics-server pod-template-hash:7d674f87b8] Annotations:map[] OwnerReferences:[{APIVersion:apps/v1 Kind:ReplicaSet Name:metrics-server-7d674f87b8 UID:c295278f-6dad-4823-9b28-efc330c6cb87 Controller:0xc0020fedae BlockOwnerDeletion:0xc0020fedaf}] Finalizers:[] ZZZ_DeprecatedClusterName: ManagedFields:[{Manager:kube-controller-manager Operation:Update APIVersion:v1 Time:2022-09-03 05:51:52 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"c295278f-6dad-4823-9b28-efc330c6cb87\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"metrics-server\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:livenessProbe":{".":{},"f:failureThreshold":{},"f:httpGet":{".":{},"f:path":{},"f:port":{},"f:scheme":{}},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:name":{},"f:ports":{".":{},"k:{\"containerPort\":4443,\"protocol\":\"TCP\"}":{".":{},"f:containerPort":{},"f:name":{},"f:protocol":{}}},"f:readinessProbe":{".":{},"f:failureThreshold":{},"f:httpGet":{".":{},"f:path":{},"f:port":{},"f:scheme":{}},"f:initialDelaySeconds":{},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:resources":{".":{},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:securityContext":{".":{},"f:readOnlyRootFilesystem":{},"f:runAsNonRoot":{},"f:runAsUser":{}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/tmp\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:nodeSelector":{},"f:priorityClassName":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:serviceAccount":{},"f:serviceAccountName":{},"f:terminationGracePeriodSeconds":{},"f:tolerations":{},"f:volumes":{".":{},"k:{\"name\":\"tmp-dir\"}":{".":{},"f:emptyDir":{},"f:name":{}}}}} Subresource:} {Manager:kube-scheduler Operation:Update APIVersion:v1 Time:2022-09-03 05:51:52 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:status":{"f:conditions":{".":{},"k:{\"type\":\"PodScheduled\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} Subresource:status} {Manager:kubelet Operation:Update APIVersion:v1 Time:2022-09-03 05:52:10 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:startTime":{}}} Subresource:status}]}.
I0903 05:52:10.472727       1 controller_utils.go:189] Controller expectations fulfilled &controller.ControlleeExpectations{add:0, del:0, key:"kube-system/metrics-server-7d674f87b8", timestamp:time.Time{wall:0xc0bcd8be24a36bf4, ext:14573668529, loc:(*time.Location)(0x7249da0)}}
I0903 05:52:10.472801       1 replica_set.go:667] Finished syncing ReplicaSet "kube-system/metrics-server-7d674f87b8" (79.201µs)
I0903 05:52:10.472820       1 disruption.go:427] updatePod called on pod "metrics-server-7d674f87b8-8wwpw"
I0903 05:52:10.472840       1 disruption.go:490] No PodDisruptionBudgets found for pod metrics-server-7d674f87b8-8wwpw, PodDisruptionBudget controller will avoid syncing.
I0903 05:52:10.472847       1 disruption.go:430] No matching pdb for pod "metrics-server-7d674f87b8-8wwpw"
I0903 05:52:13.468420       1 node_lifecycle_controller.go:1040] ReadyCondition for Node capz-qnu7s3-control-plane-6hptv transitioned from &NodeCondition{Type:Ready,Status:False,LastHeartbeatTime:2022-09-03 05:51:59 +0000 UTC,LastTransitionTime:2022-09-03 05:51:27 +0000 UTC,Reason:KubeletNotReady,Message:container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized,} to &NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-09-03 05:52:10 +0000 UTC,LastTransitionTime:2022-09-03 05:52:10 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,}
I0903 05:52:13.468522       1 node_lifecycle_controller.go:1048] Node capz-qnu7s3-control-plane-6hptv ReadyCondition updated. Updating timestamp.
I0903 05:52:13.468551       1 node_lifecycle_controller.go:894] Node capz-qnu7s3-control-plane-6hptv is healthy again, removing all taints
I0903 05:52:13.468569       1 node_lifecycle_controller.go:1192] Controller detected that some Nodes are Ready. Exiting master disruption mode.
I0903 05:52:16.666641       1 httplog.go:131] "HTTP" verb="GET" URI="/healthz" latency="88.603µs" userAgent="kube-probe/1.24+" audit-ID="" srcIP="127.0.0.1:33854" resp=200
I0903 05:52:17.806984       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-qnu7s3-control-plane-6hptv"
I0903 05:52:17.988278       1 daemon_controller.go:570] Pod calico-node-t97n5 updated.
... skipping 30 lines ...
I0903 05:52:18.642632       1 reflector.go:219] Starting reflector *v1.PartialObjectMetadata (12h33m16.698961331s) from vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:90
I0903 05:52:18.642912       1 reflector.go:255] Listing and watching *v1.PartialObjectMetadata from vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:90
I0903 05:52:18.668956       1 pv_controller_base.go:605] resyncing PV controller
I0903 05:52:18.743154       1 shared_informer.go:285] caches populated
I0903 05:52:18.743177       1 shared_informer.go:262] Caches are synced for resource quota
I0903 05:52:18.743189       1 resource_quota_controller.go:458] synced quota controller
W0903 05:52:19.231681       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
I0903 05:52:19.231936       1 garbagecollector.go:215] syncing garbage collector with updated resources from discovery (attempt 1): added: [crd.projectcalico.org/v1, Resource=bgpconfigurations crd.projectcalico.org/v1, Resource=bgppeers crd.projectcalico.org/v1, Resource=blockaffinities crd.projectcalico.org/v1, Resource=caliconodestatuses crd.projectcalico.org/v1, Resource=clusterinformations crd.projectcalico.org/v1, Resource=felixconfigurations crd.projectcalico.org/v1, Resource=globalnetworkpolicies crd.projectcalico.org/v1, Resource=globalnetworksets crd.projectcalico.org/v1, Resource=hostendpoints crd.projectcalico.org/v1, Resource=ipamblocks crd.projectcalico.org/v1, Resource=ipamconfigs crd.projectcalico.org/v1, Resource=ipamhandles crd.projectcalico.org/v1, Resource=ippools crd.projectcalico.org/v1, Resource=ipreservations crd.projectcalico.org/v1, Resource=kubecontrollersconfigurations crd.projectcalico.org/v1, Resource=networkpolicies crd.projectcalico.org/v1, Resource=networksets], removed: []
I0903 05:52:19.231954       1 garbagecollector.go:221] reset restmapper
E0903 05:52:19.236456       1 memcache.go:206] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request
E0903 05:52:19.244917       1 memcache.go:104] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0903 05:52:19.245667       1 graph_builder.go:174] using a shared informer for resource "crd.projectcalico.org/v1, Resource=bgpconfigurations", kind "crd.projectcalico.org/v1, Kind=BGPConfiguration"
I0903 05:52:19.245725       1 graph_builder.go:174] using a shared informer for resource "crd.projectcalico.org/v1, Resource=globalnetworkpolicies", kind "crd.projectcalico.org/v1, Kind=GlobalNetworkPolicy"
... skipping 219 lines ...
I0903 05:52:48.441352       1 reflector.go:382] vendor/k8s.io/client-go/informers/factory.go:134: forcing resync
I0903 05:52:48.539369       1 gc_controller.go:214] GC'ing orphaned
I0903 05:52:48.539392       1 gc_controller.go:277] GC'ing unscheduled pods which are terminating.
I0903 05:52:48.669842       1 pv_controller_base.go:605] resyncing PV controller
E0903 05:52:48.767574       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0903 05:52:48.767630       1 resource_quota_controller.go:428] no resource updates from discovery, skipping resource quota sync
W0903 05:52:49.469205       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
I0903 05:52:51.170259       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-qnu7s3-control-plane-6hptv"
I0903 05:52:53.474979       1 node_lifecycle_controller.go:1048] Node capz-qnu7s3-control-plane-6hptv ReadyCondition updated. Updating timestamp.
I0903 05:52:56.170437       1 tokencleaner.go:166] Finished syncing secret "kube-system/bootstrap-token-iz1nhe" (7.6µs)
I0903 05:52:56.665995       1 httplog.go:131] "HTTP" verb="GET" URI="/healthz" latency="83.5µs" userAgent="kube-probe/1.24+" audit-ID="" srcIP="127.0.0.1:46586" resp=200
I0903 05:53:01.118619       1 replica_set.go:457] Pod metrics-server-7d674f87b8-8wwpw updated, objectMeta {Name:metrics-server-7d674f87b8-8wwpw GenerateName:metrics-server-7d674f87b8- Namespace:kube-system SelfLink: UID:81168c0b-91f9-407e-9ccc-064aeb62505e ResourceVersion:662 Generation:0 CreationTimestamp:2022-09-03 05:51:52 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[k8s-app:metrics-server pod-template-hash:7d674f87b8] Annotations:map[cni.projectcalico.org/containerID:0aea685a81061c960ae08656bb12f82557b7c32498f66f6c984e00822218562e cni.projectcalico.org/podIP:192.168.211.68/32 cni.projectcalico.org/podIPs:192.168.211.68/32] OwnerReferences:[{APIVersion:apps/v1 Kind:ReplicaSet Name:metrics-server-7d674f87b8 UID:c295278f-6dad-4823-9b28-efc330c6cb87 Controller:0xc0027a7bc7 BlockOwnerDeletion:0xc0027a7bc8}] Finalizers:[] ZZZ_DeprecatedClusterName: ManagedFields:[{Manager:kube-controller-manager Operation:Update APIVersion:v1 Time:2022-09-03 05:51:52 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"c295278f-6dad-4823-9b28-efc330c6cb87\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"metrics-server\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:livenessProbe":{".":{},"f:failureThreshold":{},"f:httpGet":{".":{},"f:path":{},"f:port":{},"f:scheme":{}},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:name":{},"f:ports":{".":{},"k:{\"containerPort\":4443,\"protocol\":\"TCP\"}":{".":{},"f:containerPort":{},"f:name":{},"f:protocol":{}}},"f:readinessProbe":{".":{},"f:failureThreshold":{},"f:httpGet":{".":{},"f:path":{},"f:port":{},"f:scheme":{}},"f:initialDelaySeconds":{},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:resources":{".":{},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:securityContext":{".":{},"f:readOnlyRootFilesystem":{},"f:runAsNonRoot":{},"f:runAsUser":{}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/tmp\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:nodeSelector":{},"f:priorityClassName":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:serviceAccount":{},"f:serviceAccountName":{},"f:terminationGracePeriodSeconds":{},"f:tolerations":{},"f:volumes":{".":{},"k:{\"name\":\"tmp-dir\"}":{".":{},"f:emptyDir":{},"f:name":{}}}}} Subresource:} {Manager:kube-scheduler Operation:Update APIVersion:v1 Time:2022-09-03 05:51:52 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:status":{"f:conditions":{".":{},"k:{\"type\":\"PodScheduled\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} Subresource:status} {Manager:Go-http-client Operation:Update APIVersion:v1 Time:2022-09-03 05:52:26 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:annotations":{".":{},"f:cni.projectcalico.org/containerID":{},"f:cni.projectcalico.org/podIP":{},"f:cni.projectcalico.org/podIPs":{}}}} Subresource:status} {Manager:kubelet Operation:Update APIVersion:v1 Time:2022-09-03 05:52:37 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"192.168.211.68\"}":{".":{},"f:ip":{}}},"f:startTime":{}}} Subresource:status}]} -> {Name:metrics-server-7d674f87b8-8wwpw GenerateName:metrics-server-7d674f87b8- Namespace:kube-system SelfLink: UID:81168c0b-91f9-407e-9ccc-064aeb62505e ResourceVersion:696 Generation:0 CreationTimestamp:2022-09-03 05:51:52 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[k8s-app:metrics-server pod-template-hash:7d674f87b8] Annotations:map[cni.projectcalico.org/containerID:0aea685a81061c960ae08656bb12f82557b7c32498f66f6c984e00822218562e cni.projectcalico.org/podIP:192.168.211.68/32 cni.projectcalico.org/podIPs:192.168.211.68/32] OwnerReferences:[{APIVersion:apps/v1 Kind:ReplicaSet Name:metrics-server-7d674f87b8 UID:c295278f-6dad-4823-9b28-efc330c6cb87 Controller:0xc00106f72e BlockOwnerDeletion:0xc00106f72f}] Finalizers:[] ZZZ_DeprecatedClusterName: ManagedFields:[{Manager:kube-controller-manager Operation:Update APIVersion:v1 Time:2022-09-03 05:51:52 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"c295278f-6dad-4823-9b28-efc330c6cb87\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"metrics-server\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:livenessProbe":{".":{},"f:failureThreshold":{},"f:httpGet":{".":{},"f:path":{},"f:port":{},"f:scheme":{}},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:name":{},"f:ports":{".":{},"k:{\"containerPort\":4443,\"protocol\":\"TCP\"}":{".":{},"f:containerPort":{},"f:name":{},"f:protocol":{}}},"f:readinessProbe":{".":{},"f:failureThreshold":{},"f:httpGet":{".":{},"f:path":{},"f:port":{},"f:scheme":{}},"f:initialDelaySeconds":{},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:resources":{".":{},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:securityContext":{".":{},"f:readOnlyRootFilesystem":{},"f:runAsNonRoot":{},"f:runAsUser":{}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/tmp\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:nodeSelector":{},"f:priorityClassName":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:serviceAccount":{},"f:serviceAccountName":{},"f:terminationGracePeriodSeconds":{},"f:tolerations":{},"f:volumes":{".":{},"k:{\"name\":\"tmp-dir\"}":{".":{},"f:emptyDir":{},"f:name":{}}}}} Subresource:} {Manager:kube-scheduler Operation:Update APIVersion:v1 Time:2022-09-03 05:51:52 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:status":{"f:conditions":{".":{},"k:{\"type\":\"PodScheduled\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} Subresource:status} {Manager:Go-http-client Operation:Update APIVersion:v1 Time:2022-09-03 05:52:26 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:annotations":{".":{},"f:cni.projectcalico.org/containerID":{},"f:cni.projectcalico.org/podIP":{},"f:cni.projectcalico.org/podIPs":{}}}} Subresource:status} {Manager:kubelet Operation:Update APIVersion:v1 Time:2022-09-03 05:53:01 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"192.168.211.68\"}":{".":{},"f:ip":{}}},"f:startTime":{}}} Subresource:status}]}.
I0903 05:53:01.118786       1 controller_utils.go:189] Controller expectations fulfilled &controller.ControlleeExpectations{add:0, del:0, key:"kube-system/metrics-server-7d674f87b8", timestamp:time.Time{wall:0xc0bcd8be24a36bf4, ext:14573668529, loc:(*time.Location)(0x7249da0)}}
... skipping 63 lines ...
I0903 05:53:28.011877       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-qnu7s3-md-0-xv9cn"
I0903 05:53:28.011898       1 topologycache.go:179] Ignoring node capz-qnu7s3-control-plane-6hptv because it has an excluded label
I0903 05:53:28.011952       1 taint_manager.go:436] "Noticed node update" node={nodeName:capz-qnu7s3-md-0-xv9cn}
I0903 05:53:28.011990       1 controller.go:697] Ignoring node capz-qnu7s3-md-0-xv9cn with Ready condition status False
I0903 05:53:28.012994       1 controller_utils.go:189] Controller expectations fulfilled &controller.ControlleeExpectations{add:0, del:0, key:"kube-system/kube-proxy", timestamp:time.Time{wall:0xc0bcd8bec6d17035, ext:17073367794, loc:(*time.Location)(0x7249da0)}}
I0903 05:53:28.014853       1 daemon_controller.go:967] Nodes needing daemon pods for daemon set calico-node: [capz-qnu7s3-md-0-xv9cn], creating 1
W0903 05:53:28.014961       1 actual_state_of_world.go:541] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="capz-qnu7s3-md-0-xv9cn" does not exist
I0903 05:53:28.015127       1 topologycache.go:183] Ignoring node capz-qnu7s3-md-0-xv9cn because it is not ready: [{MemoryPressure False 2022-09-03 05:53:27 +0000 UTC 2022-09-03 05:53:27 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2022-09-03 05:53:27 +0000 UTC 2022-09-03 05:53:27 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2022-09-03 05:53:27 +0000 UTC 2022-09-03 05:53:27 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready False 2022-09-03 05:53:27 +0000 UTC 2022-09-03 05:53:27 +0000 UTC KubeletNotReady [container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful, container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized, CSINode is not yet initialized, missing node capacity for resources: ephemeral-storage]}]
I0903 05:53:28.016152       1 topologycache.go:215] Insufficient node info for topology hints (0 zones, %!s(int64=0) CPU, true)
I0903 05:53:28.015283       1 taint_manager.go:441] "Updating known taints on node" node="capz-qnu7s3-md-0-xv9cn" taints=[]
I0903 05:53:28.015379       1 controller.go:272] Triggering nodeSync
I0903 05:53:28.015387       1 controller.go:291] nodeSync has been triggered
I0903 05:53:28.016369       1 controller.go:792] Running updateLoadBalancerHosts(len(services)==0, workers==1)
I0903 05:53:28.016480       1 controller.go:808] Finished updateLoadBalancerHosts
... skipping 213 lines ...
I0903 05:53:43.266656       1 daemon_controller.go:1029] Pods to delete for daemon set calico-node: [], deleting 0
I0903 05:53:43.266710       1 daemon_controller.go:1112] Updating daemon set status
I0903 05:53:43.266844       1 daemon_controller.go:1172] Finished syncing daemon set "kube-system/calico-node" (2.093837ms)
I0903 05:53:43.636867       1 taint_manager.go:436] "Noticed node update" node={nodeName:capz-qnu7s3-md-0-wvhqp}
I0903 05:53:43.637021       1 taint_manager.go:441] "Updating known taints on node" node="capz-qnu7s3-md-0-wvhqp" taints=[]
I0903 05:53:43.637141       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-qnu7s3-md-0-wvhqp"
W0903 05:53:43.637244       1 actual_state_of_world.go:541] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="capz-qnu7s3-md-0-wvhqp" does not exist
I0903 05:53:43.637360       1 topologycache.go:183] Ignoring node capz-qnu7s3-md-0-xv9cn because it is not ready: [{MemoryPressure False 2022-09-03 05:53:38 +0000 UTC 2022-09-03 05:53:27 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2022-09-03 05:53:38 +0000 UTC 2022-09-03 05:53:27 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2022-09-03 05:53:38 +0000 UTC 2022-09-03 05:53:27 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready False 2022-09-03 05:53:38 +0000 UTC 2022-09-03 05:53:27 +0000 UTC KubeletNotReady container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized}]
I0903 05:53:43.637475       1 topologycache.go:183] Ignoring node capz-qnu7s3-md-0-wvhqp because it is not ready: [{MemoryPressure False 2022-09-03 05:53:43 +0000 UTC 2022-09-03 05:53:43 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2022-09-03 05:53:43 +0000 UTC 2022-09-03 05:53:43 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2022-09-03 05:53:43 +0000 UTC 2022-09-03 05:53:43 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready False 2022-09-03 05:53:43 +0000 UTC 2022-09-03 05:53:43 +0000 UTC KubeletNotReady [container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized, failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "capz-qnu7s3-md-0-wvhqp" not found]}]
I0903 05:53:43.637585       1 topologycache.go:179] Ignoring node capz-qnu7s3-control-plane-6hptv because it has an excluded label
I0903 05:53:43.637661       1 topologycache.go:215] Insufficient node info for topology hints (0 zones, %!s(int64=0) CPU, true)
I0903 05:53:43.637764       1 controller.go:697] Ignoring node capz-qnu7s3-md-0-wvhqp with Ready condition status False
I0903 05:53:43.637852       1 controller.go:697] Ignoring node capz-qnu7s3-md-0-xv9cn with Ready condition status False
I0903 05:53:43.637948       1 controller.go:272] Triggering nodeSync
I0903 05:53:43.638030       1 controller.go:291] nodeSync has been triggered
... skipping 279 lines ...
I0903 05:53:58.631858       1 controller.go:792] Running updateLoadBalancerHosts(len(services)==0, workers==1)
I0903 05:53:58.631868       1 controller.go:808] Finished updateLoadBalancerHosts
I0903 05:53:58.631887       1 controller.go:764] Successfully updated 0 out of 0 load balancers to direct traffic to the updated set of nodes
I0903 05:53:58.631898       1 controller.go:735] It took 0.000101502 seconds to finish nodeSyncInternal
I0903 05:53:58.631587       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-qnu7s3-md-0-xv9cn"
I0903 05:53:58.631621       1 topologycache.go:179] Ignoring node capz-qnu7s3-control-plane-6hptv because it has an excluded label
I0903 05:53:58.631979       1 topologycache.go:183] Ignoring node capz-qnu7s3-md-0-wvhqp because it is not ready: [{MemoryPressure False 2022-09-03 05:53:53 +0000 UTC 2022-09-03 05:53:43 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2022-09-03 05:53:53 +0000 UTC 2022-09-03 05:53:43 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2022-09-03 05:53:53 +0000 UTC 2022-09-03 05:53:43 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready False 2022-09-03 05:53:53 +0000 UTC 2022-09-03 05:53:43 +0000 UTC KubeletNotReady container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized}]
I0903 05:53:58.632063       1 topologycache.go:215] Insufficient node info for topology hints (1 zones, %!s(int64=2000) CPU, true)
I0903 05:53:58.643090       1 controller_utils.go:217] "Made sure that node has no taint" node="capz-qnu7s3-md-0-xv9cn" taint=[&Taint{Key:node.kubernetes.io/not-ready,Value:,Effect:NoSchedule,TimeAdded:<nil>,}]
I0903 05:53:58.643317       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-qnu7s3-md-0-xv9cn"
I0903 05:53:59.851209       1 azure_vmss.go:370] Can not extract scale set name from providerID (azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/capz-qnu7s3/providers/Microsoft.Compute/virtualMachines/capz-qnu7s3-md-0-wvhqp), assuming it is managed by availability set: not a vmss instance
I0903 05:53:59.851302       1 azure_vmss.go:370] Can not extract scale set name from providerID (azure:///subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/capz-qnu7s3/providers/Microsoft.Compute/virtualMachines/capz-qnu7s3-md-0-wvhqp), assuming it is managed by availability set: not a vmss instance
I0903 05:53:59.851335       1 azure_instances.go:240] InstanceShutdownByProviderID gets power status "running" for node "capz-qnu7s3-md-0-wvhqp"
I0903 05:53:59.851347       1 azure_instances.go:251] InstanceShutdownByProviderID gets provisioning state "Updating" for node "capz-qnu7s3-md-0-wvhqp"
I0903 05:54:03.444456       1 reflector.go:382] vendor/k8s.io/client-go/informers/factory.go:134: forcing resync
I0903 05:54:03.487315       1 node_lifecycle_controller.go:1040] ReadyCondition for Node capz-qnu7s3-md-0-xv9cn transitioned from &NodeCondition{Type:Ready,Status:False,LastHeartbeatTime:2022-09-03 05:53:38 +0000 UTC,LastTransitionTime:2022-09-03 05:53:27 +0000 UTC,Reason:KubeletNotReady,Message:container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized,} to &NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-09-03 05:53:58 +0000 UTC,LastTransitionTime:2022-09-03 05:53:58 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,}
I0903 05:54:03.487394       1 node_lifecycle_controller.go:1048] Node capz-qnu7s3-md-0-xv9cn ReadyCondition updated. Updating timestamp.
I0903 05:54:03.497746       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-qnu7s3-md-0-xv9cn"
I0903 05:54:03.498384       1 node_lifecycle_controller.go:894] Node capz-qnu7s3-md-0-xv9cn is healthy again, removing all taints
I0903 05:54:03.498579       1 node_lifecycle_controller.go:1215] Controller detected that zone uksouth::0 is now in state Normal.
I0903 05:54:03.498835       1 taint_manager.go:436] "Noticed node update" node={nodeName:capz-qnu7s3-md-0-xv9cn}
I0903 05:54:03.498858       1 taint_manager.go:441] "Updating known taints on node" node="capz-qnu7s3-md-0-xv9cn" taints=[]
... skipping 112 lines ...
I0903 05:54:24.311514       1 controller.go:764] Successfully updated 0 out of 0 load balancers to direct traffic to the updated set of nodes
I0903 05:54:24.311606       1 controller.go:735] It took 0.000129496 seconds to finish nodeSyncInternal
I0903 05:54:24.311359       1 controller_utils.go:205] "Added taint to node" taint=[] node="capz-qnu7s3-md-0-wvhqp"
I0903 05:54:24.325410       1 controller_utils.go:217] "Made sure that node has no taint" node="capz-qnu7s3-md-0-wvhqp" taint=[&Taint{Key:node.kubernetes.io/not-ready,Value:,Effect:NoSchedule,TimeAdded:<nil>,}]
I0903 05:54:24.326726       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-qnu7s3-md-0-wvhqp"
I0903 05:54:26.665611       1 httplog.go:131] "HTTP" verb="GET" URI="/healthz" latency="80.101µs" userAgent="kube-probe/1.24+" audit-ID="" srcIP="127.0.0.1:55862" resp=200
I0903 05:54:28.502265       1 node_lifecycle_controller.go:1040] ReadyCondition for Node capz-qnu7s3-md-0-wvhqp transitioned from &NodeCondition{Type:Ready,Status:False,LastHeartbeatTime:2022-09-03 05:54:04 +0000 UTC,LastTransitionTime:2022-09-03 05:53:43 +0000 UTC,Reason:KubeletNotReady,Message:container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized,} to &NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-09-03 05:54:24 +0000 UTC,LastTransitionTime:2022-09-03 05:54:24 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,}
I0903 05:54:28.502310       1 node_lifecycle_controller.go:1048] Node capz-qnu7s3-md-0-wvhqp ReadyCondition updated. Updating timestamp.
I0903 05:54:28.521618       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-qnu7s3-md-0-wvhqp"
I0903 05:54:28.521811       1 taint_manager.go:436] "Noticed node update" node={nodeName:capz-qnu7s3-md-0-wvhqp}
I0903 05:54:28.521925       1 taint_manager.go:441] "Updating known taints on node" node="capz-qnu7s3-md-0-wvhqp" taints=[]
I0903 05:54:28.521949       1 taint_manager.go:462] "All taints were removed from the node. Cancelling all evictions..." node="capz-qnu7s3-md-0-wvhqp"
I0903 05:54:28.523765       1 node_lifecycle_controller.go:894] Node capz-qnu7s3-md-0-wvhqp is healthy again, removing all taints
... skipping 11 lines ...
I0903 05:54:32.250859       1 deployment_util.go:774] Deployment "csi-azurefile-controller" timed out (false) [last progress check: 2022-09-03 05:54:32.240821855 +0000 UTC m=+174.199800604 - now: 2022-09-03 05:54:32.250850964 +0000 UTC m=+174.209829713]
I0903 05:54:32.251037       1 deployment_controller.go:176] "Updating deployment" deployment="kube-system/csi-azurefile-controller"
I0903 05:54:32.256613       1 pvc_protection_controller.go:380] "Enqueuing PVCs for Pod" pod="kube-system/csi-azurefile-controller-78f78cfdd5-d5wls" podUID=dde448fa-9949-4fe1-81a3-c1eea48f2946
I0903 05:54:32.257086       1 disruption.go:415] addPod called on pod "csi-azurefile-controller-78f78cfdd5-d5wls"
I0903 05:54:32.257827       1 disruption.go:490] No PodDisruptionBudgets found for pod csi-azurefile-controller-78f78cfdd5-d5wls, PodDisruptionBudget controller will avoid syncing.
I0903 05:54:32.257844       1 disruption.go:418] No matching pdb for pod "csi-azurefile-controller-78f78cfdd5-d5wls"
I0903 05:54:32.257124       1 replica_set.go:394] Pod csi-azurefile-controller-78f78cfdd5-d5wls created: &v1.Pod{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"csi-azurefile-controller-78f78cfdd5-d5wls", GenerateName:"csi-azurefile-controller-78f78cfdd5-", Namespace:"kube-system", SelfLink:"", UID:"dde448fa-9949-4fe1-81a3-c1eea48f2946", ResourceVersion:"972", Generation:0, CreationTimestamp:time.Date(2022, time.September, 3, 5, 54, 32, 0, time.Local), DeletionTimestamp:<nil>, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"csi-azurefile-controller", "pod-template-hash":"78f78cfdd5"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference{v1.OwnerReference{APIVersion:"apps/v1", Kind:"ReplicaSet", Name:"csi-azurefile-controller-78f78cfdd5", UID:"34d7c5b3-cfdc-4802-85d3-ddc0dffe8b39", Controller:(*bool)(0xc00253af97), BlockOwnerDeletion:(*bool)(0xc00253af98)}}, Finalizers:[]string(nil), ZZZ_DeprecatedClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kube-controller-manager", Operation:"Update", APIVersion:"v1", Time:time.Date(2022, time.September, 3, 5, 54, 32, 0, time.Local), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc00228a768), Subresource:""}}}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"socket-dir", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(0xc00228a780), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"azure-cred", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc00228a798), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"kube-api-access-rgd9m", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(0xc0010c0a40), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"csi-provisioner", Image:"mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v3.2.0", Command:[]string(nil), Args:[]string{"-v=2", "--csi-address=$(ADDRESS)", "--leader-election", "--leader-election-namespace=kube-system", "--timeout=300s", "--extra-create-metadata=true"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"ADDRESS", Value:"/csi/csi.sock", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:524288000, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"500Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-rgd9m", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}, v1.Container{Name:"csi-attacher", Image:"mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v3.5.0", Command:[]string(nil), Args:[]string{"-v=2", "-csi-address=$(ADDRESS)", "-timeout=120s", "--leader-election", "--leader-election-namespace=kube-system"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"ADDRESS", Value:"/csi/csi.sock", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:524288000, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"500Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-rgd9m", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}, v1.Container{Name:"csi-snapshotter", Image:"mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v5.0.1", Command:[]string(nil), Args:[]string{"-v=2", "-csi-address=$(ADDRESS)", "--leader-election", "--leader-election-namespace=kube-system"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"ADDRESS", Value:"/csi/csi.sock", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:104857600, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-rgd9m", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}, v1.Container{Name:"csi-resizer", Image:"mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.5.0", Command:[]string(nil), Args:[]string{"-csi-address=$(ADDRESS)", "-v=2", "--leader-election", "--leader-election-namespace=kube-system", "-handle-volume-inuse-error=false", "-feature-gates=RecoverVolumeExpansionFailure=true", "-timeout=120s"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"ADDRESS", Value:"/csi/csi.sock", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:524288000, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"500Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-rgd9m", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}, v1.Container{Name:"liveness-probe", Image:"mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.7.0", Command:[]string(nil), Args:[]string{"--csi-address=/csi/csi.sock", "--probe-timeout=3s", "--health-port=29612", "--v=2"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar(nil), Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:104857600, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-rgd9m", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}, v1.Container{Name:"azurefile", Image:"mcr.microsoft.com/k8s/csi/azurefile-csi:latest", Command:[]string(nil), Args:[]string{"--v=5", "--endpoint=$(CSI_ENDPOINT)", "--metrics-address=0.0.0.0:29614", "--user-agent-suffix=OSS-kubectl"}, WorkingDir:"", Ports:[]v1.ContainerPort{v1.ContainerPort{Name:"healthz", HostPort:29612, ContainerPort:29612, Protocol:"TCP", HostIP:""}, v1.ContainerPort{Name:"metrics", HostPort:29614, ContainerPort:29614, Protocol:"TCP", HostIP:""}}, EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"AZURE_CREDENTIAL_FILE", Value:"", ValueFrom:(*v1.EnvVarSource)(0xc0010c0c80)}, v1.EnvVar{Name:"CSI_ENDPOINT", Value:"unix:///csi/csi.sock", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:209715200, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"azure-cred", ReadOnly:false, MountPath:"/etc/kubernetes/", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-rgd9m", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(0xc0024ce600), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0xc00253b440), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"csi-azurefile-controller-sa", DeprecatedServiceAccount:"csi-azurefile-controller-sa", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0xc000a7e2a0), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"node-role.kubernetes.io/master", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node-role.kubernetes.io/controlplane", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node-role.kubernetes.io/control-plane", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node.kubernetes.io/not-ready", Operator:"Exists", Value:"", Effect:"NoExecute", TolerationSeconds:(*int64)(0xc00253b4b0)}, v1.Toleration{Key:"node.kubernetes.io/unreachable", Operator:"Exists", Value:"", Effect:"NoExecute", TolerationSeconds:(*int64)(0xc00253b4d0)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-cluster-critical", Priority:(*int32)(0xc00253b4d8), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(0xc00253b4dc), PreemptionPolicy:(*v1.PreemptionPolicy)(0xc002784120), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil), OS:(*v1.PodOS)(nil)}, Status:v1.PodStatus{Phase:"Pending", Conditions:[]v1.PodCondition(nil), Message:"", Reason:"", NominatedNodeName:"", HostIP:"", PodIP:"", PodIPs:[]v1.PodIP(nil), StartTime:<nil>, InitContainerStatuses:[]v1.ContainerStatus(nil), ContainerStatuses:[]v1.ContainerStatus(nil), QOSClass:"Burstable", EphemeralContainerStatuses:[]v1.ContainerStatus(nil)}}.
I0903 05:54:32.257882       1 controller_utils.go:240] Lowered expectations &controller.ControlleeExpectations{add:1, del:0, key:"kube-system/csi-azurefile-controller-78f78cfdd5", timestamp:time.Time{wall:0xc0bcd8e60e5d1a28, ext:174199961317, loc:(*time.Location)(0x7249da0)}}
I0903 05:54:32.257604       1 taint_manager.go:401] "Noticed pod update" pod="kube-system/csi-azurefile-controller-78f78cfdd5-d5wls"
I0903 05:54:32.264966       1 controller_utils.go:581] Controller csi-azurefile-controller-78f78cfdd5 created pod csi-azurefile-controller-78f78cfdd5-d5wls
I0903 05:54:32.265959       1 event.go:294] "Event occurred" object="kube-system/csi-azurefile-controller-78f78cfdd5" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: csi-azurefile-controller-78f78cfdd5-d5wls"
I0903 05:54:32.266515       1 replica_set.go:457] Pod csi-azurefile-controller-78f78cfdd5-d5wls updated, objectMeta {Name:csi-azurefile-controller-78f78cfdd5-d5wls GenerateName:csi-azurefile-controller-78f78cfdd5- Namespace:kube-system SelfLink: UID:dde448fa-9949-4fe1-81a3-c1eea48f2946 ResourceVersion:972 Generation:0 CreationTimestamp:2022-09-03 05:54:32 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[app:csi-azurefile-controller pod-template-hash:78f78cfdd5] Annotations:map[] OwnerReferences:[{APIVersion:apps/v1 Kind:ReplicaSet Name:csi-azurefile-controller-78f78cfdd5 UID:34d7c5b3-cfdc-4802-85d3-ddc0dffe8b39 Controller:0xc00253af97 BlockOwnerDeletion:0xc00253af98}] Finalizers:[] ZZZ_DeprecatedClusterName: ManagedFields:[{Manager:kube-controller-manager Operation:Update APIVersion:v1 Time:2022-09-03 05:54:32 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"34d7c5b3-cfdc-4802-85d3-ddc0dffe8b39\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"azurefile\"}":{".":{},"f:args":{},"f:env":{".":{},"k:{\"name\":\"AZURE_CREDENTIAL_FILE\"}":{".":{},"f:name":{},"f:valueFrom":{".":{},"f:configMapKeyRef":{}}},"k:{\"name\":\"CSI_ENDPOINT\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:livenessProbe":{".":{},"f:failureThreshold":{},"f:httpGet":{".":{},"f:path":{},"f:port":{},"f:scheme":{}},"f:initialDelaySeconds":{},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:name":{},"f:ports":{".":{},"k:{\"containerPort\":29612,\"protocol\":\"TCP\"}":{".":{},"f:containerPort":{},"f:hostPort":{},"f:name":{},"f:protocol":{}},"k:{\"containerPort\":29614,\"protocol\":\"TCP\"}":{".":{},"f:containerPort":{},"f:hostPort":{},"f:name":{},"f:protocol":{}}},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}},"k:{\"mountPath\":\"/etc/kubernetes/\"}":{".":{},"f:mountPath":{},"f:name":{}}}},"k:{\"name\":\"csi-attacher\"}":{".":{},"f:args":{},"f:env":{".":{},"k:{\"name\":\"ADDRESS\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}}}},"k:{\"name\":\"csi-provisioner\"}":{".":{},"f:args":{},"f:env":{".":{},"k:{\"name\":\"ADDRESS\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}}}},"k:{\"name\":\"csi-resizer\"}":{".":{},"f:args":{},"f:env":{".":{},"k:{\"name\":\"ADDRESS\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}}}},"k:{\"name\":\"csi-snapshotter\"}":{".":{},"f:args":{},"f:env":{".":{},"k:{\"name\":\"ADDRESS\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}}}},"k:{\"name\":\"liveness-probe\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:hostNetwork":{},"f:nodeSelector":{},"f:priorityClassName":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:serviceAccount":{},"f:serviceAccountName":{},"f:terminationGracePeriodSeconds":{},"f:tolerations":{},"f:volumes":{".":{},"k:{\"name\":\"azure-cred\"}":{".":{},"f:hostPath":{".":{},"f:path":{},"f:type":{}},"f:name":{}},"k:{\"name\":\"socket-dir\"}":{".":{},"f:emptyDir":{},"f:name":{}}}}} Subresource:}]} -> {Name:csi-azurefile-controller-78f78cfdd5-d5wls GenerateName:csi-azurefile-controller-78f78cfdd5- Namespace:kube-system SelfLink: UID:dde448fa-9949-4fe1-81a3-c1eea48f2946 ResourceVersion:973 Generation:0 CreationTimestamp:2022-09-03 05:54:32 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[app:csi-azurefile-controller pod-template-hash:78f78cfdd5] Annotations:map[] OwnerReferences:[{APIVersion:apps/v1 Kind:ReplicaSet Name:csi-azurefile-controller-78f78cfdd5 UID:34d7c5b3-cfdc-4802-85d3-ddc0dffe8b39 Controller:0xc0024f2a97 BlockOwnerDeletion:0xc0024f2a98}] Finalizers:[] ZZZ_DeprecatedClusterName: ManagedFields:[{Manager:kube-controller-manager Operation:Update APIVersion:v1 Time:2022-09-03 05:54:32 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"34d7c5b3-cfdc-4802-85d3-ddc0dffe8b39\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"azurefile\"}":{".":{},"f:args":{},"f:env":{".":{},"k:{\"name\":\"AZURE_CREDENTIAL_FILE\"}":{".":{},"f:name":{},"f:valueFrom":{".":{},"f:configMapKeyRef":{}}},"k:{\"name\":\"CSI_ENDPOINT\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:livenessProbe":{".":{},"f:failureThreshold":{},"f:httpGet":{".":{},"f:path":{},"f:port":{},"f:scheme":{}},"f:initialDelaySeconds":{},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:name":{},"f:ports":{".":{},"k:{\"containerPort\":29612,\"protocol\":\"TCP\"}":{".":{},"f:containerPort":{},"f:hostPort":{},"f:name":{},"f:protocol":{}},"k:{\"containerPort\":29614,\"protocol\":\"TCP\"}":{".":{},"f:containerPort":{},"f:hostPort":{},"f:name":{},"f:protocol":{}}},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}},"k:{\"mountPath\":\"/etc/kubernetes/\"}":{".":{},"f:mountPath":{},"f:name":{}}}},"k:{\"name\":\"csi-attacher\"}":{".":{},"f:args":{},"f:env":{".":{},"k:{\"name\":\"ADDRESS\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}}}},"k:{\"name\":\"csi-provisioner\"}":{".":{},"f:args":{},"f:env":{".":{},"k:{\"name\":\"ADDRESS\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}}}},"k:{\"name\":\"csi-resizer\"}":{".":{},"f:args":{},"f:env":{".":{},"k:{\"name\":\"ADDRESS\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}}}},"k:{\"name\":\"csi-snapshotter\"}":{".":{},"f:args":{},"f:env":{".":{},"k:{\"name\":\"ADDRESS\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}}}},"k:{\"name\":\"liveness-probe\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:hostNetwork":{},"f:nodeSelector":{},"f:priorityClassName":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:serviceAccount":{},"f:serviceAccountName":{},"f:terminationGracePeriodSeconds":{},"f:tolerations":{},"f:volumes":{".":{},"k:{\"name\":\"azure-cred\"}":{".":{},"f:hostPath":{".":{},"f:path":{},"f:type":{}},"f:name":{}},"k:{\"name\":\"socket-dir\"}":{".":{},"f:emptyDir":{},"f:name":{}}}}} Subresource:}]}.
I0903 05:54:32.266715       1 disruption.go:427] updatePod called on pod "csi-azurefile-controller-78f78cfdd5-d5wls"
I0903 05:54:32.267004       1 disruption.go:490] No PodDisruptionBudgets found for pod csi-azurefile-controller-78f78cfdd5-d5wls, PodDisruptionBudget controller will avoid syncing.
I0903 05:54:32.267089       1 disruption.go:430] No matching pdb for pod "csi-azurefile-controller-78f78cfdd5-d5wls"
I0903 05:54:32.266787       1 taint_manager.go:401] "Noticed pod update" pod="kube-system/csi-azurefile-controller-78f78cfdd5-d5wls"
I0903 05:54:32.281155       1 deployment_controller.go:578] "Finished syncing deployment" deployment="kube-system/csi-azurefile-controller" duration="51.853484ms"
I0903 05:54:32.282388       1 deployment_controller.go:490] "Error syncing deployment" deployment="kube-system/csi-azurefile-controller" err="Operation cannot be fulfilled on deployments.apps \"csi-azurefile-controller\": the object has been modified; please apply your changes to the latest version and try again"
I0903 05:54:32.281605       1 pvc_protection_controller.go:380] "Enqueuing PVCs for Pod" pod="kube-system/csi-azurefile-controller-78f78cfdd5-bb474" podUID=0e6ef091-492c-4174-9a82-cf4d796dfbb7
I0903 05:54:32.281628       1 replica_set.go:394] Pod csi-azurefile-controller-78f78cfdd5-bb474 created: &v1.Pod{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"csi-azurefile-controller-78f78cfdd5-bb474", GenerateName:"csi-azurefile-controller-78f78cfdd5-", Namespace:"kube-system", SelfLink:"", UID:"0e6ef091-492c-4174-9a82-cf4d796dfbb7", ResourceVersion:"975", Generation:0, CreationTimestamp:time.Date(2022, time.September, 3, 5, 54, 32, 0, time.Local), DeletionTimestamp:<nil>, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"csi-azurefile-controller", "pod-template-hash":"78f78cfdd5"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference{v1.OwnerReference{APIVersion:"apps/v1", Kind:"ReplicaSet", Name:"csi-azurefile-controller-78f78cfdd5", UID:"34d7c5b3-cfdc-4802-85d3-ddc0dffe8b39", Controller:(*bool)(0xc0024f3f47), BlockOwnerDeletion:(*bool)(0xc0024f3f48)}}, Finalizers:[]string(nil), ZZZ_DeprecatedClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kube-controller-manager", Operation:"Update", APIVersion:"v1", Time:time.Date(2022, time.September, 3, 5, 54, 32, 0, time.Local), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc002472b10), Subresource:""}}}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"socket-dir", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(0xc002472b28), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"azure-cred", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc002472b40), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"kube-api-access-lpdq4", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(0xc0019946c0), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"csi-provisioner", Image:"mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v3.2.0", Command:[]string(nil), Args:[]string{"-v=2", "--csi-address=$(ADDRESS)", "--leader-election", "--leader-election-namespace=kube-system", "--timeout=300s", "--extra-create-metadata=true"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"ADDRESS", Value:"/csi/csi.sock", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:524288000, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"500Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-lpdq4", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}, v1.Container{Name:"csi-attacher", Image:"mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v3.5.0", Command:[]string(nil), Args:[]string{"-v=2", "-csi-address=$(ADDRESS)", "-timeout=120s", "--leader-election", "--leader-election-namespace=kube-system"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"ADDRESS", Value:"/csi/csi.sock", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:524288000, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"500Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-lpdq4", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}, v1.Container{Name:"csi-snapshotter", Image:"mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v5.0.1", Command:[]string(nil), Args:[]string{"-v=2", "-csi-address=$(ADDRESS)", "--leader-election", "--leader-election-namespace=kube-system"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"ADDRESS", Value:"/csi/csi.sock", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:104857600, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-lpdq4", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}, v1.Container{Name:"csi-resizer", Image:"mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.5.0", Command:[]string(nil), Args:[]string{"-csi-address=$(ADDRESS)", "-v=2", "--leader-election", "--leader-election-namespace=kube-system", "-handle-volume-inuse-error=false", "-feature-gates=RecoverVolumeExpansionFailure=true", "-timeout=120s"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"ADDRESS", Value:"/csi/csi.sock", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:524288000, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"500Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-lpdq4", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}, v1.Container{Name:"liveness-probe", Image:"mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.7.0", Command:[]string(nil), Args:[]string{"--csi-address=/csi/csi.sock", "--probe-timeout=3s", "--health-port=29612", "--v=2"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar(nil), Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:104857600, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-lpdq4", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}, v1.Container{Name:"azurefile", Image:"mcr.microsoft.com/k8s/csi/azurefile-csi:latest", Command:[]string(nil), Args:[]string{"--v=5", "--endpoint=$(CSI_ENDPOINT)", "--metrics-address=0.0.0.0:29614", "--user-agent-suffix=OSS-kubectl"}, WorkingDir:"", Ports:[]v1.ContainerPort{v1.ContainerPort{Name:"healthz", HostPort:29612, ContainerPort:29612, Protocol:"TCP", HostIP:""}, v1.ContainerPort{Name:"metrics", HostPort:29614, ContainerPort:29614, Protocol:"TCP", HostIP:""}}, EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"AZURE_CREDENTIAL_FILE", Value:"", ValueFrom:(*v1.EnvVarSource)(0xc0019947e0)}, v1.EnvVar{Name:"CSI_ENDPOINT", Value:"unix:///csi/csi.sock", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:209715200, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"azure-cred", ReadOnly:false, MountPath:"/etc/kubernetes/", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-lpdq4", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(0xc0025e7540), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0xc00260e340), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"csi-azurefile-controller-sa", DeprecatedServiceAccount:"csi-azurefile-controller-sa", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0xc0003c9ab0), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"node-role.kubernetes.io/master", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node-role.kubernetes.io/controlplane", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node-role.kubernetes.io/control-plane", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node.kubernetes.io/not-ready", Operator:"Exists", Value:"", Effect:"NoExecute", TolerationSeconds:(*int64)(0xc00260e3c0)}, v1.Toleration{Key:"node.kubernetes.io/unreachable", Operator:"Exists", Value:"", Effect:"NoExecute", TolerationSeconds:(*int64)(0xc00260e3e0)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-cluster-critical", Priority:(*int32)(0xc00260e3e8), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(0xc00260e3ec), PreemptionPolicy:(*v1.PreemptionPolicy)(0xc00277ab10), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil), OS:(*v1.PodOS)(nil)}, Status:v1.PodStatus{Phase:"Pending", Conditions:[]v1.PodCondition(nil), Message:"", Reason:"", NominatedNodeName:"", HostIP:"", PodIP:"", PodIPs:[]v1.PodIP(nil), StartTime:<nil>, InitContainerStatuses:[]v1.ContainerStatus(nil), ContainerStatuses:[]v1.ContainerStatus(nil), QOSClass:"Burstable", EphemeralContainerStatuses:[]v1.ContainerStatus(nil)}}.
I0903 05:54:32.282083       1 disruption.go:415] addPod called on pod "csi-azurefile-controller-78f78cfdd5-bb474"
I0903 05:54:32.282109       1 taint_manager.go:401] "Noticed pod update" pod="kube-system/csi-azurefile-controller-78f78cfdd5-bb474"
I0903 05:54:32.282253       1 controller_utils.go:581] Controller csi-azurefile-controller-78f78cfdd5 created pod csi-azurefile-controller-78f78cfdd5-bb474
I0903 05:54:32.283670       1 deployment_controller.go:576] "Started syncing deployment" deployment="kube-system/csi-azurefile-controller" startTime="2022-09-03 05:54:32.283606507 +0000 UTC m=+174.242585356"
I0903 05:54:32.285033       1 replica_set_utils.go:59] Updating status for : kube-system/csi-azurefile-controller-78f78cfdd5, replicas 0->0 (need 2), fullyLabeledReplicas 0->0, readyReplicas 0->0, availableReplicas 0->0, sequence No: 0->1
I0903 05:54:32.285400       1 event.go:294] "Event occurred" object="kube-system/csi-azurefile-controller-78f78cfdd5" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: csi-azurefile-controller-78f78cfdd5-bb474"
... skipping 242 lines ...
I0903 05:54:42.401997       1 disruption.go:427] updatePod called on pod "csi-snapshot-controller-8545756757-fg2sz"
I0903 05:54:42.402027       1 disruption.go:490] No PodDisruptionBudgets found for pod csi-snapshot-controller-8545756757-fg2sz, PodDisruptionBudget controller will avoid syncing.
I0903 05:54:42.402035       1 disruption.go:430] No matching pdb for pod "csi-snapshot-controller-8545756757-fg2sz"
I0903 05:54:42.402084       1 taint_manager.go:401] "Noticed pod update" pod="kube-system/csi-snapshot-controller-8545756757-fg2sz"
I0903 05:54:42.404002       1 pvc_protection_controller.go:380] "Enqueuing PVCs for Pod" pod="kube-system/csi-snapshot-controller-8545756757-fr4xk" podUID=9aa82473-33d1-477a-a088-5ebca7fcd4be
I0903 05:54:42.404020       1 deployment_controller.go:578] "Finished syncing deployment" deployment="kube-system/csi-snapshot-controller" duration="57.462748ms"
I0903 05:54:42.404041       1 deployment_controller.go:490] "Error syncing deployment" deployment="kube-system/csi-snapshot-controller" err="Operation cannot be fulfilled on deployments.apps \"csi-snapshot-controller\": the object has been modified; please apply your changes to the latest version and try again"
I0903 05:54:42.404072       1 deployment_controller.go:576] "Started syncing deployment" deployment="kube-system/csi-snapshot-controller" startTime="2022-09-03 05:54:42.404060929 +0000 UTC m=+184.363039678"
I0903 05:54:42.404035       1 replica_set.go:394] Pod csi-snapshot-controller-8545756757-fr4xk created: &v1.Pod{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"csi-snapshot-controller-8545756757-fr4xk", GenerateName:"csi-snapshot-controller-8545756757-", Namespace:"kube-system", SelfLink:"", UID:"9aa82473-33d1-477a-a088-5ebca7fcd4be", ResourceVersion:"1101", Generation:0, CreationTimestamp:time.Date(2022, time.September, 3, 5, 54, 42, 0, time.Local), DeletionTimestamp:<nil>, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"csi-snapshot-controller", "pod-template-hash":"8545756757"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference{v1.OwnerReference{APIVersion:"apps/v1", Kind:"ReplicaSet", Name:"csi-snapshot-controller-8545756757", UID:"06b6f3d8-87a1-4e4d-8921-a2b03888ebae", Controller:(*bool)(0xc0020433e7), BlockOwnerDeletion:(*bool)(0xc0020433e8)}}, Finalizers:[]string(nil), ZZZ_DeprecatedClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kube-controller-manager", Operation:"Update", APIVersion:"v1", Time:time.Date(2022, time.September, 3, 5, 54, 42, 0, time.Local), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0010d4858), Subresource:""}}}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"kube-api-access-gxsvc", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(0xc0023e9f00), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"csi-snapshot-controller", Image:"mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller:v5.0.1", Command:[]string(nil), Args:[]string{"--v=2", "--leader-election=true", "--leader-election-namespace=kube-system"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar(nil), Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:104857600, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-api-access-gxsvc", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0xc002043488), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"csi-snapshot-controller-sa", DeprecatedServiceAccount:"csi-snapshot-controller-sa", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:false, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0xc00035db90), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"node-role.kubernetes.io/master", Operator:"Equal", Value:"true", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node-role.kubernetes.io/controlplane", Operator:"Equal", Value:"true", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node-role.kubernetes.io/control-plane", Operator:"Equal", Value:"true", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node.kubernetes.io/not-ready", Operator:"Exists", Value:"", Effect:"NoExecute", TolerationSeconds:(*int64)(0xc002043510)}, v1.Toleration{Key:"node.kubernetes.io/unreachable", Operator:"Exists", Value:"", Effect:"NoExecute", TolerationSeconds:(*int64)(0xc002043530)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-cluster-critical", Priority:(*int32)(0xc002043538), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(0xc00204353c), PreemptionPolicy:(*v1.PreemptionPolicy)(0xc001ba9990), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil), OS:(*v1.PodOS)(nil)}, Status:v1.PodStatus{Phase:"Pending", Conditions:[]v1.PodCondition(nil), Message:"", Reason:"", NominatedNodeName:"", HostIP:"", PodIP:"", PodIPs:[]v1.PodIP(nil), StartTime:<nil>, InitContainerStatuses:[]v1.ContainerStatus(nil), ContainerStatuses:[]v1.ContainerStatus(nil), QOSClass:"Burstable", EphemeralContainerStatuses:[]v1.ContainerStatus(nil)}}.
I0903 05:54:42.404265       1 controller_utils.go:240] Lowered expectations &controller.ControlleeExpectations{add:0, del:0, key:"kube-system/csi-snapshot-controller-8545756757", timestamp:time.Time{wall:0xc0bcd8e8965d8506, ext:184334206403, loc:(*time.Location)(0x7249da0)}}
I0903 05:54:42.404284       1 disruption.go:415] addPod called on pod "csi-snapshot-controller-8545756757-fr4xk"
I0903 05:54:42.404304       1 disruption.go:490] No PodDisruptionBudgets found for pod csi-snapshot-controller-8545756757-fr4xk, PodDisruptionBudget controller will avoid syncing.
I0903 05:54:42.404311       1 disruption.go:418] No matching pdb for pod "csi-snapshot-controller-8545756757-fr4xk"
... skipping 1582 lines ...
I0903 06:00:39.957404       1 disruption.go:418] No matching pdb for pod "azurefile-volume-tester-7bwtc-56d9448676-mlklv"
I0903 06:00:39.955598       1 taint_manager.go:401] "Noticed pod update" pod="azurefile-5356/azurefile-volume-tester-7bwtc-56d9448676-mlklv"
I0903 06:00:39.957717       1 event.go:294] "Event occurred" object="azurefile-5356/azurefile-volume-tester-7bwtc-56d9448676" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: azurefile-volume-tester-7bwtc-56d9448676-mlklv"
I0903 06:00:39.955525       1 replica_set.go:394] Pod azurefile-volume-tester-7bwtc-56d9448676-mlklv created: &v1.Pod{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"azurefile-volume-tester-7bwtc-56d9448676-mlklv", GenerateName:"azurefile-volume-tester-7bwtc-56d9448676-", Namespace:"azurefile-5356", SelfLink:"", UID:"43c395dd-34c9-4e65-81f9-60e3a24d21e5", ResourceVersion:"2283", Generation:0, CreationTimestamp:time.Date(2022, time.September, 3, 6, 0, 39, 0, time.Local), DeletionTimestamp:<nil>, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"azurefile-volume-tester-5018949295715050020", "pod-template-hash":"56d9448676"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference{v1.OwnerReference{APIVersion:"apps/v1", Kind:"ReplicaSet", Name:"azurefile-volume-tester-7bwtc-56d9448676", UID:"199b1875-9cc6-4249-a5f6-c392b6e2e378", Controller:(*bool)(0xc00254b2f7), BlockOwnerDeletion:(*bool)(0xc00254b2f8)}}, Finalizers:[]string(nil), ZZZ_DeprecatedClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kube-controller-manager", Operation:"Update", APIVersion:"v1", Time:time.Date(2022, time.September, 3, 6, 0, 39, 0, time.Local), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc00298f638), Subresource:""}}}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"test-volume-1", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(0xc00298f650), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"kube-api-access-68pj7", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(0xc0029d40a0), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"volume-tester", Image:"k8s.gcr.io/e2e-test-images/busybox:1.29-2", Command:[]string{"/bin/sh"}, Args:[]string{"-c", "echo 'hello world' >> /mnt/test-1/data && while true; do sleep 100; done"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar(nil), Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"test-volume-1", ReadOnly:false, MountPath:"/mnt/test-1", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-68pj7", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0xc00254b3c8), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string(nil), ServiceAccountName:"default", DeprecatedServiceAccount:"default", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:false, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0xc000333f80), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"node.kubernetes.io/not-ready", Operator:"Exists", Value:"", Effect:"NoExecute", TolerationSeconds:(*int64)(0xc00254b400)}, v1.Toleration{Key:"node.kubernetes.io/unreachable", Operator:"Exists", Value:"", Effect:"NoExecute", TolerationSeconds:(*int64)(0xc00254b420)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"", Priority:(*int32)(0xc00254b428), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(0xc00254b42c), PreemptionPolicy:(*v1.PreemptionPolicy)(0xc002ae06d0), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil), OS:(*v1.PodOS)(nil)}, Status:v1.PodStatus{Phase:"Pending", Conditions:[]v1.PodCondition(nil), Message:"", Reason:"", NominatedNodeName:"", HostIP:"", PodIP:"", PodIPs:[]v1.PodIP(nil), StartTime:<nil>, InitContainerStatuses:[]v1.ContainerStatus(nil), ContainerStatuses:[]v1.ContainerStatus(nil), QOSClass:"BestEffort", EphemeralContainerStatuses:[]v1.ContainerStatus(nil)}}.
I0903 06:00:39.959003       1 controller_utils.go:240] Lowered expectations &controller.ControlleeExpectations{add:0, del:0, key:"azurefile-5356/azurefile-volume-tester-7bwtc-56d9448676", timestamp:time.Time{wall:0xc0bcd941f864fd2f, ext:541905121360, loc:(*time.Location)(0x7249da0)}}
I0903 06:00:39.959927       1 deployment_controller.go:578] "Finished syncing deployment" deployment="azurefile-5356/azurefile-volume-tester-7bwtc" duration="19.79947ms"
I0903 06:00:39.960108       1 deployment_controller.go:490] "Error syncing deployment" deployment="azurefile-5356/azurefile-volume-tester-7bwtc" err="Operation cannot be fulfilled on deployments.apps \"azurefile-volume-tester-7bwtc\": the object has been modified; please apply your changes to the latest version and try again"
I0903 06:00:39.960306       1 deployment_controller.go:576] "Started syncing deployment" deployment="azurefile-5356/azurefile-volume-tester-7bwtc" startTime="2022-09-03 06:00:39.960288475 +0000 UTC m=+541.919267224"
I0903 06:00:39.960843       1 deployment_util.go:774] Deployment "azurefile-volume-tester-7bwtc" timed out (false) [last progress check: 2022-09-03 06:00:39 +0000 UTC - now: 2022-09-03 06:00:39.960835686 +0000 UTC m=+541.919814435]
I0903 06:00:39.966276       1 replica_set.go:457] Pod azurefile-volume-tester-7bwtc-56d9448676-mlklv updated, objectMeta {Name:azurefile-volume-tester-7bwtc-56d9448676-mlklv GenerateName:azurefile-volume-tester-7bwtc-56d9448676- Namespace:azurefile-5356 SelfLink: UID:43c395dd-34c9-4e65-81f9-60e3a24d21e5 ResourceVersion:2283 Generation:0 CreationTimestamp:2022-09-03 06:00:39 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[app:azurefile-volume-tester-5018949295715050020 pod-template-hash:56d9448676] Annotations:map[] OwnerReferences:[{APIVersion:apps/v1 Kind:ReplicaSet Name:azurefile-volume-tester-7bwtc-56d9448676 UID:199b1875-9cc6-4249-a5f6-c392b6e2e378 Controller:0xc00254b2f7 BlockOwnerDeletion:0xc00254b2f8}] Finalizers:[] ZZZ_DeprecatedClusterName: ManagedFields:[{Manager:kube-controller-manager Operation:Update APIVersion:v1 Time:2022-09-03 06:00:39 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"199b1875-9cc6-4249-a5f6-c392b6e2e378\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"volume-tester\"}":{".":{},"f:args":{},"f:command":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/mnt/test-1\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{},"f:volumes":{".":{},"k:{\"name\":\"test-volume-1\"}":{".":{},"f:name":{},"f:persistentVolumeClaim":{".":{},"f:claimName":{}}}}}} Subresource:}]} -> {Name:azurefile-volume-tester-7bwtc-56d9448676-mlklv GenerateName:azurefile-volume-tester-7bwtc-56d9448676- Namespace:azurefile-5356 SelfLink: UID:43c395dd-34c9-4e65-81f9-60e3a24d21e5 ResourceVersion:2286 Generation:0 CreationTimestamp:2022-09-03 06:00:39 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[app:azurefile-volume-tester-5018949295715050020 pod-template-hash:56d9448676] Annotations:map[] OwnerReferences:[{APIVersion:apps/v1 Kind:ReplicaSet Name:azurefile-volume-tester-7bwtc-56d9448676 UID:199b1875-9cc6-4249-a5f6-c392b6e2e378 Controller:0xc0025e081e BlockOwnerDeletion:0xc0025e081f}] Finalizers:[] ZZZ_DeprecatedClusterName: ManagedFields:[{Manager:kube-controller-manager Operation:Update APIVersion:v1 Time:2022-09-03 06:00:39 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"199b1875-9cc6-4249-a5f6-c392b6e2e378\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"volume-tester\"}":{".":{},"f:args":{},"f:command":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/mnt/test-1\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{},"f:volumes":{".":{},"k:{\"name\":\"test-volume-1\"}":{".":{},"f:name":{},"f:persistentVolumeClaim":{".":{},"f:claimName":{}}}}}} Subresource:}]}.
I0903 06:00:39.966418       1 disruption.go:427] updatePod called on pod "azurefile-volume-tester-7bwtc-56d9448676-mlklv"
I0903 06:00:39.966437       1 disruption.go:490] No PodDisruptionBudgets found for pod azurefile-volume-tester-7bwtc-56d9448676-mlklv, PodDisruptionBudget controller will avoid syncing.
I0903 06:00:39.966445       1 disruption.go:430] No matching pdb for pod "azurefile-volume-tester-7bwtc-56d9448676-mlklv"
... skipping 1385 lines ...
I0903 06:03:53.880257       1 namespace_controller.go:180] Finished syncing namespace "azurefile-8666" (70.202µs)
2022/09/03 06:03:54 ===================================================

JUnit report was created: /logs/artifacts/junit_01.xml

Ran 6 of 34 Specs in 365.133 seconds
SUCCESS! -- 6 Passed | 0 Failed | 0 Pending | 28 Skipped

You're using deprecated Ginkgo functionality:
=============================================
Ginkgo 2.0 is under active development and will introduce several new features, improvements, and a small handful of breaking changes.
A release candidate for 2.0 is now available and 2.0 should GA in Fall 2021.  Please give the RC a try and send us feedback!
  - To learn more, view the migration guide at https://github.com/onsi/ginkgo/blob/ver2/docs/MIGRATING_TO_V2.md
... skipping 44 lines ...
INFO: Creating log watcher for controller capz-system/capz-controller-manager, pod capz-controller-manager-858df9cd95-fqg66, container manager
STEP: Dumping workload cluster default/capz-qnu7s3 logs
Sep  3 06:05:23.369: INFO: Collecting logs for Linux node capz-qnu7s3-control-plane-6hptv in cluster capz-qnu7s3 in namespace default

Sep  3 06:06:23.370: INFO: Collecting boot logs for AzureMachine capz-qnu7s3-control-plane-6hptv

Failed to get logs for machine capz-qnu7s3-control-plane-ppcl8, cluster default/capz-qnu7s3: open /etc/azure-ssh/azure-ssh: no such file or directory
Sep  3 06:06:24.672: INFO: Collecting logs for Linux node capz-qnu7s3-md-0-wvhqp in cluster capz-qnu7s3 in namespace default

Sep  3 06:07:24.674: INFO: Collecting boot logs for AzureMachine capz-qnu7s3-md-0-wvhqp

Failed to get logs for machine capz-qnu7s3-md-0-58c8d5cd58-bnqbv, cluster default/capz-qnu7s3: open /etc/azure-ssh/azure-ssh: no such file or directory
Sep  3 06:07:25.303: INFO: Collecting logs for Linux node capz-qnu7s3-md-0-xv9cn in cluster capz-qnu7s3 in namespace default

Sep  3 06:08:25.304: INFO: Collecting boot logs for AzureMachine capz-qnu7s3-md-0-xv9cn

Failed to get logs for machine capz-qnu7s3-md-0-58c8d5cd58-kxv94, cluster default/capz-qnu7s3: open /etc/azure-ssh/azure-ssh: no such file or directory
STEP: Dumping workload cluster default/capz-qnu7s3 kube-system pod logs
STEP: Creating log watcher for controller kube-system/csi-azurefile-controller-78f78cfdd5-bb474, container csi-provisioner
STEP: Fetching kube-system pod logs took 1.023532553s
STEP: Dumping workload cluster default/capz-qnu7s3 Azure activity log
STEP: Creating log watcher for controller kube-system/calico-node-bl7hr, container calico-node
STEP: Collecting events for Pod kube-system/calico-node-bl7hr
... skipping 4 lines ...
STEP: Creating log watcher for controller kube-system/calico-kube-controllers-7867496574-8fdcf, container calico-kube-controllers
STEP: Creating log watcher for controller kube-system/csi-azurefile-controller-78f78cfdd5-d5wls, container azurefile
STEP: Collecting events for Pod kube-system/coredns-6d4b75cb6d-rr8b9
STEP: Creating log watcher for controller kube-system/csi-azurefile-node-gdw4d, container liveness-probe
STEP: Collecting events for Pod kube-system/kube-controller-manager-capz-qnu7s3-control-plane-6hptv
STEP: Collecting events for Pod kube-system/csi-azurefile-node-gdw4d
STEP: failed to find events of Pod "kube-controller-manager-capz-qnu7s3-control-plane-6hptv"
STEP: Collecting events for Pod kube-system/csi-azurefile-node-n4zbm
STEP: Creating log watcher for controller kube-system/csi-azurefile-node-gdw4d, container node-driver-registrar
STEP: Creating log watcher for controller kube-system/csi-snapshot-controller-8545756757-fg2sz, container csi-snapshot-controller
STEP: Creating log watcher for controller kube-system/csi-azurefile-node-n4zbm, container liveness-probe
STEP: Creating log watcher for controller kube-system/kube-proxy-6zcgn, container kube-proxy
STEP: Collecting events for Pod kube-system/csi-azurefile-controller-78f78cfdd5-d5wls
... skipping 22 lines ...
STEP: Creating log watcher for controller kube-system/csi-azurefile-controller-78f78cfdd5-bb474, container csi-resizer
STEP: Collecting events for Pod kube-system/csi-azurefile-node-8d8p7
STEP: Creating log watcher for controller kube-system/csi-azurefile-node-8d8p7, container azurefile
STEP: Creating log watcher for controller kube-system/metrics-server-7d674f87b8-8wwpw, container metrics-server
STEP: Collecting events for Pod kube-system/kube-proxy-xw4p2
STEP: Collecting events for Pod kube-system/etcd-capz-qnu7s3-control-plane-6hptv
STEP: failed to find events of Pod "etcd-capz-qnu7s3-control-plane-6hptv"
STEP: Creating log watcher for controller kube-system/kube-apiserver-capz-qnu7s3-control-plane-6hptv, container kube-apiserver
STEP: Creating log watcher for controller kube-system/kube-proxy-xw4p2, container kube-proxy
STEP: Creating log watcher for controller kube-system/coredns-6d4b75cb6d-9tcct, container coredns
STEP: Creating log watcher for controller kube-system/kube-scheduler-capz-qnu7s3-control-plane-6hptv, container kube-scheduler
STEP: Creating log watcher for controller kube-system/csi-azurefile-node-8d8p7, container node-driver-registrar
STEP: Collecting events for Pod kube-system/calico-node-twqp9
STEP: Collecting events for Pod kube-system/kube-scheduler-capz-qnu7s3-control-plane-6hptv
STEP: failed to find events of Pod "kube-scheduler-capz-qnu7s3-control-plane-6hptv"
STEP: Creating log watcher for controller kube-system/kube-controller-manager-capz-qnu7s3-control-plane-6hptv, container kube-controller-manager
STEP: Collecting events for Pod kube-system/kube-apiserver-capz-qnu7s3-control-plane-6hptv
STEP: failed to find events of Pod "kube-apiserver-capz-qnu7s3-control-plane-6hptv"
STEP: Collecting events for Pod kube-system/metrics-server-7d674f87b8-8wwpw
STEP: Creating log watcher for controller kube-system/kube-proxy-pt7w9, container kube-proxy
STEP: Fetching activity logs took 5.598464521s
================ REDACTING LOGS ================
All sensitive variables are redacted
cluster.cluster.x-k8s.io "capz-qnu7s3" deleted
... skipping 14 lines ...