This job view page is being replaced by Spyglass soon. Check out the new job view.
Resultsuccess
Tests 0 failed / 12 succeeded
Started2022-09-03 23:43
Elapsed51m46s
Revision
uploadercrier
uploadercrier

No Test Failures!


Show 12 Passed Tests

Show 47 Skipped Tests

Error lines from build-log.txt

... skipping 702 lines ...
certificate.cert-manager.io "selfsigned-cert" deleted
# Create secret for AzureClusterIdentity
./hack/create-identity-secret.sh
make[2]: Entering directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure'
make[2]: Nothing to be done for 'kubectl'.
make[2]: Leaving directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure'
Error from server (NotFound): secrets "cluster-identity-secret" not found
secret/cluster-identity-secret created
secret/cluster-identity-secret labeled
# Create customized cloud provider configs
./hack/create-custom-cloud-provider-config.sh
make[2]: Entering directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure'
make[2]: Nothing to be done for 'kubectl'.
... skipping 134 lines ...
# Wait for the kubeconfig to become available.
timeout --foreground 300 bash -c "while ! /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/hack/tools/bin/kubectl-v1.22.4 get secrets | grep capz-oshnip-kubeconfig; do sleep 1; done"
capz-oshnip-kubeconfig                 cluster.x-k8s.io/secret   1      0s
# Get kubeconfig and store it locally.
/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/hack/tools/bin/kubectl-v1.22.4 get secrets capz-oshnip-kubeconfig -o json | jq -r .data.value | base64 --decode > ./kubeconfig
timeout --foreground 600 bash -c "while ! /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/hack/tools/bin/kubectl-v1.22.4 --kubeconfig=./kubeconfig get nodes | grep control-plane; do sleep 1; done"
error: the server doesn't have a resource type "nodes"
capz-oshnip-control-plane-jqxrs   NotReady   control-plane   14s   v1.26.0-alpha.0.376+e7192a49552483
run "/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/hack/tools/bin/kubectl-v1.22.4 --kubeconfig=./kubeconfig ..." to work with the new target cluster
make[1]: Leaving directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure'
Waiting for 1 control plane machine(s), 2 worker machine(s), and  windows machine(s) to become Ready
node/capz-oshnip-control-plane-jqxrs condition met
node/capz-oshnip-mp-0000000 condition met
... skipping 62 lines ...
Pre-Provisioned [single-az] 
  should use a pre-provisioned volume and mount it as readOnly in a pod [disk.csi.azure.com][windows]
  /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning_test.go:70
STEP: Creating a kubernetes client
Sep  4 00:02:55.728: INFO: >>> kubeConfig: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig
STEP: Building a namespace api object, basename azuredisk
Sep  4 00:02:55.993: INFO: Error listing PodSecurityPolicies; assuming PodSecurityPolicy is disabled: the server could not find the requested resource
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
I0904 00:02:56.116471   36197 azuredisk_driver.go:56] Using azure disk driver: kubernetes.io/azure-disk
Sep  4 00:02:56.117: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "azuredisk-8081" for this suite.

... skipping 55 lines ...

    test case is only available for CSI drivers

    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/suite_test.go:304
------------------------------
Pre-Provisioned [single-az] 
  should fail when maxShares is invalid [disk.csi.azure.com][windows]
  /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning_test.go:163
STEP: Creating a kubernetes client
Sep  4 00:02:56.808: INFO: >>> kubeConfig: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig
STEP: Building a namespace api object, basename azuredisk
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
... skipping 3 lines ...

S [SKIPPING] [0.316 seconds]
Pre-Provisioned
/home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning_test.go:37
  [single-az]
  /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning_test.go:69
    should fail when maxShares is invalid [disk.csi.azure.com][windows] [It]
    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/pre_provisioning_test.go:163

    test case is only available for CSI drivers

    /home/prow/go/src/sigs.k8s.io/azuredisk-csi-driver/test/e2e/suite_test.go:304
------------------------------
... skipping 85 lines ...
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying the pod
STEP: checking that the pod's command exits with no error
Sep  4 00:02:58.682: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-5zksd" in namespace "azuredisk-1353" to be "Succeeded or Failed"
Sep  4 00:02:58.713: INFO: Pod "azuredisk-volume-tester-5zksd": Phase="Pending", Reason="", readiness=false. Elapsed: 31.219119ms
Sep  4 00:03:00.745: INFO: Pod "azuredisk-volume-tester-5zksd": Phase="Pending", Reason="", readiness=false. Elapsed: 2.063593535s
Sep  4 00:03:02.778: INFO: Pod "azuredisk-volume-tester-5zksd": Phase="Pending", Reason="", readiness=false. Elapsed: 4.096665099s
Sep  4 00:03:04.813: INFO: Pod "azuredisk-volume-tester-5zksd": Phase="Pending", Reason="", readiness=false. Elapsed: 6.1312168s
Sep  4 00:03:06.845: INFO: Pod "azuredisk-volume-tester-5zksd": Phase="Pending", Reason="", readiness=false. Elapsed: 8.163447903s
Sep  4 00:03:08.878: INFO: Pod "azuredisk-volume-tester-5zksd": Phase="Pending", Reason="", readiness=false. Elapsed: 10.196116154s
... skipping 2 lines ...
Sep  4 00:03:14.974: INFO: Pod "azuredisk-volume-tester-5zksd": Phase="Pending", Reason="", readiness=false. Elapsed: 16.292783537s
Sep  4 00:03:17.007: INFO: Pod "azuredisk-volume-tester-5zksd": Phase="Pending", Reason="", readiness=false. Elapsed: 18.32565816s
Sep  4 00:03:19.042: INFO: Pod "azuredisk-volume-tester-5zksd": Phase="Pending", Reason="", readiness=false. Elapsed: 20.360303548s
Sep  4 00:03:21.076: INFO: Pod "azuredisk-volume-tester-5zksd": Phase="Pending", Reason="", readiness=false. Elapsed: 22.393947965s
Sep  4 00:03:23.110: INFO: Pod "azuredisk-volume-tester-5zksd": Phase="Succeeded", Reason="", readiness=false. Elapsed: 24.428478319s
STEP: Saw pod success
Sep  4 00:03:23.110: INFO: Pod "azuredisk-volume-tester-5zksd" satisfied condition "Succeeded or Failed"
Sep  4 00:03:23.110: INFO: deleting Pod "azuredisk-1353"/"azuredisk-volume-tester-5zksd"
Sep  4 00:03:23.160: INFO: Pod azuredisk-volume-tester-5zksd has the following logs: hello world

STEP: Deleting pod azuredisk-volume-tester-5zksd in namespace azuredisk-1353
STEP: validating provisioned PV
STEP: checking the PV
... skipping 97 lines ...
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying the pod
STEP: checking that the pod has 'FailedMount' event
Sep  4 00:04:19.385: INFO: deleting Pod "azuredisk-1563"/"azuredisk-volume-tester-mtnpn"
Sep  4 00:04:19.428: INFO: Error getting logs for pod azuredisk-volume-tester-mtnpn: the server rejected our request for an unknown reason (get pods azuredisk-volume-tester-mtnpn)
STEP: Deleting pod azuredisk-volume-tester-mtnpn in namespace azuredisk-1563
STEP: validating provisioned PV
STEP: checking the PV
Sep  4 00:04:19.522: INFO: deleting PVC "azuredisk-1563"/"pvc-9v76x"
Sep  4 00:04:19.523: INFO: Deleting PersistentVolumeClaim "pvc-9v76x"
STEP: waiting for claim's PV "pvc-9b68daff-0851-472c-9253-0fcc27cd9bf6" to be deleted
... skipping 58 lines ...
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying the pod
STEP: checking that the pod's command exits with no error
Sep  4 00:06:46.383: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-s4fkw" in namespace "azuredisk-7463" to be "Succeeded or Failed"
Sep  4 00:06:46.414: INFO: Pod "azuredisk-volume-tester-s4fkw": Phase="Pending", Reason="", readiness=false. Elapsed: 30.371532ms
Sep  4 00:06:48.445: INFO: Pod "azuredisk-volume-tester-s4fkw": Phase="Pending", Reason="", readiness=false. Elapsed: 2.061471356s
Sep  4 00:06:50.478: INFO: Pod "azuredisk-volume-tester-s4fkw": Phase="Pending", Reason="", readiness=false. Elapsed: 4.094617511s
Sep  4 00:06:52.511: INFO: Pod "azuredisk-volume-tester-s4fkw": Phase="Pending", Reason="", readiness=false. Elapsed: 6.127166898s
Sep  4 00:06:54.543: INFO: Pod "azuredisk-volume-tester-s4fkw": Phase="Pending", Reason="", readiness=false. Elapsed: 8.159074927s
Sep  4 00:06:56.574: INFO: Pod "azuredisk-volume-tester-s4fkw": Phase="Pending", Reason="", readiness=false. Elapsed: 10.190811737s
Sep  4 00:06:58.609: INFO: Pod "azuredisk-volume-tester-s4fkw": Phase="Pending", Reason="", readiness=false. Elapsed: 12.225132642s
Sep  4 00:07:00.641: INFO: Pod "azuredisk-volume-tester-s4fkw": Phase="Pending", Reason="", readiness=false. Elapsed: 14.257630472s
Sep  4 00:07:02.673: INFO: Pod "azuredisk-volume-tester-s4fkw": Phase="Pending", Reason="", readiness=false. Elapsed: 16.289793512s
Sep  4 00:07:04.705: INFO: Pod "azuredisk-volume-tester-s4fkw": Phase="Pending", Reason="", readiness=false. Elapsed: 18.321246895s
Sep  4 00:07:06.744: INFO: Pod "azuredisk-volume-tester-s4fkw": Phase="Pending", Reason="", readiness=false. Elapsed: 20.360270311s
Sep  4 00:07:08.778: INFO: Pod "azuredisk-volume-tester-s4fkw": Phase="Succeeded", Reason="", readiness=false. Elapsed: 22.394003299s
STEP: Saw pod success
Sep  4 00:07:08.778: INFO: Pod "azuredisk-volume-tester-s4fkw" satisfied condition "Succeeded or Failed"
Sep  4 00:07:08.778: INFO: deleting Pod "azuredisk-7463"/"azuredisk-volume-tester-s4fkw"
Sep  4 00:07:08.818: INFO: Pod azuredisk-volume-tester-s4fkw has the following logs: e2e-test

STEP: Deleting pod azuredisk-volume-tester-s4fkw in namespace azuredisk-7463
STEP: validating provisioned PV
STEP: checking the PV
... skipping 39 lines ...
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying the pod
STEP: checking that the pod's command exits with an error
Sep  4 00:07:44.917: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-v9925" in namespace "azuredisk-9241" to be "Error status code"
Sep  4 00:07:44.948: INFO: Pod "azuredisk-volume-tester-v9925": Phase="Pending", Reason="", readiness=false. Elapsed: 30.601242ms
Sep  4 00:07:46.979: INFO: Pod "azuredisk-volume-tester-v9925": Phase="Pending", Reason="", readiness=false. Elapsed: 2.061901605s
Sep  4 00:07:49.012: INFO: Pod "azuredisk-volume-tester-v9925": Phase="Pending", Reason="", readiness=false. Elapsed: 4.094528143s
Sep  4 00:07:51.044: INFO: Pod "azuredisk-volume-tester-v9925": Phase="Pending", Reason="", readiness=false. Elapsed: 6.126913757s
Sep  4 00:07:53.077: INFO: Pod "azuredisk-volume-tester-v9925": Phase="Pending", Reason="", readiness=false. Elapsed: 8.159240239s
Sep  4 00:07:55.109: INFO: Pod "azuredisk-volume-tester-v9925": Phase="Pending", Reason="", readiness=false. Elapsed: 10.191922374s
Sep  4 00:07:57.141: INFO: Pod "azuredisk-volume-tester-v9925": Phase="Pending", Reason="", readiness=false. Elapsed: 12.223179576s
Sep  4 00:07:59.172: INFO: Pod "azuredisk-volume-tester-v9925": Phase="Pending", Reason="", readiness=false. Elapsed: 14.254325061s
Sep  4 00:08:01.205: INFO: Pod "azuredisk-volume-tester-v9925": Phase="Pending", Reason="", readiness=false. Elapsed: 16.287350336s
Sep  4 00:08:03.238: INFO: Pod "azuredisk-volume-tester-v9925": Phase="Running", Reason="", readiness=true. Elapsed: 18.320280273s
Sep  4 00:08:05.271: INFO: Pod "azuredisk-volume-tester-v9925": Phase="Running", Reason="", readiness=false. Elapsed: 20.353466394s
Sep  4 00:08:07.305: INFO: Pod "azuredisk-volume-tester-v9925": Phase="Failed", Reason="", readiness=false. Elapsed: 22.387552795s
STEP: Saw pod failure
Sep  4 00:08:07.305: INFO: Pod "azuredisk-volume-tester-v9925" satisfied condition "Error status code"
STEP: checking that pod logs contain expected message
Sep  4 00:08:07.338: INFO: deleting Pod "azuredisk-9241"/"azuredisk-volume-tester-v9925"
Sep  4 00:08:07.371: INFO: Pod azuredisk-volume-tester-v9925 has the following logs: touch: /mnt/test-1/data: Read-only file system

STEP: Deleting pod azuredisk-volume-tester-v9925 in namespace azuredisk-9241
STEP: validating provisioned PV
... skipping 375 lines ...
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying the pod
STEP: checking that the pod's command exits with no error
Sep  4 00:15:28.126: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-hf776" in namespace "azuredisk-1387" to be "Succeeded or Failed"
Sep  4 00:15:28.167: INFO: Pod "azuredisk-volume-tester-hf776": Phase="Pending", Reason="", readiness=false. Elapsed: 41.211422ms
Sep  4 00:15:30.200: INFO: Pod "azuredisk-volume-tester-hf776": Phase="Pending", Reason="", readiness=false. Elapsed: 2.07366514s
Sep  4 00:15:32.232: INFO: Pod "azuredisk-volume-tester-hf776": Phase="Pending", Reason="", readiness=false. Elapsed: 4.106450744s
Sep  4 00:15:34.270: INFO: Pod "azuredisk-volume-tester-hf776": Phase="Pending", Reason="", readiness=false. Elapsed: 6.143562018s
Sep  4 00:15:36.303: INFO: Pod "azuredisk-volume-tester-hf776": Phase="Pending", Reason="", readiness=false. Elapsed: 8.177243506s
Sep  4 00:15:38.336: INFO: Pod "azuredisk-volume-tester-hf776": Phase="Pending", Reason="", readiness=false. Elapsed: 10.21014585s
... skipping 7 lines ...
Sep  4 00:15:54.605: INFO: Pod "azuredisk-volume-tester-hf776": Phase="Pending", Reason="", readiness=false. Elapsed: 26.479279298s
Sep  4 00:15:56.641: INFO: Pod "azuredisk-volume-tester-hf776": Phase="Pending", Reason="", readiness=false. Elapsed: 28.515339671s
Sep  4 00:15:58.675: INFO: Pod "azuredisk-volume-tester-hf776": Phase="Running", Reason="", readiness=true. Elapsed: 30.548727438s
Sep  4 00:16:00.707: INFO: Pod "azuredisk-volume-tester-hf776": Phase="Running", Reason="", readiness=false. Elapsed: 32.581123853s
Sep  4 00:16:02.742: INFO: Pod "azuredisk-volume-tester-hf776": Phase="Succeeded", Reason="", readiness=false. Elapsed: 34.615543915s
STEP: Saw pod success
Sep  4 00:16:02.742: INFO: Pod "azuredisk-volume-tester-hf776" satisfied condition "Succeeded or Failed"
Sep  4 00:16:02.742: INFO: deleting Pod "azuredisk-1387"/"azuredisk-volume-tester-hf776"
Sep  4 00:16:02.786: INFO: Pod azuredisk-volume-tester-hf776 has the following logs: hello world
hello world
hello world

STEP: Deleting pod azuredisk-volume-tester-hf776 in namespace azuredisk-1387
... skipping 74 lines ...
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: setting up the pod
STEP: deploying the pod
STEP: checking that the pod's command exits with no error
Sep  4 00:17:19.628: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-mqkcq" in namespace "azuredisk-4547" to be "Succeeded or Failed"
Sep  4 00:17:19.659: INFO: Pod "azuredisk-volume-tester-mqkcq": Phase="Pending", Reason="", readiness=false. Elapsed: 30.309702ms
Sep  4 00:17:21.689: INFO: Pod "azuredisk-volume-tester-mqkcq": Phase="Pending", Reason="", readiness=false. Elapsed: 2.060994349s
Sep  4 00:17:23.721: INFO: Pod "azuredisk-volume-tester-mqkcq": Phase="Pending", Reason="", readiness=false. Elapsed: 4.093129568s
Sep  4 00:17:25.755: INFO: Pod "azuredisk-volume-tester-mqkcq": Phase="Pending", Reason="", readiness=false. Elapsed: 6.126706906s
Sep  4 00:17:27.787: INFO: Pod "azuredisk-volume-tester-mqkcq": Phase="Pending", Reason="", readiness=false. Elapsed: 8.158385949s
Sep  4 00:17:29.820: INFO: Pod "azuredisk-volume-tester-mqkcq": Phase="Pending", Reason="", readiness=false. Elapsed: 10.191608049s
... skipping 3 lines ...
Sep  4 00:17:37.949: INFO: Pod "azuredisk-volume-tester-mqkcq": Phase="Pending", Reason="", readiness=false. Elapsed: 18.321186457s
Sep  4 00:17:39.981: INFO: Pod "azuredisk-volume-tester-mqkcq": Phase="Pending", Reason="", readiness=false. Elapsed: 20.352449435s
Sep  4 00:17:42.013: INFO: Pod "azuredisk-volume-tester-mqkcq": Phase="Pending", Reason="", readiness=false. Elapsed: 22.384475976s
Sep  4 00:17:44.047: INFO: Pod "azuredisk-volume-tester-mqkcq": Phase="Pending", Reason="", readiness=false. Elapsed: 24.418681119s
Sep  4 00:17:46.082: INFO: Pod "azuredisk-volume-tester-mqkcq": Phase="Succeeded", Reason="", readiness=false. Elapsed: 26.453324867s
STEP: Saw pod success
Sep  4 00:17:46.082: INFO: Pod "azuredisk-volume-tester-mqkcq" satisfied condition "Succeeded or Failed"
Sep  4 00:17:46.082: INFO: deleting Pod "azuredisk-4547"/"azuredisk-volume-tester-mqkcq"
Sep  4 00:17:46.122: INFO: Pod azuredisk-volume-tester-mqkcq has the following logs: 100+0 records in
100+0 records out
104857600 bytes (100.0MB) copied, 0.054400 seconds, 1.8GB/s
hello world

... skipping 117 lines ...
STEP: creating a PVC
STEP: setting up the StorageClass
STEP: creating a StorageClass 
STEP: setting up the PVC and PV
STEP: creating a PVC
STEP: deploying the pod
STEP: checking that the pod's command exits with no error
Sep  4 00:18:34.020: INFO: Waiting up to 15m0s for pod "azuredisk-volume-tester-pclx4" in namespace "azuredisk-7578" to be "Succeeded or Failed"
Sep  4 00:18:34.060: INFO: Pod "azuredisk-volume-tester-pclx4": Phase="Pending", Reason="", readiness=false. Elapsed: 40.219787ms
Sep  4 00:18:36.093: INFO: Pod "azuredisk-volume-tester-pclx4": Phase="Pending", Reason="", readiness=false. Elapsed: 2.073117477s
Sep  4 00:18:38.127: INFO: Pod "azuredisk-volume-tester-pclx4": Phase="Pending", Reason="", readiness=false. Elapsed: 4.106619835s
Sep  4 00:18:40.161: INFO: Pod "azuredisk-volume-tester-pclx4": Phase="Pending", Reason="", readiness=false. Elapsed: 6.14064292s
Sep  4 00:18:42.194: INFO: Pod "azuredisk-volume-tester-pclx4": Phase="Pending", Reason="", readiness=false. Elapsed: 8.174510193s
Sep  4 00:18:44.228: INFO: Pod "azuredisk-volume-tester-pclx4": Phase="Pending", Reason="", readiness=false. Elapsed: 10.20816187s
... skipping 8 lines ...
Sep  4 00:19:02.535: INFO: Pod "azuredisk-volume-tester-pclx4": Phase="Pending", Reason="", readiness=false. Elapsed: 28.514984534s
Sep  4 00:19:04.569: INFO: Pod "azuredisk-volume-tester-pclx4": Phase="Pending", Reason="", readiness=false. Elapsed: 30.549308588s
Sep  4 00:19:06.603: INFO: Pod "azuredisk-volume-tester-pclx4": Phase="Pending", Reason="", readiness=false. Elapsed: 32.582681087s
Sep  4 00:19:08.637: INFO: Pod "azuredisk-volume-tester-pclx4": Phase="Pending", Reason="", readiness=false. Elapsed: 34.616775569s
Sep  4 00:19:10.670: INFO: Pod "azuredisk-volume-tester-pclx4": Phase="Succeeded", Reason="", readiness=false. Elapsed: 36.650076559s
STEP: Saw pod success
Sep  4 00:19:10.670: INFO: Pod "azuredisk-volume-tester-pclx4" satisfied condition "Succeeded or Failed"
Sep  4 00:19:10.670: INFO: deleting Pod "azuredisk-7578"/"azuredisk-volume-tester-pclx4"
Sep  4 00:19:10.713: INFO: Pod azuredisk-volume-tester-pclx4 has the following logs: hello world

STEP: Deleting pod azuredisk-volume-tester-pclx4 in namespace azuredisk-7578
STEP: validating provisioned PV
STEP: checking the PV
... skipping 524 lines ...
I0903 23:57:26.491494       1 tlsconfig.go:200] "Loaded serving cert" certName="Generated self signed cert" certDetail="\"localhost@1662249445\" [serving] validServingFor=[127.0.0.1,127.0.0.1,localhost] issuer=\"localhost-ca@1662249445\" (2022-09-03 22:57:25 +0000 UTC to 2023-09-03 22:57:25 +0000 UTC (now=2022-09-03 23:57:26.491471282 +0000 UTC))"
I0903 23:57:26.491643       1 named_certificates.go:53] "Loaded SNI cert" index=0 certName="self-signed loopback" certDetail="\"apiserver-loopback-client@1662249446\" [serving] validServingFor=[apiserver-loopback-client] issuer=\"apiserver-loopback-client-ca@1662249446\" (2022-09-03 22:57:25 +0000 UTC to 2023-09-03 22:57:25 +0000 UTC (now=2022-09-03 23:57:26.491624983 +0000 UTC))"
I0903 23:57:26.491674       1 secure_serving.go:210] Serving securely on 127.0.0.1:10257
I0903 23:57:26.491869       1 leaderelection.go:248] attempting to acquire leader lease kube-system/kube-controller-manager...
I0903 23:57:26.492203       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"
I0903 23:57:26.492554       1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt"
E0903 23:57:29.126519       1 leaderelection.go:330] error retrieving resource lock kube-system/kube-controller-manager: leases.coordination.k8s.io "kube-controller-manager" is forbidden: User "system:kube-controller-manager" cannot get resource "leases" in API group "coordination.k8s.io" in the namespace "kube-system"
I0903 23:57:29.126970       1 leaderelection.go:253] failed to acquire lease kube-system/kube-controller-manager
I0903 23:57:32.046583       1 leaderelection.go:258] successfully acquired lease kube-system/kube-controller-manager
I0903 23:57:32.047418       1 event.go:294] "Event occurred" object="kube-system/kube-controller-manager" fieldPath="" kind="Lease" apiVersion="coordination.k8s.io/v1" type="Normal" reason="LeaderElection" message="capz-oshnip-control-plane-jqxrs_d9d84109-e08f-49e9-9d78-4fc17433c3dd became leader"
W0903 23:57:32.097911       1 plugins.go:131] WARNING: azure built-in cloud provider is now deprecated. The Azure provider is deprecated and will be removed in a future release. Please use https://github.com/kubernetes-sigs/cloud-provider-azure
I0903 23:57:32.098522       1 azure_auth.go:232] Using AzurePublicCloud environment
I0903 23:57:32.098566       1 azure_auth.go:117] azure: using client_id+client_secret to retrieve access token
I0903 23:57:32.098623       1 azure_interfaceclient.go:63] Azure InterfacesClient (read ops) using rate limit config: QPS=1, bucket=5
... skipping 29 lines ...
I0903 23:57:32.101736       1 reflector.go:221] Starting reflector *v1.Node (14h59m22.212073852s) from vendor/k8s.io/client-go/informers/factory.go:134
I0903 23:57:32.101757       1 reflector.go:257] Listing and watching *v1.Node from vendor/k8s.io/client-go/informers/factory.go:134
I0903 23:57:32.102152       1 reflector.go:221] Starting reflector *v1.ServiceAccount (14h59m22.212073852s) from vendor/k8s.io/client-go/informers/factory.go:134
I0903 23:57:32.102170       1 reflector.go:257] Listing and watching *v1.ServiceAccount from vendor/k8s.io/client-go/informers/factory.go:134
I0903 23:57:32.105793       1 reflector.go:221] Starting reflector *v1.Secret (14h59m22.212073852s) from vendor/k8s.io/client-go/informers/factory.go:134
I0903 23:57:32.112735       1 reflector.go:257] Listing and watching *v1.Secret from vendor/k8s.io/client-go/informers/factory.go:134
W0903 23:57:32.128938       1 azure_config.go:53] Failed to get cloud-config from secret: failed to get secret azure-cloud-provider: secrets "azure-cloud-provider" is forbidden: User "system:serviceaccount:kube-system:azure-cloud-provider" cannot get resource "secrets" in API group "" in the namespace "kube-system", skip initializing from secret
I0903 23:57:32.128962       1 controllermanager.go:573] Starting "endpointslicemirroring"
I0903 23:57:32.134273       1 controllermanager.go:602] Started "endpointslicemirroring"
I0903 23:57:32.134294       1 controllermanager.go:573] Starting "namespace"
I0903 23:57:32.134461       1 endpointslicemirroring_controller.go:216] Starting EndpointSliceMirroring controller
I0903 23:57:32.134577       1 shared_informer.go:255] Waiting for caches to sync for endpoint_slice_mirroring
I0903 23:57:32.152009       1 controllermanager.go:602] Started "namespace"
... skipping 39 lines ...
I0903 23:57:32.176177       1 plugins.go:646] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
I0903 23:57:32.176196       1 plugins.go:646] "Loaded volume plugin" pluginName="kubernetes.io/rbd"
I0903 23:57:32.176210       1 plugins.go:646] "Loaded volume plugin" pluginName="kubernetes.io/aws-ebs"
I0903 23:57:32.176272       1 plugins.go:646] "Loaded volume plugin" pluginName="kubernetes.io/gce-pd"
I0903 23:57:32.176295       1 plugins.go:646] "Loaded volume plugin" pluginName="kubernetes.io/azure-file"
I0903 23:57:32.176308       1 plugins.go:646] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
I0903 23:57:32.176371       1 csi_plugin.go:257] Cast from VolumeHost to KubeletVolumeHost failed. Skipping CSINode initialization, not running on kubelet
I0903 23:57:32.176386       1 plugins.go:646] "Loaded volume plugin" pluginName="kubernetes.io/csi"
I0903 23:57:32.176501       1 controllermanager.go:602] Started "persistentvolume-binder"
I0903 23:57:32.176518       1 controllermanager.go:573] Starting "clusterrole-aggregation"
I0903 23:57:32.176730       1 pv_controller_base.go:318] Starting persistent volume controller
I0903 23:57:32.176745       1 shared_informer.go:255] Waiting for caches to sync for persistent volume
I0903 23:57:32.181566       1 controllermanager.go:602] Started "clusterrole-aggregation"
... skipping 169 lines ...
I0903 23:57:35.905338       1 plugins.go:646] "Loaded volume plugin" pluginName="kubernetes.io/rbd"
I0903 23:57:35.905352       1 plugins.go:646] "Loaded volume plugin" pluginName="kubernetes.io/aws-ebs"
I0903 23:57:35.905365       1 plugins.go:646] "Loaded volume plugin" pluginName="kubernetes.io/gce-pd"
I0903 23:57:35.905378       1 plugins.go:646] "Loaded volume plugin" pluginName="kubernetes.io/azure-disk"
I0903 23:57:35.905392       1 plugins.go:646] "Loaded volume plugin" pluginName="kubernetes.io/fc"
I0903 23:57:35.905415       1 plugins.go:646] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
I0903 23:57:35.905437       1 csi_plugin.go:257] Cast from VolumeHost to KubeletVolumeHost failed. Skipping CSINode initialization, not running on kubelet
I0903 23:57:35.905453       1 plugins.go:646] "Loaded volume plugin" pluginName="kubernetes.io/csi"
I0903 23:57:35.905535       1 controllermanager.go:602] Started "attachdetach"
I0903 23:57:35.905556       1 controllermanager.go:573] Starting "podgc"
I0903 23:57:35.906368       1 attach_detach_controller.go:328] Starting attach detach controller
I0903 23:57:35.906387       1 shared_informer.go:255] Waiting for caches to sync for attach detach
I0903 23:57:36.055515       1 controllermanager.go:602] Started "podgc"
... skipping 276 lines ...
I0903 23:57:37.015937       1 shared_informer.go:262] Caches are synced for garbage collector
I0903 23:57:37.015952       1 garbagecollector.go:263] synced garbage collector
I0903 23:57:37.054121       1 shared_informer.go:285] caches populated
I0903 23:57:37.054153       1 shared_informer.go:262] Caches are synced for garbage collector
I0903 23:57:37.054163       1 garbagecollector.go:163] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0903 23:57:38.803726       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-oshnip-control-plane-jqxrs"
W0903 23:57:38.803767       1 actual_state_of_world.go:541] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="capz-oshnip-control-plane-jqxrs" does not exist
I0903 23:57:38.803793       1 topologycache.go:183] Ignoring node capz-oshnip-control-plane-jqxrs because it is not ready: [{MemoryPressure False 2022-09-03 23:57:15 +0000 UTC 2022-09-03 23:57:15 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2022-09-03 23:57:15 +0000 UTC 2022-09-03 23:57:15 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2022-09-03 23:57:15 +0000 UTC 2022-09-03 23:57:15 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready False 2022-09-03 23:57:15 +0000 UTC 2022-09-03 23:57:15 +0000 UTC KubeletNotReady [container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful, container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized, CSINode is not yet initialized]}]
I0903 23:57:38.803882       1 topologycache.go:215] Insufficient node info for topology hints (0 zones, %!s(int64=0) CPU, true)
I0903 23:57:38.803923       1 controller.go:690] Syncing backends for all LB services.
I0903 23:57:38.803937       1 controller.go:728] Running updateLoadBalancerHosts(len(services)==0, workers==1)
I0903 23:57:38.803948       1 controller.go:753] Finished updateLoadBalancerHosts
I0903 23:57:38.803953       1 controller.go:694] Successfully updated 0 out of 0 load balancers to direct traffic to the updated set of nodes
I0903 23:57:38.803961       1 controller.go:686] It took 3.89e-05 seconds to finish syncNodes
... skipping 53 lines ...
I0903 23:57:44.350571       1 controller_utils.go:581] Controller coredns-84994b8c4 created pod coredns-84994b8c4-rmc7x
I0903 23:57:44.352415       1 event.go:294] "Event occurred" object="kube-system/coredns-84994b8c4" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-84994b8c4-rmc7x"
I0903 23:57:44.355513       1 endpointslicemirroring_controller.go:278] syncEndpoints("kube-system/kube-dns")
I0903 23:57:44.355529       1 endpointslicemirroring_controller.go:313] kube-system/kube-dns Service now has selector, cleaning up any mirrored EndpointSlices
I0903 23:57:44.355547       1 endpointslicemirroring_controller.go:275] Finished syncing EndpointSlices for "kube-system/kube-dns" Endpoints. (39.9µs)
I0903 23:57:44.355623       1 deployment_controller.go:585] "Finished syncing deployment" deployment="kube-system/coredns" duration="84.299166ms"
I0903 23:57:44.355644       1 deployment_controller.go:497] "Error syncing deployment" deployment="kube-system/coredns" err="Operation cannot be fulfilled on deployments.apps \"coredns\": the object has been modified; please apply your changes to the latest version and try again"
I0903 23:57:44.355674       1 deployment_controller.go:583] "Started syncing deployment" deployment="kube-system/coredns" startTime="2022-09-03 23:57:44.355660218 +0000 UTC m=+19.490018259"
I0903 23:57:44.356255       1 deployment_util.go:775] Deployment "coredns" timed out (false) [last progress check: 2022-09-03 23:57:44 +0000 UTC - now: 2022-09-03 23:57:44.356246225 +0000 UTC m=+19.490604366]
I0903 23:57:44.367678       1 endpointslice_controller.go:319] Finished syncing service "kube-system/kube-dns" endpoint slices. (119.901µs)
I0903 23:57:44.367721       1 pvc_protection_controller.go:380] "Enqueuing PVCs for Pod" pod="kube-system/coredns-84994b8c4-5zd66" podUID=ce2daa9f-db36-466e-b1a7-9eb1bfc1a950
I0903 23:57:44.367740       1 replica_set.go:394] Pod coredns-84994b8c4-5zd66 created: &v1.Pod{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"coredns-84994b8c4-5zd66", GenerateName:"coredns-84994b8c4-", Namespace:"kube-system", SelfLink:"", UID:"ce2daa9f-db36-466e-b1a7-9eb1bfc1a950", ResourceVersion:"335", Generation:0, CreationTimestamp:time.Date(2022, time.September, 3, 23, 57, 44, 0, time.Local), DeletionTimestamp:<nil>, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-dns", "pod-template-hash":"84994b8c4"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference{v1.OwnerReference{APIVersion:"apps/v1", Kind:"ReplicaSet", Name:"coredns-84994b8c4", UID:"137d6fae-f575-402d-902f-3d8c8248640a", Controller:(*bool)(0xc002119df0), BlockOwnerDeletion:(*bool)(0xc002119df1)}}, Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kube-controller-manager", Operation:"Update", APIVersion:"v1", Time:time.Date(2022, time.September, 3, 23, 57, 44, 0, time.Local), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc00217e1b0), Subresource:""}}}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"config-volume", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(0xc002162dc0), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"kube-api-access-xsvw7", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(0xc0016451e0), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"coredns", Image:"registry.k8s.io/coredns/coredns:v1.9.3", Command:[]string(nil), Args:[]string{"-conf", "/etc/coredns/Corefile"}, WorkingDir:"", Ports:[]v1.ContainerPort{v1.ContainerPort{Name:"dns", HostPort:0, ContainerPort:53, Protocol:"UDP", HostIP:""}, v1.ContainerPort{Name:"dns-tcp", HostPort:0, ContainerPort:53, Protocol:"TCP", HostIP:""}, v1.ContainerPort{Name:"metrics", HostPort:0, ContainerPort:9153, Protocol:"TCP", HostIP:""}}, EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar(nil), Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:178257920, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"170Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:100, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:73400320, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"70Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"config-volume", ReadOnly:true, MountPath:"/etc/coredns", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-xsvw7", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(0xc002162f40), ReadinessProbe:(*v1.Probe)(0xc002162f80), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0xc0021742a0), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0xc002119f40), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"Default", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"coredns", DeprecatedServiceAccount:"coredns", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:false, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0xc00051b810), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(0xc00217e1e0), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"CriticalAddonsOnly", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node-role.kubernetes.io/control-plane", Operator:"", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node.kubernetes.io/not-ready", Operator:"Exists", Value:"", Effect:"NoExecute", TolerationSeconds:(*int64)(0xc002119fb0)}, v1.Toleration{Key:"node.kubernetes.io/unreachable", Operator:"Exists", Value:"", Effect:"NoExecute", TolerationSeconds:(*int64)(0xc002119fd0)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-cluster-critical", Priority:(*int32)(0xc002119fd8), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(0xc002119fdc), PreemptionPolicy:(*v1.PreemptionPolicy)(0xc002170b50), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil), OS:(*v1.PodOS)(nil), HostUsers:(*bool)(nil)}, Status:v1.PodStatus{Phase:"Pending", Conditions:[]v1.PodCondition(nil), Message:"", Reason:"", NominatedNodeName:"", HostIP:"", PodIP:"", PodIPs:[]v1.PodIP(nil), StartTime:<nil>, InitContainerStatuses:[]v1.ContainerStatus(nil), ContainerStatuses:[]v1.ContainerStatus(nil), QOSClass:"Burstable", EphemeralContainerStatuses:[]v1.ContainerStatus(nil)}}.
I0903 23:57:44.367983       1 controller_utils.go:240] Lowered expectations &controller.ControlleeExpectations{add:0, del:0, key:"kube-system/coredns-84994b8c4", timestamp:time.Time{wall:0xc0bd185e1229cb67, ext:19439086976, loc:(*time.Location)(0x6f10040)}}
... skipping 269 lines ...
I0903 23:58:06.122178       1 controller_utils.go:240] Lowered expectations &controller.ControlleeExpectations{add:0, del:0, key:"kube-system/calico-kube-controllers-755ff8d7b5", timestamp:time.Time{wall:0xc0bd1863862ad9f2, ext:41237829743, loc:(*time.Location)(0x6f10040)}}
I0903 23:58:06.121982       1 disruption.go:479] addPod called on pod "calico-kube-controllers-755ff8d7b5-5nstc"
I0903 23:58:06.122494       1 disruption.go:484] addPod "calico-kube-controllers-755ff8d7b5-5nstc" -> PDB "calico-kube-controllers"
I0903 23:58:06.122054       1 taint_manager.go:431] "Noticed pod update" pod="kube-system/calico-kube-controllers-755ff8d7b5-5nstc"
I0903 23:58:06.122070       1 disruption.go:448] add DB "calico-kube-controllers"
I0903 23:58:06.122140       1 deployment_controller.go:585] "Finished syncing deployment" deployment="kube-system/calico-kube-controllers" duration="47.616908ms"
I0903 23:58:06.123042       1 deployment_controller.go:497] "Error syncing deployment" deployment="kube-system/calico-kube-controllers" err="Operation cannot be fulfilled on deployments.apps \"calico-kube-controllers\": the object has been modified; please apply your changes to the latest version and try again"
I0903 23:58:06.123190       1 deployment_controller.go:583] "Started syncing deployment" deployment="kube-system/calico-kube-controllers" startTime="2022-09-03 23:58:06.12317326 +0000 UTC m=+41.257531301"
I0903 23:58:06.123712       1 deployment_util.go:775] Deployment "calico-kube-controllers" timed out (false) [last progress check: 2022-09-03 23:58:06 +0000 UTC - now: 2022-09-03 23:58:06.123705002 +0000 UTC m=+41.258063043]
I0903 23:58:06.121733       1 controller_utils.go:581] Controller calico-kube-controllers-755ff8d7b5 created pod calico-kube-controllers-755ff8d7b5-5nstc
I0903 23:58:06.124506       1 replica_set_utils.go:59] Updating status for : kube-system/calico-kube-controllers-755ff8d7b5, replicas 0->0 (need 1), fullyLabeledReplicas 0->0, readyReplicas 0->0, availableReplicas 0->0, sequence No: 0->1
I0903 23:58:06.125111       1 event.go:294] "Event occurred" object="kube-system/calico-kube-controllers-755ff8d7b5" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: calico-kube-controllers-755ff8d7b5-5nstc"
I0903 23:58:06.139154       1 pvc_protection_controller.go:380] "Enqueuing PVCs for Pod" pod="kube-system/calico-kube-controllers-755ff8d7b5-5nstc" podUID=e2e42e05-3cba-4459-8c0c-62893c0c1352
... skipping 332 lines ...
I0903 23:58:26.069028       1 controller_utils.go:189] Controller expectations fulfilled &controller.ControlleeExpectations{add:0, del:0, key:"kube-system/calico-node", timestamp:time.Time{wall:0xc0bd1868841b529f, ext:61203257628, loc:(*time.Location)(0x6f10040)}}
I0903 23:58:26.069078       1 controller_utils.go:223] Setting expectations &controller.ControlleeExpectations{add:0, del:0, key:"kube-system/calico-node", timestamp:time.Time{wall:0xc0bd1868841dfe5f, ext:61203432568, loc:(*time.Location)(0x6f10040)}}
I0903 23:58:26.069109       1 daemon_controller.go:974] Nodes needing daemon pods for daemon set calico-node: [], creating 0
I0903 23:58:26.069157       1 daemon_controller.go:1036] Pods to delete for daemon set calico-node: [], deleting 0
I0903 23:58:26.069202       1 daemon_controller.go:1119] Updating daemon set status
I0903 23:58:26.069244       1 daemon_controller.go:1179] Finished syncing daemon set "kube-system/calico-node" (2.11615ms)
I0903 23:58:26.566933       1 node_lifecycle_controller.go:1084] ReadyCondition for Node capz-oshnip-control-plane-jqxrs transitioned from &NodeCondition{Type:Ready,Status:False,LastHeartbeatTime:2022-09-03 23:58:15 +0000 UTC,LastTransitionTime:2022-09-03 23:57:15 +0000 UTC,Reason:KubeletNotReady,Message:container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized,} to &NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-09-03 23:58:25 +0000 UTC,LastTransitionTime:2022-09-03 23:58:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,}
I0903 23:58:26.567034       1 node_lifecycle_controller.go:1092] Node capz-oshnip-control-plane-jqxrs ReadyCondition updated. Updating timestamp.
I0903 23:58:26.567061       1 node_lifecycle_controller.go:938] Node capz-oshnip-control-plane-jqxrs is healthy again, removing all taints
I0903 23:58:26.567081       1 node_lifecycle_controller.go:1236] Controller detected that some Nodes are Ready. Exiting master disruption mode.
I0903 23:58:26.765761       1 disruption.go:494] updatePod called on pod "coredns-84994b8c4-rmc7x"
I0903 23:58:26.765911       1 disruption.go:570] No PodDisruptionBudgets found for pod coredns-84994b8c4-rmc7x, PodDisruptionBudget controller will avoid syncing.
I0903 23:58:26.765920       1 disruption.go:497] No matching pdb for pod "coredns-84994b8c4-rmc7x"
... skipping 222 lines ...
I0903 23:59:36.515203       1 reflector.go:281] vendor/k8s.io/client-go/informers/factory.go:134: forcing resync
I0903 23:59:36.561174       1 gc_controller.go:221] GC'ing orphaned
I0903 23:59:36.561231       1 gc_controller.go:290] GC'ing unscheduled pods which are terminating.
I0903 23:59:36.582444       1 pv_controller_base.go:612] resyncing PV controller
I0903 23:59:36.713177       1 resource_quota_controller.go:432] no resource updates from discovery, skipping resource quota sync
I0903 23:59:39.133607       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-oshnip-mp-0000000"
W0903 23:59:39.133661       1 actual_state_of_world.go:541] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="capz-oshnip-mp-0000000" does not exist
I0903 23:59:39.134497       1 controller_utils.go:189] Controller expectations fulfilled &controller.ControlleeExpectations{add:0, del:0, key:"kube-system/kube-proxy", timestamp:time.Time{wall:0xc0bd185fc51bddcc, ext:26220070373, loc:(*time.Location)(0x6f10040)}}
I0903 23:59:39.134911       1 controller_utils.go:223] Setting expectations &controller.ControlleeExpectations{add:1, del:0, key:"kube-system/kube-proxy", timestamp:time.Time{wall:0xc0bd187ac80a7a5c, ext:134269262553, loc:(*time.Location)(0x6f10040)}}
I0903 23:59:39.134939       1 daemon_controller.go:974] Nodes needing daemon pods for daemon set kube-proxy: [capz-oshnip-mp-0000000], creating 1
I0903 23:59:39.136090       1 controller_utils.go:189] Controller expectations fulfilled &controller.ControlleeExpectations{add:0, del:0, key:"kube-system/calico-node", timestamp:time.Time{wall:0xc0bd1868e53f3178, ext:62759256565, loc:(*time.Location)(0x6f10040)}}
I0903 23:59:39.137724       1 topologycache.go:179] Ignoring node capz-oshnip-control-plane-jqxrs because it has an excluded label
I0903 23:59:39.137750       1 topologycache.go:183] Ignoring node capz-oshnip-mp-0000000 because it is not ready: [{MemoryPressure False 2022-09-03 23:59:38 +0000 UTC 2022-09-03 23:59:38 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2022-09-03 23:59:38 +0000 UTC 2022-09-03 23:59:38 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2022-09-03 23:59:38 +0000 UTC 2022-09-03 23:59:38 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready False 2022-09-03 23:59:38 +0000 UTC 2022-09-03 23:59:38 +0000 UTC KubeletNotReady [container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized, failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "capz-oshnip-mp-0000000" not found]}]
I0903 23:59:39.137812       1 topologycache.go:215] Insufficient node info for topology hints (0 zones, %!s(int64=0) CPU, true)
I0903 23:59:39.137838       1 controller.go:690] Syncing backends for all LB services.
I0903 23:59:39.137849       1 controller.go:728] Running updateLoadBalancerHosts(len(services)==0, workers==1)
I0903 23:59:39.137862       1 controller.go:753] Finished updateLoadBalancerHosts
I0903 23:59:39.137871       1 controller.go:694] Successfully updated 0 out of 0 load balancers to direct traffic to the updated set of nodes
I0903 23:59:39.137882       1 controller.go:686] It took 4.3e-05 seconds to finish syncNodes
... skipping 69 lines ...
I0903 23:59:39.193069       1 daemon_controller.go:1119] Updating daemon set status
I0903 23:59:39.193267       1 daemon_controller.go:1179] Finished syncing daemon set "kube-system/calico-node" (2.851532ms)
I0903 23:59:39.464246       1 controller_utils.go:189] Controller expectations fulfilled &controller.ControlleeExpectations{add:0, del:0, key:"kube-system/calico-node", timestamp:time.Time{wall:0xc0bd187acb791024, ext:134326841505, loc:(*time.Location)(0x6f10040)}}
I0903 23:59:39.466523       1 controller_utils.go:223] Setting expectations &controller.ControlleeExpectations{add:1, del:0, key:"kube-system/calico-node", timestamp:time.Time{wall:0xc0bd187adbce8933, ext:134600878512, loc:(*time.Location)(0x6f10040)}}
I0903 23:59:39.466546       1 daemon_controller.go:974] Nodes needing daemon pods for daemon set calico-node: [capz-oshnip-mp-0000001], creating 1
I0903 23:59:39.465414       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-oshnip-mp-0000001"
W0903 23:59:39.466638       1 actual_state_of_world.go:541] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="capz-oshnip-mp-0000001" does not exist
I0903 23:59:39.466110       1 topologycache.go:183] Ignoring node capz-oshnip-mp-0000000 because it is not ready: [{MemoryPressure False 2022-09-03 23:59:39 +0000 UTC 2022-09-03 23:59:38 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2022-09-03 23:59:39 +0000 UTC 2022-09-03 23:59:38 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2022-09-03 23:59:39 +0000 UTC 2022-09-03 23:59:38 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready False 2022-09-03 23:59:39 +0000 UTC 2022-09-03 23:59:38 +0000 UTC KubeletNotReady [container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized, failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "capz-oshnip-mp-0000000" not found]}]
I0903 23:59:39.466714       1 topologycache.go:183] Ignoring node capz-oshnip-mp-0000001 because it is not ready: [{MemoryPressure False 2022-09-03 23:59:39 +0000 UTC 2022-09-03 23:59:39 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2022-09-03 23:59:39 +0000 UTC 2022-09-03 23:59:39 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2022-09-03 23:59:39 +0000 UTC 2022-09-03 23:59:39 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready False 2022-09-03 23:59:39 +0000 UTC 2022-09-03 23:59:39 +0000 UTC KubeletNotReady [container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized, failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "capz-oshnip-mp-0000001" not found]}]
I0903 23:59:39.466750       1 topologycache.go:179] Ignoring node capz-oshnip-control-plane-jqxrs because it has an excluded label
I0903 23:59:39.466758       1 topologycache.go:215] Insufficient node info for topology hints (0 zones, %!s(int64=0) CPU, true)
I0903 23:59:39.466139       1 controller.go:690] Syncing backends for all LB services.
I0903 23:59:39.466794       1 controller.go:728] Running updateLoadBalancerHosts(len(services)==0, workers==1)
I0903 23:59:39.466808       1 controller.go:753] Finished updateLoadBalancerHosts
I0903 23:59:39.466820       1 controller.go:694] Successfully updated 0 out of 0 load balancers to direct traffic to the updated set of nodes
... skipping 386 lines ...
I0904 00:00:09.462533       1 daemon_controller.go:974] Nodes needing daemon pods for daemon set calico-node: [], creating 0
I0904 00:00:09.462702       1 daemon_controller.go:1036] Pods to delete for daemon set calico-node: [], deleting 0
I0904 00:00:09.462840       1 daemon_controller.go:1119] Updating daemon set status
I0904 00:00:09.463032       1 daemon_controller.go:1179] Finished syncing daemon set "kube-system/calico-node" (5.47736ms)
I0904 00:00:09.484569       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-oshnip-mp-0000000"
I0904 00:00:09.849129       1 topologycache.go:179] Ignoring node capz-oshnip-control-plane-jqxrs because it has an excluded label
I0904 00:00:09.849776       1 topologycache.go:183] Ignoring node capz-oshnip-mp-0000000 because it is not ready: [{NetworkUnavailable False 2022-09-04 00:00:09 +0000 UTC 2022-09-04 00:00:09 +0000 UTC CalicoIsUp Calico is running on this node} {MemoryPressure False 2022-09-03 23:59:59 +0000 UTC 2022-09-03 23:59:38 +0000 UTC KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2022-09-03 23:59:59 +0000 UTC 2022-09-03 23:59:38 +0000 UTC KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2022-09-03 23:59:59 +0000 UTC 2022-09-03 23:59:38 +0000 UTC KubeletHasSufficientPID kubelet has sufficient PID available} {Ready False 2022-09-03 23:59:59 +0000 UTC 2022-09-03 23:59:38 +0000 UTC KubeletNotReady container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized}]
I0904 00:00:09.849928       1 topologycache.go:215] Insufficient node info for topology hints (1 zones, %!s(int64=2000) CPU, true)
I0904 00:00:09.849400       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-oshnip-mp-0000001"
I0904 00:00:09.849443       1 controller.go:690] Syncing backends for all LB services.
I0904 00:00:09.850156       1 controller.go:728] Running updateLoadBalancerHosts(len(services)==0, workers==1)
I0904 00:00:09.850193       1 controller.go:753] Finished updateLoadBalancerHosts
I0904 00:00:09.850262       1 controller.go:694] Successfully updated 0 out of 0 load balancers to direct traffic to the updated set of nodes
... skipping 8 lines ...
I0904 00:00:10.021959       1 controller.go:694] Successfully updated 0 out of 0 load balancers to direct traffic to the updated set of nodes
I0904 00:00:10.021986       1 controller.go:686] It took 0.000222702 seconds to finish syncNodes
I0904 00:00:10.022102       1 controller_utils.go:205] "Added taint to node" taint=[] node="capz-oshnip-mp-0000000"
I0904 00:00:10.022293       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-oshnip-mp-0000000"
I0904 00:00:10.043421       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-oshnip-mp-0000000"
I0904 00:00:10.044710       1 controller_utils.go:217] "Made sure that node has no taint" node="capz-oshnip-mp-0000000" taint=[&Taint{Key:node.kubernetes.io/not-ready,Value:,Effect:NoSchedule,TimeAdded:<nil>,}]
I0904 00:00:11.581586       1 node_lifecycle_controller.go:1084] ReadyCondition for Node capz-oshnip-mp-0000000 transitioned from &NodeCondition{Type:Ready,Status:False,LastHeartbeatTime:2022-09-03 23:59:59 +0000 UTC,LastTransitionTime:2022-09-03 23:59:38 +0000 UTC,Reason:KubeletNotReady,Message:container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized,} to &NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-09-04 00:00:10 +0000 UTC,LastTransitionTime:2022-09-04 00:00:10 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,}
I0904 00:00:11.581674       1 node_lifecycle_controller.go:1092] Node capz-oshnip-mp-0000000 ReadyCondition updated. Updating timestamp.
I0904 00:00:11.590305       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-oshnip-mp-0000000"
I0904 00:00:11.590398       1 taint_manager.go:466] "Noticed node update" node={nodeName:capz-oshnip-mp-0000000}
I0904 00:00:11.591398       1 taint_manager.go:471] "Updating known taints on node" node="capz-oshnip-mp-0000000" taints=[]
I0904 00:00:11.591429       1 taint_manager.go:492] "All taints were removed from the node. Cancelling all evictions..." node="capz-oshnip-mp-0000000"
I0904 00:00:11.591115       1 node_lifecycle_controller.go:938] Node capz-oshnip-mp-0000000 is healthy again, removing all taints
I0904 00:00:11.591539       1 node_lifecycle_controller.go:1084] ReadyCondition for Node capz-oshnip-mp-0000001 transitioned from &NodeCondition{Type:Ready,Status:False,LastHeartbeatTime:2022-09-03 23:59:59 +0000 UTC,LastTransitionTime:2022-09-03 23:59:39 +0000 UTC,Reason:KubeletNotReady,Message:container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized,} to &NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-09-04 00:00:09 +0000 UTC,LastTransitionTime:2022-09-04 00:00:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,}
I0904 00:00:11.591685       1 node_lifecycle_controller.go:1092] Node capz-oshnip-mp-0000001 ReadyCondition updated. Updating timestamp.
I0904 00:00:11.603051       1 node_lifecycle_controller.go:938] Node capz-oshnip-mp-0000001 is healthy again, removing all taints
I0904 00:00:11.603222       1 node_lifecycle_controller.go:1259] Controller detected that zone eastus::0 is now in state Normal.
I0904 00:00:11.603243       1 node_lifecycle_controller.go:1259] Controller detected that zone eastus::1 is now in state Normal.
I0904 00:00:11.604832       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-oshnip-mp-0000001"
I0904 00:00:11.605059       1 taint_manager.go:466] "Noticed node update" node={nodeName:capz-oshnip-mp-0000001}
... skipping 213 lines ...
I0904 00:00:14.678802       1 event.go:294] "Event occurred" object="kube-system/csi-azuredisk-controller" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set csi-azuredisk-controller-6dbf65647f to 2"
I0904 00:00:14.689395       1 deployment_controller.go:183] "Updating deployment" deployment="kube-system/csi-azuredisk-controller"
I0904 00:00:14.689643       1 deployment_util.go:775] Deployment "csi-azuredisk-controller" timed out (false) [last progress check: 2022-09-04 00:00:14.678560636 +0000 UTC m=+169.812918677 - now: 2022-09-04 00:00:14.689634267 +0000 UTC m=+169.823992308]
I0904 00:00:14.691053       1 controller_utils.go:581] Controller csi-azuredisk-controller-6dbf65647f created pod csi-azuredisk-controller-6dbf65647f-vqzd2
I0904 00:00:14.691472       1 event.go:294] "Event occurred" object="kube-system/csi-azuredisk-controller-6dbf65647f" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: csi-azuredisk-controller-6dbf65647f-vqzd2"
I0904 00:00:14.692033       1 pvc_protection_controller.go:380] "Enqueuing PVCs for Pod" pod="kube-system/csi-azuredisk-controller-6dbf65647f-vqzd2" podUID=506ad2e7-797c-4488-bc90-60b0aa6b0fe5
I0904 00:00:14.692076       1 replica_set.go:394] Pod csi-azuredisk-controller-6dbf65647f-vqzd2 created: &v1.Pod{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"csi-azuredisk-controller-6dbf65647f-vqzd2", GenerateName:"csi-azuredisk-controller-6dbf65647f-", Namespace:"kube-system", SelfLink:"", UID:"506ad2e7-797c-4488-bc90-60b0aa6b0fe5", ResourceVersion:"932", Generation:0, CreationTimestamp:time.Date(2022, time.September, 4, 0, 0, 14, 0, time.Local), DeletionTimestamp:<nil>, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"csi-azuredisk-controller", "pod-template-hash":"6dbf65647f"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference{v1.OwnerReference{APIVersion:"apps/v1", Kind:"ReplicaSet", Name:"csi-azuredisk-controller-6dbf65647f", UID:"c695a72c-eac0-4590-882c-d8f115156587", Controller:(*bool)(0xc0028b4a97), BlockOwnerDeletion:(*bool)(0xc0028b4a98)}}, Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kube-controller-manager", Operation:"Update", APIVersion:"v1", Time:time.Date(2022, time.September, 4, 0, 0, 14, 0, time.Local), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc00264e7e0), Subresource:""}}}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"socket-dir", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(0xc00264e7f8), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"azure-cred", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc00264e810), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"kube-api-access-4x9x6", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(0xc00168eee0), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"csi-provisioner", Image:"mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v3.2.0", Command:[]string(nil), Args:[]string{"--feature-gates=Topology=true", "--csi-address=$(ADDRESS)", "--v=2", "--timeout=15s", "--leader-election", "--leader-election-namespace=kube-system", "--worker-threads=40", "--extra-create-metadata=true", "--strict-topology=true"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"ADDRESS", Value:"/csi/csi.sock", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:524288000, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"500Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-4x9x6", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}, v1.Container{Name:"csi-attacher", Image:"mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v3.5.0", Command:[]string(nil), Args:[]string{"-v=2", "-csi-address=$(ADDRESS)", "-timeout=600s", "-leader-election", "--leader-election-namespace=kube-system", "-worker-threads=500"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"ADDRESS", Value:"/csi/csi.sock", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:524288000, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"500Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-4x9x6", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}, v1.Container{Name:"csi-snapshotter", Image:"mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v5.0.1", Command:[]string(nil), Args:[]string{"-csi-address=$(ADDRESS)", "-leader-election", "--leader-election-namespace=kube-system", "--v=2"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"ADDRESS", Value:"/csi/csi.sock", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:104857600, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-4x9x6", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}, v1.Container{Name:"csi-resizer", Image:"mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.5.0", Command:[]string(nil), Args:[]string{"-csi-address=$(ADDRESS)", "-v=2", "-leader-election", "--leader-election-namespace=kube-system", "-handle-volume-inuse-error=false", "-feature-gates=RecoverVolumeExpansionFailure=true", "-timeout=240s"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"ADDRESS", Value:"/csi/csi.sock", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:524288000, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"500Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-4x9x6", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}, v1.Container{Name:"liveness-probe", Image:"mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.7.0", Command:[]string(nil), Args:[]string{"--csi-address=/csi/csi.sock", "--probe-timeout=3s", "--health-port=29602", "--v=2"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar(nil), Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:104857600, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-4x9x6", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}, v1.Container{Name:"azuredisk", Image:"mcr.microsoft.com/k8s/csi/azuredisk-csi:latest", Command:[]string(nil), Args:[]string{"--v=5", "--endpoint=$(CSI_ENDPOINT)", "--metrics-address=0.0.0.0:29604", "--user-agent-suffix=OSS-kubectl", "--disable-avset-nodes=false", "--allow-empty-cloud-config=false"}, WorkingDir:"", Ports:[]v1.ContainerPort{v1.ContainerPort{Name:"healthz", HostPort:29602, ContainerPort:29602, Protocol:"TCP", HostIP:""}, v1.ContainerPort{Name:"metrics", HostPort:29604, ContainerPort:29604, Protocol:"TCP", HostIP:""}}, EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"AZURE_CREDENTIAL_FILE", Value:"", ValueFrom:(*v1.EnvVarSource)(0xc00168f000)}, v1.EnvVar{Name:"CSI_ENDPOINT", Value:"unix:///csi/csi.sock", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:524288000, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"500Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"azure-cred", ReadOnly:false, MountPath:"/etc/kubernetes/", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-4x9x6", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(0xc002ad7240), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0xc0028b4e70), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"csi-azuredisk-controller-sa", DeprecatedServiceAccount:"csi-azuredisk-controller-sa", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0xc000140460), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"node-role.kubernetes.io/master", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node-role.kubernetes.io/controlplane", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node-role.kubernetes.io/control-plane", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node.kubernetes.io/not-ready", Operator:"Exists", Value:"", Effect:"NoExecute", TolerationSeconds:(*int64)(0xc0028b4ee0)}, v1.Toleration{Key:"node.kubernetes.io/unreachable", Operator:"Exists", Value:"", Effect:"NoExecute", TolerationSeconds:(*int64)(0xc0028b4f00)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-cluster-critical", Priority:(*int32)(0xc0028b4f08), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(0xc0028b4f0c), PreemptionPolicy:(*v1.PreemptionPolicy)(0xc002a38f60), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil), OS:(*v1.PodOS)(nil), HostUsers:(*bool)(nil)}, Status:v1.PodStatus{Phase:"Pending", Conditions:[]v1.PodCondition(nil), Message:"", Reason:"", NominatedNodeName:"", HostIP:"", PodIP:"", PodIPs:[]v1.PodIP(nil), StartTime:<nil>, InitContainerStatuses:[]v1.ContainerStatus(nil), ContainerStatuses:[]v1.ContainerStatus(nil), QOSClass:"Burstable", EphemeralContainerStatuses:[]v1.ContainerStatus(nil)}}.
I0904 00:00:14.692689       1 controller_utils.go:240] Lowered expectations &controller.ControlleeExpectations{add:1, del:0, key:"kube-system/csi-azuredisk-controller-6dbf65647f", timestamp:time.Time{wall:0xc0bd1883a85aaf8a, ext:169811389959, loc:(*time.Location)(0x6f10040)}}
I0904 00:00:14.692729       1 disruption.go:479] addPod called on pod "csi-azuredisk-controller-6dbf65647f-vqzd2"
I0904 00:00:14.692757       1 disruption.go:570] No PodDisruptionBudgets found for pod csi-azuredisk-controller-6dbf65647f-vqzd2, PodDisruptionBudget controller will avoid syncing.
I0904 00:00:14.692763       1 disruption.go:482] No matching pdb for pod "csi-azuredisk-controller-6dbf65647f-vqzd2"
I0904 00:00:14.692848       1 taint_manager.go:431] "Noticed pod update" pod="kube-system/csi-azuredisk-controller-6dbf65647f-vqzd2"
I0904 00:00:14.702680       1 controller_utils.go:581] Controller csi-azuredisk-controller-6dbf65647f created pod csi-azuredisk-controller-6dbf65647f-f4m9x
I0904 00:00:14.703039       1 replica_set_utils.go:59] Updating status for : kube-system/csi-azuredisk-controller-6dbf65647f, replicas 0->0 (need 2), fullyLabeledReplicas 0->0, readyReplicas 0->0, availableReplicas 0->0, sequence No: 0->1
I0904 00:00:14.703439       1 event.go:294] "Event occurred" object="kube-system/csi-azuredisk-controller-6dbf65647f" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: csi-azuredisk-controller-6dbf65647f-f4m9x"
I0904 00:00:14.705513       1 pvc_protection_controller.go:380] "Enqueuing PVCs for Pod" pod="kube-system/csi-azuredisk-controller-6dbf65647f-f4m9x" podUID=78d5c242-2e7c-4a2a-87c5-36f5abe91358
I0904 00:00:14.705869       1 disruption.go:479] addPod called on pod "csi-azuredisk-controller-6dbf65647f-f4m9x"
I0904 00:00:14.706105       1 disruption.go:570] No PodDisruptionBudgets found for pod csi-azuredisk-controller-6dbf65647f-f4m9x, PodDisruptionBudget controller will avoid syncing.
I0904 00:00:14.706157       1 disruption.go:482] No matching pdb for pod "csi-azuredisk-controller-6dbf65647f-f4m9x"
I0904 00:00:14.706269       1 taint_manager.go:431] "Noticed pod update" pod="kube-system/csi-azuredisk-controller-6dbf65647f-f4m9x"
I0904 00:00:14.705634       1 replica_set.go:394] Pod csi-azuredisk-controller-6dbf65647f-f4m9x created: &v1.Pod{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"csi-azuredisk-controller-6dbf65647f-f4m9x", GenerateName:"csi-azuredisk-controller-6dbf65647f-", Namespace:"kube-system", SelfLink:"", UID:"78d5c242-2e7c-4a2a-87c5-36f5abe91358", ResourceVersion:"933", Generation:0, CreationTimestamp:time.Date(2022, time.September, 4, 0, 0, 14, 0, time.Local), DeletionTimestamp:<nil>, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"csi-azuredisk-controller", "pod-template-hash":"6dbf65647f"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference{v1.OwnerReference{APIVersion:"apps/v1", Kind:"ReplicaSet", Name:"csi-azuredisk-controller-6dbf65647f", UID:"c695a72c-eac0-4590-882c-d8f115156587", Controller:(*bool)(0xc002903077), BlockOwnerDeletion:(*bool)(0xc002903078)}}, Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kube-controller-manager", Operation:"Update", APIVersion:"v1", Time:time.Date(2022, time.September, 4, 0, 0, 14, 0, time.Local), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc002531620), Subresource:""}}}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"socket-dir", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(0xc002531638), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"azure-cred", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc002531650), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"kube-api-access-5jpzk", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(0xc001807620), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"csi-provisioner", Image:"mcr.microsoft.com/oss/kubernetes-csi/csi-provisioner:v3.2.0", Command:[]string(nil), Args:[]string{"--feature-gates=Topology=true", "--csi-address=$(ADDRESS)", "--v=2", "--timeout=15s", "--leader-election", "--leader-election-namespace=kube-system", "--worker-threads=40", "--extra-create-metadata=true", "--strict-topology=true"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"ADDRESS", Value:"/csi/csi.sock", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:524288000, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"500Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-5jpzk", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}, v1.Container{Name:"csi-attacher", Image:"mcr.microsoft.com/oss/kubernetes-csi/csi-attacher:v3.5.0", Command:[]string(nil), Args:[]string{"-v=2", "-csi-address=$(ADDRESS)", "-timeout=600s", "-leader-election", "--leader-election-namespace=kube-system", "-worker-threads=500"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"ADDRESS", Value:"/csi/csi.sock", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:524288000, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"500Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-5jpzk", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}, v1.Container{Name:"csi-snapshotter", Image:"mcr.microsoft.com/oss/kubernetes-csi/csi-snapshotter:v5.0.1", Command:[]string(nil), Args:[]string{"-csi-address=$(ADDRESS)", "-leader-election", "--leader-election-namespace=kube-system", "--v=2"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"ADDRESS", Value:"/csi/csi.sock", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:104857600, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-5jpzk", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}, v1.Container{Name:"csi-resizer", Image:"mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.5.0", Command:[]string(nil), Args:[]string{"-csi-address=$(ADDRESS)", "-v=2", "-leader-election", "--leader-election-namespace=kube-system", "-handle-volume-inuse-error=false", "-feature-gates=RecoverVolumeExpansionFailure=true", "-timeout=240s"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"ADDRESS", Value:"/csi/csi.sock", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:524288000, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"500Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-5jpzk", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}, v1.Container{Name:"liveness-probe", Image:"mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.7.0", Command:[]string(nil), Args:[]string{"--csi-address=/csi/csi.sock", "--probe-timeout=3s", "--health-port=29602", "--v=2"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar(nil), Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:104857600, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-5jpzk", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}, v1.Container{Name:"azuredisk", Image:"mcr.microsoft.com/k8s/csi/azuredisk-csi:latest", Command:[]string(nil), Args:[]string{"--v=5", "--endpoint=$(CSI_ENDPOINT)", "--metrics-address=0.0.0.0:29604", "--user-agent-suffix=OSS-kubectl", "--disable-avset-nodes=false", "--allow-empty-cloud-config=false"}, WorkingDir:"", Ports:[]v1.ContainerPort{v1.ContainerPort{Name:"healthz", HostPort:29602, ContainerPort:29602, Protocol:"TCP", HostIP:""}, v1.ContainerPort{Name:"metrics", HostPort:29604, ContainerPort:29604, Protocol:"TCP", HostIP:""}}, EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"AZURE_CREDENTIAL_FILE", Value:"", ValueFrom:(*v1.EnvVarSource)(0xc001807740)}, v1.EnvVar{Name:"CSI_ENDPOINT", Value:"unix:///csi/csi.sock", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:524288000, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"500Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"socket-dir", ReadOnly:false, MountPath:"/csi", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"azure-cred", ReadOnly:false, MountPath:"/etc/kubernetes/", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-5jpzk", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(0xc002bab900), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0xc002903450), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"csi-azuredisk-controller-sa", DeprecatedServiceAccount:"csi-azuredisk-controller-sa", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0xc000547ea0), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"node-role.kubernetes.io/master", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node-role.kubernetes.io/controlplane", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node-role.kubernetes.io/control-plane", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node.kubernetes.io/not-ready", Operator:"Exists", Value:"", Effect:"NoExecute", TolerationSeconds:(*int64)(0xc0029034c0)}, v1.Toleration{Key:"node.kubernetes.io/unreachable", Operator:"Exists", Value:"", Effect:"NoExecute", TolerationSeconds:(*int64)(0xc0029034e0)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-cluster-critical", Priority:(*int32)(0xc0029034e8), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(0xc0029034ec), PreemptionPolicy:(*v1.PreemptionPolicy)(0xc002b8ad10), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil), OS:(*v1.PodOS)(nil), HostUsers:(*bool)(nil)}, Status:v1.PodStatus{Phase:"Pending", Conditions:[]v1.PodCondition(nil), Message:"", Reason:"", NominatedNodeName:"", HostIP:"", PodIP:"", PodIPs:[]v1.PodIP(nil), StartTime:<nil>, InitContainerStatuses:[]v1.ContainerStatus(nil), ContainerStatuses:[]v1.ContainerStatus(nil), QOSClass:"Burstable", EphemeralContainerStatuses:[]v1.ContainerStatus(nil)}}.
I0904 00:00:14.707152       1 controller_utils.go:240] Lowered expectations &controller.ControlleeExpectations{add:0, del:0, key:"kube-system/csi-azuredisk-controller-6dbf65647f", timestamp:time.Time{wall:0xc0bd1883a85aaf8a, ext:169811389959, loc:(*time.Location)(0x6f10040)}}
I0904 00:00:14.710721       1 deployment_controller.go:585] "Finished syncing deployment" deployment="kube-system/csi-azuredisk-controller" duration="46.310346ms"
I0904 00:00:14.710864       1 deployment_controller.go:497] "Error syncing deployment" deployment="kube-system/csi-azuredisk-controller" err="Operation cannot be fulfilled on deployments.apps \"csi-azuredisk-controller\": the object has been modified; please apply your changes to the latest version and try again"
I0904 00:00:14.710995       1 deployment_controller.go:583] "Started syncing deployment" deployment="kube-system/csi-azuredisk-controller" startTime="2022-09-04 00:00:14.710944318 +0000 UTC m=+169.845302459"
I0904 00:00:14.712717       1 deployment_util.go:775] Deployment "csi-azuredisk-controller" timed out (false) [last progress check: 2022-09-04 00:00:14 +0000 UTC - now: 2022-09-04 00:00:14.712708639 +0000 UTC m=+169.847066680]
I0904 00:00:14.723243       1 replica_set.go:457] Pod csi-azuredisk-controller-6dbf65647f-vqzd2 updated, objectMeta {Name:csi-azuredisk-controller-6dbf65647f-vqzd2 GenerateName:csi-azuredisk-controller-6dbf65647f- Namespace:kube-system SelfLink: UID:506ad2e7-797c-4488-bc90-60b0aa6b0fe5 ResourceVersion:932 Generation:0 CreationTimestamp:2022-09-04 00:00:14 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[app:csi-azuredisk-controller pod-template-hash:6dbf65647f] Annotations:map[] OwnerReferences:[{APIVersion:apps/v1 Kind:ReplicaSet Name:csi-azuredisk-controller-6dbf65647f UID:c695a72c-eac0-4590-882c-d8f115156587 Controller:0xc0028b4a97 BlockOwnerDeletion:0xc0028b4a98}] Finalizers:[] ManagedFields:[{Manager:kube-controller-manager Operation:Update APIVersion:v1 Time:2022-09-04 00:00:14 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"c695a72c-eac0-4590-882c-d8f115156587\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"azuredisk\"}":{".":{},"f:args":{},"f:env":{".":{},"k:{\"name\":\"AZURE_CREDENTIAL_FILE\"}":{".":{},"f:name":{},"f:valueFrom":{".":{},"f:configMapKeyRef":{}}},"k:{\"name\":\"CSI_ENDPOINT\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:livenessProbe":{".":{},"f:failureThreshold":{},"f:httpGet":{".":{},"f:path":{},"f:port":{},"f:scheme":{}},"f:initialDelaySeconds":{},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:name":{},"f:ports":{".":{},"k:{\"containerPort\":29602,\"protocol\":\"TCP\"}":{".":{},"f:containerPort":{},"f:hostPort":{},"f:name":{},"f:protocol":{}},"k:{\"containerPort\":29604,\"protocol\":\"TCP\"}":{".":{},"f:containerPort":{},"f:hostPort":{},"f:name":{},"f:protocol":{}}},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}},"k:{\"mountPath\":\"/etc/kubernetes/\"}":{".":{},"f:mountPath":{},"f:name":{}}}},"k:{\"name\":\"csi-attacher\"}":{".":{},"f:args":{},"f:env":{".":{},"k:{\"name\":\"ADDRESS\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}}}},"k:{\"name\":\"csi-provisioner\"}":{".":{},"f:args":{},"f:env":{".":{},"k:{\"name\":\"ADDRESS\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}}}},"k:{\"name\":\"csi-resizer\"}":{".":{},"f:args":{},"f:env":{".":{},"k:{\"name\":\"ADDRESS\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}}}},"k:{\"name\":\"csi-snapshotter\"}":{".":{},"f:args":{},"f:env":{".":{},"k:{\"name\":\"ADDRESS\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}}}},"k:{\"name\":\"liveness-probe\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:hostNetwork":{},"f:nodeSelector":{},"f:priorityClassName":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:serviceAccount":{},"f:serviceAccountName":{},"f:terminationGracePeriodSeconds":{},"f:tolerations":{},"f:volumes":{".":{},"k:{\"name\":\"azure-cred\"}":{".":{},"f:hostPath":{".":{},"f:path":{},"f:type":{}},"f:name":{}},"k:{\"name\":\"socket-dir\"}":{".":{},"f:emptyDir":{},"f:name":{}}}}} Subresource:}]} -> {Name:csi-azuredisk-controller-6dbf65647f-vqzd2 GenerateName:csi-azuredisk-controller-6dbf65647f- Namespace:kube-system SelfLink: UID:506ad2e7-797c-4488-bc90-60b0aa6b0fe5 ResourceVersion:935 Generation:0 CreationTimestamp:2022-09-04 00:00:14 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[app:csi-azuredisk-controller pod-template-hash:6dbf65647f] Annotations:map[] OwnerReferences:[{APIVersion:apps/v1 Kind:ReplicaSet Name:csi-azuredisk-controller-6dbf65647f UID:c695a72c-eac0-4590-882c-d8f115156587 Controller:0xc002d211f7 BlockOwnerDeletion:0xc002d211f8}] Finalizers:[] ManagedFields:[{Manager:kube-controller-manager Operation:Update APIVersion:v1 Time:2022-09-04 00:00:14 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"c695a72c-eac0-4590-882c-d8f115156587\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"azuredisk\"}":{".":{},"f:args":{},"f:env":{".":{},"k:{\"name\":\"AZURE_CREDENTIAL_FILE\"}":{".":{},"f:name":{},"f:valueFrom":{".":{},"f:configMapKeyRef":{}}},"k:{\"name\":\"CSI_ENDPOINT\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:livenessProbe":{".":{},"f:failureThreshold":{},"f:httpGet":{".":{},"f:path":{},"f:port":{},"f:scheme":{}},"f:initialDelaySeconds":{},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:name":{},"f:ports":{".":{},"k:{\"containerPort\":29602,\"protocol\":\"TCP\"}":{".":{},"f:containerPort":{},"f:hostPort":{},"f:name":{},"f:protocol":{}},"k:{\"containerPort\":29604,\"protocol\":\"TCP\"}":{".":{},"f:containerPort":{},"f:hostPort":{},"f:name":{},"f:protocol":{}}},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}},"k:{\"mountPath\":\"/etc/kubernetes/\"}":{".":{},"f:mountPath":{},"f:name":{}}}},"k:{\"name\":\"csi-attacher\"}":{".":{},"f:args":{},"f:env":{".":{},"k:{\"name\":\"ADDRESS\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}}}},"k:{\"name\":\"csi-provisioner\"}":{".":{},"f:args":{},"f:env":{".":{},"k:{\"name\":\"ADDRESS\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}}}},"k:{\"name\":\"csi-resizer\"}":{".":{},"f:args":{},"f:env":{".":{},"k:{\"name\":\"ADDRESS\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}}}},"k:{\"name\":\"csi-snapshotter\"}":{".":{},"f:args":{},"f:env":{".":{},"k:{\"name\":\"ADDRESS\"}":{".":{},"f:name":{},"f:value":{}}},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}}}},"k:{\"name\":\"liveness-probe\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{".":{},"f:limits":{".":{},"f:memory":{}},"f:requests":{".":{},"f:cpu":{},"f:memory":{}}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/csi\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:hostNetwork":{},"f:nodeSelector":{},"f:priorityClassName":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:serviceAccount":{},"f:serviceAccountName":{},"f:terminationGracePeriodSeconds":{},"f:tolerations":{},"f:volumes":{".":{},"k:{\"name\":\"azure-cred\"}":{".":{},"f:hostPath":{".":{},"f:path":{},"f:type":{}},"f:name":{}},"k:{\"name\":\"socket-dir\"}":{".":{},"f:emptyDir":{},"f:name":{}}}}} Subresource:}]}.
I0904 00:00:14.723432       1 disruption.go:494] updatePod called on pod "csi-azuredisk-controller-6dbf65647f-vqzd2"
I0904 00:00:14.723467       1 disruption.go:570] No PodDisruptionBudgets found for pod csi-azuredisk-controller-6dbf65647f-vqzd2, PodDisruptionBudget controller will avoid syncing.
I0904 00:00:14.723518       1 disruption.go:497] No matching pdb for pod "csi-azuredisk-controller-6dbf65647f-vqzd2"
... skipping 79 lines ...
I0904 00:00:17.600095       1 disruption.go:570] No PodDisruptionBudgets found for pod csi-snapshot-controller-84ccd6c756-v4g6g, PodDisruptionBudget controller will avoid syncing.
I0904 00:00:17.600102       1 disruption.go:482] No matching pdb for pod "csi-snapshot-controller-84ccd6c756-v4g6g"
I0904 00:00:17.600156       1 taint_manager.go:431] "Noticed pod update" pod="kube-system/csi-snapshot-controller-84ccd6c756-v4g6g"
I0904 00:00:17.599163       1 replica_set.go:394] Pod csi-snapshot-controller-84ccd6c756-v4g6g created: &v1.Pod{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"csi-snapshot-controller-84ccd6c756-v4g6g", GenerateName:"csi-snapshot-controller-84ccd6c756-", Namespace:"kube-system", SelfLink:"", UID:"06fef28b-cfff-47b3-84c5-54214f506e33", ResourceVersion:"988", Generation:0, CreationTimestamp:time.Date(2022, time.September, 4, 0, 0, 17, 0, time.Local), DeletionTimestamp:<nil>, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"csi-snapshot-controller", "pod-template-hash":"84ccd6c756"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference{v1.OwnerReference{APIVersion:"apps/v1", Kind:"ReplicaSet", Name:"csi-snapshot-controller-84ccd6c756", UID:"4c057c03-5036-4158-b0b4-d999ca927980", Controller:(*bool)(0xc0029c9787), BlockOwnerDeletion:(*bool)(0xc0029c9788)}}, Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kube-controller-manager", Operation:"Update", APIVersion:"v1", Time:time.Date(2022, time.September, 4, 0, 0, 17, 0, time.Local), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0025157e8), Subresource:""}}}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"kube-api-access-5ksdc", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(0xc0029fa7c0), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"csi-snapshot-controller", Image:"mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller:v5.0.1", Command:[]string(nil), Args:[]string{"--v=2", "--leader-election=true", "--leader-election-namespace=kube-system"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar(nil), Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:104857600, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-api-access-5ksdc", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0xc0029c9828), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"csi-snapshot-controller-sa", DeprecatedServiceAccount:"csi-snapshot-controller-sa", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:false, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0xc0003a60e0), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"node-role.kubernetes.io/master", Operator:"Equal", Value:"true", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node-role.kubernetes.io/controlplane", Operator:"Equal", Value:"true", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node-role.kubernetes.io/control-plane", Operator:"Equal", Value:"true", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node.kubernetes.io/not-ready", Operator:"Exists", Value:"", Effect:"NoExecute", TolerationSeconds:(*int64)(0xc0029c98b0)}, v1.Toleration{Key:"node.kubernetes.io/unreachable", Operator:"Exists", Value:"", Effect:"NoExecute", TolerationSeconds:(*int64)(0xc0029c98d0)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-cluster-critical", Priority:(*int32)(0xc0029c98d8), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(0xc0029c98dc), PreemptionPolicy:(*v1.PreemptionPolicy)(0xc0017737f0), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil), OS:(*v1.PodOS)(nil), HostUsers:(*bool)(nil)}, Status:v1.PodStatus{Phase:"Pending", Conditions:[]v1.PodCondition(nil), Message:"", Reason:"", NominatedNodeName:"", HostIP:"", PodIP:"", PodIPs:[]v1.PodIP(nil), StartTime:<nil>, InitContainerStatuses:[]v1.ContainerStatus(nil), ContainerStatuses:[]v1.ContainerStatus(nil), QOSClass:"Burstable", EphemeralContainerStatuses:[]v1.ContainerStatus(nil)}}.
I0904 00:00:17.600297       1 controller_utils.go:240] Lowered expectations &controller.ControlleeExpectations{add:1, del:0, key:"kube-system/csi-snapshot-controller-84ccd6c756", timestamp:time.Time{wall:0xc0bd188462d1f946, ext:172718544323, loc:(*time.Location)(0x6f10040)}}
I0904 00:00:17.609766       1 deployment_controller.go:585] "Finished syncing deployment" deployment="kube-system/csi-snapshot-controller" duration="57.541874ms"
I0904 00:00:17.609797       1 deployment_controller.go:497] "Error syncing deployment" deployment="kube-system/csi-snapshot-controller" err="Operation cannot be fulfilled on deployments.apps \"csi-snapshot-controller\": the object has been modified; please apply your changes to the latest version and try again"
I0904 00:00:17.609828       1 deployment_controller.go:583] "Started syncing deployment" deployment="kube-system/csi-snapshot-controller" startTime="2022-09-04 00:00:17.609813582 +0000 UTC m=+172.744171623"
I0904 00:00:17.610241       1 deployment_util.go:775] Deployment "csi-snapshot-controller" timed out (false) [last progress check: 2022-09-04 00:00:17 +0000 UTC - now: 2022-09-04 00:00:17.610233487 +0000 UTC m=+172.744591528]
I0904 00:00:17.610619       1 pvc_protection_controller.go:380] "Enqueuing PVCs for Pod" pod="kube-system/csi-snapshot-controller-84ccd6c756-js8qc" podUID=86589d63-1eda-4752-8fa2-fbba9140de45
I0904 00:00:17.610639       1 replica_set.go:394] Pod csi-snapshot-controller-84ccd6c756-js8qc created: &v1.Pod{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"csi-snapshot-controller-84ccd6c756-js8qc", GenerateName:"csi-snapshot-controller-84ccd6c756-", Namespace:"kube-system", SelfLink:"", UID:"86589d63-1eda-4752-8fa2-fbba9140de45", ResourceVersion:"990", Generation:0, CreationTimestamp:time.Date(2022, time.September, 4, 0, 0, 17, 0, time.Local), DeletionTimestamp:<nil>, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"csi-snapshot-controller", "pod-template-hash":"84ccd6c756"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference{v1.OwnerReference{APIVersion:"apps/v1", Kind:"ReplicaSet", Name:"csi-snapshot-controller-84ccd6c756", UID:"4c057c03-5036-4158-b0b4-d999ca927980", Controller:(*bool)(0xc002a90a27), BlockOwnerDeletion:(*bool)(0xc002a90a28)}}, Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kube-controller-manager", Operation:"Update", APIVersion:"v1", Time:time.Date(2022, time.September, 4, 0, 0, 17, 0, time.Local), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc001891230), Subresource:""}}}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"kube-api-access-lmkbl", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(0xc0027b5440), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"csi-snapshot-controller", Image:"mcr.microsoft.com/oss/kubernetes-csi/snapshot-controller:v5.0.1", Command:[]string(nil), Args:[]string{"--v=2", "--leader-election=true", "--leader-election-namespace=kube-system"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar(nil), Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"memory":resource.Quantity{i:resource.int64Amount{value:104857600, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:10, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"10m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:20971520, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"20Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-api-access-lmkbl", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0xc002a90ac8), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"csi-snapshot-controller-sa", DeprecatedServiceAccount:"csi-snapshot-controller-sa", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:false, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0xc0003e8c40), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"node-role.kubernetes.io/master", Operator:"Equal", Value:"true", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node-role.kubernetes.io/controlplane", Operator:"Equal", Value:"true", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node-role.kubernetes.io/control-plane", Operator:"Equal", Value:"true", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"node.kubernetes.io/not-ready", Operator:"Exists", Value:"", Effect:"NoExecute", TolerationSeconds:(*int64)(0xc002a90b50)}, v1.Toleration{Key:"node.kubernetes.io/unreachable", Operator:"Exists", Value:"", Effect:"NoExecute", TolerationSeconds:(*int64)(0xc002a90b70)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-cluster-critical", Priority:(*int32)(0xc002a90b78), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(0xc002a90b7c), PreemptionPolicy:(*v1.PreemptionPolicy)(0xc0017f7d00), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil), OS:(*v1.PodOS)(nil), HostUsers:(*bool)(nil)}, Status:v1.PodStatus{Phase:"Pending", Conditions:[]v1.PodCondition(nil), Message:"", Reason:"", NominatedNodeName:"", HostIP:"", PodIP:"", PodIPs:[]v1.PodIP(nil), StartTime:<nil>, InitContainerStatuses:[]v1.ContainerStatus(nil), ContainerStatuses:[]v1.ContainerStatus(nil), QOSClass:"Burstable", EphemeralContainerStatuses:[]v1.ContainerStatus(nil)}}.
I0904 00:00:17.610877       1 controller_utils.go:240] Lowered expectations &controller.ControlleeExpectations{add:0, del:0, key:"kube-system/csi-snapshot-controller-84ccd6c756", timestamp:time.Time{wall:0xc0bd188462d1f946, ext:172718544323, loc:(*time.Location)(0x6f10040)}}
I0904 00:00:17.610900       1 disruption.go:479] addPod called on pod "csi-snapshot-controller-84ccd6c756-js8qc"
... skipping 730 lines ...
I0904 00:03:56.242537       1 pv_protection_controller.go:121] Processing PV pvc-cd68b0da-bfca-458f-90ea-2b0a935a5b5c
I0904 00:03:56.250997       1 pv_controller_base.go:726] storeObjectUpdate updating volume "pvc-cd68b0da-bfca-458f-90ea-2b0a935a5b5c" with version 1745
I0904 00:03:56.251793       1 pv_controller.go:551] synchronizing PersistentVolume[pvc-cd68b0da-bfca-458f-90ea-2b0a935a5b5c]: phase: Released, bound to: "azuredisk-1353/pvc-f45rh (uid: cd68b0da-bfca-458f-90ea-2b0a935a5b5c)", boundByController: false
I0904 00:03:56.251929       1 pv_controller.go:585] synchronizing PersistentVolume[pvc-cd68b0da-bfca-458f-90ea-2b0a935a5b5c]: volume is bound to claim azuredisk-1353/pvc-f45rh
I0904 00:03:56.252043       1 pv_controller.go:619] synchronizing PersistentVolume[pvc-cd68b0da-bfca-458f-90ea-2b0a935a5b5c]: claim azuredisk-1353/pvc-f45rh not found
I0904 00:03:56.252155       1 pv_protection_controller.go:198] Got event on PV pvc-cd68b0da-bfca-458f-90ea-2b0a935a5b5c
I0904 00:03:56.260994       1 pv_protection_controller.go:173] Error removing protection finalizer from PV pvc-cd68b0da-bfca-458f-90ea-2b0a935a5b5c: Operation cannot be fulfilled on persistentvolumes "pvc-cd68b0da-bfca-458f-90ea-2b0a935a5b5c": the object has been modified; please apply your changes to the latest version and try again
I0904 00:03:56.261011       1 pv_protection_controller.go:124] Finished processing PV pvc-cd68b0da-bfca-458f-90ea-2b0a935a5b5c (18.424889ms)
E0904 00:03:56.261037       1 pv_protection_controller.go:114] PV pvc-cd68b0da-bfca-458f-90ea-2b0a935a5b5c failed with : Operation cannot be fulfilled on persistentvolumes "pvc-cd68b0da-bfca-458f-90ea-2b0a935a5b5c": the object has been modified; please apply your changes to the latest version and try again
I0904 00:03:56.261164       1 pv_protection_controller.go:121] Processing PV pvc-cd68b0da-bfca-458f-90ea-2b0a935a5b5c
I0904 00:03:56.265414       1 pv_protection_controller.go:176] Removed protection finalizer from PV pvc-cd68b0da-bfca-458f-90ea-2b0a935a5b5c
I0904 00:03:56.265431       1 pv_protection_controller.go:124] Finished processing PV pvc-cd68b0da-bfca-458f-90ea-2b0a935a5b5c (4.25269ms)
I0904 00:03:56.265705       1 pv_controller_base.go:238] volume "pvc-cd68b0da-bfca-458f-90ea-2b0a935a5b5c" deleted
I0904 00:03:56.265733       1 pv_controller_base.go:589] deletion of claim "azuredisk-1353/pvc-f45rh" was already processed
I0904 00:03:56.266902       1 pv_protection_controller.go:121] Processing PV pvc-cd68b0da-bfca-458f-90ea-2b0a935a5b5c
... skipping 1191 lines ...
I0904 00:08:23.216814       1 pv_protection_controller.go:121] Processing PV pvc-ae902f49-93dc-4e86-bf70-534070183079
I0904 00:08:23.222987       1 pv_controller_base.go:726] storeObjectUpdate updating volume "pvc-ae902f49-93dc-4e86-bf70-534070183079" with version 2620
I0904 00:08:23.223000       1 pv_protection_controller.go:198] Got event on PV pvc-ae902f49-93dc-4e86-bf70-534070183079
I0904 00:08:23.223027       1 pv_controller.go:551] synchronizing PersistentVolume[pvc-ae902f49-93dc-4e86-bf70-534070183079]: phase: Released, bound to: "azuredisk-9241/pvc-hrdvf (uid: ae902f49-93dc-4e86-bf70-534070183079)", boundByController: false
I0904 00:08:23.223053       1 pv_controller.go:585] synchronizing PersistentVolume[pvc-ae902f49-93dc-4e86-bf70-534070183079]: volume is bound to claim azuredisk-9241/pvc-hrdvf
I0904 00:08:23.223062       1 pv_controller.go:619] synchronizing PersistentVolume[pvc-ae902f49-93dc-4e86-bf70-534070183079]: claim azuredisk-9241/pvc-hrdvf not found
I0904 00:08:23.225070       1 pv_protection_controller.go:173] Error removing protection finalizer from PV pvc-ae902f49-93dc-4e86-bf70-534070183079: Operation cannot be fulfilled on persistentvolumes "pvc-ae902f49-93dc-4e86-bf70-534070183079": the object has been modified; please apply your changes to the latest version and try again
I0904 00:08:23.225088       1 pv_protection_controller.go:124] Finished processing PV pvc-ae902f49-93dc-4e86-bf70-534070183079 (8.266629ms)
E0904 00:08:23.225101       1 pv_protection_controller.go:114] PV pvc-ae902f49-93dc-4e86-bf70-534070183079 failed with : Operation cannot be fulfilled on persistentvolumes "pvc-ae902f49-93dc-4e86-bf70-534070183079": the object has been modified; please apply your changes to the latest version and try again
I0904 00:08:23.225510       1 pv_protection_controller.go:121] Processing PV pvc-ae902f49-93dc-4e86-bf70-534070183079
I0904 00:08:23.229929       1 pv_controller_base.go:238] volume "pvc-ae902f49-93dc-4e86-bf70-534070183079" deleted
I0904 00:08:23.230115       1 pv_controller_base.go:589] deletion of claim "azuredisk-9241/pvc-hrdvf" was already processed
I0904 00:08:23.229942       1 pv_protection_controller.go:176] Removed protection finalizer from PV pvc-ae902f49-93dc-4e86-bf70-534070183079
I0904 00:08:23.230230       1 pv_protection_controller.go:124] Finished processing PV pvc-ae902f49-93dc-4e86-bf70-534070183079 (4.700374ms)
I0904 00:08:23.230347       1 pv_protection_controller.go:121] Processing PV pvc-ae902f49-93dc-4e86-bf70-534070183079
... skipping 1525 lines ...
I0904 00:12:42.913454       1 pv_protection_controller.go:121] Processing PV pvc-80b0dfff-c3ab-4c0b-a02b-f697a379ca6b
I0904 00:12:42.919457       1 pv_controller_base.go:726] storeObjectUpdate updating volume "pvc-80b0dfff-c3ab-4c0b-a02b-f697a379ca6b" with version 3437
I0904 00:12:42.919491       1 pv_controller.go:551] synchronizing PersistentVolume[pvc-80b0dfff-c3ab-4c0b-a02b-f697a379ca6b]: phase: Released, bound to: "azuredisk-9336/pvc-gsnx6 (uid: 80b0dfff-c3ab-4c0b-a02b-f697a379ca6b)", boundByController: false
I0904 00:12:42.919512       1 pv_controller.go:585] synchronizing PersistentVolume[pvc-80b0dfff-c3ab-4c0b-a02b-f697a379ca6b]: volume is bound to claim azuredisk-9336/pvc-gsnx6
I0904 00:12:42.919638       1 pv_controller.go:619] synchronizing PersistentVolume[pvc-80b0dfff-c3ab-4c0b-a02b-f697a379ca6b]: claim azuredisk-9336/pvc-gsnx6 not found
I0904 00:12:42.919671       1 pv_protection_controller.go:198] Got event on PV pvc-80b0dfff-c3ab-4c0b-a02b-f697a379ca6b
I0904 00:12:42.925203       1 pv_protection_controller.go:173] Error removing protection finalizer from PV pvc-80b0dfff-c3ab-4c0b-a02b-f697a379ca6b: Operation cannot be fulfilled on persistentvolumes "pvc-80b0dfff-c3ab-4c0b-a02b-f697a379ca6b": the object has been modified; please apply your changes to the latest version and try again
I0904 00:12:42.925223       1 pv_protection_controller.go:124] Finished processing PV pvc-80b0dfff-c3ab-4c0b-a02b-f697a379ca6b (11.75986ms)
E0904 00:12:42.925237       1 pv_protection_controller.go:114] PV pvc-80b0dfff-c3ab-4c0b-a02b-f697a379ca6b failed with : Operation cannot be fulfilled on persistentvolumes "pvc-80b0dfff-c3ab-4c0b-a02b-f697a379ca6b": the object has been modified; please apply your changes to the latest version and try again
I0904 00:12:42.925386       1 pv_protection_controller.go:121] Processing PV pvc-80b0dfff-c3ab-4c0b-a02b-f697a379ca6b
I0904 00:12:42.928931       1 pv_controller_base.go:238] volume "pvc-80b0dfff-c3ab-4c0b-a02b-f697a379ca6b" deleted
I0904 00:12:42.928967       1 pv_controller_base.go:589] deletion of claim "azuredisk-9336/pvc-gsnx6" was already processed
I0904 00:12:42.929914       1 pv_protection_controller.go:176] Removed protection finalizer from PV pvc-80b0dfff-c3ab-4c0b-a02b-f697a379ca6b
I0904 00:12:42.929935       1 pv_protection_controller.go:124] Finished processing PV pvc-80b0dfff-c3ab-4c0b-a02b-f697a379ca6b (4.533523ms)
I0904 00:12:42.931042       1 pv_protection_controller.go:121] Processing PV pvc-80b0dfff-c3ab-4c0b-a02b-f697a379ca6b
... skipping 21 lines ...
I0904 00:12:46.547983       1 deployment_controller.go:183] "Updating deployment" deployment="azuredisk-2205/azuredisk-volume-tester-5gnhl"
I0904 00:12:46.548647       1 deployment_util.go:775] Deployment "azuredisk-volume-tester-5gnhl" timed out (false) [last progress check: 2022-09-04 00:12:46.543889689 +0000 UTC m=+921.678247830 - now: 2022-09-04 00:12:46.548639749 +0000 UTC m=+921.682997790]
I0904 00:12:46.554813       1 controller_utils.go:581] Controller azuredisk-volume-tester-5gnhl-977c6cff7 created pod azuredisk-volume-tester-5gnhl-977c6cff7-j6t2v
I0904 00:12:46.555027       1 replica_set_utils.go:59] Updating status for : azuredisk-2205/azuredisk-volume-tester-5gnhl-977c6cff7, replicas 0->0 (need 1), fullyLabeledReplicas 0->0, readyReplicas 0->0, availableReplicas 0->0, sequence No: 0->1
I0904 00:12:46.555225       1 event.go:294] "Event occurred" object="azuredisk-2205/azuredisk-volume-tester-5gnhl-977c6cff7" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: azuredisk-volume-tester-5gnhl-977c6cff7-j6t2v"
I0904 00:12:46.555500       1 deployment_controller.go:585] "Finished syncing deployment" deployment="azuredisk-2205/azuredisk-volume-tester-5gnhl" duration="15.150476ms"
I0904 00:12:46.560391       1 deployment_controller.go:497] "Error syncing deployment" deployment="azuredisk-2205/azuredisk-volume-tester-5gnhl" err="Operation cannot be fulfilled on deployments.apps \"azuredisk-volume-tester-5gnhl\": the object has been modified; please apply your changes to the latest version and try again"
I0904 00:12:46.557636       1 pvc_protection_controller.go:380] "Enqueuing PVCs for Pod" pod="azuredisk-2205/azuredisk-volume-tester-5gnhl-977c6cff7-j6t2v" podUID=567c3be6-b803-4f3d-9248-ff447e4dcb0c
I0904 00:12:46.557652       1 replica_set.go:394] Pod azuredisk-volume-tester-5gnhl-977c6cff7-j6t2v created: &v1.Pod{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"azuredisk-volume-tester-5gnhl-977c6cff7-j6t2v", GenerateName:"azuredisk-volume-tester-5gnhl-977c6cff7-", Namespace:"azuredisk-2205", SelfLink:"", UID:"567c3be6-b803-4f3d-9248-ff447e4dcb0c", ResourceVersion:"3462", Generation:0, CreationTimestamp:time.Date(2022, time.September, 4, 0, 12, 46, 0, time.Local), DeletionTimestamp:<nil>, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"azuredisk-volume-tester-7660323324116104765", "pod-template-hash":"977c6cff7"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference{v1.OwnerReference{APIVersion:"apps/v1", Kind:"ReplicaSet", Name:"azuredisk-volume-tester-5gnhl-977c6cff7", UID:"da13d4e1-a16e-4a57-b2af-4109cf9a0abb", Controller:(*bool)(0xc0021de9b7), BlockOwnerDeletion:(*bool)(0xc0021de9b8)}}, Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kube-controller-manager", Operation:"Update", APIVersion:"v1", Time:time.Date(2022, time.September, 4, 0, 12, 46, 0, time.Local), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc001f081b0), Subresource:""}}}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"test-volume-1", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(0xc001f081c8), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"kube-api-access-rjn5t", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(0xc002b3d5c0), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"volume-tester", Image:"k8s.gcr.io/e2e-test-images/busybox:1.29-2", Command:[]string{"/bin/sh"}, Args:[]string{"-c", "echo 'hello world' >> /mnt/test-1/data && while true; do sleep 3600; done"}, WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar(nil), Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"test-volume-1", ReadOnly:false, MountPath:"/mnt/test-1", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"kube-api-access-rjn5t", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0xc0021dea88), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"default", DeprecatedServiceAccount:"default", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:false, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0xc0005c7e30), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"node.kubernetes.io/not-ready", Operator:"Exists", Value:"", Effect:"NoExecute", TolerationSeconds:(*int64)(0xc0021deae0)}, v1.Toleration{Key:"node.kubernetes.io/unreachable", Operator:"Exists", Value:"", Effect:"NoExecute", TolerationSeconds:(*int64)(0xc0021deb00)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"", Priority:(*int32)(0xc0021deb08), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(0xc0021deb0c), PreemptionPolicy:(*v1.PreemptionPolicy)(0xc00232c3e0), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil), OS:(*v1.PodOS)(nil), HostUsers:(*bool)(nil)}, Status:v1.PodStatus{Phase:"Pending", Conditions:[]v1.PodCondition(nil), Message:"", Reason:"", NominatedNodeName:"", HostIP:"", PodIP:"", PodIPs:[]v1.PodIP(nil), StartTime:<nil>, InitContainerStatuses:[]v1.ContainerStatus(nil), ContainerStatuses:[]v1.ContainerStatus(nil), QOSClass:"BestEffort", EphemeralContainerStatuses:[]v1.ContainerStatus(nil)}}.
I0904 00:12:46.557853       1 disruption.go:479] addPod called on pod "azuredisk-volume-tester-5gnhl-977c6cff7-j6t2v"
I0904 00:12:46.557893       1 taint_manager.go:431] "Noticed pod update" pod="azuredisk-2205/azuredisk-volume-tester-5gnhl-977c6cff7-j6t2v"
I0904 00:12:46.560674       1 deployment_controller.go:583] "Started syncing deployment" deployment="azuredisk-2205/azuredisk-volume-tester-5gnhl" startTime="2022-09-04 00:12:46.560653799 +0000 UTC m=+921.695011940"
I0904 00:12:46.561632       1 deployment_util.go:775] Deployment "azuredisk-volume-tester-5gnhl" timed out (false) [last progress check: 2022-09-04 00:12:46 +0000 UTC - now: 2022-09-04 00:12:46.561624112 +0000 UTC m=+921.695982153]
... skipping 244 lines ...
I0904 00:13:05.398195       1 disruption.go:494] updatePod called on pod "azuredisk-volume-tester-5gnhl-977c6cff7-bdvvb"
I0904 00:13:05.398472       1 disruption.go:570] No PodDisruptionBudgets found for pod azuredisk-volume-tester-5gnhl-977c6cff7-bdvvb, PodDisruptionBudget controller will avoid syncing.
I0904 00:13:05.398484       1 disruption.go:497] No matching pdb for pod "azuredisk-volume-tester-5gnhl-977c6cff7-bdvvb"
I0904 00:13:05.398293       1 controller_utils.go:189] Controller expectations fulfilled &controller.ControlleeExpectations{add:0, del:0, key:"azuredisk-2205/azuredisk-volume-tester-5gnhl-977c6cff7", timestamp:time.Time{wall:0xc0bd194454871c6c, ext:940478756997, loc:(*time.Location)(0x6f10040)}}
I0904 00:13:05.398555       1 controller_utils.go:938] Ignoring inactive pod azuredisk-2205/azuredisk-volume-tester-5gnhl-977c6cff7-j6t2v in state Running, deletion time 2022-09-04 00:13:35 +0000 UTC
I0904 00:13:05.398627       1 replica_set.go:667] Finished syncing ReplicaSet "azuredisk-2205/azuredisk-volume-tester-5gnhl-977c6cff7" (300.703µs)
I0904 00:13:05.403601       1 reconciler.go:420] "Multi-Attach error: volume is already used by pods" pods=[azuredisk-2205/azuredisk-volume-tester-5gnhl-977c6cff7-j6t2v] attachedTo=[capz-oshnip-mp-0000000] volume={VolumeToAttach:{MultiAttachErrorReported:false VolumeName:kubernetes.io/csi/disk.csi.azure.com^/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/capz-oshnip/providers/Microsoft.Compute/disks/pvc-25d00000-50d0-490b-a720-5a594cc6ba13 VolumeSpec:0xc0021aaf78 NodeName:capz-oshnip-mp-0000001 ScheduledPods:[&Pod{ObjectMeta:{azuredisk-volume-tester-5gnhl-977c6cff7-bdvvb azuredisk-volume-tester-5gnhl-977c6cff7- azuredisk-2205  42a48c44-ba05-428e-86db-6a5ccf23053f 3583 0 2022-09-04 00:13:05 +0000 UTC <nil> <nil> map[app:azuredisk-volume-tester-7660323324116104765 pod-template-hash:977c6cff7] map[] [{apps/v1 ReplicaSet azuredisk-volume-tester-5gnhl-977c6cff7 da13d4e1-a16e-4a57-b2af-4109cf9a0abb 0xc0023b7ad0 0xc0023b7ad1}] [] [{kube-controller-manager Update v1 2022-09-04 00:13:05 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"da13d4e1-a16e-4a57-b2af-4109cf9a0abb\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"volume-tester\"}":{".":{},"f:args":{},"f:command":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/mnt/test-1\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:nodeSelector":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{},"f:volumes":{".":{},"k:{\"name\":\"test-volume-1\"}":{".":{},"f:name":{},"f:persistentVolumeClaim":{".":{},"f:claimName":{}}}}}} }]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:test-volume-1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-6bfg4,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},Volume{Name:kube-api-access-x685h,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:volume-tester,Image:k8s.gcr.io/e2e-test-images/busybox:1.29-2,Command:[/bin/sh],Args:[-c echo 'hello world' >> /mnt/test-1/data && while true; do sleep 3600; done],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:test-volume-1,ReadOnly:false,MountPath:/mnt/test-1,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:kube-api-access-x685h,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*30,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{kubernetes.io/os: linux,},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:capz-oshnip-mp-0000001,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,HostUsers:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-09-04 00:13:05 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:,PodIP:,StartTime:<nil>,ContainerStatuses:[]ContainerStatus{},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},}]}}
I0904 00:13:05.403658       1 event.go:294] "Event occurred" object="azuredisk-2205/azuredisk-volume-tester-5gnhl-977c6cff7-bdvvb" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="FailedAttachVolume" message="Multi-Attach error for volume \"pvc-25d00000-50d0-490b-a720-5a594cc6ba13\" Volume is already used by pod(s) azuredisk-volume-tester-5gnhl-977c6cff7-j6t2v"
I0904 00:13:06.508284       1 reflector.go:281] vendor/k8s.io/client-go/informers/factory.go:134: forcing resync
I0904 00:13:06.552641       1 reflector.go:281] vendor/k8s.io/client-go/informers/factory.go:134: forcing resync
I0904 00:13:06.623880       1 pv_controller_base.go:612] resyncing PV controller
I0904 00:13:06.623948       1 pv_controller_base.go:726] storeObjectUpdate updating claim "azuredisk-2205/pvc-6bfg4" with version 3481
I0904 00:13:06.623974       1 pv_controller.go:255] synchronizing PersistentVolumeClaim[azuredisk-2205/pvc-6bfg4]: phase: Bound, bound to: "pvc-25d00000-50d0-490b-a720-5a594cc6ba13", bindCompleted: true, boundByController: true
I0904 00:13:06.624009       1 pv_controller.go:511] synchronizing bound PersistentVolumeClaim[azuredisk-2205/pvc-6bfg4]: volume "pvc-25d00000-50d0-490b-a720-5a594cc6ba13" found: phase: Bound, bound to: "azuredisk-2205/pvc-6bfg4 (uid: 25d00000-50d0-490b-a720-5a594cc6ba13)", boundByController: false
... skipping 1573 lines ...
I0904 00:17:07.181206       1 pv_protection_controller.go:121] Processing PV pvc-c470f399-5813-49d4-bcd7-55f02bbdc976
I0904 00:17:07.186325       1 pv_controller_base.go:726] storeObjectUpdate updating volume "pvc-c470f399-5813-49d4-bcd7-55f02bbdc976" with version 4407
I0904 00:17:07.186542       1 pv_controller.go:551] synchronizing PersistentVolume[pvc-c470f399-5813-49d4-bcd7-55f02bbdc976]: phase: Released, bound to: "azuredisk-1387/pvc-zskpx (uid: c470f399-5813-49d4-bcd7-55f02bbdc976)", boundByController: false
I0904 00:17:07.186738       1 pv_controller.go:585] synchronizing PersistentVolume[pvc-c470f399-5813-49d4-bcd7-55f02bbdc976]: volume is bound to claim azuredisk-1387/pvc-zskpx
I0904 00:17:07.186894       1 pv_controller.go:619] synchronizing PersistentVolume[pvc-c470f399-5813-49d4-bcd7-55f02bbdc976]: claim azuredisk-1387/pvc-zskpx not found
I0904 00:17:07.186978       1 pv_protection_controller.go:198] Got event on PV pvc-c470f399-5813-49d4-bcd7-55f02bbdc976
I0904 00:17:07.189268       1 pv_protection_controller.go:173] Error removing protection finalizer from PV pvc-c470f399-5813-49d4-bcd7-55f02bbdc976: Operation cannot be fulfilled on persistentvolumes "pvc-c470f399-5813-49d4-bcd7-55f02bbdc976": the object has been modified; please apply your changes to the latest version and try again
I0904 00:17:07.189286       1 pv_protection_controller.go:124] Finished processing PV pvc-c470f399-5813-49d4-bcd7-55f02bbdc976 (8.072497ms)
E0904 00:17:07.189297       1 pv_protection_controller.go:114] PV pvc-c470f399-5813-49d4-bcd7-55f02bbdc976 failed with : Operation cannot be fulfilled on persistentvolumes "pvc-c470f399-5813-49d4-bcd7-55f02bbdc976": the object has been modified; please apply your changes to the latest version and try again
I0904 00:17:07.189316       1 pv_protection_controller.go:121] Processing PV pvc-c470f399-5813-49d4-bcd7-55f02bbdc976
I0904 00:17:07.193175       1 pv_protection_controller.go:176] Removed protection finalizer from PV pvc-c470f399-5813-49d4-bcd7-55f02bbdc976
I0904 00:17:07.193192       1 pv_protection_controller.go:124] Finished processing PV pvc-c470f399-5813-49d4-bcd7-55f02bbdc976 (3.868346ms)
I0904 00:17:07.193334       1 pv_controller_base.go:238] volume "pvc-c470f399-5813-49d4-bcd7-55f02bbdc976" deleted
I0904 00:17:07.193416       1 pv_controller_base.go:589] deletion of claim "azuredisk-1387/pvc-zskpx" was already processed
I0904 00:17:07.194512       1 pv_protection_controller.go:121] Processing PV pvc-c470f399-5813-49d4-bcd7-55f02bbdc976
... skipping 102 lines ...
I0904 00:17:14.491017       1 pv_protection_controller.go:121] Processing PV pvc-3a9df7f5-3a28-41b1-95e6-74eab911d059
I0904 00:17:14.502031       1 pv_controller_base.go:726] storeObjectUpdate updating volume "pvc-3a9df7f5-3a28-41b1-95e6-74eab911d059" with version 4441
I0904 00:17:14.502061       1 pv_controller.go:551] synchronizing PersistentVolume[pvc-3a9df7f5-3a28-41b1-95e6-74eab911d059]: phase: Released, bound to: "azuredisk-1387/pvc-46zm8 (uid: 3a9df7f5-3a28-41b1-95e6-74eab911d059)", boundByController: false
I0904 00:17:14.502084       1 pv_controller.go:585] synchronizing PersistentVolume[pvc-3a9df7f5-3a28-41b1-95e6-74eab911d059]: volume is bound to claim azuredisk-1387/pvc-46zm8
I0904 00:17:14.502120       1 pv_protection_controller.go:198] Got event on PV pvc-3a9df7f5-3a28-41b1-95e6-74eab911d059
I0904 00:17:14.502137       1 pv_controller.go:619] synchronizing PersistentVolume[pvc-3a9df7f5-3a28-41b1-95e6-74eab911d059]: claim azuredisk-1387/pvc-46zm8 not found
I0904 00:17:14.519553       1 pv_protection_controller.go:173] Error removing protection finalizer from PV pvc-3a9df7f5-3a28-41b1-95e6-74eab911d059: Operation cannot be fulfilled on persistentvolumes "pvc-3a9df7f5-3a28-41b1-95e6-74eab911d059": the object has been modified; please apply your changes to the latest version and try again
I0904 00:17:14.519742       1 pv_protection_controller.go:124] Finished processing PV pvc-3a9df7f5-3a28-41b1-95e6-74eab911d059 (28.690246ms)
E0904 00:17:14.519889       1 pv_protection_controller.go:114] PV pvc-3a9df7f5-3a28-41b1-95e6-74eab911d059 failed with : Operation cannot be fulfilled on persistentvolumes "pvc-3a9df7f5-3a28-41b1-95e6-74eab911d059": the object has been modified; please apply your changes to the latest version and try again
I0904 00:17:14.520054       1 pv_protection_controller.go:121] Processing PV pvc-3a9df7f5-3a28-41b1-95e6-74eab911d059
I0904 00:17:14.539538       1 pv_controller_base.go:238] volume "pvc-3a9df7f5-3a28-41b1-95e6-74eab911d059" deleted
I0904 00:17:14.540122       1 pv_controller_base.go:589] deletion of claim "azuredisk-1387/pvc-46zm8" was already processed
I0904 00:17:14.540472       1 pv_protection_controller.go:176] Removed protection finalizer from PV pvc-3a9df7f5-3a28-41b1-95e6-74eab911d059
I0904 00:17:14.540619       1 pv_protection_controller.go:124] Finished processing PV pvc-3a9df7f5-3a28-41b1-95e6-74eab911d059 (20.398246ms)
I0904 00:17:14.540760       1 pv_protection_controller.go:121] Processing PV pvc-3a9df7f5-3a28-41b1-95e6-74eab911d059
... skipping 2514 lines ...
I0904 00:22:33.618282       1 stateful_set_control.go:379] "StatefulSet has unhealthy Pods" statefulSet="azuredisk-7886/azuredisk-volume-tester-m5f7t" unhealthyReplicas=1 pod="azuredisk-7886/azuredisk-volume-tester-m5f7t-0"
I0904 00:22:33.618315       1 stateful_set_control.go:454] "StatefulSet is waiting for Pod to be Running and Ready" statefulSet="azuredisk-7886/azuredisk-volume-tester-m5f7t" pod="azuredisk-7886/azuredisk-volume-tester-m5f7t-0"
I0904 00:22:33.618329       1 stateful_set_control.go:333] "Updated status" statefulSet="azuredisk-7886/azuredisk-volume-tester-m5f7t" replicas=1 readyReplicas=0 currentReplicas=1 updatedReplicas=1
I0904 00:22:33.618342       1 stateful_set_control.go:112] "StatefulSet revisions" statefulSet="azuredisk-7886/azuredisk-volume-tester-m5f7t" currentRevision="azuredisk-volume-tester-m5f7t-5ccc4f5bfd" updateRevision="azuredisk-volume-tester-m5f7t-5ccc4f5bfd"
I0904 00:22:33.618570       1 stateful_set.go:485] Successfully synced StatefulSet azuredisk-7886/azuredisk-volume-tester-m5f7t successful
I0904 00:22:33.618585       1 stateful_set.go:440] Finished syncing statefulset "azuredisk-7886/azuredisk-volume-tester-m5f7t" (1.423428ms)
I0904 00:22:33.659078       1 event.go:294] "Event occurred" object="azuredisk-7886/azuredisk-volume-tester-m5f7t-0" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="FailedAttachVolume" message="Multi-Attach error for volume \"pvc-6703fb63-77cf-448b-aebe-da145884f00a\" Volume is already exclusively attached to one node and can't be attached to another"
I0904 00:22:33.659436       1 reconciler.go:384] "Multi-Attach error: volume is already exclusively attached and can't be attached to another node" attachedTo=[capz-oshnip-mp-0000000] volume={VolumeToAttach:{MultiAttachErrorReported:false VolumeName:kubernetes.io/csi/disk.csi.azure.com^/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/capz-oshnip/providers/Microsoft.Compute/disks/pvc-6703fb63-77cf-448b-aebe-da145884f00a VolumeSpec:0xc00217fbc0 NodeName:capz-oshnip-mp-0000001 ScheduledPods:[&Pod{ObjectMeta:{azuredisk-volume-tester-m5f7t-0 azuredisk-volume-tester-m5f7t- azuredisk-7886  595dbb1b-15ce-4a4e-9056-98755d915f8e 5669 0 2022-09-04 00:22:33 +0000 UTC <nil> <nil> map[app:azuredisk-volume-tester-5956761487052003905 controller-revision-hash:azuredisk-volume-tester-m5f7t-5ccc4f5bfd statefulset.kubernetes.io/pod-name:azuredisk-volume-tester-m5f7t-0] map[] [{apps/v1 StatefulSet azuredisk-volume-tester-m5f7t 9623d7be-c58e-4f79-b494-53b9f7866e3f 0xc0021de007 0xc0021de008}] [] [{kube-controller-manager Update v1 2022-09-04 00:22:33 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:app":{},"f:controller-revision-hash":{},"f:statefulset.kubernetes.io/pod-name":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"9623d7be-c58e-4f79-b494-53b9f7866e3f\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"volume-tester\"}":{".":{},"f:args":{},"f:command":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/mnt/test-1\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:hostname":{},"f:nodeSelector":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{},"f:volumes":{".":{},"k:{\"name\":\"pvc\"}":{".":{},"f:name":{},"f:persistentVolumeClaim":{".":{},"f:claimName":{}}}}}} }]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:pvc,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-azuredisk-volume-tester-m5f7t-0,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},Volume{Name:kube-api-access-c946c,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:volume-tester,Image:k8s.gcr.io/e2e-test-images/busybox:1.29-2,Command:[/bin/sh],Args:[-c echo 'hello world' >> /mnt/test-1/data && while true; do sleep 3600; done],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:pvc,ReadOnly:false,MountPath:/mnt/test-1,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:kube-api-access-c946c,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*30,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{kubernetes.io/os: linux,},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:capz-oshnip-mp-0000001,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:azuredisk-volume-tester-m5f7t-0,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,HostUsers:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-09-04 00:22:33 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:,PodIP:,StartTime:<nil>,ContainerStatuses:[]ContainerStatus{},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},}]}}
I0904 00:22:35.069466       1 attach_detach_controller.go:673] processVolumesInUse for node "capz-oshnip-mp-0000001"
I0904 00:22:35.918888       1 reflector.go:559] vendor/k8s.io/client-go/informers/factory.go:134: Watch close - *v1beta2.FlowSchema total 10 items received
I0904 00:22:36.489922       1 reflector.go:281] vendor/k8s.io/client-go/informers/factory.go:134: forcing resync
I0904 00:22:36.494240       1 reflector.go:281] vendor/k8s.io/client-go/informers/factory.go:134: forcing resync
I0904 00:22:36.520644       1 reflector.go:281] vendor/k8s.io/client-go/informers/factory.go:134: forcing resync
I0904 00:22:36.581815       1 reflector.go:281] vendor/k8s.io/client-go/informers/factory.go:134: forcing resync
... skipping 201 lines ...
I0904 00:23:33.001948       1 serviceaccounts_controller.go:188] Finished syncing namespace "azuredisk-8470" (5.3µs)
2022/09/04 00:23:34 ===================================================

JUnit report was created: /logs/artifacts/junit_01.xml

Ran 12 of 59 Specs in 1238.853 seconds
SUCCESS! -- 12 Passed | 0 Failed | 0 Pending | 47 Skipped

You're using deprecated Ginkgo functionality:
=============================================
Ginkgo 2.0 is under active development and will introduce several new features, improvements, and a small handful of breaking changes.
A release candidate for 2.0 is now available and 2.0 should GA in Fall 2021.  Please give the RC a try and send us feedback!
  - To learn more, view the migration guide at https://github.com/onsi/ginkgo/blob/ver2/docs/MIGRATING_TO_V2.md
... skipping 44 lines ...
INFO: Creating log watcher for controller capz-system/capz-controller-manager, pod capz-controller-manager-858df9cd95-2cvvx, container manager
STEP: Dumping workload cluster default/capz-oshnip logs
Sep  4 00:25:09.815: INFO: Collecting logs for Linux node capz-oshnip-control-plane-jqxrs in cluster capz-oshnip in namespace default

Sep  4 00:26:09.816: INFO: Collecting boot logs for AzureMachine capz-oshnip-control-plane-jqxrs

Failed to get logs for machine capz-oshnip-control-plane-5mv7n, cluster default/capz-oshnip: open /etc/azure-ssh/azure-ssh: no such file or directory
Sep  4 00:26:10.742: INFO: Collecting logs for Linux node capz-oshnip-mp-0000000 in cluster capz-oshnip in namespace default

Sep  4 00:27:10.743: INFO: Collecting boot logs for VMSS instance 0 of scale set capz-oshnip-mp-0

Sep  4 00:27:11.037: INFO: Collecting logs for Linux node capz-oshnip-mp-0000001 in cluster capz-oshnip in namespace default

Sep  4 00:28:11.042: INFO: Collecting boot logs for VMSS instance 1 of scale set capz-oshnip-mp-0

Failed to get logs for machine pool capz-oshnip-mp-0, cluster default/capz-oshnip: open /etc/azure-ssh/azure-ssh: no such file or directory
STEP: Dumping workload cluster default/capz-oshnip kube-system pod logs
STEP: Collecting events for Pod kube-system/calico-node-dsgtq
STEP: Collecting events for Pod kube-system/calico-kube-controllers-755ff8d7b5-5nstc
STEP: Creating log watcher for controller kube-system/csi-azuredisk-controller-6dbf65647f-vqzd2, container csi-snapshotter
STEP: Fetching kube-system pod logs took 381.81233ms
STEP: Dumping workload cluster default/capz-oshnip Azure activity log
... skipping 71 lines ...