This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 0 failed / 0 succeeded
Started2022-06-21 16:04
Elapsed42m5s
Revisionmaster

No Test Failures!


Error lines from build-log.txt

... skipping 183 lines ...
Updating project ssh metadata...
.....................................Updated [https://www.googleapis.com/compute/v1/projects/gce-gci-upg-1-4-1-3-ctl-skew].
.done.
WARNING: No host aliases were added to your SSH configs because you do not have any running instances. Try running this command again after running some instances.
I0621 16:05:36.546775    5961 up.go:44] Cleaning up any leaked resources from previous cluster
I0621 16:05:36.547079    5961 dumplogs.go:45] /logs/artifacts/b29e4240-f17b-11ec-9ac1-d2ba5eb345d8/kops toolbox dump --name e2e-e2e-kops-gce-stable.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh1815779924/key --ssh-user prow
W0621 16:05:36.854812    5961 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1
I0621 16:05:36.854886    5961 down.go:48] /logs/artifacts/b29e4240-f17b-11ec-9ac1-d2ba5eb345d8/kops delete cluster --name e2e-e2e-kops-gce-stable.k8s.local --yes
I0621 16:05:36.893429    6010 featureflag.go:164] FeatureFlag "SpecOverrideFlag"=true
I0621 16:05:36.893615    6010 featureflag.go:164] FeatureFlag "AlphaAllowGCE"=true
Error: error reading cluster configuration: Cluster.kops.k8s.io "e2e-e2e-kops-gce-stable.k8s.local" not found
I0621 16:05:37.030527    5961 gcs.go:51] gsutil ls -b -p gce-gci-upg-1-4-1-3-ctl-skew gs://gce-gci-upg-1-4-1-3-ctl-skew-state-b2
I0621 16:05:39.145740    5961 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip
2022/06/21 16:05:39 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404
I0621 16:05:39.156324    5961 http.go:37] curl https://ip.jsb.workers.dev
I0621 16:05:39.272189    5961 up.go:159] /logs/artifacts/b29e4240-f17b-11ec-9ac1-d2ba5eb345d8/kops create cluster --name e2e-e2e-kops-gce-stable.k8s.local --cloud gce --kubernetes-version https://storage.googleapis.com/kubernetes-release/release/v1.25.0-alpha.1 --ssh-public-key /tmp/kops-ssh1815779924/key.pub --override cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --gce-service-account=default --admin-access 34.68.85.244/32 --master-count 1 --master-volume-size 48 --node-count 4 --node-volume-size 48 --zones us-west3-a --master-size e2-standard-2 --project gce-gci-upg-1-4-1-3-ctl-skew
I0621 16:05:39.307904    6161 featureflag.go:164] FeatureFlag "SpecOverrideFlag"=true
I0621 16:05:39.308023    6161 featureflag.go:164] FeatureFlag "AlphaAllowGCE"=true
I0621 16:05:39.364233    6161 create_cluster.go:862] Using SSH public key: /tmp/kops-ssh1815779924/key.pub
I0621 16:05:39.591963    6161 new_cluster.go:425] VMs will be configured to use specified Service Account: default
... skipping 375 lines ...
I0621 16:05:45.353925    6183 keypair.go:225] Issuing new certificate: "etcd-peers-ca-events"
W0621 16:05:45.395544    6183 vfs_castore.go:379] CA private key was not found
I0621 16:05:45.397654    6183 address.go:139] GCE creating address: "api-e2e-e2e-kops-gce-stable-k8s-local"
I0621 16:05:45.404028    6183 keypair.go:225] Issuing new certificate: "service-account"
I0621 16:05:45.421670    6183 keypair.go:225] Issuing new certificate: "kubernetes-ca"
I0621 16:05:55.073432    6183 executor.go:111] Tasks: 42 done / 68 total; 20 can run
W0621 16:06:08.746809    6183 executor.go:139] error running task "ForwardingRule/api-e2e-e2e-kops-gce-stable-k8s-local" (9m46s remaining to succeed): error creating ForwardingRule "api-e2e-e2e-kops-gce-stable-k8s-local": googleapi: Error 400: The resource 'projects/gce-gci-upg-1-4-1-3-ctl-skew/regions/us-west3/targetPools/api-e2e-e2e-kops-gce-stable-k8s-local' is not ready, resourceNotReady
I0621 16:06:08.746973    6183 executor.go:111] Tasks: 61 done / 68 total; 5 can run
I0621 16:06:19.492918    6183 executor.go:111] Tasks: 66 done / 68 total; 2 can run
I0621 16:06:33.677614    6183 executor.go:111] Tasks: 68 done / 68 total; 0 can run
I0621 16:06:33.794602    6183 update_cluster.go:326] Exporting kubeconfig for cluster
kOps has set your kubectl context to e2e-e2e-kops-gce-stable.k8s.local

... skipping 8 lines ...

I0621 16:06:44.175529    5961 up.go:243] /logs/artifacts/b29e4240-f17b-11ec-9ac1-d2ba5eb345d8/kops validate cluster --name e2e-e2e-kops-gce-stable.k8s.local --count 10 --wait 15m0s
I0621 16:06:44.287062    6203 featureflag.go:164] FeatureFlag "SpecOverrideFlag"=true
I0621 16:06:44.287170    6203 featureflag.go:164] FeatureFlag "AlphaAllowGCE"=true
Validating cluster e2e-e2e-kops-gce-stable.k8s.local

W0621 16:07:14.609849    6203 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.151.197/api/v1/nodes": dial tcp 34.106.151.197:443: i/o timeout
W0621 16:07:24.634715    6203 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.151.197/api/v1/nodes": dial tcp 34.106.151.197:443: connect: connection refused
W0621 16:07:34.659606    6203 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.151.197/api/v1/nodes": dial tcp 34.106.151.197:443: connect: connection refused
W0621 16:07:44.682693    6203 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.151.197/api/v1/nodes": dial tcp 34.106.151.197:443: connect: connection refused
W0621 16:07:54.706989    6203 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.151.197/api/v1/nodes": dial tcp 34.106.151.197:443: connect: connection refused
W0621 16:08:04.730112    6203 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.151.197/api/v1/nodes": dial tcp 34.106.151.197:443: connect: connection refused
W0621 16:08:14.753183    6203 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.151.197/api/v1/nodes": dial tcp 34.106.151.197:443: connect: connection refused
W0621 16:08:24.776678    6203 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.151.197/api/v1/nodes": dial tcp 34.106.151.197:443: connect: connection refused
W0621 16:08:34.801658    6203 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.151.197/api/v1/nodes": dial tcp 34.106.151.197:443: connect: connection refused
W0621 16:08:44.828207    6203 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.151.197/api/v1/nodes": dial tcp 34.106.151.197:443: connect: connection refused
W0621 16:08:54.851505    6203 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.151.197/api/v1/nodes": dial tcp 34.106.151.197:443: connect: connection refused
W0621 16:09:04.874030    6203 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.151.197/api/v1/nodes": dial tcp 34.106.151.197:443: connect: connection refused
W0621 16:09:14.898034    6203 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.151.197/api/v1/nodes": dial tcp 34.106.151.197:443: connect: connection refused
W0621 16:09:34.921893    6203 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.151.197/api/v1/nodes": net/http: TLS handshake timeout
W0621 16:09:54.945001    6203 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.151.197/api/v1/nodes": net/http: TLS handshake timeout
I0621 16:10:05.379133    6203 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c]
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-us-west3-a	Master	e2-standard-2	1	1	us-west3
nodes-us-west3-a	Node	n1-standard-2	4	4	us-west3

... skipping 5 lines ...
Machine	https://www.googleapis.com/compute/v1/projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/master-us-west3-a-r9rv	machine "https://www.googleapis.com/compute/v1/projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/master-us-west3-a-r9rv" has not yet joined cluster
Machine	https://www.googleapis.com/compute/v1/projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/nodes-us-west3-a-12tt	machine "https://www.googleapis.com/compute/v1/projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/nodes-us-west3-a-12tt" has not yet joined cluster
Machine	https://www.googleapis.com/compute/v1/projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/nodes-us-west3-a-kkxs	machine "https://www.googleapis.com/compute/v1/projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/nodes-us-west3-a-kkxs" has not yet joined cluster
Machine	https://www.googleapis.com/compute/v1/projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/nodes-us-west3-a-rbw1	machine "https://www.googleapis.com/compute/v1/projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/nodes-us-west3-a-rbw1" has not yet joined cluster
Machine	https://www.googleapis.com/compute/v1/projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/nodes-us-west3-a-tw9s	machine "https://www.googleapis.com/compute/v1/projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/nodes-us-west3-a-tw9s" has not yet joined cluster

Validation Failed
W0621 16:10:06.078563    6203 validate_cluster.go:232] (will retry): cluster not yet healthy
I0621 16:10:16.487426    6203 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c]
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-us-west3-a	Master	e2-standard-2	1	1	us-west3
nodes-us-west3-a	Node	n1-standard-2	4	4	us-west3
... skipping 6 lines ...
Machine	https://www.googleapis.com/compute/v1/projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/master-us-west3-a-r9rv	machine "https://www.googleapis.com/compute/v1/projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/master-us-west3-a-r9rv" has not yet joined cluster
Machine	https://www.googleapis.com/compute/v1/projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/nodes-us-west3-a-12tt	machine "https://www.googleapis.com/compute/v1/projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/nodes-us-west3-a-12tt" has not yet joined cluster
Machine	https://www.googleapis.com/compute/v1/projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/nodes-us-west3-a-kkxs	machine "https://www.googleapis.com/compute/v1/projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/nodes-us-west3-a-kkxs" has not yet joined cluster
Machine	https://www.googleapis.com/compute/v1/projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/nodes-us-west3-a-rbw1	machine "https://www.googleapis.com/compute/v1/projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/nodes-us-west3-a-rbw1" has not yet joined cluster
Machine	https://www.googleapis.com/compute/v1/projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/nodes-us-west3-a-tw9s	machine "https://www.googleapis.com/compute/v1/projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/nodes-us-west3-a-tw9s" has not yet joined cluster

Validation Failed
W0621 16:10:17.146483    6203 validate_cluster.go:232] (will retry): cluster not yet healthy
I0621 16:10:27.576397    6203 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c]
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-us-west3-a	Master	e2-standard-2	1	1	us-west3
nodes-us-west3-a	Node	n1-standard-2	4	4	us-west3
... skipping 6 lines ...
Machine	https://www.googleapis.com/compute/v1/projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/master-us-west3-a-r9rv	machine "https://www.googleapis.com/compute/v1/projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/master-us-west3-a-r9rv" has not yet joined cluster
Machine	https://www.googleapis.com/compute/v1/projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/nodes-us-west3-a-12tt	machine "https://www.googleapis.com/compute/v1/projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/nodes-us-west3-a-12tt" has not yet joined cluster
Machine	https://www.googleapis.com/compute/v1/projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/nodes-us-west3-a-kkxs	machine "https://www.googleapis.com/compute/v1/projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/nodes-us-west3-a-kkxs" has not yet joined cluster
Machine	https://www.googleapis.com/compute/v1/projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/nodes-us-west3-a-rbw1	machine "https://www.googleapis.com/compute/v1/projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/nodes-us-west3-a-rbw1" has not yet joined cluster
Machine	https://www.googleapis.com/compute/v1/projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/nodes-us-west3-a-tw9s	machine "https://www.googleapis.com/compute/v1/projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/nodes-us-west3-a-tw9s" has not yet joined cluster

Validation Failed
W0621 16:10:28.219661    6203 validate_cluster.go:232] (will retry): cluster not yet healthy
I0621 16:10:38.556172    6203 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c]
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-us-west3-a	Master	e2-standard-2	1	1	us-west3
nodes-us-west3-a	Node	n1-standard-2	4	4	us-west3
... skipping 10 lines ...
Machine	https://www.googleapis.com/compute/v1/projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/nodes-us-west3-a-tw9s	machine "https://www.googleapis.com/compute/v1/projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/nodes-us-west3-a-tw9s" has not yet joined cluster
Pod	kube-system/coredns-autoscaler-5d4dbc7b59-d42gf											system-cluster-critical pod "coredns-autoscaler-5d4dbc7b59-d42gf" is pending
Pod	kube-system/coredns-dd657c749-jtxhs												system-cluster-critical pod "coredns-dd657c749-jtxhs" is pending
Pod	kube-system/etcd-manager-main-master-us-west3-a-r9rv										system-cluster-critical pod "etcd-manager-main-master-us-west3-a-r9rv" is pending
Pod	kube-system/kube-proxy-master-us-west3-a-r9rv											system-node-critical pod "kube-proxy-master-us-west3-a-r9rv" is pending

Validation Failed
W0621 16:10:39.251845    6203 validate_cluster.go:232] (will retry): cluster not yet healthy
I0621 16:10:49.591239    6203 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c]
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-us-west3-a	Master	e2-standard-2	1	1	us-west3
nodes-us-west3-a	Node	n1-standard-2	4	4	us-west3
... skipping 11 lines ...
Node	master-us-west3-a-r9rv														node "master-us-west3-a-r9rv" of role "master" is not ready
Pod	kube-system/coredns-autoscaler-5d4dbc7b59-d42gf											system-cluster-critical pod "coredns-autoscaler-5d4dbc7b59-d42gf" is pending
Pod	kube-system/coredns-dd657c749-jtxhs												system-cluster-critical pod "coredns-dd657c749-jtxhs" is pending
Pod	kube-system/kube-apiserver-master-us-west3-a-r9rv										system-cluster-critical pod "kube-apiserver-master-us-west3-a-r9rv" is pending
Pod	kube-system/metadata-proxy-v0.12-7rr44												system-node-critical pod "metadata-proxy-v0.12-7rr44" is pending

Validation Failed
W0621 16:10:50.223925    6203 validate_cluster.go:232] (will retry): cluster not yet healthy
I0621 16:11:00.621495    6203 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c]
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-us-west3-a	Master	e2-standard-2	1	1	us-west3
nodes-us-west3-a	Node	n1-standard-2	4	4	us-west3
... skipping 13 lines ...
Node	nodes-us-west3-a-tw9s														node "nodes-us-west3-a-tw9s" of role "node" is not ready
Pod	kube-system/coredns-autoscaler-5d4dbc7b59-d42gf											system-cluster-critical pod "coredns-autoscaler-5d4dbc7b59-d42gf" is pending
Pod	kube-system/coredns-dd657c749-jtxhs												system-cluster-critical pod "coredns-dd657c749-jtxhs" is pending
Pod	kube-system/metadata-proxy-v0.12-4rwqt												system-node-critical pod "metadata-proxy-v0.12-4rwqt" is pending
Pod	kube-system/metadata-proxy-v0.12-ntrfh												system-node-critical pod "metadata-proxy-v0.12-ntrfh" is pending

Validation Failed
W0621 16:11:01.239413    6203 validate_cluster.go:232] (will retry): cluster not yet healthy
I0621 16:11:11.573945    6203 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c]
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-us-west3-a	Master	e2-standard-2	1	1	us-west3
nodes-us-west3-a	Node	n1-standard-2	4	4	us-west3
... skipping 10 lines ...
KIND	NAME					MESSAGE
Node	nodes-us-west3-a-12tt			node "nodes-us-west3-a-12tt" of role "node" is not ready
Node	nodes-us-west3-a-rbw1			node "nodes-us-west3-a-rbw1" of role "node" is not ready
Node	nodes-us-west3-a-tw9s			node "nodes-us-west3-a-tw9s" of role "node" is not ready
Pod	kube-system/metadata-proxy-v0.12-xg8wq	system-node-critical pod "metadata-proxy-v0.12-xg8wq" is pending

Validation Failed
W0621 16:11:12.157873    6203 validate_cluster.go:232] (will retry): cluster not yet healthy
I0621 16:11:22.567184    6203 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c]
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-us-west3-a	Master	e2-standard-2	1	1	us-west3
nodes-us-west3-a	Node	n1-standard-2	4	4	us-west3
... skipping 71 lines ...
nodes-us-west3-a-tw9s	node	True

VALIDATION ERRORS
KIND	NAME						MESSAGE
Pod	kube-system/kube-proxy-nodes-us-west3-a-rbw1	system-node-critical pod "kube-proxy-nodes-us-west3-a-rbw1" is pending

Validation Failed
W0621 16:12:07.160979    6203 validate_cluster.go:232] (will retry): cluster not yet healthy
I0621 16:12:17.849524    6203 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c]
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-us-west3-a	Master	e2-standard-2	1	1	us-west3
nodes-us-west3-a	Node	n1-standard-2	4	4	us-west3
... skipping 7 lines ...
nodes-us-west3-a-tw9s	node	True

VALIDATION ERRORS
KIND	NAME						MESSAGE
Pod	kube-system/kube-proxy-nodes-us-west3-a-tw9s	system-node-critical pod "kube-proxy-nodes-us-west3-a-tw9s" is pending

Validation Failed
W0621 16:12:18.538905    6203 validate_cluster.go:232] (will retry): cluster not yet healthy
I0621 16:12:28.856316    6203 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c]
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-us-west3-a	Master	e2-standard-2	1	1	us-west3
nodes-us-west3-a	Node	n1-standard-2	4	4	us-west3
... skipping 183 lines ...
===================================
Random Seed: 1655828070 - Will randomize all specs
Will run 7042 specs

Running in parallel across 25 nodes

Jun 21 16:14:46.836: INFO: lookupDiskImageSources: gcloud error with [[]string{"instance-groups", "list-instances", "", "--format=get(instance)"}]; err:exit status 1
Jun 21 16:14:46.836: INFO:  > ERROR: (gcloud.compute.instance-groups.list-instances) could not parse resource []
Jun 21 16:14:46.836: INFO:  > 
Jun 21 16:14:46.836: INFO: Cluster image sources lookup failed: exit status 1

Jun 21 16:14:46.836: INFO: >>> kubeConfig: /root/.kube/config
Jun 21 16:14:46.838: INFO: Waiting up to 30m0s for all (but 0) nodes to be schedulable
Jun 21 16:14:46.960: INFO: Waiting up to 10m0s for all pods (need at least 0) in namespace 'kube-system' to be running and ready
Jun 21 16:14:47.054: INFO: 21 / 21 pods in namespace 'kube-system' are running and ready (0 seconds elapsed)
Jun 21 16:14:47.054: INFO: expected 4 pod replicas in namespace 'kube-system', 4 are Running and Ready.
... skipping 366 lines ...
[sig-storage] In-tree Volumes
test/e2e/storage/utils/framework.go:23
  [Driver: azure-disk]
  test/e2e/storage/in_tree_volumes.go:63
    [Testpattern: Dynamic PV (delayed binding)] topology
    test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
      test/e2e/storage/testsuites/topology.go:194

      Only supported for providers [azure] (not gce)

      test/e2e/storage/drivers/in_tree.go:1577
------------------------------
... skipping 698 lines ...
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
Jun 21 16:14:47.283: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename configmap
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[It] should fail to create ConfigMap with empty key [Conformance]
  test/e2e/framework/framework.go:647
STEP: Creating configMap that has name configmap-test-emptyKey-58e01451-bc76-40c5-a92e-a7c41144a4a3
[AfterEach] [sig-node] ConfigMap
  test/e2e/framework/framework.go:187
Jun 21 16:14:47.501: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "configmap-8461" for this suite.

•
------------------------------
{"msg":"PASSED [sig-node] ConfigMap should fail to create ConfigMap with empty key [Conformance]","total":-1,"completed":1,"skipped":6,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:14:47.660: INFO: Driver local doesn't support GenericEphemeralVolume -- skipping
... skipping 55 lines ...
  test/e2e/framework/framework.go:187
Jun 21 16:14:48.303: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "kubectl-9720" for this suite.

•
------------------------------
{"msg":"PASSED [sig-cli] Kubectl client Kubectl create quota should create a quota with scopes","total":-1,"completed":2,"skipped":10,"failed":0}

S
------------------------------
[BeforeEach] [sig-cli] Kubectl client
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
... skipping 19 lines ...
  test/e2e/framework/framework.go:187
Jun 21 16:14:48.750: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "kubectl-7603" for this suite.

•
------------------------------
{"msg":"PASSED [sig-cli] Kubectl client Kubectl diff should check if kubectl diff finds a difference for Deployments [Conformance]","total":-1,"completed":1,"skipped":5,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:14:48.840: INFO: Only supported for node OS distro [gci ubuntu custom] (not debian)
... skipping 35 lines ...
  test/e2e/framework/framework.go:187
Jun 21 16:14:49.095: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "metrics-grabber-7260" for this suite.

•
------------------------------
{"msg":"PASSED [sig-instrumentation] MetricsGrabber should grab all metrics from a Kubelet.","total":-1,"completed":1,"skipped":2,"failed":0}
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:14:49.163: INFO: Driver local doesn't support InlineVolume -- skipping
[AfterEach] [Testpattern: Inline-volume (default fs)] subPath
  test/e2e/framework/framework.go:187

... skipping 72 lines ...
• [SLOW TEST:8.554 seconds]
[sig-apps] ReplicaSet
test/e2e/apps/framework.go:23
  should adopt matching pods on creation and release no longer matching pods [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-apps] ReplicaSet should adopt matching pods on creation and release no longer matching pods [Conformance]","total":-1,"completed":1,"skipped":0,"failed":0}

SSSS
------------------------------
[BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:14:55.837: INFO: Driver local doesn't support GenericEphemeralVolume -- skipping
... skipping 67 lines ...
• [SLOW TEST:8.694 seconds]
[sig-storage] ConfigMap
test/e2e/common/storage/framework.go:23
  binary data should be reflected in volume [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-storage] ConfigMap binary data should be reflected in volume [NodeConformance] [Conformance]","total":-1,"completed":1,"skipped":4,"failed":0}
[BeforeEach] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:14:56.010: INFO: Only supported for providers [vsphere] (not gce)
[AfterEach] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral
  test/e2e/framework/framework.go:187

... skipping 38 lines ...
STEP: verifying the pod is in kubernetes
STEP: updating the pod
Jun 21 16:14:52.116: INFO: Successfully updated pod "pod-update-activedeadlineseconds-d3869a3c-4359-4135-993e-bdac9baaed36"
Jun 21 16:14:52.116: INFO: Waiting up to 5m0s for pod "pod-update-activedeadlineseconds-d3869a3c-4359-4135-993e-bdac9baaed36" in namespace "pods-3432" to be "terminated with reason DeadlineExceeded"
Jun 21 16:14:52.140: INFO: Pod "pod-update-activedeadlineseconds-d3869a3c-4359-4135-993e-bdac9baaed36": Phase="Running", Reason="", readiness=false. Elapsed: 24.090812ms
Jun 21 16:14:54.168: INFO: Pod "pod-update-activedeadlineseconds-d3869a3c-4359-4135-993e-bdac9baaed36": Phase="Running", Reason="", readiness=false. Elapsed: 2.051697543s
Jun 21 16:14:56.167: INFO: Pod "pod-update-activedeadlineseconds-d3869a3c-4359-4135-993e-bdac9baaed36": Phase="Failed", Reason="DeadlineExceeded", readiness=false. Elapsed: 4.05092546s
Jun 21 16:14:56.167: INFO: Pod "pod-update-activedeadlineseconds-d3869a3c-4359-4135-993e-bdac9baaed36" satisfied condition "terminated with reason DeadlineExceeded"
[AfterEach] [sig-node] Pods
  test/e2e/framework/framework.go:187
Jun 21 16:14:56.167: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "pods-3432" for this suite.


• [SLOW TEST:9.009 seconds]
[sig-node] Pods
test/e2e/common/node/framework.go:23
  should allow activeDeadlineSeconds to be updated [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-node] Pods should allow activeDeadlineSeconds to be updated [NodeConformance] [Conformance]","total":-1,"completed":1,"skipped":12,"failed":0}

SSS
------------------------------
[BeforeEach] [sig-storage] Secrets
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
... skipping 33 lines ...
STEP: Destroying namespace "services-9800" for this suite.
[AfterEach] [sig-network] Services
  test/e2e/network/service.go:762

•
------------------------------
{"msg":"PASSED [sig-api-machinery] Garbage collector should not be blocked by dependency circle [Conformance]","total":-1,"completed":1,"skipped":16,"failed":0}
[BeforeEach] [sig-node] Container Runtime
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
Jun 21 16:14:53.201: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename container-runtime
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 11 lines ...
  test/e2e/framework/framework.go:187
Jun 21 16:14:56.581: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "container-runtime-2538" for this suite.

•
------------------------------
{"msg":"PASSED [sig-node] Container Runtime blackbox test on terminated container should report termination message if TerminationMessagePath is set as non-root user and at a non-default path [NodeConformance] [Conformance]","total":-1,"completed":2,"skipped":16,"failed":0}
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:14:57.133: INFO: Only supported for providers [azure] (not gce)
[AfterEach] [Testpattern: Inline-volume (default fs)] subPath
  test/e2e/framework/framework.go:187

... skipping 9 lines ...
      test/e2e/storage/testsuites/subpath.go:232

      Only supported for providers [azure] (not gce)

      test/e2e/storage/drivers/in_tree.go:2079
------------------------------
{"msg":"PASSED [sig-network] Services should delete a collection of services [Conformance]","total":-1,"completed":2,"skipped":9,"failed":0}
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:14:57.133: INFO: Only supported for providers [azure] (not gce)
[AfterEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  test/e2e/framework/framework.go:187

... skipping 11 lines ...
      Only supported for providers [azure] (not gce)

      test/e2e/storage/drivers/in_tree.go:2079
------------------------------
SSSS
------------------------------
{"msg":"PASSED [sig-architecture] Conformance Tests should have at least two untainted nodes [Conformance]","total":-1,"completed":1,"skipped":4,"failed":0}
[BeforeEach] [sig-storage] ConfigMap
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
Jun 21 16:14:47.769: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename configmap
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[It] should be consumable from pods in volume as non-root [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
STEP: Creating configMap with name configmap-test-volume-ac73b18a-91cb-4f5f-adc3-7b23151bd6c0
STEP: Creating a pod to test consume configMaps
Jun 21 16:14:48.262: INFO: Waiting up to 5m0s for pod "pod-configmaps-4df5f9c6-d33b-442c-8653-ead1fdac4cb7" in namespace "configmap-4002" to be "Succeeded or Failed"
Jun 21 16:14:48.303: INFO: Pod "pod-configmaps-4df5f9c6-d33b-442c-8653-ead1fdac4cb7": Phase="Pending", Reason="", readiness=false. Elapsed: 41.69379ms
Jun 21 16:14:50.330: INFO: Pod "pod-configmaps-4df5f9c6-d33b-442c-8653-ead1fdac4cb7": Phase="Pending", Reason="", readiness=false. Elapsed: 2.068348762s
Jun 21 16:14:52.330: INFO: Pod "pod-configmaps-4df5f9c6-d33b-442c-8653-ead1fdac4cb7": Phase="Pending", Reason="", readiness=false. Elapsed: 4.068084989s
Jun 21 16:14:54.328: INFO: Pod "pod-configmaps-4df5f9c6-d33b-442c-8653-ead1fdac4cb7": Phase="Pending", Reason="", readiness=false. Elapsed: 6.066802858s
Jun 21 16:14:56.350: INFO: Pod "pod-configmaps-4df5f9c6-d33b-442c-8653-ead1fdac4cb7": Phase="Pending", Reason="", readiness=false. Elapsed: 8.087959033s
Jun 21 16:14:58.330: INFO: Pod "pod-configmaps-4df5f9c6-d33b-442c-8653-ead1fdac4cb7": Phase="Succeeded", Reason="", readiness=false. Elapsed: 10.068113836s
STEP: Saw pod success
Jun 21 16:14:58.330: INFO: Pod "pod-configmaps-4df5f9c6-d33b-442c-8653-ead1fdac4cb7" satisfied condition "Succeeded or Failed"
Jun 21 16:14:58.355: INFO: Trying to get logs from node nodes-us-west3-a-kkxs pod pod-configmaps-4df5f9c6-d33b-442c-8653-ead1fdac4cb7 container agnhost-container: <nil>
STEP: delete the pod
Jun 21 16:14:58.418: INFO: Waiting for pod pod-configmaps-4df5f9c6-d33b-442c-8653-ead1fdac4cb7 to disappear
Jun 21 16:14:58.444: INFO: Pod pod-configmaps-4df5f9c6-d33b-442c-8653-ead1fdac4cb7 no longer exists
[AfterEach] [sig-storage] ConfigMap
  test/e2e/framework/framework.go:187
... skipping 4 lines ...
• [SLOW TEST:10.732 seconds]
[sig-storage] ConfigMap
test/e2e/common/storage/framework.go:23
  should be consumable from pods in volume as non-root [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-storage] ConfigMap should be consumable from pods in volume as non-root [NodeConformance] [Conformance]","total":-1,"completed":2,"skipped":4,"failed":0}

SSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (immediate binding)] topology
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:14:58.532: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 5 lines ...
[sig-storage] In-tree Volumes
test/e2e/storage/utils/framework.go:23
  [Driver: local][LocalVolumeType: dir-link-bindmounted]
  test/e2e/storage/in_tree_volumes.go:63
    [Testpattern: Dynamic PV (immediate binding)] topology
    test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
      test/e2e/storage/testsuites/topology.go:194

      Driver local doesn't support DynamicPV -- skipping

      test/e2e/storage/framework/testsuite.go:116
------------------------------
... skipping 6 lines ...
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[BeforeEach] [sig-storage] Projected downwardAPI
  test/e2e/common/storage/projected_downwardapi.go:43
[It] should provide container's cpu limit [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
STEP: Creating a pod to test downward API volume plugin
Jun 21 16:14:49.059: INFO: Waiting up to 5m0s for pod "downwardapi-volume-8f719b1f-f212-4dc4-8a28-1009594ec6ed" in namespace "projected-4822" to be "Succeeded or Failed"
Jun 21 16:14:49.083: INFO: Pod "downwardapi-volume-8f719b1f-f212-4dc4-8a28-1009594ec6ed": Phase="Pending", Reason="", readiness=false. Elapsed: 24.459836ms
Jun 21 16:14:51.109: INFO: Pod "downwardapi-volume-8f719b1f-f212-4dc4-8a28-1009594ec6ed": Phase="Pending", Reason="", readiness=false. Elapsed: 2.050496193s
Jun 21 16:14:53.109: INFO: Pod "downwardapi-volume-8f719b1f-f212-4dc4-8a28-1009594ec6ed": Phase="Pending", Reason="", readiness=false. Elapsed: 4.050595392s
Jun 21 16:14:55.109: INFO: Pod "downwardapi-volume-8f719b1f-f212-4dc4-8a28-1009594ec6ed": Phase="Running", Reason="", readiness=true. Elapsed: 6.049733328s
Jun 21 16:14:57.108: INFO: Pod "downwardapi-volume-8f719b1f-f212-4dc4-8a28-1009594ec6ed": Phase="Running", Reason="", readiness=false. Elapsed: 8.048857716s
Jun 21 16:14:59.108: INFO: Pod "downwardapi-volume-8f719b1f-f212-4dc4-8a28-1009594ec6ed": Phase="Succeeded", Reason="", readiness=false. Elapsed: 10.049503669s
STEP: Saw pod success
Jun 21 16:14:59.108: INFO: Pod "downwardapi-volume-8f719b1f-f212-4dc4-8a28-1009594ec6ed" satisfied condition "Succeeded or Failed"
Jun 21 16:14:59.134: INFO: Trying to get logs from node nodes-us-west3-a-kkxs pod downwardapi-volume-8f719b1f-f212-4dc4-8a28-1009594ec6ed container client-container: <nil>
STEP: delete the pod
Jun 21 16:14:59.192: INFO: Waiting for pod downwardapi-volume-8f719b1f-f212-4dc4-8a28-1009594ec6ed to disappear
Jun 21 16:14:59.215: INFO: Pod downwardapi-volume-8f719b1f-f212-4dc4-8a28-1009594ec6ed no longer exists
[AfterEach] [sig-storage] Projected downwardAPI
  test/e2e/framework/framework.go:187
... skipping 4 lines ...
• [SLOW TEST:10.416 seconds]
[sig-storage] Projected downwardAPI
test/e2e/common/storage/framework.go:23
  should provide container's cpu limit [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-storage] Projected downwardAPI should provide container's cpu limit [NodeConformance] [Conformance]","total":-1,"completed":2,"skipped":9,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] provisioning
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:14:59.285: INFO: Only supported for providers [openstack] (not gce)
[AfterEach] [Testpattern: Dynamic PV (block volmode)] provisioning
  test/e2e/framework/framework.go:187

... skipping 209 lines ...
• [SLOW TEST:12.802 seconds]
[sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/framework.go:23
  should mutate custom resource [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate custom resource [Conformance]","total":-1,"completed":1,"skipped":11,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] volumes
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:15:00.190: INFO: Only supported for providers [aws] (not gce)
... skipping 145 lines ...
test/e2e/network/common/framework.go:23
  version v1
  test/e2e/network/proxy.go:74
    A set of valid responses are returned for both pod and service ProxyWithPath [Conformance]
    test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-network] Proxy version v1 A set of valid responses are returned for both pod and service ProxyWithPath [Conformance]","total":-1,"completed":3,"skipped":11,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (delayed binding)] topology
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:15:01.141: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 83 lines ...
  test/e2e/framework/framework.go:187
Jun 21 16:15:01.607: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "emptydir-wrapper-7289" for this suite.

•
------------------------------
{"msg":"PASSED [sig-storage] Secrets should be immutable if `immutable` field is set [Conformance]","total":-1,"completed":2,"skipped":10,"failed":0}
[BeforeEach] [sig-node] Variable Expansion
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
Jun 21 16:14:56.405: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename var-expansion
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[It] should allow composing env vars into new env vars [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
STEP: Creating a pod to test env composition
Jun 21 16:14:56.627: INFO: Waiting up to 5m0s for pod "var-expansion-bebeafec-e857-42ff-ba8d-796039387214" in namespace "var-expansion-5849" to be "Succeeded or Failed"
Jun 21 16:14:56.652: INFO: Pod "var-expansion-bebeafec-e857-42ff-ba8d-796039387214": Phase="Pending", Reason="", readiness=false. Elapsed: 24.855945ms
Jun 21 16:14:58.677: INFO: Pod "var-expansion-bebeafec-e857-42ff-ba8d-796039387214": Phase="Pending", Reason="", readiness=false. Elapsed: 2.050214467s
Jun 21 16:15:00.677: INFO: Pod "var-expansion-bebeafec-e857-42ff-ba8d-796039387214": Phase="Running", Reason="", readiness=false. Elapsed: 4.050016866s
Jun 21 16:15:02.677: INFO: Pod "var-expansion-bebeafec-e857-42ff-ba8d-796039387214": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.050131518s
STEP: Saw pod success
Jun 21 16:15:02.677: INFO: Pod "var-expansion-bebeafec-e857-42ff-ba8d-796039387214" satisfied condition "Succeeded or Failed"
Jun 21 16:15:02.702: INFO: Trying to get logs from node nodes-us-west3-a-12tt pod var-expansion-bebeafec-e857-42ff-ba8d-796039387214 container dapi-container: <nil>
STEP: delete the pod
Jun 21 16:15:03.599: INFO: Waiting for pod var-expansion-bebeafec-e857-42ff-ba8d-796039387214 to disappear
Jun 21 16:15:03.625: INFO: Pod var-expansion-bebeafec-e857-42ff-ba8d-796039387214 no longer exists
[AfterEach] [sig-node] Variable Expansion
  test/e2e/framework/framework.go:187
... skipping 4 lines ...
• [SLOW TEST:7.276 seconds]
[sig-node] Variable Expansion
test/e2e/common/node/framework.go:23
  should allow composing env vars into new env vars [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-node] Variable Expansion should allow composing env vars into new env vars [NodeConformance] [Conformance]","total":-1,"completed":3,"skipped":10,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] provisioning
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:15:03.692: INFO: Driver emptydir doesn't support DynamicPV -- skipping
[AfterEach] [Testpattern: Dynamic PV (block volmode)] provisioning
  test/e2e/framework/framework.go:187

... skipping 48 lines ...
[sig-storage] In-tree Volumes
test/e2e/storage/utils/framework.go:23
  [Driver: vsphere]
  test/e2e/storage/in_tree_volumes.go:63
    [Testpattern: Dynamic PV (delayed binding)] topology
    test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
      test/e2e/storage/testsuites/topology.go:194

      Only supported for providers [vsphere] (not gce)

      test/e2e/storage/drivers/in_tree.go:1439
------------------------------
... skipping 71 lines ...
• [SLOW TEST:16.629 seconds]
[sig-api-machinery] ResourceQuota
test/e2e/apimachinery/framework.go:23
  should create a ResourceQuota and capture the life of a secret. [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a secret. [Conformance]","total":-1,"completed":1,"skipped":11,"failed":0}

S
------------------------------
[BeforeEach] [sig-node] PreStop
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
... skipping 44 lines ...
• [SLOW TEST:17.970 seconds]
[sig-node] PreStop
test/e2e/node/framework.go:23
  should call prestop when killing a pod  [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-node] PreStop should call prestop when killing a pod  [Conformance]","total":-1,"completed":1,"skipped":22,"failed":0}
[BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:15:05.403: INFO: Only supported for providers [aws] (not gce)
[AfterEach] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral
  test/e2e/framework/framework.go:187

... skipping 121 lines ...
  test/e2e/framework/framework.go:187
Jun 21 16:15:05.754: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "podtemplate-6274" for this suite.

•
------------------------------
{"msg":"PASSED [sig-node] PodTemplates should replace a pod template [Conformance]","total":-1,"completed":2,"skipped":42,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (default fs)] provisioning
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:15:05.820: INFO: Only supported for node OS distro [gci ubuntu custom] (not debian)
[AfterEach] [Testpattern: Dynamic PV (default fs)] provisioning
  test/e2e/framework/framework.go:187

... skipping 57 lines ...
      Driver local doesn't support DynamicPV -- skipping

      test/e2e/storage/framework/testsuite.go:116
------------------------------
SSS
------------------------------
{"msg":"PASSED [sig-storage] EmptyDir wrapper volumes should not conflict [Conformance]","total":-1,"completed":3,"skipped":11,"failed":0}
[BeforeEach] [sig-storage] Projected configMap
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
Jun 21 16:15:01.691: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename projected
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[It] should be consumable from pods in volume with mappings as non-root with FSGroup [LinuxOnly] [NodeFeature:FSGroup]
  test/e2e/common/storage/projected_configmap.go:112
STEP: Creating configMap with name projected-configmap-test-volume-map-28a9982c-f6ec-4fbf-9111-abd913b70188
STEP: Creating a pod to test consume configMaps
Jun 21 16:15:01.959: INFO: Waiting up to 5m0s for pod "pod-projected-configmaps-9b933439-3c31-41cc-88aa-7b4737b09b06" in namespace "projected-3148" to be "Succeeded or Failed"
Jun 21 16:15:01.986: INFO: Pod "pod-projected-configmaps-9b933439-3c31-41cc-88aa-7b4737b09b06": Phase="Pending", Reason="", readiness=false. Elapsed: 26.922132ms
Jun 21 16:15:04.018: INFO: Pod "pod-projected-configmaps-9b933439-3c31-41cc-88aa-7b4737b09b06": Phase="Pending", Reason="", readiness=false. Elapsed: 2.05895694s
Jun 21 16:15:06.013: INFO: Pod "pod-projected-configmaps-9b933439-3c31-41cc-88aa-7b4737b09b06": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.053761831s
STEP: Saw pod success
Jun 21 16:15:06.013: INFO: Pod "pod-projected-configmaps-9b933439-3c31-41cc-88aa-7b4737b09b06" satisfied condition "Succeeded or Failed"
Jun 21 16:15:06.039: INFO: Trying to get logs from node nodes-us-west3-a-kkxs pod pod-projected-configmaps-9b933439-3c31-41cc-88aa-7b4737b09b06 container agnhost-container: <nil>
STEP: delete the pod
Jun 21 16:15:06.117: INFO: Waiting for pod pod-projected-configmaps-9b933439-3c31-41cc-88aa-7b4737b09b06 to disappear
Jun 21 16:15:06.146: INFO: Pod pod-projected-configmaps-9b933439-3c31-41cc-88aa-7b4737b09b06 no longer exists
[AfterEach] [sig-storage] Projected configMap
  test/e2e/framework/framework.go:187
Jun 21 16:15:06.146: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "projected-3148" for this suite.

•
------------------------------
{"msg":"PASSED [sig-storage] Projected configMap should be consumable from pods in volume with mappings as non-root with FSGroup [LinuxOnly] [NodeFeature:FSGroup]","total":-1,"completed":4,"skipped":11,"failed":0}

SSS
------------------------------
[BeforeEach] [sig-apps] StatefulSet
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
... skipping 15 lines ...
• [SLOW TEST:10.288 seconds]
[sig-apps] StatefulSet
test/e2e/apps/framework.go:23
  MinReadySeconds should be honored when enabled
  test/e2e/apps/statefulset.go:1152
------------------------------
{"msg":"PASSED [sig-apps] StatefulSet MinReadySeconds should be honored when enabled","total":-1,"completed":3,"skipped":20,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ext3)] volumes
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:15:07.468: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 162 lines ...
[sig-storage] In-tree Volumes
test/e2e/storage/utils/framework.go:23
  [Driver: emptydir]
  test/e2e/storage/in_tree_volumes.go:63
    [Testpattern: Dynamic PV (immediate binding)] topology
    test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
      test/e2e/storage/testsuites/topology.go:194

      Driver emptydir doesn't support DynamicPV -- skipping

      test/e2e/storage/framework/testsuite.go:116
------------------------------
... skipping 41 lines ...
• [SLOW TEST:20.915 seconds]
[sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/framework.go:23
  should be able to deny pod and configmap creation [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should be able to deny pod and configmap creation [Conformance]","total":-1,"completed":1,"skipped":7,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
... skipping 26 lines ...
Jun 21 16:14:59.999: INFO: PersistentVolumeClaim pvc-lcsst found but phase is Pending instead of Bound.
Jun 21 16:15:02.025: INFO: PersistentVolumeClaim pvc-lcsst found and phase=Bound (6.109960983s)
Jun 21 16:15:02.025: INFO: Waiting up to 3m0s for PersistentVolume local-jk79h to have phase Bound
Jun 21 16:15:02.052: INFO: PersistentVolume local-jk79h found and phase=Bound (27.62109ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-zbkz
STEP: Creating a pod to test subpath
Jun 21 16:15:02.139: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-zbkz" in namespace "provisioning-6554" to be "Succeeded or Failed"
Jun 21 16:15:02.169: INFO: Pod "pod-subpath-test-preprovisionedpv-zbkz": Phase="Pending", Reason="", readiness=false. Elapsed: 29.440604ms
Jun 21 16:15:04.195: INFO: Pod "pod-subpath-test-preprovisionedpv-zbkz": Phase="Pending", Reason="", readiness=false. Elapsed: 2.055999372s
Jun 21 16:15:06.198: INFO: Pod "pod-subpath-test-preprovisionedpv-zbkz": Phase="Pending", Reason="", readiness=false. Elapsed: 4.058678639s
Jun 21 16:15:08.198: INFO: Pod "pod-subpath-test-preprovisionedpv-zbkz": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.058559278s
STEP: Saw pod success
Jun 21 16:15:08.198: INFO: Pod "pod-subpath-test-preprovisionedpv-zbkz" satisfied condition "Succeeded or Failed"
Jun 21 16:15:08.223: INFO: Trying to get logs from node nodes-us-west3-a-12tt pod pod-subpath-test-preprovisionedpv-zbkz container test-container-subpath-preprovisionedpv-zbkz: <nil>
STEP: delete the pod
Jun 21 16:15:08.319: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-zbkz to disappear
Jun 21 16:15:08.344: INFO: Pod pod-subpath-test-preprovisionedpv-zbkz no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-zbkz
Jun 21 16:15:08.344: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-zbkz" in namespace "provisioning-6554"
... skipping 21 lines ...
  test/e2e/storage/in_tree_volumes.go:63
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    test/e2e/storage/framework/testsuite.go:50
      should support existing single file [LinuxOnly]
      test/e2e/storage/testsuites/subpath.go:221
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir-link-bindmounted] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing single file [LinuxOnly]","total":-1,"completed":1,"skipped":3,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:15:08.810: INFO: Only supported for node OS distro [gci ubuntu custom] (not debian)
... skipping 94 lines ...
Jun 21 16:15:00.182: INFO: PersistentVolumeClaim pvc-6ktwq found but phase is Pending instead of Bound.
Jun 21 16:15:02.211: INFO: PersistentVolumeClaim pvc-6ktwq found and phase=Bound (8.130370839s)
Jun 21 16:15:02.211: INFO: Waiting up to 3m0s for PersistentVolume local-49v6w to have phase Bound
Jun 21 16:15:02.234: INFO: PersistentVolume local-49v6w found and phase=Bound (23.069357ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-66mg
STEP: Creating a pod to test subpath
Jun 21 16:15:02.306: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-66mg" in namespace "provisioning-2673" to be "Succeeded or Failed"
Jun 21 16:15:02.332: INFO: Pod "pod-subpath-test-preprovisionedpv-66mg": Phase="Pending", Reason="", readiness=false. Elapsed: 25.59582ms
Jun 21 16:15:04.361: INFO: Pod "pod-subpath-test-preprovisionedpv-66mg": Phase="Pending", Reason="", readiness=false. Elapsed: 2.054866729s
Jun 21 16:15:06.371: INFO: Pod "pod-subpath-test-preprovisionedpv-66mg": Phase="Pending", Reason="", readiness=false. Elapsed: 4.064137067s
Jun 21 16:15:08.365: INFO: Pod "pod-subpath-test-preprovisionedpv-66mg": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.058475236s
STEP: Saw pod success
Jun 21 16:15:08.365: INFO: Pod "pod-subpath-test-preprovisionedpv-66mg" satisfied condition "Succeeded or Failed"
Jun 21 16:15:08.389: INFO: Trying to get logs from node nodes-us-west3-a-12tt pod pod-subpath-test-preprovisionedpv-66mg container test-container-subpath-preprovisionedpv-66mg: <nil>
STEP: delete the pod
Jun 21 16:15:08.447: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-66mg to disappear
Jun 21 16:15:08.474: INFO: Pod pod-subpath-test-preprovisionedpv-66mg no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-66mg
Jun 21 16:15:08.474: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-66mg" in namespace "provisioning-2673"
... skipping 21 lines ...
  test/e2e/storage/in_tree_volumes.go:63
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    test/e2e/storage/framework/testsuite.go:50
      should support existing single file [LinuxOnly]
      test/e2e/storage/testsuites/subpath.go:221
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing single file [LinuxOnly]","total":-1,"completed":1,"skipped":2,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:15:08.964: INFO: Driver hostPath doesn't support DynamicPV -- skipping
[AfterEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  test/e2e/framework/framework.go:187

... skipping 25 lines ...
  test/e2e/framework/framework.go:187
Jun 21 16:15:09.427: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "lease-test-8554" for this suite.

•
------------------------------
{"msg":"PASSED [sig-node] Lease lease API should be available [Conformance]","total":-1,"completed":2,"skipped":11,"failed":0}

SSSS
------------------------------
[BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:15:09.532: INFO: Driver local doesn't support GenericEphemeralVolume -- skipping
... skipping 23 lines ...
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[It] should be consumable from pods in volume [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
STEP: Creating secret with name secret-test-3b6a3afa-7334-499a-963d-159a9342cc7e
STEP: Creating a pod to test consume secrets
Jun 21 16:15:04.230: INFO: Waiting up to 5m0s for pod "pod-secrets-8db98bf6-6bfd-42dd-8f6d-fb74af94ddeb" in namespace "secrets-465" to be "Succeeded or Failed"
Jun 21 16:15:04.254: INFO: Pod "pod-secrets-8db98bf6-6bfd-42dd-8f6d-fb74af94ddeb": Phase="Pending", Reason="", readiness=false. Elapsed: 23.891416ms
Jun 21 16:15:06.281: INFO: Pod "pod-secrets-8db98bf6-6bfd-42dd-8f6d-fb74af94ddeb": Phase="Pending", Reason="", readiness=false. Elapsed: 2.05052544s
Jun 21 16:15:08.281: INFO: Pod "pod-secrets-8db98bf6-6bfd-42dd-8f6d-fb74af94ddeb": Phase="Pending", Reason="", readiness=false. Elapsed: 4.051029229s
Jun 21 16:15:10.281: INFO: Pod "pod-secrets-8db98bf6-6bfd-42dd-8f6d-fb74af94ddeb": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.050548362s
STEP: Saw pod success
Jun 21 16:15:10.281: INFO: Pod "pod-secrets-8db98bf6-6bfd-42dd-8f6d-fb74af94ddeb" satisfied condition "Succeeded or Failed"
Jun 21 16:15:10.306: INFO: Trying to get logs from node nodes-us-west3-a-12tt pod pod-secrets-8db98bf6-6bfd-42dd-8f6d-fb74af94ddeb container secret-volume-test: <nil>
STEP: delete the pod
Jun 21 16:15:10.370: INFO: Waiting for pod pod-secrets-8db98bf6-6bfd-42dd-8f6d-fb74af94ddeb to disappear
Jun 21 16:15:10.401: INFO: Pod pod-secrets-8db98bf6-6bfd-42dd-8f6d-fb74af94ddeb no longer exists
[AfterEach] [sig-storage] Secrets
  test/e2e/framework/framework.go:187
... skipping 4 lines ...
• [SLOW TEST:6.448 seconds]
[sig-storage] Secrets
test/e2e/common/storage/framework.go:23
  should be consumable from pods in volume [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-storage] Secrets should be consumable from pods in volume [NodeConformance] [Conformance]","total":-1,"completed":2,"skipped":12,"failed":0}

SS
------------------------------
[BeforeEach] [sig-api-machinery] Watchers
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
... skipping 29 lines ...
• [SLOW TEST:10.571 seconds]
[sig-api-machinery] Watchers
test/e2e/apimachinery/framework.go:23
  should observe an object deletion if it stops meeting the requirements of the selector [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-api-machinery] Watchers should observe an object deletion if it stops meeting the requirements of the selector [Conformance]","total":-1,"completed":2,"skipped":25,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (immediate binding)] topology
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:15:10.850: INFO: Driver local doesn't support DynamicPV -- skipping
[AfterEach] [Testpattern: Dynamic PV (immediate binding)] topology
  test/e2e/framework/framework.go:187

... skipping 107 lines ...
  test/e2e/storage/persistent_volumes-local.go:194
    One pod requesting one prebound PVC
    test/e2e/storage/persistent_volumes-local.go:211
      should be able to mount volume and read from pod1
      test/e2e/storage/persistent_volumes-local.go:234
------------------------------
{"msg":"PASSED [sig-storage] PersistentVolumes-local  [Volume type: blockfswithoutformat] One pod requesting one prebound PVC should be able to mount volume and read from pod1","total":-1,"completed":3,"skipped":46,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] provisioning
  test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] provisioning
... skipping 59 lines ...
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[It] should be consumable from pods in volume with defaultMode set [LinuxOnly] [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
STEP: Creating secret with name secret-test-da831772-1af5-43d1-8c3f-9049d8c1c0ce
STEP: Creating a pod to test consume secrets
Jun 21 16:15:01.420: INFO: Waiting up to 5m0s for pod "pod-secrets-dbf369e8-66be-4332-a6b2-dc6476fd6181" in namespace "secrets-3220" to be "Succeeded or Failed"
Jun 21 16:15:01.443: INFO: Pod "pod-secrets-dbf369e8-66be-4332-a6b2-dc6476fd6181": Phase="Pending", Reason="", readiness=false. Elapsed: 22.9438ms
Jun 21 16:15:03.468: INFO: Pod "pod-secrets-dbf369e8-66be-4332-a6b2-dc6476fd6181": Phase="Pending", Reason="", readiness=false. Elapsed: 2.047995849s
Jun 21 16:15:05.467: INFO: Pod "pod-secrets-dbf369e8-66be-4332-a6b2-dc6476fd6181": Phase="Pending", Reason="", readiness=false. Elapsed: 4.047082125s
Jun 21 16:15:07.468: INFO: Pod "pod-secrets-dbf369e8-66be-4332-a6b2-dc6476fd6181": Phase="Pending", Reason="", readiness=false. Elapsed: 6.048062109s
Jun 21 16:15:09.471: INFO: Pod "pod-secrets-dbf369e8-66be-4332-a6b2-dc6476fd6181": Phase="Running", Reason="", readiness=true. Elapsed: 8.051093672s
Jun 21 16:15:11.475: INFO: Pod "pod-secrets-dbf369e8-66be-4332-a6b2-dc6476fd6181": Phase="Succeeded", Reason="", readiness=false. Elapsed: 10.055222995s
STEP: Saw pod success
Jun 21 16:15:11.475: INFO: Pod "pod-secrets-dbf369e8-66be-4332-a6b2-dc6476fd6181" satisfied condition "Succeeded or Failed"
Jun 21 16:15:11.503: INFO: Trying to get logs from node nodes-us-west3-a-tw9s pod pod-secrets-dbf369e8-66be-4332-a6b2-dc6476fd6181 container secret-volume-test: <nil>
STEP: delete the pod
Jun 21 16:15:11.568: INFO: Waiting for pod pod-secrets-dbf369e8-66be-4332-a6b2-dc6476fd6181 to disappear
Jun 21 16:15:11.600: INFO: Pod pod-secrets-dbf369e8-66be-4332-a6b2-dc6476fd6181 no longer exists
[AfterEach] [sig-storage] Secrets
  test/e2e/framework/framework.go:187
... skipping 4 lines ...
• [SLOW TEST:10.482 seconds]
[sig-storage] Secrets
test/e2e/common/storage/framework.go:23
  should be consumable from pods in volume with defaultMode set [LinuxOnly] [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-storage] Secrets should be consumable from pods in volume with defaultMode set [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":4,"skipped":18,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:15:11.681: INFO: Only supported for providers [vsphere] (not gce)
... skipping 143 lines ...
• [SLOW TEST:7.910 seconds]
[sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin]
test/e2e/apimachinery/framework.go:23
  works for CRD preserving unknown fields in an embedded object [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for CRD preserving unknown fields in an embedded object [Conformance]","total":-1,"completed":3,"skipped":50,"failed":0}

SSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:15:13.807: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 47 lines ...
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[BeforeEach] [sig-storage] Downward API volume
  test/e2e/common/storage/downwardapi_volume.go:43
[It] should provide node allocatable (memory) as default memory limit if the limit is not set [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
STEP: Creating a pod to test downward API volume plugin
Jun 21 16:15:07.781: INFO: Waiting up to 5m0s for pod "downwardapi-volume-14a4982f-cd9f-4085-916d-9902bffbf5aa" in namespace "downward-api-1165" to be "Succeeded or Failed"
Jun 21 16:15:07.804: INFO: Pod "downwardapi-volume-14a4982f-cd9f-4085-916d-9902bffbf5aa": Phase="Pending", Reason="", readiness=false. Elapsed: 22.30101ms
Jun 21 16:15:09.827: INFO: Pod "downwardapi-volume-14a4982f-cd9f-4085-916d-9902bffbf5aa": Phase="Pending", Reason="", readiness=false. Elapsed: 2.046113796s
Jun 21 16:15:11.827: INFO: Pod "downwardapi-volume-14a4982f-cd9f-4085-916d-9902bffbf5aa": Phase="Pending", Reason="", readiness=false. Elapsed: 4.046253771s
Jun 21 16:15:13.827: INFO: Pod "downwardapi-volume-14a4982f-cd9f-4085-916d-9902bffbf5aa": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.045367065s
STEP: Saw pod success
Jun 21 16:15:13.827: INFO: Pod "downwardapi-volume-14a4982f-cd9f-4085-916d-9902bffbf5aa" satisfied condition "Succeeded or Failed"
Jun 21 16:15:13.849: INFO: Trying to get logs from node nodes-us-west3-a-12tt pod downwardapi-volume-14a4982f-cd9f-4085-916d-9902bffbf5aa container client-container: <nil>
STEP: delete the pod
Jun 21 16:15:13.918: INFO: Waiting for pod downwardapi-volume-14a4982f-cd9f-4085-916d-9902bffbf5aa to disappear
Jun 21 16:15:13.941: INFO: Pod downwardapi-volume-14a4982f-cd9f-4085-916d-9902bffbf5aa no longer exists
[AfterEach] [sig-storage] Downward API volume
  test/e2e/framework/framework.go:187
... skipping 4 lines ...
• [SLOW TEST:6.406 seconds]
[sig-storage] Downward API volume
test/e2e/common/storage/framework.go:23
  should provide node allocatable (memory) as default memory limit if the limit is not set [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-storage] Downward API volume should provide node allocatable (memory) as default memory limit if the limit is not set [NodeConformance] [Conformance]","total":-1,"completed":4,"skipped":41,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (ext3)] volumes
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:15:14.019: INFO: Only supported for providers [azure] (not gce)
... skipping 81 lines ...
  test/e2e/framework/framework.go:187
Jun 21 16:15:14.065: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "pods-9569" for this suite.

•
------------------------------
{"msg":"PASSED [sig-node] Pods Extended Pods Set QOS Class should be set on Pods with matching resource requests and limits for memory and cpu [Conformance]","total":-1,"completed":4,"skipped":58,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:15:14.142: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 202 lines ...
  test/e2e/storage/persistent_volumes-local.go:194
    Two pods mounting a local volume one after the other
    test/e2e/storage/persistent_volumes-local.go:256
      should be able to write from pod1 and read from pod2
      test/e2e/storage/persistent_volumes-local.go:257
------------------------------
{"msg":"PASSED [sig-storage] PersistentVolumes-local  [Volume type: dir-bindmounted] Two pods mounting a local volume one after the other should be able to write from pod1 and read from pod2","total":-1,"completed":1,"skipped":17,"failed":0}

SSSS
------------------------------
[BeforeEach] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:15:16.056: INFO: Only supported for providers [azure] (not gce)
... skipping 135 lines ...
      Driver hostPath doesn't support DynamicPV -- skipping

      test/e2e/storage/framework/testsuite.go:116
------------------------------
S
------------------------------
{"msg":"PASSED [sig-storage] PersistentVolumes-local  [Volume type: dir-link-bindmounted] Two pods mounting a local volume one after the other should be able to write from pod1 and read from pod2","total":-1,"completed":1,"skipped":6,"failed":0}
[BeforeEach] [Testpattern: Inline-volume (ext3)] volumes
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:15:16.072: INFO: Driver hostPathSymlink doesn't support ext3 -- skipping
[AfterEach] [Testpattern: Inline-volume (ext3)] volumes
  test/e2e/framework/framework.go:187

... skipping 71 lines ...
[sig-storage] In-tree Volumes
test/e2e/storage/utils/framework.go:23
  [Driver: local][LocalVolumeType: blockfs]
  test/e2e/storage/in_tree_volumes.go:63
    [Testpattern: Dynamic PV (delayed binding)] topology
    test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
      test/e2e/storage/testsuites/topology.go:194

      Driver local doesn't support DynamicPV -- skipping

      test/e2e/storage/framework/testsuite.go:116
------------------------------
... skipping 30 lines ...
  test/e2e/framework/framework.go:187
Jun 21 16:15:16.743: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "pods-9693" for this suite.

•
------------------------------
{"msg":"PASSED [sig-node] Pods should be updated [NodeConformance] [Conformance]","total":-1,"completed":5,"skipped":45,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] volumes
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:15:16.817: INFO: Driver emptydir doesn't support PreprovisionedPV -- skipping
... skipping 29 lines ...
[It] should allow exec of files on the volume
  test/e2e/storage/testsuites/volumes.go:198
Jun 21 16:15:11.224: INFO: In-tree plugin kubernetes.io/empty-dir is not migrated, not validating any metrics
Jun 21 16:15:11.224: INFO: Creating resource for inline volume
STEP: Creating pod exec-volume-test-inlinevolume-2968
STEP: Creating a pod to test exec-volume-test
Jun 21 16:15:11.255: INFO: Waiting up to 5m0s for pod "exec-volume-test-inlinevolume-2968" in namespace "volume-6384" to be "Succeeded or Failed"
Jun 21 16:15:11.280: INFO: Pod "exec-volume-test-inlinevolume-2968": Phase="Pending", Reason="", readiness=false. Elapsed: 25.088219ms
Jun 21 16:15:13.309: INFO: Pod "exec-volume-test-inlinevolume-2968": Phase="Pending", Reason="", readiness=false. Elapsed: 2.054169729s
Jun 21 16:15:15.306: INFO: Pod "exec-volume-test-inlinevolume-2968": Phase="Pending", Reason="", readiness=false. Elapsed: 4.050810658s
Jun 21 16:15:17.308: INFO: Pod "exec-volume-test-inlinevolume-2968": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.05308953s
STEP: Saw pod success
Jun 21 16:15:17.308: INFO: Pod "exec-volume-test-inlinevolume-2968" satisfied condition "Succeeded or Failed"
Jun 21 16:15:17.333: INFO: Trying to get logs from node nodes-us-west3-a-12tt pod exec-volume-test-inlinevolume-2968 container exec-container-inlinevolume-2968: <nil>
STEP: delete the pod
Jun 21 16:15:17.390: INFO: Waiting for pod exec-volume-test-inlinevolume-2968 to disappear
Jun 21 16:15:17.414: INFO: Pod exec-volume-test-inlinevolume-2968 no longer exists
STEP: Deleting pod exec-volume-test-inlinevolume-2968
Jun 21 16:15:17.414: INFO: Deleting pod "exec-volume-test-inlinevolume-2968" in namespace "volume-6384"
... skipping 10 lines ...
  test/e2e/storage/in_tree_volumes.go:63
    [Testpattern: Inline-volume (default fs)] volumes
    test/e2e/storage/framework/testsuite.go:50
      should allow exec of files on the volume
      test/e2e/storage/testsuites/volumes.go:198
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Inline-volume (default fs)] volumes should allow exec of files on the volume","total":-1,"completed":4,"skipped":49,"failed":0}

SSSS
------------------------------
[BeforeEach] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:15:17.534: INFO: Driver local doesn't support GenericEphemeralVolume -- skipping
... skipping 74 lines ...
Jun 21 16:15:00.620: INFO: PersistentVolumeClaim pvc-txc8r found but phase is Pending instead of Bound.
Jun 21 16:15:02.644: INFO: PersistentVolumeClaim pvc-txc8r found and phase=Bound (6.10006241s)
Jun 21 16:15:02.644: INFO: Waiting up to 3m0s for PersistentVolume local-m2gn9 to have phase Bound
Jun 21 16:15:02.668: INFO: PersistentVolume local-m2gn9 found and phase=Bound (23.530502ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-5k9q
STEP: Creating a pod to test subpath
Jun 21 16:15:02.746: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-5k9q" in namespace "provisioning-4427" to be "Succeeded or Failed"
Jun 21 16:15:02.772: INFO: Pod "pod-subpath-test-preprovisionedpv-5k9q": Phase="Pending", Reason="", readiness=false. Elapsed: 25.45735ms
Jun 21 16:15:04.798: INFO: Pod "pod-subpath-test-preprovisionedpv-5k9q": Phase="Pending", Reason="", readiness=false. Elapsed: 2.052185253s
Jun 21 16:15:06.797: INFO: Pod "pod-subpath-test-preprovisionedpv-5k9q": Phase="Pending", Reason="", readiness=false. Elapsed: 4.050681327s
Jun 21 16:15:08.798: INFO: Pod "pod-subpath-test-preprovisionedpv-5k9q": Phase="Pending", Reason="", readiness=false. Elapsed: 6.05212511s
Jun 21 16:15:10.797: INFO: Pod "pod-subpath-test-preprovisionedpv-5k9q": Phase="Pending", Reason="", readiness=false. Elapsed: 8.05086266s
Jun 21 16:15:12.796: INFO: Pod "pod-subpath-test-preprovisionedpv-5k9q": Phase="Pending", Reason="", readiness=false. Elapsed: 10.050167922s
Jun 21 16:15:14.797: INFO: Pod "pod-subpath-test-preprovisionedpv-5k9q": Phase="Pending", Reason="", readiness=false. Elapsed: 12.050849651s
Jun 21 16:15:16.798: INFO: Pod "pod-subpath-test-preprovisionedpv-5k9q": Phase="Succeeded", Reason="", readiness=false. Elapsed: 14.05170287s
STEP: Saw pod success
Jun 21 16:15:16.798: INFO: Pod "pod-subpath-test-preprovisionedpv-5k9q" satisfied condition "Succeeded or Failed"
Jun 21 16:15:16.824: INFO: Trying to get logs from node nodes-us-west3-a-rbw1 pod pod-subpath-test-preprovisionedpv-5k9q container test-container-subpath-preprovisionedpv-5k9q: <nil>
STEP: delete the pod
Jun 21 16:15:16.899: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-5k9q to disappear
Jun 21 16:15:16.927: INFO: Pod pod-subpath-test-preprovisionedpv-5k9q no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-5k9q
Jun 21 16:15:16.927: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-5k9q" in namespace "provisioning-4427"
... skipping 109 lines ...
STEP: Building a namespace api object, basename provisioning
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[It] should support readOnly file specified in the volumeMount [LinuxOnly]
  test/e2e/storage/testsuites/subpath.go:382
Jun 21 16:14:47.451: INFO: In-tree plugin kubernetes.io/host-path is not migrated, not validating any metrics
Jun 21 16:14:47.605: INFO: Waiting up to 5m0s for pod "hostpath-symlink-prep-provisioning-4278" in namespace "provisioning-4278" to be "Succeeded or Failed"
Jun 21 16:14:47.658: INFO: Pod "hostpath-symlink-prep-provisioning-4278": Phase="Pending", Reason="", readiness=false. Elapsed: 52.090658ms
Jun 21 16:14:49.683: INFO: Pod "hostpath-symlink-prep-provisioning-4278": Phase="Pending", Reason="", readiness=false. Elapsed: 2.077913151s
Jun 21 16:14:51.684: INFO: Pod "hostpath-symlink-prep-provisioning-4278": Phase="Pending", Reason="", readiness=false. Elapsed: 4.077949047s
Jun 21 16:14:53.682: INFO: Pod "hostpath-symlink-prep-provisioning-4278": Phase="Pending", Reason="", readiness=false. Elapsed: 6.076575847s
Jun 21 16:14:55.683: INFO: Pod "hostpath-symlink-prep-provisioning-4278": Phase="Pending", Reason="", readiness=false. Elapsed: 8.077422979s
Jun 21 16:14:57.687: INFO: Pod "hostpath-symlink-prep-provisioning-4278": Phase="Running", Reason="", readiness=true. Elapsed: 10.08161143s
Jun 21 16:14:59.682: INFO: Pod "hostpath-symlink-prep-provisioning-4278": Phase="Running", Reason="", readiness=false. Elapsed: 12.076733992s
Jun 21 16:15:01.693: INFO: Pod "hostpath-symlink-prep-provisioning-4278": Phase="Succeeded", Reason="", readiness=false. Elapsed: 14.087388456s
STEP: Saw pod success
Jun 21 16:15:01.693: INFO: Pod "hostpath-symlink-prep-provisioning-4278" satisfied condition "Succeeded or Failed"
Jun 21 16:15:01.693: INFO: Deleting pod "hostpath-symlink-prep-provisioning-4278" in namespace "provisioning-4278"
Jun 21 16:15:01.743: INFO: Wait up to 5m0s for pod "hostpath-symlink-prep-provisioning-4278" to be fully deleted
Jun 21 16:15:01.773: INFO: Creating resource for inline volume
STEP: Creating pod pod-subpath-test-inlinevolume-vtc6
STEP: Creating a pod to test subpath
Jun 21 16:15:01.808: INFO: Waiting up to 5m0s for pod "pod-subpath-test-inlinevolume-vtc6" in namespace "provisioning-4278" to be "Succeeded or Failed"
Jun 21 16:15:01.861: INFO: Pod "pod-subpath-test-inlinevolume-vtc6": Phase="Pending", Reason="", readiness=false. Elapsed: 52.914714ms
Jun 21 16:15:03.887: INFO: Pod "pod-subpath-test-inlinevolume-vtc6": Phase="Pending", Reason="", readiness=false. Elapsed: 2.078757303s
Jun 21 16:15:05.887: INFO: Pod "pod-subpath-test-inlinevolume-vtc6": Phase="Pending", Reason="", readiness=false. Elapsed: 4.079051777s
Jun 21 16:15:07.888: INFO: Pod "pod-subpath-test-inlinevolume-vtc6": Phase="Pending", Reason="", readiness=false. Elapsed: 6.079925724s
Jun 21 16:15:09.890: INFO: Pod "pod-subpath-test-inlinevolume-vtc6": Phase="Pending", Reason="", readiness=false. Elapsed: 8.081767341s
Jun 21 16:15:11.886: INFO: Pod "pod-subpath-test-inlinevolume-vtc6": Phase="Succeeded", Reason="", readiness=false. Elapsed: 10.078390832s
STEP: Saw pod success
Jun 21 16:15:11.886: INFO: Pod "pod-subpath-test-inlinevolume-vtc6" satisfied condition "Succeeded or Failed"
Jun 21 16:15:11.912: INFO: Trying to get logs from node nodes-us-west3-a-rbw1 pod pod-subpath-test-inlinevolume-vtc6 container test-container-subpath-inlinevolume-vtc6: <nil>
STEP: delete the pod
Jun 21 16:15:12.700: INFO: Waiting for pod pod-subpath-test-inlinevolume-vtc6 to disappear
Jun 21 16:15:12.724: INFO: Pod pod-subpath-test-inlinevolume-vtc6 no longer exists
STEP: Deleting pod pod-subpath-test-inlinevolume-vtc6
Jun 21 16:15:12.724: INFO: Deleting pod "pod-subpath-test-inlinevolume-vtc6" in namespace "provisioning-4278"
STEP: Deleting pod
Jun 21 16:15:12.753: INFO: Deleting pod "pod-subpath-test-inlinevolume-vtc6" in namespace "provisioning-4278"
Jun 21 16:15:12.804: INFO: Waiting up to 5m0s for pod "hostpath-symlink-prep-provisioning-4278" in namespace "provisioning-4278" to be "Succeeded or Failed"
Jun 21 16:15:12.828: INFO: Pod "hostpath-symlink-prep-provisioning-4278": Phase="Pending", Reason="", readiness=false. Elapsed: 24.268639ms
Jun 21 16:15:14.858: INFO: Pod "hostpath-symlink-prep-provisioning-4278": Phase="Pending", Reason="", readiness=false. Elapsed: 2.054009837s
Jun 21 16:15:16.858: INFO: Pod "hostpath-symlink-prep-provisioning-4278": Phase="Pending", Reason="", readiness=false. Elapsed: 4.053859035s
Jun 21 16:15:18.858: INFO: Pod "hostpath-symlink-prep-provisioning-4278": Phase="Pending", Reason="", readiness=false. Elapsed: 6.053984959s
Jun 21 16:15:20.859: INFO: Pod "hostpath-symlink-prep-provisioning-4278": Phase="Succeeded", Reason="", readiness=false. Elapsed: 8.055670236s
STEP: Saw pod success
Jun 21 16:15:20.860: INFO: Pod "hostpath-symlink-prep-provisioning-4278" satisfied condition "Succeeded or Failed"
Jun 21 16:15:20.860: INFO: Deleting pod "hostpath-symlink-prep-provisioning-4278" in namespace "provisioning-4278"
Jun 21 16:15:20.894: INFO: Wait up to 5m0s for pod "hostpath-symlink-prep-provisioning-4278" to be fully deleted
[AfterEach] [Testpattern: Inline-volume (default fs)] subPath
  test/e2e/framework/framework.go:187
Jun 21 16:15:20.918: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "provisioning-4278" for this suite.
... skipping 6 lines ...
  test/e2e/storage/in_tree_volumes.go:63
    [Testpattern: Inline-volume (default fs)] subPath
    test/e2e/storage/framework/testsuite.go:50
      should support readOnly file specified in the volumeMount [LinuxOnly]
      test/e2e/storage/testsuites/subpath.go:382
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Inline-volume (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]","total":-1,"completed":1,"skipped":0,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volumes
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:15:20.993: INFO: Driver local doesn't support DynamicPV -- skipping
[AfterEach] [Testpattern: Dynamic PV (block volmode)] volumes
  test/e2e/framework/framework.go:187

... skipping 109 lines ...
  test/e2e/storage/in_tree_volumes.go:63
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    test/e2e/storage/framework/testsuite.go:50
      should be able to unmount after the subpath directory is deleted [LinuxOnly]
      test/e2e/storage/testsuites/subpath.go:447
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir] [Testpattern: Pre-provisioned PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]","total":-1,"completed":1,"skipped":6,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:15:21.255: INFO: Only supported for providers [azure] (not gce)
... skipping 204 lines ...
  test/e2e/storage/persistent_volumes-local.go:194
    Two pods mounting a local volume at the same time
    test/e2e/storage/persistent_volumes-local.go:250
      should be able to write from pod1 and read from pod2
      test/e2e/storage/persistent_volumes-local.go:251
------------------------------
{"msg":"PASSED [sig-storage] PersistentVolumes-local  [Volume type: block] Two pods mounting a local volume at the same time should be able to write from pod1 and read from pod2","total":-1,"completed":1,"skipped":5,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (ext3)] volumes
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:15:21.822: INFO: Driver local doesn't support InlineVolume -- skipping
... skipping 97 lines ...
• [SLOW TEST:34.704 seconds]
[sig-node] Probing container
test/e2e/common/node/framework.go:23
  with readiness probe should not be ready before initial delay and never restart [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-node] Probing container with readiness probe should not be ready before initial delay and never restart [NodeConformance] [Conformance]","total":-1,"completed":1,"skipped":40,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] provisioning
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:15:22.263: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 37 lines ...
      Driver hostPath doesn't support PreprovisionedPV -- skipping

      test/e2e/storage/framework/testsuite.go:116
------------------------------
S
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: tmpfs] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing single file [LinuxOnly]","total":-1,"completed":1,"skipped":20,"failed":0}
[BeforeEach] [sig-node] Container Runtime
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
Jun 21 16:15:17.577: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename container-runtime
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 17 lines ...
  test/e2e/common/node/runtime.go:43
    when running a container with a new image
    test/e2e/common/node/runtime.go:259
      should be able to pull from private registry with secret [NodeConformance]
      test/e2e/common/node/runtime.go:386
------------------------------
{"msg":"PASSED [sig-node] Container Runtime blackbox test when running a container with a new image should be able to pull from private registry with secret [NodeConformance]","total":-1,"completed":2,"skipped":20,"failed":0}

SSSSSSSSSSSSSS
------------------------------
[BeforeEach] [sig-auth] ServiceAccounts
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
... skipping 14 lines ...
  test/e2e/framework/framework.go:187
Jun 21 16:15:23.185: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "svcaccounts-3456" for this suite.

•
------------------------------
{"msg":"PASSED [sig-auth] ServiceAccounts should guarantee kube-root-ca.crt exist in any namespace [Conformance]","total":-1,"completed":2,"skipped":13,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Inline-volume (ext3)] volumes
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:15:23.260: INFO: Only supported for providers [vsphere] (not gce)
... skipping 134 lines ...
• [SLOW TEST:6.667 seconds]
[sig-node] Ephemeral Containers [NodeFeature:EphemeralContainers]
test/e2e/common/node/framework.go:23
  will start an ephemeral container in an existing pod
  test/e2e/common/node/ephemeral_containers.go:44
------------------------------
{"msg":"PASSED [sig-node] Ephemeral Containers [NodeFeature:EphemeralContainers] will start an ephemeral container in an existing pod","total":-1,"completed":5,"skipped":63,"failed":0}

SS
------------------------------
[BeforeEach] [sig-storage] EmptyDir volumes
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
Jun 21 16:15:23.238: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename emptydir
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[It] should support (non-root,0666,tmpfs) [LinuxOnly] [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
STEP: Creating a pod to test emptydir 0666 on tmpfs
Jun 21 16:15:23.438: INFO: Waiting up to 5m0s for pod "pod-a98c4c0d-f0b4-453b-a652-7aa198f3965c" in namespace "emptydir-4486" to be "Succeeded or Failed"
Jun 21 16:15:23.462: INFO: Pod "pod-a98c4c0d-f0b4-453b-a652-7aa198f3965c": Phase="Pending", Reason="", readiness=false. Elapsed: 23.736776ms
Jun 21 16:15:25.490: INFO: Pod "pod-a98c4c0d-f0b4-453b-a652-7aa198f3965c": Phase="Pending", Reason="", readiness=false. Elapsed: 2.05152163s
Jun 21 16:15:27.487: INFO: Pod "pod-a98c4c0d-f0b4-453b-a652-7aa198f3965c": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.048687935s
STEP: Saw pod success
Jun 21 16:15:27.487: INFO: Pod "pod-a98c4c0d-f0b4-453b-a652-7aa198f3965c" satisfied condition "Succeeded or Failed"
Jun 21 16:15:27.511: INFO: Trying to get logs from node nodes-us-west3-a-12tt pod pod-a98c4c0d-f0b4-453b-a652-7aa198f3965c container test-container: <nil>
STEP: delete the pod
Jun 21 16:15:27.568: INFO: Waiting for pod pod-a98c4c0d-f0b4-453b-a652-7aa198f3965c to disappear
Jun 21 16:15:27.593: INFO: Pod pod-a98c4c0d-f0b4-453b-a652-7aa198f3965c no longer exists
[AfterEach] [sig-storage] EmptyDir volumes
  test/e2e/framework/framework.go:187
Jun 21 16:15:27.593: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "emptydir-4486" for this suite.

•
------------------------------
{"msg":"PASSED [sig-storage] EmptyDir volumes should support (non-root,0666,tmpfs) [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":3,"skipped":34,"failed":0}

SS
------------------------------
[BeforeEach] [sig-storage] Projected downwardAPI
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
... skipping 3 lines ...
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[BeforeEach] [sig-storage] Projected downwardAPI
  test/e2e/common/storage/projected_downwardapi.go:43
[It] should set mode on item file [LinuxOnly] [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
STEP: Creating a pod to test downward API volume plugin
Jun 21 16:15:21.554: INFO: Waiting up to 5m0s for pod "downwardapi-volume-dc7491b0-801e-4e6d-98a2-0a202111219f" in namespace "projected-8291" to be "Succeeded or Failed"
Jun 21 16:15:21.580: INFO: Pod "downwardapi-volume-dc7491b0-801e-4e6d-98a2-0a202111219f": Phase="Pending", Reason="", readiness=false. Elapsed: 26.17167ms
Jun 21 16:15:23.605: INFO: Pod "downwardapi-volume-dc7491b0-801e-4e6d-98a2-0a202111219f": Phase="Pending", Reason="", readiness=false. Elapsed: 2.051075102s
Jun 21 16:15:25.605: INFO: Pod "downwardapi-volume-dc7491b0-801e-4e6d-98a2-0a202111219f": Phase="Pending", Reason="", readiness=false. Elapsed: 4.051532116s
Jun 21 16:15:27.606: INFO: Pod "downwardapi-volume-dc7491b0-801e-4e6d-98a2-0a202111219f": Phase="Pending", Reason="", readiness=false. Elapsed: 6.051776559s
Jun 21 16:15:29.605: INFO: Pod "downwardapi-volume-dc7491b0-801e-4e6d-98a2-0a202111219f": Phase="Succeeded", Reason="", readiness=false. Elapsed: 8.051151693s
STEP: Saw pod success
Jun 21 16:15:29.605: INFO: Pod "downwardapi-volume-dc7491b0-801e-4e6d-98a2-0a202111219f" satisfied condition "Succeeded or Failed"
Jun 21 16:15:29.629: INFO: Trying to get logs from node nodes-us-west3-a-tw9s pod downwardapi-volume-dc7491b0-801e-4e6d-98a2-0a202111219f container client-container: <nil>
STEP: delete the pod
Jun 21 16:15:29.692: INFO: Waiting for pod downwardapi-volume-dc7491b0-801e-4e6d-98a2-0a202111219f to disappear
Jun 21 16:15:29.716: INFO: Pod downwardapi-volume-dc7491b0-801e-4e6d-98a2-0a202111219f no longer exists
[AfterEach] [sig-storage] Projected downwardAPI
  test/e2e/framework/framework.go:187
... skipping 4 lines ...
• [SLOW TEST:8.438 seconds]
[sig-storage] Projected downwardAPI
test/e2e/common/storage/framework.go:23
  should set mode on item file [LinuxOnly] [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-storage] Projected downwardAPI should set mode on item file [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":2,"skipped":14,"failed":0}
[BeforeEach] [Testpattern: Inline-volume (ext4)] volumes
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:15:29.783: INFO: Only supported for providers [aws] (not gce)
[AfterEach] [Testpattern: Inline-volume (ext4)] volumes
  test/e2e/framework/framework.go:187

... skipping 20 lines ...
Jun 21 16:15:29.801: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename pod-os-rejection
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[It] should reject pod when the node OS doesn't match pod's OS
  test/e2e/common/node/pod_admission.go:38
Jun 21 16:15:30.023: INFO: Waiting up to 2m0s for pod "wrong-pod-os" in namespace "pod-os-rejection-4490" to be "failed with reason PodOSNotSupported"
Jun 21 16:15:30.047: INFO: Pod "wrong-pod-os": Phase="Failed", Reason="PodOSNotSupported", readiness=false. Elapsed: 23.422985ms
Jun 21 16:15:30.047: INFO: Pod "wrong-pod-os" satisfied condition "failed with reason PodOSNotSupported"
[AfterEach] [sig-node] PodOSRejection [NodeConformance]
  test/e2e/framework/framework.go:187
Jun 21 16:15:30.047: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "pod-os-rejection-4490" for this suite.

•
------------------------------
{"msg":"PASSED [sig-node] PodOSRejection [NodeConformance] Kubelet should reject pod when the node OS doesn't match pod's OS","total":-1,"completed":3,"skipped":16,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:15:30.128: INFO: Driver hostPath doesn't support GenericEphemeralVolume -- skipping
... skipping 170 lines ...
• [SLOW TEST:44.488 seconds]
[sig-network] Conntrack
test/e2e/network/common/framework.go:23
  should be able to preserve UDP traffic when server pod cycles for a ClusterIP service
  test/e2e/network/conntrack.go:208
------------------------------
{"msg":"PASSED [sig-network] Conntrack should be able to preserve UDP traffic when server pod cycles for a ClusterIP service","total":-1,"completed":1,"skipped":4,"failed":0}

SS
------------------------------
[BeforeEach] [sig-node] ConfigMap
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
... skipping 2 lines ...
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[It] should be consumable via environment variable [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
STEP: Creating configMap configmap-9987/configmap-test-0b6b5e7c-a2ea-4742-a25c-7b53b12dace7
STEP: Creating a pod to test consume configMaps
Jun 21 16:15:22.556: INFO: Waiting up to 5m0s for pod "pod-configmaps-61e3001d-a9e5-4963-8bb3-c7cb85b072df" in namespace "configmap-9987" to be "Succeeded or Failed"
Jun 21 16:15:22.586: INFO: Pod "pod-configmaps-61e3001d-a9e5-4963-8bb3-c7cb85b072df": Phase="Pending", Reason="", readiness=false. Elapsed: 29.670982ms
Jun 21 16:15:24.619: INFO: Pod "pod-configmaps-61e3001d-a9e5-4963-8bb3-c7cb85b072df": Phase="Pending", Reason="", readiness=false. Elapsed: 2.06236049s
Jun 21 16:15:26.612: INFO: Pod "pod-configmaps-61e3001d-a9e5-4963-8bb3-c7cb85b072df": Phase="Pending", Reason="", readiness=false. Elapsed: 4.055451922s
Jun 21 16:15:28.615: INFO: Pod "pod-configmaps-61e3001d-a9e5-4963-8bb3-c7cb85b072df": Phase="Pending", Reason="", readiness=false. Elapsed: 6.058706648s
Jun 21 16:15:30.611: INFO: Pod "pod-configmaps-61e3001d-a9e5-4963-8bb3-c7cb85b072df": Phase="Pending", Reason="", readiness=false. Elapsed: 8.054798753s
Jun 21 16:15:32.611: INFO: Pod "pod-configmaps-61e3001d-a9e5-4963-8bb3-c7cb85b072df": Phase="Succeeded", Reason="", readiness=false. Elapsed: 10.054446962s
STEP: Saw pod success
Jun 21 16:15:32.611: INFO: Pod "pod-configmaps-61e3001d-a9e5-4963-8bb3-c7cb85b072df" satisfied condition "Succeeded or Failed"
Jun 21 16:15:32.635: INFO: Trying to get logs from node nodes-us-west3-a-tw9s pod pod-configmaps-61e3001d-a9e5-4963-8bb3-c7cb85b072df container env-test: <nil>
STEP: delete the pod
Jun 21 16:15:32.706: INFO: Waiting for pod pod-configmaps-61e3001d-a9e5-4963-8bb3-c7cb85b072df to disappear
Jun 21 16:15:32.730: INFO: Pod pod-configmaps-61e3001d-a9e5-4963-8bb3-c7cb85b072df no longer exists
[AfterEach] [sig-node] ConfigMap
  test/e2e/framework/framework.go:187
... skipping 4 lines ...
• [SLOW TEST:10.473 seconds]
[sig-node] ConfigMap
test/e2e/common/node/framework.go:23
  should be consumable via environment variable [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-node] ConfigMap should be consumable via environment variable [NodeConformance] [Conformance]","total":-1,"completed":2,"skipped":49,"failed":0}

SSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] capacity
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:15:32.830: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 46 lines ...
• [SLOW TEST:22.618 seconds]
[sig-node] Probing container
test/e2e/common/node/framework.go:23
  should be restarted with a local redirect http liveness probe
  test/e2e/common/node/container_probe.go:278
------------------------------
{"msg":"PASSED [sig-node] Probing container should be restarted with a local redirect http liveness probe","total":-1,"completed":5,"skipped":72,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:15:36.858: INFO: Driver emptydir doesn't support PreprovisionedPV -- skipping
... skipping 150 lines ...
      Only supported for node OS distro [gci ubuntu custom] (not debian)

      test/e2e/storage/drivers/in_tree.go:263
------------------------------
S
------------------------------
{"msg":"PASSED [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a replication controller. [Conformance]","total":-1,"completed":2,"skipped":3,"failed":0}
[BeforeEach] [sig-cli] Kubectl Port forwarding
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
Jun 21 16:15:20.442: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename port-forwarding
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 49 lines ...
  test/e2e/kubectl/portforward.go:454
    that expects a client request
    test/e2e/kubectl/portforward.go:455
      should support a client that connects, sends DATA, and disconnects
      test/e2e/kubectl/portforward.go:459
------------------------------
{"msg":"PASSED [sig-cli] Kubectl Port forwarding With a server listening on 0.0.0.0 that expects a client request should support a client that connects, sends DATA, and disconnects","total":-1,"completed":3,"skipped":3,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:15:41.093: INFO: Driver hostPathSymlink doesn't support PreprovisionedPV -- skipping
... skipping 26 lines ...
  test/e2e/storage/subpath.go:40
STEP: Setting up data
[It] should support subpaths with projected pod [Conformance]
  test/e2e/framework/framework.go:647
STEP: Creating pod pod-subpath-test-projected-4bqd
STEP: Creating a pod to test atomic-volume-subpath
Jun 21 16:15:09.798: INFO: Waiting up to 5m0s for pod "pod-subpath-test-projected-4bqd" in namespace "subpath-3459" to be "Succeeded or Failed"
Jun 21 16:15:09.827: INFO: Pod "pod-subpath-test-projected-4bqd": Phase="Pending", Reason="", readiness=false. Elapsed: 28.973033ms
Jun 21 16:15:11.856: INFO: Pod "pod-subpath-test-projected-4bqd": Phase="Pending", Reason="", readiness=false. Elapsed: 2.057710696s
Jun 21 16:15:13.852: INFO: Pod "pod-subpath-test-projected-4bqd": Phase="Pending", Reason="", readiness=false. Elapsed: 4.053958064s
Jun 21 16:15:15.854: INFO: Pod "pod-subpath-test-projected-4bqd": Phase="Running", Reason="", readiness=true. Elapsed: 6.056086969s
Jun 21 16:15:17.853: INFO: Pod "pod-subpath-test-projected-4bqd": Phase="Running", Reason="", readiness=true. Elapsed: 8.054399227s
Jun 21 16:15:19.856: INFO: Pod "pod-subpath-test-projected-4bqd": Phase="Running", Reason="", readiness=true. Elapsed: 10.057431154s
... skipping 7 lines ...
Jun 21 16:15:35.854: INFO: Pod "pod-subpath-test-projected-4bqd": Phase="Running", Reason="", readiness=true. Elapsed: 26.055744508s
Jun 21 16:15:37.853: INFO: Pod "pod-subpath-test-projected-4bqd": Phase="Running", Reason="", readiness=true. Elapsed: 28.054313142s
Jun 21 16:15:39.854: INFO: Pod "pod-subpath-test-projected-4bqd": Phase="Running", Reason="", readiness=true. Elapsed: 30.056030213s
Jun 21 16:15:41.865: INFO: Pod "pod-subpath-test-projected-4bqd": Phase="Running", Reason="", readiness=true. Elapsed: 32.066446992s
Jun 21 16:15:43.860: INFO: Pod "pod-subpath-test-projected-4bqd": Phase="Succeeded", Reason="", readiness=false. Elapsed: 34.061114542s
STEP: Saw pod success
Jun 21 16:15:43.860: INFO: Pod "pod-subpath-test-projected-4bqd" satisfied condition "Succeeded or Failed"
Jun 21 16:15:43.884: INFO: Trying to get logs from node nodes-us-west3-a-12tt pod pod-subpath-test-projected-4bqd container test-container-subpath-projected-4bqd: <nil>
STEP: delete the pod
Jun 21 16:15:43.943: INFO: Waiting for pod pod-subpath-test-projected-4bqd to disappear
Jun 21 16:15:43.969: INFO: Pod pod-subpath-test-projected-4bqd no longer exists
STEP: Deleting pod pod-subpath-test-projected-4bqd
Jun 21 16:15:43.969: INFO: Deleting pod "pod-subpath-test-projected-4bqd" in namespace "subpath-3459"
... skipping 8 lines ...
test/e2e/storage/utils/framework.go:23
  Atomic writer volumes
  test/e2e/storage/subpath.go:36
    should support subpaths with projected pod [Conformance]
    test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-storage] Subpath Atomic writer volumes should support subpaths with projected pod [Conformance]","total":-1,"completed":3,"skipped":16,"failed":0}

SSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] provisioning
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:15:44.138: INFO: Driver hostPath doesn't support DynamicPV -- skipping
... skipping 12 lines ...
      test/e2e/storage/testsuites/provisioning.go:187

      Driver hostPath doesn't support DynamicPV -- skipping

      test/e2e/storage/framework/testsuite.go:116
------------------------------
{"msg":"PASSED [sig-network] DNS should provide DNS for the cluster  [Conformance]","total":-1,"completed":2,"skipped":8,"failed":0}
[BeforeEach] [sig-network] Services
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
Jun 21 16:15:20.742: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename services
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 53 lines ...
• [SLOW TEST:24.217 seconds]
[sig-network] Services
test/e2e/network/common/framework.go:23
  should be able to change the type from ExternalName to NodePort [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-network] Services should be able to change the type from ExternalName to NodePort [Conformance]","total":-1,"completed":3,"skipped":8,"failed":0}
[BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:15:44.969: INFO: Driver local doesn't support GenericEphemeralVolume -- skipping
[AfterEach] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
  test/e2e/framework/framework.go:187

... skipping 157 lines ...

Jun 21 16:15:45.303: INFO: New ReplicaSet "webserver-deployment-5fd5c5f98f" of Deployment "webserver-deployment":
&ReplicaSet{ObjectMeta:{webserver-deployment-5fd5c5f98f  deployment-784  184bd8fb-97bd-4c49-8f74-d988ac3ba382 3801 3 2022-06-21 16:15:40 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:5fd5c5f98f] map[deployment.kubernetes.io/desired-replicas:30 deployment.kubernetes.io/max-replicas:33 deployment.kubernetes.io/revision:2] [{apps/v1 Deployment webserver-deployment b9249284-5fbc-4e7b-91a3-3e4919950c4f 0xc00253dc67 0xc00253dc68}] [] [{kube-controller-manager Update apps/v1 2022-06-21 16:15:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:deployment.kubernetes.io/desired-replicas":{},"f:deployment.kubernetes.io/max-replicas":{},"f:deployment.kubernetes.io/revision":{}},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"b9249284-5fbc-4e7b-91a3-3e4919950c4f\"}":{}}},"f:spec":{"f:replicas":{},"f:selector":{},"f:template":{"f:metadata":{"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}} } {kube-controller-manager Update apps/v1 2022-06-21 16:15:43 +0000 UTC FieldsV1 {"f:status":{"f:fullyLabeledReplicas":{},"f:observedGeneration":{},"f:replicas":{}}} status}]},Spec:ReplicaSetSpec{Replicas:*13,Selector:&v1.LabelSelector{MatchLabels:map[string]string{name: httpd,pod-template-hash: 5fd5c5f98f,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{      0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:5fd5c5f98f] map[] [] [] []} {[] [] [{httpd webserver:404 [] []  [] [] [] {map[] map[]} [] [] nil nil nil nil /dev/termination-log File IfNotPresent SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,} false false false}] [] Always 0xc00253dd08 <nil> ClusterFirst map[]   <nil>  false false false <nil> &PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} []   nil default-scheduler [] []  <nil> nil [] <nil> <nil> <nil> map[] [] <nil> nil}},MinReadySeconds:0,},Status:ReplicaSetStatus{Replicas:13,FullyLabeledReplicas:13,ObservedGeneration:3,ReadyReplicas:0,AvailableReplicas:0,Conditions:[]ReplicaSetCondition{},},}
Jun 21 16:15:45.303: INFO: All old ReplicaSets of Deployment "webserver-deployment":
Jun 21 16:15:45.303: INFO: &ReplicaSet{ObjectMeta:{webserver-deployment-68c48f9ff9  deployment-784  82803c1a-610e-4d11-a7bd-335fc1505f34 3805 3 2022-06-21 16:15:24 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:68c48f9ff9] map[deployment.kubernetes.io/desired-replicas:30 deployment.kubernetes.io/max-replicas:33 deployment.kubernetes.io/revision:1] [{apps/v1 Deployment webserver-deployment b9249284-5fbc-4e7b-91a3-3e4919950c4f 0xc00253dd67 0xc00253dd68}] [] [{kube-controller-manager Update apps/v1 2022-06-21 16:15:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:deployment.kubernetes.io/desired-replicas":{},"f:deployment.kubernetes.io/max-replicas":{},"f:deployment.kubernetes.io/revision":{}},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"b9249284-5fbc-4e7b-91a3-3e4919950c4f\"}":{}}},"f:spec":{"f:replicas":{},"f:selector":{},"f:template":{"f:metadata":{"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}} } {kube-controller-manager Update apps/v1 2022-06-21 16:15:43 +0000 UTC FieldsV1 {"f:status":{"f:availableReplicas":{},"f:fullyLabeledReplicas":{},"f:observedGeneration":{},"f:readyReplicas":{},"f:replicas":{}}} status}]},Spec:ReplicaSetSpec{Replicas:*20,Selector:&v1.LabelSelector{MatchLabels:map[string]string{name: httpd,pod-template-hash: 68c48f9ff9,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{      0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:68c48f9ff9] map[] [] [] []} {[] [] [{httpd registry.k8s.io/e2e-test-images/httpd:2.4.38-2 [] []  [] [] [] {map[] map[]} [] [] nil nil nil nil /dev/termination-log File IfNotPresent SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,} false false false}] [] Always 0xc00253ddf8 <nil> ClusterFirst map[]   <nil>  false false false <nil> &PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} []   nil default-scheduler [] []  <nil> nil [] <nil> <nil> <nil> map[] [] <nil> nil}},MinReadySeconds:0,},Status:ReplicaSetStatus{Replicas:20,FullyLabeledReplicas:20,ObservedGeneration:3,ReadyReplicas:8,AvailableReplicas:8,Conditions:[]ReplicaSetCondition{},},}
Jun 21 16:15:45.332: INFO: Pod "webserver-deployment-5fd5c5f98f-25pbr" is not available:
&Pod{ObjectMeta:{webserver-deployment-5fd5c5f98f-25pbr webserver-deployment-5fd5c5f98f- deployment-784  8d19fa09-d6b1-4eec-b3c6-f0d534a2942b 3741 0 2022-06-21 16:15:40 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:5fd5c5f98f] map[] [{apps/v1 ReplicaSet webserver-deployment-5fd5c5f98f 184bd8fb-97bd-4c49-8f74-d988ac3ba382 0xc001de4600 0xc001de4601}] [] [{kube-controller-manager Update v1 2022-06-21 16:15:40 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"184bd8fb-97bd-4c49-8f74-d988ac3ba382\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2022-06-21 16:15:42 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"100.96.1.33\"}":{".":{},"f:ip":{}}},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-wjts6,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:webserver:404,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-wjts6,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:nodes-us-west3-a-kkxs,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-06-21 16:15:40 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-06-21 16:15:40 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-06-21 16:15:40 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-06-21 16:15:40 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:10.0.16.3,PodIP:100.96.1.33,StartTime:2022-06-21 16:15:40 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ErrImagePull,Message:rpc error: code = Unknown desc = failed to pull and unpack image "docker.io/library/webserver:404": failed to resolve reference "docker.io/library/webserver:404": pull access denied, repository does not exist or may require authorization: server message: insufficient_scope: authorization failed,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:webserver:404,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:100.96.1.33,},},EphemeralContainerStatuses:[]ContainerStatus{},},}
Jun 21 16:15:45.333: INFO: Pod "webserver-deployment-5fd5c5f98f-2trll" is not available:
&Pod{ObjectMeta:{webserver-deployment-5fd5c5f98f-2trll webserver-deployment-5fd5c5f98f- deployment-784  bff1afdd-fc96-43c0-b075-9e4eabc3b683 3782 0 2022-06-21 16:15:43 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:5fd5c5f98f] map[] [{apps/v1 ReplicaSet webserver-deployment-5fd5c5f98f 184bd8fb-97bd-4c49-8f74-d988ac3ba382 0xc001de4800 0xc001de4801}] [] [{kube-controller-manager Update v1 2022-06-21 16:15:43 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"184bd8fb-97bd-4c49-8f74-d988ac3ba382\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} }]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-w2cjd,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:webserver:404,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-w2cjd,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:nodes-us-west3-a-12tt,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-06-21 16:15:43 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:,PodIP:,StartTime:<nil>,ContainerStatuses:[]ContainerStatus{},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},}
Jun 21 16:15:45.333: INFO: Pod "webserver-deployment-5fd5c5f98f-5wzw9" is not available:
&Pod{ObjectMeta:{webserver-deployment-5fd5c5f98f-5wzw9 webserver-deployment-5fd5c5f98f- deployment-784  fa38d944-6dc1-417d-a44b-b00f885f9fbf 3795 0 2022-06-21 16:15:43 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:5fd5c5f98f] map[] [{apps/v1 ReplicaSet webserver-deployment-5fd5c5f98f 184bd8fb-97bd-4c49-8f74-d988ac3ba382 0xc001de4960 0xc001de4961}] [] [{kube-controller-manager Update v1 2022-06-21 16:15:43 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"184bd8fb-97bd-4c49-8f74-d988ac3ba382\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} }]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-2kx4b,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:webserver:404,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-2kx4b,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:nodes-us-west3-a-tw9s,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-06-21 16:15:43 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:,PodIP:,StartTime:<nil>,ContainerStatuses:[]ContainerStatus{},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},}
Jun 21 16:15:45.333: INFO: Pod "webserver-deployment-5fd5c5f98f-6z6dq" is not available:
&Pod{ObjectMeta:{webserver-deployment-5fd5c5f98f-6z6dq webserver-deployment-5fd5c5f98f- deployment-784  0ac98ff0-f835-48e3-a6e3-f941217659d2 3718 0 2022-06-21 16:15:40 +0000 UTC <nil> <nil> map[name:httpd pod-template-hash:5fd5c5f98f] map[] [{apps/v1 ReplicaSet webserver-deployment-5fd5c5f98f 184bd8fb-97bd-4c49-8f74-d988ac3ba382 0xc001de4ac0 0xc001de4ac1}] [] [{kube-controller-manager Update v1 2022-06-21 16:15:40 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"184bd8fb-97bd-4c49-8f74-d988ac3ba382\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2022-06-21 16:15:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-r8g2b,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:webserver:404,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-r8g2b,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:nodes-us-west3-a-tw9s,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-06-21 16:15:40 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-06-21 16:15:40 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-06-21 16:15:40 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-06-21 16:15:40 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:10.0.16.4,PodIP:,StartTime:2022-06-21 16:15:40 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:webserver:404,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},}
... skipping 64 lines ...
• [SLOW TEST:21.080 seconds]
[sig-apps] Deployment
test/e2e/apps/framework.go:23
  deployment should support proportional scaling [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-apps] Deployment deployment should support proportional scaling [Conformance]","total":-1,"completed":6,"skipped":65,"failed":0}

SSSSS
------------------------------
[BeforeEach] [sig-network] Networking
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
... skipping 197 lines ...
Jun 21 16:15:49.204: INFO: stderr: "Warning: v1 ComponentStatus is deprecated in v1.19+\n"
Jun 21 16:15:49.205: INFO: stdout: "etcd-1 controller-manager etcd-0 scheduler"
STEP: getting details of componentstatuses
STEP: getting status of etcd-1
Jun 21 16:15:49.205: INFO: Running '/logs/artifacts/b29e4240-f17b-11ec-9ac1-d2ba5eb345d8/kubectl --server=https://34.106.151.197 --kubeconfig=/root/.kube/config --namespace=kubectl-4501 get componentstatuses etcd-1'
Jun 21 16:15:49.366: INFO: stderr: "Warning: v1 ComponentStatus is deprecated in v1.19+\n"
Jun 21 16:15:49.366: INFO: stdout: "NAME     STATUS    MESSAGE                         ERROR\netcd-1   Healthy   {\"health\":\"true\",\"reason\":\"\"}   \n"
STEP: getting status of controller-manager
Jun 21 16:15:49.366: INFO: Running '/logs/artifacts/b29e4240-f17b-11ec-9ac1-d2ba5eb345d8/kubectl --server=https://34.106.151.197 --kubeconfig=/root/.kube/config --namespace=kubectl-4501 get componentstatuses controller-manager'
Jun 21 16:15:49.524: INFO: stderr: "Warning: v1 ComponentStatus is deprecated in v1.19+\n"
Jun 21 16:15:49.524: INFO: stdout: "NAME                 STATUS    MESSAGE   ERROR\ncontroller-manager   Healthy   ok        \n"
STEP: getting status of etcd-0
Jun 21 16:15:49.524: INFO: Running '/logs/artifacts/b29e4240-f17b-11ec-9ac1-d2ba5eb345d8/kubectl --server=https://34.106.151.197 --kubeconfig=/root/.kube/config --namespace=kubectl-4501 get componentstatuses etcd-0'
Jun 21 16:15:49.695: INFO: stderr: "Warning: v1 ComponentStatus is deprecated in v1.19+\n"
Jun 21 16:15:49.695: INFO: stdout: "NAME     STATUS    MESSAGE                         ERROR\netcd-0   Healthy   {\"health\":\"true\",\"reason\":\"\"}   \n"
STEP: getting status of scheduler
Jun 21 16:15:49.695: INFO: Running '/logs/artifacts/b29e4240-f17b-11ec-9ac1-d2ba5eb345d8/kubectl --server=https://34.106.151.197 --kubeconfig=/root/.kube/config --namespace=kubectl-4501 get componentstatuses scheduler'
Jun 21 16:15:49.858: INFO: stderr: "Warning: v1 ComponentStatus is deprecated in v1.19+\n"
Jun 21 16:15:49.858: INFO: stdout: "NAME        STATUS    MESSAGE   ERROR\nscheduler   Healthy   ok        \n"
[AfterEach] [sig-cli] Kubectl client
  test/e2e/framework/framework.go:187
Jun 21 16:15:49.858: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "kubectl-4501" for this suite.

•
------------------------------
{"msg":"PASSED [sig-cli] Kubectl client Kubectl get componentstatuses should get componentstatuses","total":-1,"completed":4,"skipped":54,"failed":0}

SS
------------------------------
[BeforeEach] [sig-apps] ReplicaSet
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
... skipping 26 lines ...
• [SLOW TEST:15.407 seconds]
[sig-apps] ReplicaSet
test/e2e/apps/framework.go:23
  should serve a basic image on each replica with a private image
  test/e2e/apps/replica_set.go:115
------------------------------
{"msg":"PASSED [sig-apps] ReplicaSet should serve a basic image on each replica with a private image","total":-1,"completed":4,"skipped":34,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] volumeLimits
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:15:59.594: INFO: Only supported for providers [azure] (not gce)
... skipping 151 lines ...
Jun 21 16:15:41.269: INFO: Running '/logs/artifacts/b29e4240-f17b-11ec-9ac1-d2ba5eb345d8/kubectl --server=https://34.106.151.197 --kubeconfig=/root/.kube/config --namespace=kubectl-1907 create -f -'
Jun 21 16:15:42.631: INFO: stderr: ""
Jun 21 16:15:42.631: INFO: stdout: "pod/httpd created\n"
Jun 21 16:15:42.631: INFO: Waiting up to 5m0s for 1 pods to be running and ready: [httpd]
Jun 21 16:15:42.631: INFO: Waiting up to 5m0s for pod "httpd" in namespace "kubectl-1907" to be "running and ready"
Jun 21 16:15:42.673: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 42.302278ms
Jun 21 16:15:42.673: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'nodes-us-west3-a-tw9s' to be 'Running' but was 'Pending'
Jun 21 16:15:44.698: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2.06724888s
Jun 21 16:15:44.698: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'nodes-us-west3-a-tw9s' to be 'Running' but was 'Pending'
Jun 21 16:15:46.699: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4.067990606s
Jun 21 16:15:46.699: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'nodes-us-west3-a-tw9s' to be 'Running' but was 'Pending'
Jun 21 16:15:48.697: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 6.06636286s
Jun 21 16:15:48.697: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'nodes-us-west3-a-tw9s' to be 'Running' but was 'Pending'
Jun 21 16:15:50.711: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 8.079956057s
Jun 21 16:15:50.711: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'nodes-us-west3-a-tw9s' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:15:42 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:15:42 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:15:42 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:15:42 +0000 UTC  }]
Jun 21 16:15:52.698: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 10.067274545s
Jun 21 16:15:52.698: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'nodes-us-west3-a-tw9s' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:15:42 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:15:42 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:15:42 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:15:42 +0000 UTC  }]
Jun 21 16:15:54.699: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 12.068097661s
Jun 21 16:15:54.699: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'nodes-us-west3-a-tw9s' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:15:42 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:15:42 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:15:42 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:15:42 +0000 UTC  }]
Jun 21 16:15:56.698: INFO: Pod "httpd": Phase="Running", Reason="", readiness=true. Elapsed: 14.067274894s
Jun 21 16:15:56.698: INFO: Pod "httpd" satisfied condition "running and ready"
Jun 21 16:15:56.698: INFO: Wanted all 1 pods to be running and ready. Result: true. Pods: [httpd]
[It] running a failing command
  test/e2e/kubectl/kubectl.go:547
Jun 21 16:15:56.698: INFO: Running '/logs/artifacts/b29e4240-f17b-11ec-9ac1-d2ba5eb345d8/kubectl --server=https://34.106.151.197 --kubeconfig=/root/.kube/config --namespace=kubectl-1907 run -i --image=registry.k8s.io/e2e-test-images/busybox:1.29-2 --restart=Never --pod-running-timeout=2m0s failure-1 -- /bin/sh -c exit 42'
... skipping 23 lines ...
  test/e2e/kubectl/kubectl.go:407
    should return command exit codes
    test/e2e/kubectl/kubectl.go:527
      running a failing command
      test/e2e/kubectl/kubectl.go:547
------------------------------
{"msg":"PASSED [sig-cli] Kubectl client Simple pod should return command exit codes running a failing command","total":-1,"completed":4,"skipped":6,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] provisioning
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:16:02.924: INFO: Only supported for providers [azure] (not gce)
... skipping 24 lines ...
STEP: Building a namespace api object, basename downward-api
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[It] should provide default limits.cpu/memory from node allocatable [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
STEP: Creating a pod to test downward api env vars
Jun 21 16:15:59.826: INFO: Waiting up to 5m0s for pod "downward-api-156f5ba2-5bc1-4548-a979-34023766ba7f" in namespace "downward-api-6638" to be "Succeeded or Failed"
Jun 21 16:15:59.853: INFO: Pod "downward-api-156f5ba2-5bc1-4548-a979-34023766ba7f": Phase="Pending", Reason="", readiness=false. Elapsed: 26.738556ms
Jun 21 16:16:01.877: INFO: Pod "downward-api-156f5ba2-5bc1-4548-a979-34023766ba7f": Phase="Pending", Reason="", readiness=false. Elapsed: 2.051371214s
Jun 21 16:16:03.878: INFO: Pod "downward-api-156f5ba2-5bc1-4548-a979-34023766ba7f": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.051643711s
STEP: Saw pod success
Jun 21 16:16:03.878: INFO: Pod "downward-api-156f5ba2-5bc1-4548-a979-34023766ba7f" satisfied condition "Succeeded or Failed"
Jun 21 16:16:03.902: INFO: Trying to get logs from node nodes-us-west3-a-tw9s pod downward-api-156f5ba2-5bc1-4548-a979-34023766ba7f container dapi-container: <nil>
STEP: delete the pod
Jun 21 16:16:03.970: INFO: Waiting for pod downward-api-156f5ba2-5bc1-4548-a979-34023766ba7f to disappear
Jun 21 16:16:03.994: INFO: Pod downward-api-156f5ba2-5bc1-4548-a979-34023766ba7f no longer exists
[AfterEach] [sig-node] Downward API
  test/e2e/framework/framework.go:187
Jun 21 16:16:03.994: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "downward-api-6638" for this suite.

•
------------------------------
{"msg":"PASSED [sig-node] Downward API should provide default limits.cpu/memory from node allocatable [NodeConformance] [Conformance]","total":-1,"completed":5,"skipped":39,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] provisioning
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:16:04.085: INFO: Driver hostPathSymlink doesn't support DynamicPV -- skipping
... skipping 51 lines ...
• [SLOW TEST:77.263 seconds]
[sig-node] Probing container
test/e2e/common/node/framework.go:23
  should be restarted with a failing exec liveness probe that took longer than the timeout
  test/e2e/common/node/container_probe.go:261
------------------------------
{"msg":"PASSED [sig-node] Probing container should be restarted with a failing exec liveness probe that took longer than the timeout","total":-1,"completed":2,"skipped":3,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ext4)] volumes
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:16:06.458: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 140 lines ...
Jun 21 16:15:30.799: INFO: PersistentVolumeClaim pvc-xlzfm found but phase is Pending instead of Bound.
Jun 21 16:15:32.823: INFO: PersistentVolumeClaim pvc-xlzfm found and phase=Bound (8.133971057s)
Jun 21 16:15:32.823: INFO: Waiting up to 3m0s for PersistentVolume local-gtccf to have phase Bound
Jun 21 16:15:32.846: INFO: PersistentVolume local-gtccf found and phase=Bound (23.653309ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-krll
STEP: Creating a pod to test atomic-volume-subpath
Jun 21 16:15:32.933: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-krll" in namespace "provisioning-285" to be "Succeeded or Failed"
Jun 21 16:15:32.955: INFO: Pod "pod-subpath-test-preprovisionedpv-krll": Phase="Pending", Reason="", readiness=false. Elapsed: 22.605581ms
Jun 21 16:15:34.981: INFO: Pod "pod-subpath-test-preprovisionedpv-krll": Phase="Pending", Reason="", readiness=false. Elapsed: 2.048447293s
Jun 21 16:15:36.980: INFO: Pod "pod-subpath-test-preprovisionedpv-krll": Phase="Pending", Reason="", readiness=false. Elapsed: 4.046910491s
Jun 21 16:15:38.987: INFO: Pod "pod-subpath-test-preprovisionedpv-krll": Phase="Pending", Reason="", readiness=false. Elapsed: 6.054091578s
Jun 21 16:15:40.980: INFO: Pod "pod-subpath-test-preprovisionedpv-krll": Phase="Pending", Reason="", readiness=false. Elapsed: 8.047245508s
Jun 21 16:15:42.980: INFO: Pod "pod-subpath-test-preprovisionedpv-krll": Phase="Pending", Reason="", readiness=false. Elapsed: 10.047198874s
... skipping 7 lines ...
Jun 21 16:15:58.981: INFO: Pod "pod-subpath-test-preprovisionedpv-krll": Phase="Running", Reason="", readiness=true. Elapsed: 26.048413955s
Jun 21 16:16:00.980: INFO: Pod "pod-subpath-test-preprovisionedpv-krll": Phase="Running", Reason="", readiness=true. Elapsed: 28.046945959s
Jun 21 16:16:02.982: INFO: Pod "pod-subpath-test-preprovisionedpv-krll": Phase="Running", Reason="", readiness=true. Elapsed: 30.048958772s
Jun 21 16:16:04.981: INFO: Pod "pod-subpath-test-preprovisionedpv-krll": Phase="Running", Reason="", readiness=true. Elapsed: 32.048573187s
Jun 21 16:16:06.981: INFO: Pod "pod-subpath-test-preprovisionedpv-krll": Phase="Succeeded", Reason="", readiness=false. Elapsed: 34.047951008s
STEP: Saw pod success
Jun 21 16:16:06.981: INFO: Pod "pod-subpath-test-preprovisionedpv-krll" satisfied condition "Succeeded or Failed"
Jun 21 16:16:07.005: INFO: Trying to get logs from node nodes-us-west3-a-rbw1 pod pod-subpath-test-preprovisionedpv-krll container test-container-subpath-preprovisionedpv-krll: <nil>
STEP: delete the pod
Jun 21 16:16:07.066: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-krll to disappear
Jun 21 16:16:07.092: INFO: Pod pod-subpath-test-preprovisionedpv-krll no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-krll
Jun 21 16:16:07.092: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-krll" in namespace "provisioning-285"
... skipping 21 lines ...
  test/e2e/storage/in_tree_volumes.go:63
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    test/e2e/storage/framework/testsuite.go:50
      should support file as subpath [LinuxOnly]
      test/e2e/storage/testsuites/subpath.go:232
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir] [Testpattern: Pre-provisioned PV (default fs)] subPath should support file as subpath [LinuxOnly]","total":-1,"completed":5,"skipped":52,"failed":0}

SSS
------------------------------
[BeforeEach] [sig-storage] Projected downwardAPI
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
... skipping 24 lines ...
• [SLOW TEST:7.003 seconds]
[sig-storage] Projected downwardAPI
test/e2e/common/storage/framework.go:23
  should update annotations on modification [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-storage] Projected downwardAPI should update annotations on modification [NodeConformance] [Conformance]","total":-1,"completed":5,"skipped":10,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:16:09.979: INFO: Only supported for node OS distro [gci ubuntu custom] (not debian)
... skipping 48 lines ...
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[It] should be consumable from pods in volume with defaultMode set [LinuxOnly] [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
STEP: Creating configMap with name projected-configmap-test-volume-c14b7c50-6e1e-4e07-b6db-0446a5c616c0
STEP: Creating a pod to test consume configMaps
Jun 21 16:15:45.655: INFO: Waiting up to 5m0s for pod "pod-projected-configmaps-fa7ed830-ac0b-40e9-9bd0-3e406814421a" in namespace "projected-2388" to be "Succeeded or Failed"
Jun 21 16:15:45.679: INFO: Pod "pod-projected-configmaps-fa7ed830-ac0b-40e9-9bd0-3e406814421a": Phase="Pending", Reason="", readiness=false. Elapsed: 23.56831ms
Jun 21 16:15:47.704: INFO: Pod "pod-projected-configmaps-fa7ed830-ac0b-40e9-9bd0-3e406814421a": Phase="Pending", Reason="", readiness=false. Elapsed: 2.048906725s
Jun 21 16:15:49.707: INFO: Pod "pod-projected-configmaps-fa7ed830-ac0b-40e9-9bd0-3e406814421a": Phase="Pending", Reason="", readiness=false. Elapsed: 4.051743392s
Jun 21 16:15:51.706: INFO: Pod "pod-projected-configmaps-fa7ed830-ac0b-40e9-9bd0-3e406814421a": Phase="Pending", Reason="", readiness=false. Elapsed: 6.051306321s
Jun 21 16:15:53.741: INFO: Pod "pod-projected-configmaps-fa7ed830-ac0b-40e9-9bd0-3e406814421a": Phase="Pending", Reason="", readiness=false. Elapsed: 8.085747423s
Jun 21 16:15:55.709: INFO: Pod "pod-projected-configmaps-fa7ed830-ac0b-40e9-9bd0-3e406814421a": Phase="Pending", Reason="", readiness=false. Elapsed: 10.054015256s
... skipping 3 lines ...
Jun 21 16:16:03.705: INFO: Pod "pod-projected-configmaps-fa7ed830-ac0b-40e9-9bd0-3e406814421a": Phase="Pending", Reason="", readiness=false. Elapsed: 18.049993528s
Jun 21 16:16:05.704: INFO: Pod "pod-projected-configmaps-fa7ed830-ac0b-40e9-9bd0-3e406814421a": Phase="Pending", Reason="", readiness=false. Elapsed: 20.048719208s
Jun 21 16:16:07.703: INFO: Pod "pod-projected-configmaps-fa7ed830-ac0b-40e9-9bd0-3e406814421a": Phase="Pending", Reason="", readiness=false. Elapsed: 22.047525136s
Jun 21 16:16:09.704: INFO: Pod "pod-projected-configmaps-fa7ed830-ac0b-40e9-9bd0-3e406814421a": Phase="Pending", Reason="", readiness=false. Elapsed: 24.049407281s
Jun 21 16:16:11.704: INFO: Pod "pod-projected-configmaps-fa7ed830-ac0b-40e9-9bd0-3e406814421a": Phase="Succeeded", Reason="", readiness=false. Elapsed: 26.048832039s
STEP: Saw pod success
Jun 21 16:16:11.704: INFO: Pod "pod-projected-configmaps-fa7ed830-ac0b-40e9-9bd0-3e406814421a" satisfied condition "Succeeded or Failed"
Jun 21 16:16:11.729: INFO: Trying to get logs from node nodes-us-west3-a-rbw1 pod pod-projected-configmaps-fa7ed830-ac0b-40e9-9bd0-3e406814421a container agnhost-container: <nil>
STEP: delete the pod
Jun 21 16:16:11.791: INFO: Waiting for pod pod-projected-configmaps-fa7ed830-ac0b-40e9-9bd0-3e406814421a to disappear
Jun 21 16:16:11.815: INFO: Pod pod-projected-configmaps-fa7ed830-ac0b-40e9-9bd0-3e406814421a no longer exists
[AfterEach] [sig-storage] Projected configMap
  test/e2e/framework/framework.go:187
... skipping 4 lines ...
• [SLOW TEST:26.442 seconds]
[sig-storage] Projected configMap
test/e2e/common/storage/framework.go:23
  should be consumable from pods in volume with defaultMode set [LinuxOnly] [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-apps] CronJob should support CronJob API operations [Conformance]","total":-1,"completed":3,"skipped":19,"failed":0}
[BeforeEach] [sig-storage] PersistentVolumes-local 
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
Jun 21 16:15:24.032: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename persistent-local-volumes-test
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 227 lines ...
test/e2e/storage/utils/framework.go:23
  CSI FSGroupPolicy [LinuxOnly]
  test/e2e/storage/csi_mock_volume.go:1636
    should modify fsGroup if fsGroupPolicy=default
    test/e2e/storage/csi_mock_volume.go:1660
------------------------------
{"msg":"PASSED [sig-storage] CSI mock volume CSI FSGroupPolicy [LinuxOnly] should modify fsGroup if fsGroupPolicy=default","total":-1,"completed":2,"skipped":15,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:16:13.531: INFO: Driver local doesn't support InlineVolume -- skipping
... skipping 120 lines ...
Jun 21 16:15:31.284: INFO: PersistentVolumeClaim pvc-62drv found but phase is Pending instead of Bound.
Jun 21 16:15:33.349: INFO: PersistentVolumeClaim pvc-62drv found and phase=Bound (12.22842213s)
Jun 21 16:15:33.349: INFO: Waiting up to 3m0s for PersistentVolume local-sjzr2 to have phase Bound
Jun 21 16:15:33.383: INFO: PersistentVolume local-sjzr2 found and phase=Bound (33.698156ms)
STEP: Creating pod exec-volume-test-preprovisionedpv-9jw9
STEP: Creating a pod to test exec-volume-test
Jun 21 16:15:33.471: INFO: Waiting up to 5m0s for pod "exec-volume-test-preprovisionedpv-9jw9" in namespace "volume-7701" to be "Succeeded or Failed"
Jun 21 16:15:33.498: INFO: Pod "exec-volume-test-preprovisionedpv-9jw9": Phase="Pending", Reason="", readiness=false. Elapsed: 27.29364ms
Jun 21 16:15:35.523: INFO: Pod "exec-volume-test-preprovisionedpv-9jw9": Phase="Pending", Reason="", readiness=false. Elapsed: 2.051885708s
Jun 21 16:15:37.522: INFO: Pod "exec-volume-test-preprovisionedpv-9jw9": Phase="Pending", Reason="", readiness=false. Elapsed: 4.0515903s
Jun 21 16:15:39.524: INFO: Pod "exec-volume-test-preprovisionedpv-9jw9": Phase="Pending", Reason="", readiness=false. Elapsed: 6.053626986s
Jun 21 16:15:41.529: INFO: Pod "exec-volume-test-preprovisionedpv-9jw9": Phase="Pending", Reason="", readiness=false. Elapsed: 8.058082295s
Jun 21 16:15:43.527: INFO: Pod "exec-volume-test-preprovisionedpv-9jw9": Phase="Pending", Reason="", readiness=false. Elapsed: 10.056131921s
... skipping 10 lines ...
Jun 21 16:16:05.523: INFO: Pod "exec-volume-test-preprovisionedpv-9jw9": Phase="Pending", Reason="", readiness=false. Elapsed: 32.051996162s
Jun 21 16:16:07.523: INFO: Pod "exec-volume-test-preprovisionedpv-9jw9": Phase="Pending", Reason="", readiness=false. Elapsed: 34.052642162s
Jun 21 16:16:09.525: INFO: Pod "exec-volume-test-preprovisionedpv-9jw9": Phase="Pending", Reason="", readiness=false. Elapsed: 36.05407888s
Jun 21 16:16:11.525: INFO: Pod "exec-volume-test-preprovisionedpv-9jw9": Phase="Pending", Reason="", readiness=false. Elapsed: 38.054075344s
Jun 21 16:16:13.524: INFO: Pod "exec-volume-test-preprovisionedpv-9jw9": Phase="Succeeded", Reason="", readiness=false. Elapsed: 40.053654441s
STEP: Saw pod success
Jun 21 16:16:13.524: INFO: Pod "exec-volume-test-preprovisionedpv-9jw9" satisfied condition "Succeeded or Failed"
Jun 21 16:16:13.549: INFO: Trying to get logs from node nodes-us-west3-a-rbw1 pod exec-volume-test-preprovisionedpv-9jw9 container exec-container-preprovisionedpv-9jw9: <nil>
STEP: delete the pod
Jun 21 16:16:13.614: INFO: Waiting for pod exec-volume-test-preprovisionedpv-9jw9 to disappear
Jun 21 16:16:13.639: INFO: Pod exec-volume-test-preprovisionedpv-9jw9 no longer exists
STEP: Deleting pod exec-volume-test-preprovisionedpv-9jw9
Jun 21 16:16:13.639: INFO: Deleting pod "exec-volume-test-preprovisionedpv-9jw9" in namespace "volume-7701"
... skipping 24 lines ...
  test/e2e/storage/in_tree_volumes.go:63
    [Testpattern: Pre-provisioned PV (default fs)] volumes
    test/e2e/storage/framework/testsuite.go:50
      should allow exec of files on the volume
      test/e2e/storage/testsuites/volumes.go:198
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: tmpfs] [Testpattern: Pre-provisioned PV (default fs)] volumes should allow exec of files on the volume","total":-1,"completed":3,"skipped":14,"failed":0}

S
------------------------------
[BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance]
  test/e2e/common/node/sysctl.go:37
[BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance]
... skipping 5 lines ...
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance]
  test/e2e/common/node/sysctl.go:67
[It] should not launch unsafe, but not explicitly enabled sysctls on the node [MinimumKubeletVersion:1.21]
  test/e2e/common/node/sysctl.go:159
STEP: Creating a pod with an ignorelisted, but not allowlisted sysctl on the node
STEP: Wait for pod failed reason
Jun 21 16:16:10.222: INFO: Waiting up to 5m0s for pod "sysctl-31cde4ea-b0e7-494b-a0c5-66b94514216d" in namespace "sysctl-5097" to be "failed with reason SysctlForbidden"
Jun 21 16:16:10.261: INFO: Pod "sysctl-31cde4ea-b0e7-494b-a0c5-66b94514216d": Phase="Pending", Reason="", readiness=false. Elapsed: 39.314962ms
Jun 21 16:16:12.284: INFO: Pod "sysctl-31cde4ea-b0e7-494b-a0c5-66b94514216d": Phase="Pending", Reason="", readiness=false. Elapsed: 2.062414809s
Jun 21 16:16:14.285: INFO: Pod "sysctl-31cde4ea-b0e7-494b-a0c5-66b94514216d": Phase="Failed", Reason="SysctlForbidden", readiness=false. Elapsed: 4.063035469s
Jun 21 16:16:14.285: INFO: Pod "sysctl-31cde4ea-b0e7-494b-a0c5-66b94514216d" satisfied condition "failed with reason SysctlForbidden"
[AfterEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance]
  test/e2e/framework/framework.go:187
Jun 21 16:16:14.285: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "sysctl-5097" for this suite.

•
------------------------------
{"msg":"PASSED [sig-node] Sysctls [LinuxOnly] [NodeConformance] should not launch unsafe, but not explicitly enabled sysctls on the node [MinimumKubeletVersion:1.21]","total":-1,"completed":6,"skipped":16,"failed":0}

SSSSSS
------------------------------
[BeforeEach] [sig-apps] ReplicationController
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
... skipping 29 lines ...
• [SLOW TEST:8.421 seconds]
[sig-apps] ReplicationController
test/e2e/apps/framework.go:23
  should adopt matching pods on creation [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-apps] ReplicationController should adopt matching pods on creation [Conformance]","total":-1,"completed":3,"skipped":19,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Inline-volume (ext4)] volumes
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:16:15.066: INFO: Driver local doesn't support InlineVolume -- skipping
... skipping 89 lines ...
• [SLOW TEST:10.735 seconds]
[sig-api-machinery] Garbage collector
test/e2e/apimachinery/framework.go:23
  should delete pods created by rc when not orphaning [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-api-machinery] Garbage collector should delete pods created by rc when not orphaning [Conformance]","total":-1,"completed":6,"skipped":55,"failed":0}

SSSSS
------------------------------
[BeforeEach] [sig-network] SCTP [LinuxOnly]
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
... skipping 20 lines ...
Jun 21 16:15:21.534: INFO: ExecWithOptions: Clientset creation
Jun 21 16:15:21.534: INFO: ExecWithOptions: execute(POST https://34.106.151.197/api/v1/namespaces/sctp-1235/pods/hostexec-nodes-us-west3-a-rbw1-brlcr/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=lsmod+%7C+grep+sctp&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true)
Jun 21 16:15:21.845: INFO: exec nodes-us-west3-a-rbw1: command:   lsmod | grep sctp
Jun 21 16:15:21.845: INFO: exec nodes-us-west3-a-rbw1: stdout:    ""
Jun 21 16:15:21.845: INFO: exec nodes-us-west3-a-rbw1: stderr:    ""
Jun 21 16:15:21.845: INFO: exec nodes-us-west3-a-rbw1: exit code: 0
Jun 21 16:15:21.845: INFO: sctp module is not loaded or error occurred while executing command lsmod | grep sctp on node: command terminated with exit code 1
Jun 21 16:15:21.845: INFO: the sctp module is not loaded on node: nodes-us-west3-a-rbw1
STEP: Deleting pod hostexec-nodes-us-west3-a-rbw1-brlcr in namespace sctp-1235
STEP: creating a pod with hostport on the selected node
STEP: Launching the pod on node nodes-us-west3-a-rbw1
Jun 21 16:15:21.907: INFO: Waiting up to 5m0s for pod "hostport" in namespace "sctp-1235" to be "running and ready"
Jun 21 16:15:21.932: INFO: Pod "hostport": Phase="Pending", Reason="", readiness=false. Elapsed: 24.763978ms
... skipping 65 lines ...
• [SLOW TEST:67.655 seconds]
[sig-network] SCTP [LinuxOnly]
test/e2e/network/common/framework.go:23
  should create a Pod with SCTP HostPort
  test/e2e/network/service.go:4124
------------------------------
{"msg":"PASSED [sig-network] SCTP [LinuxOnly] should create a Pod with SCTP HostPort","total":-1,"completed":3,"skipped":35,"failed":0}

SSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
... skipping 33 lines ...
Jun 21 16:15:45.836: INFO: PersistentVolumeClaim pvc-zq8t2 found but phase is Pending instead of Bound.
Jun 21 16:15:47.860: INFO: PersistentVolumeClaim pvc-zq8t2 found and phase=Bound (12.194213703s)
Jun 21 16:15:47.861: INFO: Waiting up to 3m0s for PersistentVolume local-cgqz4 to have phase Bound
Jun 21 16:15:47.885: INFO: PersistentVolume local-cgqz4 found and phase=Bound (24.159243ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-k2mx
STEP: Creating a pod to test subpath
Jun 21 16:15:47.959: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-k2mx" in namespace "provisioning-3242" to be "Succeeded or Failed"
Jun 21 16:15:47.983: INFO: Pod "pod-subpath-test-preprovisionedpv-k2mx": Phase="Pending", Reason="", readiness=false. Elapsed: 24.064656ms
Jun 21 16:15:50.014: INFO: Pod "pod-subpath-test-preprovisionedpv-k2mx": Phase="Pending", Reason="", readiness=false. Elapsed: 2.055071196s
Jun 21 16:15:52.010: INFO: Pod "pod-subpath-test-preprovisionedpv-k2mx": Phase="Pending", Reason="", readiness=false. Elapsed: 4.051149728s
Jun 21 16:15:54.013: INFO: Pod "pod-subpath-test-preprovisionedpv-k2mx": Phase="Pending", Reason="", readiness=false. Elapsed: 6.053402008s
Jun 21 16:15:56.009: INFO: Pod "pod-subpath-test-preprovisionedpv-k2mx": Phase="Pending", Reason="", readiness=false. Elapsed: 8.049861059s
Jun 21 16:15:58.009: INFO: Pod "pod-subpath-test-preprovisionedpv-k2mx": Phase="Pending", Reason="", readiness=false. Elapsed: 10.049802794s
Jun 21 16:16:00.010: INFO: Pod "pod-subpath-test-preprovisionedpv-k2mx": Phase="Pending", Reason="", readiness=false. Elapsed: 12.051019174s
Jun 21 16:16:02.009: INFO: Pod "pod-subpath-test-preprovisionedpv-k2mx": Phase="Pending", Reason="", readiness=false. Elapsed: 14.049390555s
Jun 21 16:16:04.011: INFO: Pod "pod-subpath-test-preprovisionedpv-k2mx": Phase="Succeeded", Reason="", readiness=false. Elapsed: 16.052148086s
STEP: Saw pod success
Jun 21 16:16:04.012: INFO: Pod "pod-subpath-test-preprovisionedpv-k2mx" satisfied condition "Succeeded or Failed"
Jun 21 16:16:04.037: INFO: Trying to get logs from node nodes-us-west3-a-rbw1 pod pod-subpath-test-preprovisionedpv-k2mx container test-container-subpath-preprovisionedpv-k2mx: <nil>
STEP: delete the pod
Jun 21 16:16:04.127: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-k2mx to disappear
Jun 21 16:16:04.151: INFO: Pod pod-subpath-test-preprovisionedpv-k2mx no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-k2mx
Jun 21 16:16:04.151: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-k2mx" in namespace "provisioning-3242"
STEP: Creating pod pod-subpath-test-preprovisionedpv-k2mx
STEP: Creating a pod to test subpath
Jun 21 16:16:04.212: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-k2mx" in namespace "provisioning-3242" to be "Succeeded or Failed"
Jun 21 16:16:04.238: INFO: Pod "pod-subpath-test-preprovisionedpv-k2mx": Phase="Pending", Reason="", readiness=false. Elapsed: 25.298979ms
Jun 21 16:16:06.265: INFO: Pod "pod-subpath-test-preprovisionedpv-k2mx": Phase="Pending", Reason="", readiness=false. Elapsed: 2.052766012s
Jun 21 16:16:08.271: INFO: Pod "pod-subpath-test-preprovisionedpv-k2mx": Phase="Pending", Reason="", readiness=false. Elapsed: 4.058491419s
Jun 21 16:16:10.265: INFO: Pod "pod-subpath-test-preprovisionedpv-k2mx": Phase="Pending", Reason="", readiness=false. Elapsed: 6.052683151s
Jun 21 16:16:12.268: INFO: Pod "pod-subpath-test-preprovisionedpv-k2mx": Phase="Pending", Reason="", readiness=false. Elapsed: 8.055856617s
Jun 21 16:16:14.267: INFO: Pod "pod-subpath-test-preprovisionedpv-k2mx": Phase="Pending", Reason="", readiness=false. Elapsed: 10.055057905s
Jun 21 16:16:16.263: INFO: Pod "pod-subpath-test-preprovisionedpv-k2mx": Phase="Pending", Reason="", readiness=false. Elapsed: 12.050182195s
Jun 21 16:16:18.267: INFO: Pod "pod-subpath-test-preprovisionedpv-k2mx": Phase="Pending", Reason="", readiness=false. Elapsed: 14.054468157s
Jun 21 16:16:20.265: INFO: Pod "pod-subpath-test-preprovisionedpv-k2mx": Phase="Succeeded", Reason="", readiness=false. Elapsed: 16.05315731s
STEP: Saw pod success
Jun 21 16:16:20.266: INFO: Pod "pod-subpath-test-preprovisionedpv-k2mx" satisfied condition "Succeeded or Failed"
Jun 21 16:16:20.293: INFO: Trying to get logs from node nodes-us-west3-a-rbw1 pod pod-subpath-test-preprovisionedpv-k2mx container test-container-subpath-preprovisionedpv-k2mx: <nil>
STEP: delete the pod
Jun 21 16:16:20.367: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-k2mx to disappear
Jun 21 16:16:20.393: INFO: Pod pod-subpath-test-preprovisionedpv-k2mx no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-k2mx
Jun 21 16:16:20.394: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-k2mx" in namespace "provisioning-3242"
... skipping 21 lines ...
  test/e2e/storage/in_tree_volumes.go:63
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    test/e2e/storage/framework/testsuite.go:50
      should support existing directories when readOnly specified in the volumeSource
      test/e2e/storage/testsuites/subpath.go:397
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir-link-bindmounted] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource","total":-1,"completed":2,"skipped":3,"failed":0}
[BeforeEach] [Testpattern: Inline-volume (default fs)] volumes
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:16:20.935: INFO: Driver csi-hostpath doesn't support InlineVolume -- skipping
[AfterEach] [Testpattern: Inline-volume (default fs)] volumes
  test/e2e/framework/framework.go:187

... skipping 291 lines ...
test/e2e/node/framework.go:23
  Clean up pods on node
  test/e2e/node/kubelet.go:281
    kubelet should be able to delete 10 pods per node in 1m0s.
    test/e2e/node/kubelet.go:343
------------------------------
{"msg":"PASSED [sig-node] kubelet Clean up pods on node kubelet should be able to delete 10 pods per node in 1m0s.","total":-1,"completed":4,"skipped":36,"failed":0}
[BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs)] volumeLimits
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:16:24.583: INFO: Only supported for providers [azure] (not gce)
[AfterEach] [Testpattern: Generic Ephemeral-volume (default fs)] volumeLimits
  test/e2e/framework/framework.go:187

... skipping 99 lines ...
  test/e2e/storage/in_tree_volumes.go:63
    [Testpattern: Inline-volume (default fs)] subPath
    test/e2e/storage/framework/testsuite.go:50
      should be able to unmount after the subpath directory is deleted [LinuxOnly]
      test/e2e/storage/testsuites/subpath.go:447
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Inline-volume (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]","total":-1,"completed":7,"skipped":60,"failed":0}

S
------------------------------
[BeforeEach] [sig-storage] ConfigMap
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
... skipping 2 lines ...
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[It] should be consumable from pods in volume [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
STEP: Creating configMap with name configmap-test-volume-ff2e2565-5f92-4bee-b90d-3f4781b443ae
STEP: Creating a pod to test consume configMaps
Jun 21 16:16:19.141: INFO: Waiting up to 5m0s for pod "pod-configmaps-1b8c4942-c2ae-4d61-a016-6cb617a984fa" in namespace "configmap-1731" to be "Succeeded or Failed"
Jun 21 16:16:19.166: INFO: Pod "pod-configmaps-1b8c4942-c2ae-4d61-a016-6cb617a984fa": Phase="Pending", Reason="", readiness=false. Elapsed: 24.658868ms
Jun 21 16:16:21.192: INFO: Pod "pod-configmaps-1b8c4942-c2ae-4d61-a016-6cb617a984fa": Phase="Pending", Reason="", readiness=false. Elapsed: 2.050725431s
Jun 21 16:16:23.192: INFO: Pod "pod-configmaps-1b8c4942-c2ae-4d61-a016-6cb617a984fa": Phase="Pending", Reason="", readiness=false. Elapsed: 4.051086215s
Jun 21 16:16:25.194: INFO: Pod "pod-configmaps-1b8c4942-c2ae-4d61-a016-6cb617a984fa": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.052245737s
STEP: Saw pod success
Jun 21 16:16:25.194: INFO: Pod "pod-configmaps-1b8c4942-c2ae-4d61-a016-6cb617a984fa" satisfied condition "Succeeded or Failed"
Jun 21 16:16:25.218: INFO: Trying to get logs from node nodes-us-west3-a-kkxs pod pod-configmaps-1b8c4942-c2ae-4d61-a016-6cb617a984fa container agnhost-container: <nil>
STEP: delete the pod
Jun 21 16:16:25.287: INFO: Waiting for pod pod-configmaps-1b8c4942-c2ae-4d61-a016-6cb617a984fa to disappear
Jun 21 16:16:25.313: INFO: Pod pod-configmaps-1b8c4942-c2ae-4d61-a016-6cb617a984fa no longer exists
[AfterEach] [sig-storage] ConfigMap
  test/e2e/framework/framework.go:187
... skipping 4 lines ...
• [SLOW TEST:6.466 seconds]
[sig-storage] ConfigMap
test/e2e/common/storage/framework.go:23
  should be consumable from pods in volume [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-storage] ConfigMap should be consumable from pods in volume [NodeConformance] [Conformance]","total":-1,"completed":4,"skipped":43,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:16:25.380: INFO: Only supported for providers [aws] (not gce)
... skipping 290 lines ...
  test/e2e/storage/in_tree_volumes.go:63
    [Testpattern: Pre-provisioned PV (ext4)] volumes
    test/e2e/storage/framework/testsuite.go:50
      should store data
      test/e2e/storage/testsuites/volumes.go:161
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: block] [Testpattern: Pre-provisioned PV (ext4)] volumes should store data","total":-1,"completed":1,"skipped":12,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
... skipping 3 lines ...
STEP: Building a namespace api object, basename provisioning
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[It] should support readOnly directory specified in the volumeMount
  test/e2e/storage/testsuites/subpath.go:367
Jun 21 16:15:50.144: INFO: In-tree plugin kubernetes.io/host-path is not migrated, not validating any metrics
Jun 21 16:15:50.211: INFO: Waiting up to 5m0s for pod "hostpath-symlink-prep-provisioning-7480" in namespace "provisioning-7480" to be "Succeeded or Failed"
Jun 21 16:15:50.236: INFO: Pod "hostpath-symlink-prep-provisioning-7480": Phase="Pending", Reason="", readiness=false. Elapsed: 24.993979ms
Jun 21 16:15:52.262: INFO: Pod "hostpath-symlink-prep-provisioning-7480": Phase="Pending", Reason="", readiness=false. Elapsed: 2.051580598s
Jun 21 16:15:54.264: INFO: Pod "hostpath-symlink-prep-provisioning-7480": Phase="Pending", Reason="", readiness=false. Elapsed: 4.053551387s
Jun 21 16:15:56.264: INFO: Pod "hostpath-symlink-prep-provisioning-7480": Phase="Pending", Reason="", readiness=false. Elapsed: 6.053127501s
Jun 21 16:15:58.266: INFO: Pod "hostpath-symlink-prep-provisioning-7480": Phase="Pending", Reason="", readiness=false. Elapsed: 8.055009293s
Jun 21 16:16:00.263: INFO: Pod "hostpath-symlink-prep-provisioning-7480": Phase="Pending", Reason="", readiness=false. Elapsed: 10.052708933s
Jun 21 16:16:02.269: INFO: Pod "hostpath-symlink-prep-provisioning-7480": Phase="Pending", Reason="", readiness=false. Elapsed: 12.057778788s
Jun 21 16:16:04.263: INFO: Pod "hostpath-symlink-prep-provisioning-7480": Phase="Succeeded", Reason="", readiness=false. Elapsed: 14.052054121s
STEP: Saw pod success
Jun 21 16:16:04.263: INFO: Pod "hostpath-symlink-prep-provisioning-7480" satisfied condition "Succeeded or Failed"
Jun 21 16:16:04.263: INFO: Deleting pod "hostpath-symlink-prep-provisioning-7480" in namespace "provisioning-7480"
Jun 21 16:16:04.298: INFO: Wait up to 5m0s for pod "hostpath-symlink-prep-provisioning-7480" to be fully deleted
Jun 21 16:16:04.323: INFO: Creating resource for inline volume
STEP: Creating pod pod-subpath-test-inlinevolume-m9ss
STEP: Creating a pod to test subpath
Jun 21 16:16:04.357: INFO: Waiting up to 5m0s for pod "pod-subpath-test-inlinevolume-m9ss" in namespace "provisioning-7480" to be "Succeeded or Failed"
Jun 21 16:16:04.391: INFO: Pod "pod-subpath-test-inlinevolume-m9ss": Phase="Pending", Reason="", readiness=false. Elapsed: 34.02006ms
Jun 21 16:16:06.422: INFO: Pod "pod-subpath-test-inlinevolume-m9ss": Phase="Pending", Reason="", readiness=false. Elapsed: 2.065474139s
Jun 21 16:16:08.418: INFO: Pod "pod-subpath-test-inlinevolume-m9ss": Phase="Pending", Reason="", readiness=false. Elapsed: 4.061302034s
Jun 21 16:16:10.420: INFO: Pod "pod-subpath-test-inlinevolume-m9ss": Phase="Pending", Reason="", readiness=false. Elapsed: 6.062841603s
Jun 21 16:16:12.422: INFO: Pod "pod-subpath-test-inlinevolume-m9ss": Phase="Pending", Reason="", readiness=false. Elapsed: 8.064845986s
Jun 21 16:16:14.418: INFO: Pod "pod-subpath-test-inlinevolume-m9ss": Phase="Pending", Reason="", readiness=false. Elapsed: 10.061140988s
Jun 21 16:16:16.418: INFO: Pod "pod-subpath-test-inlinevolume-m9ss": Phase="Pending", Reason="", readiness=false. Elapsed: 12.060942616s
Jun 21 16:16:18.417: INFO: Pod "pod-subpath-test-inlinevolume-m9ss": Phase="Pending", Reason="", readiness=false. Elapsed: 14.060416496s
Jun 21 16:16:20.426: INFO: Pod "pod-subpath-test-inlinevolume-m9ss": Phase="Pending", Reason="", readiness=false. Elapsed: 16.06860398s
Jun 21 16:16:22.418: INFO: Pod "pod-subpath-test-inlinevolume-m9ss": Phase="Succeeded", Reason="", readiness=false. Elapsed: 18.060941654s
STEP: Saw pod success
Jun 21 16:16:22.418: INFO: Pod "pod-subpath-test-inlinevolume-m9ss" satisfied condition "Succeeded or Failed"
Jun 21 16:16:22.446: INFO: Trying to get logs from node nodes-us-west3-a-rbw1 pod pod-subpath-test-inlinevolume-m9ss container test-container-subpath-inlinevolume-m9ss: <nil>
STEP: delete the pod
Jun 21 16:16:22.509: INFO: Waiting for pod pod-subpath-test-inlinevolume-m9ss to disappear
Jun 21 16:16:22.534: INFO: Pod pod-subpath-test-inlinevolume-m9ss no longer exists
STEP: Deleting pod pod-subpath-test-inlinevolume-m9ss
Jun 21 16:16:22.534: INFO: Deleting pod "pod-subpath-test-inlinevolume-m9ss" in namespace "provisioning-7480"
STEP: Deleting pod
Jun 21 16:16:22.559: INFO: Deleting pod "pod-subpath-test-inlinevolume-m9ss" in namespace "provisioning-7480"
Jun 21 16:16:22.616: INFO: Waiting up to 5m0s for pod "hostpath-symlink-prep-provisioning-7480" in namespace "provisioning-7480" to be "Succeeded or Failed"
Jun 21 16:16:22.641: INFO: Pod "hostpath-symlink-prep-provisioning-7480": Phase="Pending", Reason="", readiness=false. Elapsed: 25.278166ms
Jun 21 16:16:24.670: INFO: Pod "hostpath-symlink-prep-provisioning-7480": Phase="Pending", Reason="", readiness=false. Elapsed: 2.053581367s
Jun 21 16:16:26.675: INFO: Pod "hostpath-symlink-prep-provisioning-7480": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.059326624s
STEP: Saw pod success
Jun 21 16:16:26.675: INFO: Pod "hostpath-symlink-prep-provisioning-7480" satisfied condition "Succeeded or Failed"
Jun 21 16:16:26.675: INFO: Deleting pod "hostpath-symlink-prep-provisioning-7480" in namespace "provisioning-7480"
Jun 21 16:16:26.706: INFO: Wait up to 5m0s for pod "hostpath-symlink-prep-provisioning-7480" to be fully deleted
[AfterEach] [Testpattern: Inline-volume (default fs)] subPath
  test/e2e/framework/framework.go:187
Jun 21 16:16:26.731: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "provisioning-7480" for this suite.
... skipping 6 lines ...
  test/e2e/storage/in_tree_volumes.go:63
    [Testpattern: Inline-volume (default fs)] subPath
    test/e2e/storage/framework/testsuite.go:50
      should support readOnly directory specified in the volumeMount
      test/e2e/storage/testsuites/subpath.go:367
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Inline-volume (default fs)] subPath should support readOnly directory specified in the volumeMount","total":-1,"completed":5,"skipped":56,"failed":0}
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:16:26.795: INFO: Only supported for providers [azure] (not gce)
[AfterEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  test/e2e/framework/framework.go:187

... skipping 69 lines ...
• [SLOW TEST:23.651 seconds]
[sig-network] Services
test/e2e/network/common/framework.go:23
  should be able to create a functioning NodePort service [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-network] Services should be able to create a functioning NodePort service [Conformance]","total":-1,"completed":6,"skipped":47,"failed":0}
[BeforeEach] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:16:27.804: INFO: Only supported for providers [azure] (not gce)
[AfterEach] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral
  test/e2e/framework/framework.go:187

... skipping 32 lines ...
      Only supported for node OS distro [gci ubuntu custom] (not debian)

      test/e2e/storage/drivers/in_tree.go:263
------------------------------
S
------------------------------
{"msg":"PASSED [sig-node] ConfigMap should update ConfigMap successfully","total":-1,"completed":8,"skipped":61,"failed":0}
[BeforeEach] [sig-network] DNS
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
Jun 21 16:16:25.532: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename dns
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 19 lines ...
  test/e2e/framework/framework.go:187
Jun 21 16:16:28.054: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "dns-9080" for this suite.

•
------------------------------
{"msg":"PASSED [sig-network] DNS should provide DNS for the cluster [Provider:GCE]","total":-1,"completed":9,"skipped":61,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:16:28.133: INFO: Driver hostPath doesn't support DynamicPV -- skipping
... skipping 23 lines ...
Jun 21 16:16:21.237: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename init-container
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[BeforeEach] [sig-node] InitContainer [NodeConformance]
  test/e2e/common/node/init_container.go:164
[It] should not start app containers and fail the pod if init containers fail on a RestartNever pod [Conformance]
  test/e2e/framework/framework.go:647
STEP: creating the pod
Jun 21 16:16:21.423: INFO: PodSpec: initContainers in spec.initContainers
[AfterEach] [sig-node] InitContainer [NodeConformance]
  test/e2e/framework/framework.go:187
Jun 21 16:16:29.455: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "init-container-2789" for this suite.


• [SLOW TEST:8.289 seconds]
[sig-node] InitContainer [NodeConformance]
test/e2e/common/node/framework.go:23
  should not start app containers and fail the pod if init containers fail on a RestartNever pod [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-node] InitContainer [NodeConformance] should not start app containers and fail the pod if init containers fail on a RestartNever pod [Conformance]","total":-1,"completed":3,"skipped":27,"failed":0}

SSSSSS
------------------------------
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
... skipping 35 lines ...
• [SLOW TEST:15.201 seconds]
[sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/framework.go:23
  listing validating webhooks should work [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] listing validating webhooks should work [Conformance]","total":-1,"completed":7,"skipped":22,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volumeMode
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:16:29.611: INFO: Driver emptydir doesn't support DynamicPV -- skipping
[AfterEach] [Testpattern: Dynamic PV (block volmode)] volumeMode
  test/e2e/framework/framework.go:187

... skipping 32 lines ...
      test/e2e/storage/testsuites/volumes.go:161

      Driver emptydir doesn't support PreprovisionedPV -- skipping

      test/e2e/storage/framework/testsuite.go:116
------------------------------
{"msg":"PASSED [sig-storage] Projected configMap should be consumable from pods in volume with defaultMode set [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":7,"skipped":70,"failed":0}
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
Jun 21 16:16:11.889: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename webhook
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 12 lines ...
Jun 21 16:16:19.916: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
[It] should honor timeout [Conformance]
  test/e2e/framework/framework.go:647
STEP: Setting timeout (1s) shorter than webhook latency (5s)
STEP: Registering slow webhook via the AdmissionRegistration API
STEP: Request fails when timeout (1s) is shorter than slow webhook latency (5s)
STEP: Having no error when timeout is shorter than webhook latency and failure policy is ignore
STEP: Registering slow webhook via the AdmissionRegistration API
STEP: Having no error when timeout is longer than webhook latency
STEP: Registering slow webhook via the AdmissionRegistration API
STEP: Having no error when timeout is empty (defaulted to 10s in v1)
STEP: Registering slow webhook via the AdmissionRegistration API
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/framework/framework.go:187
Jun 21 16:16:32.474: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "webhook-3833" for this suite.
STEP: Destroying namespace "webhook-3833-markers" for this suite.
... skipping 4 lines ...
• [SLOW TEST:20.828 seconds]
[sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/framework.go:23
  should honor timeout [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should honor timeout [Conformance]","total":-1,"completed":8,"skipped":70,"failed":0}

SSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:16:32.747: INFO: Driver hostPathSymlink doesn't support DynamicPV -- skipping
... skipping 27 lines ...
[It] should support non-existent path
  test/e2e/storage/testsuites/subpath.go:196
Jun 21 16:16:25.598: INFO: In-tree plugin kubernetes.io/empty-dir is not migrated, not validating any metrics
Jun 21 16:16:25.598: INFO: Creating resource for inline volume
STEP: Creating pod pod-subpath-test-inlinevolume-2wnt
STEP: Creating a pod to test subpath
Jun 21 16:16:25.626: INFO: Waiting up to 5m0s for pod "pod-subpath-test-inlinevolume-2wnt" in namespace "provisioning-7983" to be "Succeeded or Failed"
Jun 21 16:16:25.658: INFO: Pod "pod-subpath-test-inlinevolume-2wnt": Phase="Pending", Reason="", readiness=false. Elapsed: 31.811322ms
Jun 21 16:16:27.683: INFO: Pod "pod-subpath-test-inlinevolume-2wnt": Phase="Pending", Reason="", readiness=false. Elapsed: 2.056727833s
Jun 21 16:16:29.688: INFO: Pod "pod-subpath-test-inlinevolume-2wnt": Phase="Pending", Reason="", readiness=false. Elapsed: 4.061315077s
Jun 21 16:16:31.685: INFO: Pod "pod-subpath-test-inlinevolume-2wnt": Phase="Pending", Reason="", readiness=false. Elapsed: 6.058333666s
Jun 21 16:16:33.687: INFO: Pod "pod-subpath-test-inlinevolume-2wnt": Phase="Succeeded", Reason="", readiness=false. Elapsed: 8.060841232s
STEP: Saw pod success
Jun 21 16:16:33.687: INFO: Pod "pod-subpath-test-inlinevolume-2wnt" satisfied condition "Succeeded or Failed"
Jun 21 16:16:33.714: INFO: Trying to get logs from node nodes-us-west3-a-kkxs pod pod-subpath-test-inlinevolume-2wnt container test-container-volume-inlinevolume-2wnt: <nil>
STEP: delete the pod
Jun 21 16:16:33.792: INFO: Waiting for pod pod-subpath-test-inlinevolume-2wnt to disappear
Jun 21 16:16:33.816: INFO: Pod pod-subpath-test-inlinevolume-2wnt no longer exists
STEP: Deleting pod pod-subpath-test-inlinevolume-2wnt
Jun 21 16:16:33.816: INFO: Deleting pod "pod-subpath-test-inlinevolume-2wnt" in namespace "provisioning-7983"
... skipping 12 lines ...
  test/e2e/storage/in_tree_volumes.go:63
    [Testpattern: Inline-volume (default fs)] subPath
    test/e2e/storage/framework/testsuite.go:50
      should support non-existent path
      test/e2e/storage/testsuites/subpath.go:196
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Inline-volume (default fs)] subPath should support non-existent path","total":-1,"completed":5,"skipped":50,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:16:33.947: INFO: Driver csi-hostpath doesn't support InlineVolume -- skipping
... skipping 70 lines ...
STEP: Building a namespace api object, basename emptydir
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[It] volume on tmpfs should have the correct mode [LinuxOnly] [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
STEP: Creating a pod to test emptydir volume type on tmpfs
Jun 21 16:16:28.338: INFO: Waiting up to 5m0s for pod "pod-72927c7f-9ca8-41a0-8a0a-aa5b9ede89e6" in namespace "emptydir-7044" to be "Succeeded or Failed"
Jun 21 16:16:28.364: INFO: Pod "pod-72927c7f-9ca8-41a0-8a0a-aa5b9ede89e6": Phase="Pending", Reason="", readiness=false. Elapsed: 26.050288ms
Jun 21 16:16:30.390: INFO: Pod "pod-72927c7f-9ca8-41a0-8a0a-aa5b9ede89e6": Phase="Pending", Reason="", readiness=false. Elapsed: 2.051465563s
Jun 21 16:16:32.388: INFO: Pod "pod-72927c7f-9ca8-41a0-8a0a-aa5b9ede89e6": Phase="Running", Reason="", readiness=false. Elapsed: 4.049423947s
Jun 21 16:16:34.389: INFO: Pod "pod-72927c7f-9ca8-41a0-8a0a-aa5b9ede89e6": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.050232779s
STEP: Saw pod success
Jun 21 16:16:34.389: INFO: Pod "pod-72927c7f-9ca8-41a0-8a0a-aa5b9ede89e6" satisfied condition "Succeeded or Failed"
Jun 21 16:16:34.419: INFO: Trying to get logs from node nodes-us-west3-a-12tt pod pod-72927c7f-9ca8-41a0-8a0a-aa5b9ede89e6 container test-container: <nil>
STEP: delete the pod
Jun 21 16:16:34.493: INFO: Waiting for pod pod-72927c7f-9ca8-41a0-8a0a-aa5b9ede89e6 to disappear
Jun 21 16:16:34.517: INFO: Pod pod-72927c7f-9ca8-41a0-8a0a-aa5b9ede89e6 no longer exists
[AfterEach] [sig-storage] EmptyDir volumes
  test/e2e/framework/framework.go:187
... skipping 4 lines ...
• [SLOW TEST:6.436 seconds]
[sig-storage] EmptyDir volumes
test/e2e/common/storage/framework.go:23
  volume on tmpfs should have the correct mode [LinuxOnly] [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-storage] EmptyDir volumes volume on tmpfs should have the correct mode [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":10,"skipped":64,"failed":0}

SS
------------------------------
[BeforeEach] [sig-api-machinery] CustomResourceDefinition Watch [Privileged:ClusterAdmin]
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
... skipping 27 lines ...
test/e2e/apimachinery/framework.go:23
  CustomResourceDefinition Watch
  test/e2e/apimachinery/crd_watch.go:44
    watch on custom resource definition objects [Conformance]
    test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-api-machinery] CustomResourceDefinition Watch [Privileged:ClusterAdmin] CustomResourceDefinition Watch watch on custom resource definition objects [Conformance]","total":-1,"completed":3,"skipped":54,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:16:36.150: INFO: Driver hostPath doesn't support PreprovisionedPV -- skipping
... skipping 215 lines ...
• [SLOW TEST:35.802 seconds]
[sig-api-machinery] Garbage collector
test/e2e/apimachinery/framework.go:23
  should orphan pods created by rc if deleteOptions.OrphanDependents is nil
  test/e2e/apimachinery/garbage_collector.go:439
------------------------------
{"msg":"PASSED [sig-api-machinery] Garbage collector should orphan pods created by rc if deleteOptions.OrphanDependents is nil","total":-1,"completed":2,"skipped":11,"failed":0}

SSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] volumeLimits
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:16:36.984: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 58 lines ...
      test/e2e/storage/testsuites/volumes.go:161

      Only supported for providers [azure] (not gce)

      test/e2e/storage/drivers/in_tree.go:1577
------------------------------
{"msg":"PASSED [sig-storage] PersistentVolumes-local  [Volume type: tmpfs] One pod requesting one prebound PVC should be able to mount volume and read from pod1","total":-1,"completed":4,"skipped":19,"failed":0}
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
Jun 21 16:16:12.747: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename provisioning
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[It] should support non-existent path
  test/e2e/storage/testsuites/subpath.go:196
Jun 21 16:16:12.924: INFO: In-tree plugin kubernetes.io/host-path is not migrated, not validating any metrics
Jun 21 16:16:12.984: INFO: Waiting up to 5m0s for pod "hostpath-symlink-prep-provisioning-323" in namespace "provisioning-323" to be "Succeeded or Failed"
Jun 21 16:16:13.008: INFO: Pod "hostpath-symlink-prep-provisioning-323": Phase="Pending", Reason="", readiness=false. Elapsed: 23.920302ms
Jun 21 16:16:15.033: INFO: Pod "hostpath-symlink-prep-provisioning-323": Phase="Pending", Reason="", readiness=false. Elapsed: 2.04873633s
Jun 21 16:16:17.033: INFO: Pod "hostpath-symlink-prep-provisioning-323": Phase="Pending", Reason="", readiness=false. Elapsed: 4.04849055s
Jun 21 16:16:19.034: INFO: Pod "hostpath-symlink-prep-provisioning-323": Phase="Pending", Reason="", readiness=false. Elapsed: 6.049461365s
Jun 21 16:16:21.033: INFO: Pod "hostpath-symlink-prep-provisioning-323": Phase="Pending", Reason="", readiness=false. Elapsed: 8.04902008s
Jun 21 16:16:23.034: INFO: Pod "hostpath-symlink-prep-provisioning-323": Phase="Succeeded", Reason="", readiness=false. Elapsed: 10.049337819s
STEP: Saw pod success
Jun 21 16:16:23.034: INFO: Pod "hostpath-symlink-prep-provisioning-323" satisfied condition "Succeeded or Failed"
Jun 21 16:16:23.034: INFO: Deleting pod "hostpath-symlink-prep-provisioning-323" in namespace "provisioning-323"
Jun 21 16:16:23.066: INFO: Wait up to 5m0s for pod "hostpath-symlink-prep-provisioning-323" to be fully deleted
Jun 21 16:16:23.093: INFO: Creating resource for inline volume
STEP: Creating pod pod-subpath-test-inlinevolume-jrr2
STEP: Creating a pod to test subpath
Jun 21 16:16:23.122: INFO: Waiting up to 5m0s for pod "pod-subpath-test-inlinevolume-jrr2" in namespace "provisioning-323" to be "Succeeded or Failed"
Jun 21 16:16:23.145: INFO: Pod "pod-subpath-test-inlinevolume-jrr2": Phase="Pending", Reason="", readiness=false. Elapsed: 22.914788ms
Jun 21 16:16:25.170: INFO: Pod "pod-subpath-test-inlinevolume-jrr2": Phase="Pending", Reason="", readiness=false. Elapsed: 2.04826317s
Jun 21 16:16:27.170: INFO: Pod "pod-subpath-test-inlinevolume-jrr2": Phase="Pending", Reason="", readiness=false. Elapsed: 4.047316448s
Jun 21 16:16:29.171: INFO: Pod "pod-subpath-test-inlinevolume-jrr2": Phase="Pending", Reason="", readiness=false. Elapsed: 6.048978167s
Jun 21 16:16:31.171: INFO: Pod "pod-subpath-test-inlinevolume-jrr2": Phase="Pending", Reason="", readiness=false. Elapsed: 8.049188849s
Jun 21 16:16:33.174: INFO: Pod "pod-subpath-test-inlinevolume-jrr2": Phase="Succeeded", Reason="", readiness=false. Elapsed: 10.051409932s
STEP: Saw pod success
Jun 21 16:16:33.174: INFO: Pod "pod-subpath-test-inlinevolume-jrr2" satisfied condition "Succeeded or Failed"
Jun 21 16:16:33.201: INFO: Trying to get logs from node nodes-us-west3-a-kkxs pod pod-subpath-test-inlinevolume-jrr2 container test-container-volume-inlinevolume-jrr2: <nil>
STEP: delete the pod
Jun 21 16:16:33.295: INFO: Waiting for pod pod-subpath-test-inlinevolume-jrr2 to disappear
Jun 21 16:16:33.320: INFO: Pod pod-subpath-test-inlinevolume-jrr2 no longer exists
STEP: Deleting pod pod-subpath-test-inlinevolume-jrr2
Jun 21 16:16:33.320: INFO: Deleting pod "pod-subpath-test-inlinevolume-jrr2" in namespace "provisioning-323"
STEP: Deleting pod
Jun 21 16:16:33.349: INFO: Deleting pod "pod-subpath-test-inlinevolume-jrr2" in namespace "provisioning-323"
Jun 21 16:16:33.421: INFO: Waiting up to 5m0s for pod "hostpath-symlink-prep-provisioning-323" in namespace "provisioning-323" to be "Succeeded or Failed"
Jun 21 16:16:33.449: INFO: Pod "hostpath-symlink-prep-provisioning-323": Phase="Pending", Reason="", readiness=false. Elapsed: 28.021121ms
Jun 21 16:16:35.479: INFO: Pod "hostpath-symlink-prep-provisioning-323": Phase="Pending", Reason="", readiness=false. Elapsed: 2.057747454s
Jun 21 16:16:37.474: INFO: Pod "hostpath-symlink-prep-provisioning-323": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.052980717s
STEP: Saw pod success
Jun 21 16:16:37.474: INFO: Pod "hostpath-symlink-prep-provisioning-323" satisfied condition "Succeeded or Failed"
Jun 21 16:16:37.474: INFO: Deleting pod "hostpath-symlink-prep-provisioning-323" in namespace "provisioning-323"
Jun 21 16:16:37.510: INFO: Wait up to 5m0s for pod "hostpath-symlink-prep-provisioning-323" to be fully deleted
[AfterEach] [Testpattern: Inline-volume (default fs)] subPath
  test/e2e/framework/framework.go:187
Jun 21 16:16:37.533: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "provisioning-323" for this suite.
... skipping 6 lines ...
  test/e2e/storage/in_tree_volumes.go:63
    [Testpattern: Inline-volume (default fs)] subPath
    test/e2e/storage/framework/testsuite.go:50
      should support non-existent path
      test/e2e/storage/testsuites/subpath.go:196
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Inline-volume (default fs)] subPath should support non-existent path","total":-1,"completed":5,"skipped":19,"failed":0}

SSSSSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (ext3)] volumes
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:16:37.629: INFO: Only supported for providers [azure] (not gce)
... skipping 76 lines ...
• [SLOW TEST:6.640 seconds]
[sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/framework.go:23
  should not be able to mutate or prevent deletion of webhook configuration objects [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should not be able to mutate or prevent deletion of webhook configuration objects [Conformance]","total":-1,"completed":9,"skipped":75,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:16:39.420: INFO: Only supported for providers [azure] (not gce)
... skipping 60 lines ...
  test/e2e/framework/framework.go:187
Jun 21 16:16:40.211: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "kubectl-1723" for this suite.

•
------------------------------
{"msg":"PASSED [sig-cli] Kubectl client Kubectl describe should check if kubectl describe prints relevant information for cronjob","total":-1,"completed":10,"skipped":78,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:16:40.277: INFO: Only supported for providers [aws] (not gce)
[AfterEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand
  test/e2e/framework/framework.go:187

... skipping 75 lines ...
Jun 21 16:16:13.819: INFO: Running '/logs/artifacts/b29e4240-f17b-11ec-9ac1-d2ba5eb345d8/kubectl --server=https://34.106.151.197 --kubeconfig=/root/.kube/config --namespace=kubectl-4013 create -f -'
Jun 21 16:16:14.153: INFO: stderr: ""
Jun 21 16:16:14.153: INFO: stdout: "pod/httpd created\n"
Jun 21 16:16:14.153: INFO: Waiting up to 5m0s for 1 pods to be running and ready: [httpd]
Jun 21 16:16:14.153: INFO: Waiting up to 5m0s for pod "httpd" in namespace "kubectl-4013" to be "running and ready"
Jun 21 16:16:14.178: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 25.219749ms
Jun 21 16:16:14.178: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'nodes-us-west3-a-tw9s' to be 'Running' but was 'Pending'
Jun 21 16:16:16.204: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2.050756216s
Jun 21 16:16:16.204: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'nodes-us-west3-a-tw9s' to be 'Running' but was 'Pending'
Jun 21 16:16:18.206: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4.052634507s
Jun 21 16:16:18.206: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'nodes-us-west3-a-tw9s' to be 'Running' but was 'Pending'
Jun 21 16:16:20.211: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 6.057640813s
Jun 21 16:16:20.211: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'nodes-us-west3-a-tw9s' to be 'Running' but was 'Pending'
Jun 21 16:16:22.204: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 8.05155092s
Jun 21 16:16:22.205: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'nodes-us-west3-a-tw9s' to be 'Running' but was 'Pending'
Jun 21 16:16:24.206: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 10.05328576s
Jun 21 16:16:24.206: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'nodes-us-west3-a-tw9s' to be 'Running' but was 'Pending'
Jun 21 16:16:26.208: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 12.055042887s
Jun 21 16:16:26.208: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'nodes-us-west3-a-tw9s' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:14 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:14 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:14 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:14 +0000 UTC  }]
Jun 21 16:16:28.205: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 14.051954318s
Jun 21 16:16:28.205: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'nodes-us-west3-a-tw9s' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:14 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:14 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:14 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:14 +0000 UTC  }]
Jun 21 16:16:30.203: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 16.049713359s
Jun 21 16:16:30.203: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'nodes-us-west3-a-tw9s' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:14 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:14 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:14 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:14 +0000 UTC  }]
Jun 21 16:16:32.203: INFO: Pod "httpd": Phase="Running", Reason="", readiness=true. Elapsed: 18.050370224s
Jun 21 16:16:32.203: INFO: Pod "httpd" satisfied condition "running and ready"
Jun 21 16:16:32.203: INFO: Wanted all 1 pods to be running and ready. Result: true. Pods: [httpd]
[It] should handle in-cluster config
  test/e2e/kubectl/kubectl.go:682
STEP: adding rbac permissions
... skipping 67 lines ...
STEP: creating an object not containing a namespace with in-cluster config
Jun 21 16:16:39.049: INFO: Running '/logs/artifacts/b29e4240-f17b-11ec-9ac1-d2ba5eb345d8/kubectl --server=https://34.106.151.197 --kubeconfig=/root/.kube/config --namespace=kubectl-4013 exec httpd -- /bin/sh -x -c /tmp/kubectl create -f /tmp/invalid-configmap-without-namespace.yaml --v=6 2>&1'
Jun 21 16:16:39.623: INFO: rc: 1
STEP: trying to use kubectl with invalid token
Jun 21 16:16:39.623: INFO: Running '/logs/artifacts/b29e4240-f17b-11ec-9ac1-d2ba5eb345d8/kubectl --server=https://34.106.151.197 --kubeconfig=/root/.kube/config --namespace=kubectl-4013 exec httpd -- /bin/sh -x -c /tmp/kubectl get pods --token=invalid --v=7 2>&1'
Jun 21 16:16:40.078: INFO: rc: 1
Jun 21 16:16:40.078: INFO: got err error running /logs/artifacts/b29e4240-f17b-11ec-9ac1-d2ba5eb345d8/kubectl --server=https://34.106.151.197 --kubeconfig=/root/.kube/config --namespace=kubectl-4013 exec httpd -- /bin/sh -x -c /tmp/kubectl get pods --token=invalid --v=7 2>&1:
Command stdout:
I0621 16:16:40.041354     186 merged_client_builder.go:163] Using in-cluster namespace
I0621 16:16:40.041751     186 merged_client_builder.go:121] Using in-cluster configuration
I0621 16:16:40.050360     186 merged_client_builder.go:121] Using in-cluster configuration
I0621 16:16:40.050660     186 round_trippers.go:463] GET https://100.64.0.1:443/api/v1/namespaces/kubectl-4013/pods?limit=500
I0621 16:16:40.050682     186 round_trippers.go:469] Request Headers:
... skipping 7 lines ...
  "metadata": {},
  "status": "Failure",
  "message": "Unauthorized",
  "reason": "Unauthorized",
  "code": 401
}]
error: You must be logged in to the server (Unauthorized)

stderr:
+ /tmp/kubectl get pods '--token=invalid' '--v=7'
command terminated with exit code 1

error:
exit status 1
STEP: trying to use kubectl with invalid server
Jun 21 16:16:40.078: INFO: Running '/logs/artifacts/b29e4240-f17b-11ec-9ac1-d2ba5eb345d8/kubectl --server=https://34.106.151.197 --kubeconfig=/root/.kube/config --namespace=kubectl-4013 exec httpd -- /bin/sh -x -c /tmp/kubectl get pods --server=invalid --v=6 2>&1'
Jun 21 16:16:40.578: INFO: rc: 1
Jun 21 16:16:40.578: INFO: got err error running /logs/artifacts/b29e4240-f17b-11ec-9ac1-d2ba5eb345d8/kubectl --server=https://34.106.151.197 --kubeconfig=/root/.kube/config --namespace=kubectl-4013 exec httpd -- /bin/sh -x -c /tmp/kubectl get pods --server=invalid --v=6 2>&1:
Command stdout:
I0621 16:16:40.469629     196 merged_client_builder.go:163] Using in-cluster namespace
I0621 16:16:40.539665     196 round_trippers.go:553] GET http://invalid/api?timeout=32s  in 69 milliseconds
I0621 16:16:40.540059     196 cached_discovery.go:119] skipped caching discovery info due to Get "http://invalid/api?timeout=32s": dial tcp: lookup invalid on 100.64.0.10:53: no such host
I0621 16:16:40.545163     196 round_trippers.go:553] GET http://invalid/api?timeout=32s  in 4 milliseconds
I0621 16:16:40.545297     196 cached_discovery.go:119] skipped caching discovery info due to Get "http://invalid/api?timeout=32s": dial tcp: lookup invalid on 100.64.0.10:53: no such host
I0621 16:16:40.545322     196 shortcut.go:100] Error loading discovery information: Get "http://invalid/api?timeout=32s": dial tcp: lookup invalid on 100.64.0.10:53: no such host
I0621 16:16:40.549289     196 round_trippers.go:553] GET http://invalid/api?timeout=32s  in 3 milliseconds
I0621 16:16:40.549383     196 cached_discovery.go:119] skipped caching discovery info due to Get "http://invalid/api?timeout=32s": dial tcp: lookup invalid on 100.64.0.10:53: no such host
I0621 16:16:40.552764     196 round_trippers.go:553] GET http://invalid/api?timeout=32s  in 3 milliseconds
I0621 16:16:40.552969     196 cached_discovery.go:119] skipped caching discovery info due to Get "http://invalid/api?timeout=32s": dial tcp: lookup invalid on 100.64.0.10:53: no such host
I0621 16:16:40.556819     196 round_trippers.go:553] GET http://invalid/api?timeout=32s  in 3 milliseconds
I0621 16:16:40.557082     196 cached_discovery.go:119] skipped caching discovery info due to Get "http://invalid/api?timeout=32s": dial tcp: lookup invalid on 100.64.0.10:53: no such host
I0621 16:16:40.557240     196 helpers.go:240] Connection error: Get http://invalid/api?timeout=32s: dial tcp: lookup invalid on 100.64.0.10:53: no such host
Unable to connect to the server: dial tcp: lookup invalid on 100.64.0.10:53: no such host

stderr:
+ /tmp/kubectl get pods '--server=invalid' '--v=6'
command terminated with exit code 1

error:
exit status 1
STEP: trying to use kubectl with invalid namespace
Jun 21 16:16:40.578: INFO: Running '/logs/artifacts/b29e4240-f17b-11ec-9ac1-d2ba5eb345d8/kubectl --server=https://34.106.151.197 --kubeconfig=/root/.kube/config --namespace=kubectl-4013 exec httpd -- /bin/sh -x -c /tmp/kubectl get pods --namespace=invalid --v=6 2>&1'
Jun 21 16:16:40.998: INFO: stderr: "+ /tmp/kubectl get pods '--namespace=invalid' '--v=6'\n"
Jun 21 16:16:40.998: INFO: stdout: "I0621 16:16:40.959411     205 merged_client_builder.go:121] Using in-cluster configuration\nI0621 16:16:40.968396     205 merged_client_builder.go:121] Using in-cluster configuration\nI0621 16:16:40.977140     205 round_trippers.go:553] GET https://100.64.0.1:443/api/v1/namespaces/invalid/pods?limit=500 200 OK in 8 milliseconds\nNo resources found in invalid namespace.\n"
Jun 21 16:16:40.998: INFO: stdout: I0621 16:16:40.959411     205 merged_client_builder.go:121] Using in-cluster configuration
... skipping 58 lines ...
test/e2e/kubectl/framework.go:23
  Simple pod
  test/e2e/kubectl/kubectl.go:407
    should handle in-cluster config
    test/e2e/kubectl/kubectl.go:682
------------------------------
{"msg":"PASSED [sig-cli] Kubectl client Simple pod should handle in-cluster config","total":-1,"completed":3,"skipped":26,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:16:42.229: INFO: Driver hostPath doesn't support PreprovisionedPV -- skipping
... skipping 94 lines ...
STEP: SSH'ing host 34.106.12.233:22
STEP: SSH'ing to 1 nodes and running echo "stdout" && echo "stderr" >&2 && exit 7
STEP: SSH'ing host 34.106.12.233:22
Jun 21 16:16:22.287: INFO: Got stdout from 34.106.12.233:22: stdout
Jun 21 16:16:22.287: INFO: Got stderr from 34.106.12.233:22: stderr
STEP: SSH'ing to a nonexistent host
error dialing prow@i.do.not.exist: 'dial tcp: address i.do.not.exist: missing port in address', retrying
error dialing prow@i.do.not.exist: 'dial tcp: address i.do.not.exist: missing port in address', retrying
error dialing prow@i.do.not.exist: 'dial tcp: address i.do.not.exist: missing port in address', retrying
error dialing prow@i.do.not.exist: 'dial tcp: address i.do.not.exist: missing port in address', retrying
error dialing prow@i.do.not.exist: 'dial tcp: address i.do.not.exist: missing port in address', retrying
[AfterEach] [sig-node] SSH
  test/e2e/framework/framework.go:187
Jun 21 16:16:42.288: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "ssh-769" for this suite.


• [SLOW TEST:28.004 seconds]
[sig-node] SSH
test/e2e/node/framework.go:23
  should SSH to all nodes and run commands
  test/e2e/node/ssh.go:47
------------------------------
{"msg":"PASSED [sig-node] SSH should SSH to all nodes and run commands","total":-1,"completed":4,"skipped":15,"failed":0}

SSSSSSSSS
------------------------------
[BeforeEach] [sig-storage] CSI mock volume
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
... skipping 103 lines ...
test/e2e/storage/utils/framework.go:23
  CSIStorageCapacity
  test/e2e/storage/csi_mock_volume.go:1334
    CSIStorageCapacity used, have capacity
    test/e2e/storage/csi_mock_volume.go:1377
------------------------------
{"msg":"PASSED [sig-storage] CSI mock volume CSIStorageCapacity CSIStorageCapacity used, have capacity","total":-1,"completed":4,"skipped":26,"failed":0}

SSS
------------------------------
[BeforeEach] [sig-cli] Kubectl client
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
... skipping 13 lines ...
  test/e2e/framework/framework.go:187
Jun 21 16:16:42.722: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "kubectl-4809" for this suite.

•
------------------------------
{"msg":"PASSED [sig-cli] Kubectl client Kubectl cluster-info should check if Kubernetes control plane services is included in cluster-info  [Conformance]","total":-1,"completed":5,"skipped":24,"failed":0}

SSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:16:42.806: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 60 lines ...
Jun 21 16:16:30.688: INFO: PersistentVolumeClaim pvc-thxb7 found but phase is Pending instead of Bound.
Jun 21 16:16:32.728: INFO: PersistentVolumeClaim pvc-thxb7 found and phase=Bound (8.152004982s)
Jun 21 16:16:32.728: INFO: Waiting up to 3m0s for PersistentVolume local-pxzzt to have phase Bound
Jun 21 16:16:32.753: INFO: PersistentVolume local-pxzzt found and phase=Bound (24.550459ms)
STEP: Creating pod exec-volume-test-preprovisionedpv-kwfj
STEP: Creating a pod to test exec-volume-test
Jun 21 16:16:32.838: INFO: Waiting up to 5m0s for pod "exec-volume-test-preprovisionedpv-kwfj" in namespace "volume-9297" to be "Succeeded or Failed"
Jun 21 16:16:32.870: INFO: Pod "exec-volume-test-preprovisionedpv-kwfj": Phase="Pending", Reason="", readiness=false. Elapsed: 31.174942ms
Jun 21 16:16:34.896: INFO: Pod "exec-volume-test-preprovisionedpv-kwfj": Phase="Pending", Reason="", readiness=false. Elapsed: 2.057331896s
Jun 21 16:16:36.894: INFO: Pod "exec-volume-test-preprovisionedpv-kwfj": Phase="Pending", Reason="", readiness=false. Elapsed: 4.055754481s
Jun 21 16:16:38.899: INFO: Pod "exec-volume-test-preprovisionedpv-kwfj": Phase="Pending", Reason="", readiness=false. Elapsed: 6.060754498s
Jun 21 16:16:40.895: INFO: Pod "exec-volume-test-preprovisionedpv-kwfj": Phase="Pending", Reason="", readiness=false. Elapsed: 8.05651703s
Jun 21 16:16:42.920: INFO: Pod "exec-volume-test-preprovisionedpv-kwfj": Phase="Succeeded", Reason="", readiness=false. Elapsed: 10.081494642s
STEP: Saw pod success
Jun 21 16:16:42.920: INFO: Pod "exec-volume-test-preprovisionedpv-kwfj" satisfied condition "Succeeded or Failed"
Jun 21 16:16:42.963: INFO: Trying to get logs from node nodes-us-west3-a-kkxs pod exec-volume-test-preprovisionedpv-kwfj container exec-container-preprovisionedpv-kwfj: <nil>
STEP: delete the pod
Jun 21 16:16:43.164: INFO: Waiting for pod exec-volume-test-preprovisionedpv-kwfj to disappear
Jun 21 16:16:43.193: INFO: Pod exec-volume-test-preprovisionedpv-kwfj no longer exists
STEP: Deleting pod exec-volume-test-preprovisionedpv-kwfj
Jun 21 16:16:43.193: INFO: Deleting pod "exec-volume-test-preprovisionedpv-kwfj" in namespace "volume-9297"
... skipping 32 lines ...
  test/e2e/storage/in_tree_volumes.go:63
    [Testpattern: Pre-provisioned PV (default fs)] volumes
    test/e2e/storage/framework/testsuite.go:50
      should allow exec of files on the volume
      test/e2e/storage/testsuites/volumes.go:198
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: blockfs] [Testpattern: Pre-provisioned PV (default fs)] volumes should allow exec of files on the volume","total":-1,"completed":4,"skipped":29,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] volumeLimits
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:16:44.502: INFO: Driver hostPathSymlink doesn't support DynamicPV -- skipping
... skipping 80 lines ...
  test/e2e/framework/framework.go:187
Jun 21 16:16:44.747: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "endpointslicemirroring-6822" for this suite.

•
------------------------------
{"msg":"PASSED [sig-network] EndpointSliceMirroring should mirror a custom Endpoints resource through create update and delete [Conformance]","total":-1,"completed":4,"skipped":35,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral
  test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral
... skipping 217 lines ...
  test/e2e/storage/csi_volumes.go:40
    [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral
    test/e2e/storage/framework/testsuite.go:50
      should create read/write inline ephemeral volume
      test/e2e/storage/testsuites/ephemeral.go:196
------------------------------
{"msg":"PASSED [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should create read/write inline ephemeral volume","total":-1,"completed":6,"skipped":93,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
  test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
... skipping 164 lines ...
  test/e2e/storage/csi_volumes.go:40
    [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
    test/e2e/storage/framework/testsuite.go:50
      should create read-only inline ephemeral volume
      test/e2e/storage/testsuites/ephemeral.go:175
------------------------------
{"msg":"PASSED [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should create read-only inline ephemeral volume","total":-1,"completed":1,"skipped":4,"failed":0}

SSSSSSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:16:47.095: INFO: Only supported for providers [openstack] (not gce)
... skipping 226 lines ...
test/e2e/apps/framework.go:23
  Basic StatefulSet functionality [StatefulSetBasic]
  test/e2e/apps/statefulset.go:101
    should list, patch and delete a collection of StatefulSets [Conformance]
    test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should list, patch and delete a collection of StatefulSets [Conformance]","total":-1,"completed":4,"skipped":33,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:16:50.315: INFO: Only supported for providers [azure] (not gce)
... skipping 90 lines ...
• [SLOW TEST:13.573 seconds]
[sig-api-machinery] ResourceQuota
test/e2e/apimachinery/framework.go:23
  should create a ResourceQuota and capture the life of a pod. [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a pod. [Conformance]","total":-1,"completed":3,"skipped":25,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs)] volumeLimits
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:16:50.625: INFO: Only supported for providers [vsphere] (not gce)
... skipping 22 lines ...
STEP: Building a namespace api object, basename downward-api
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[It] should provide host IP as an env var [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
STEP: Creating a pod to test downward api env vars
Jun 21 16:16:40.589: INFO: Waiting up to 5m0s for pod "downward-api-0197d6cd-b47a-4141-a449-0d64452d0968" in namespace "downward-api-4051" to be "Succeeded or Failed"
Jun 21 16:16:40.613: INFO: Pod "downward-api-0197d6cd-b47a-4141-a449-0d64452d0968": Phase="Pending", Reason="", readiness=false. Elapsed: 23.90309ms
Jun 21 16:16:42.638: INFO: Pod "downward-api-0197d6cd-b47a-4141-a449-0d64452d0968": Phase="Pending", Reason="", readiness=false. Elapsed: 2.048406728s
Jun 21 16:16:44.650: INFO: Pod "downward-api-0197d6cd-b47a-4141-a449-0d64452d0968": Phase="Pending", Reason="", readiness=false. Elapsed: 4.060571258s
Jun 21 16:16:46.639: INFO: Pod "downward-api-0197d6cd-b47a-4141-a449-0d64452d0968": Phase="Pending", Reason="", readiness=false. Elapsed: 6.049182246s
Jun 21 16:16:48.638: INFO: Pod "downward-api-0197d6cd-b47a-4141-a449-0d64452d0968": Phase="Pending", Reason="", readiness=false. Elapsed: 8.048724966s
Jun 21 16:16:50.638: INFO: Pod "downward-api-0197d6cd-b47a-4141-a449-0d64452d0968": Phase="Succeeded", Reason="", readiness=false. Elapsed: 10.048369866s
STEP: Saw pod success
Jun 21 16:16:50.638: INFO: Pod "downward-api-0197d6cd-b47a-4141-a449-0d64452d0968" satisfied condition "Succeeded or Failed"
Jun 21 16:16:50.663: INFO: Trying to get logs from node nodes-us-west3-a-tw9s pod downward-api-0197d6cd-b47a-4141-a449-0d64452d0968 container dapi-container: <nil>
STEP: delete the pod
Jun 21 16:16:50.724: INFO: Waiting for pod downward-api-0197d6cd-b47a-4141-a449-0d64452d0968 to disappear
Jun 21 16:16:50.748: INFO: Pod downward-api-0197d6cd-b47a-4141-a449-0d64452d0968 no longer exists
[AfterEach] [sig-node] Downward API
  test/e2e/framework/framework.go:187
... skipping 4 lines ...
• [SLOW TEST:10.457 seconds]
[sig-node] Downward API
test/e2e/common/node/framework.go:23
  should provide host IP as an env var [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-node] Downward API should provide host IP as an env var [NodeConformance] [Conformance]","total":-1,"completed":11,"skipped":89,"failed":0}

SSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] volumes
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:16:50.836: INFO: Only supported for node OS distro [gci ubuntu custom] (not debian)
... skipping 53 lines ...
  test/e2e/framework/framework.go:187
Jun 21 16:16:51.070: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "tables-5832" for this suite.

•
------------------------------
{"msg":"PASSED [sig-api-machinery] Servers with support for Table transformation should return a 406 for a backend which does not implement metadata [Conformance]","total":-1,"completed":12,"skipped":97,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:16:51.138: INFO: Only supported for providers [aws] (not gce)
... skipping 91 lines ...
  test/e2e/framework/framework.go:187
Jun 21 16:16:51.169: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "events-8143" for this suite.

•
------------------------------
{"msg":"PASSED [sig-instrumentation] Events API should ensure that an event can be fetched, patched, deleted, and listed [Conformance]","total":-1,"completed":4,"skipped":28,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode
  test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode
... skipping 140 lines ...
test/e2e/storage/utils/framework.go:23
  Container restart
  test/e2e/storage/subpath.go:122
    should verify that container can restart successfully after configmaps modified
    test/e2e/storage/subpath.go:123
------------------------------
{"msg":"PASSED [sig-storage] Subpath Container restart should verify that container can restart successfully after configmaps modified","total":-1,"completed":3,"skipped":9,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:16:53.513: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 122 lines ...
  test/e2e/framework/framework.go:187
Jun 21 16:16:53.829: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "runtimeclass-3662" for this suite.

•
------------------------------
{"msg":"PASSED [sig-node] RuntimeClass should reject a Pod requesting a non-existent RuntimeClass [NodeConformance] [Conformance]","total":-1,"completed":4,"skipped":28,"failed":0}

S
------------------------------
[BeforeEach] [sig-storage] EmptyDir volumes
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
Jun 21 16:16:42.835: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename emptydir
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[It] should support (non-root,0644,tmpfs) [LinuxOnly] [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
STEP: Creating a pod to test emptydir 0644 on tmpfs
Jun 21 16:16:43.140: INFO: Waiting up to 5m0s for pod "pod-3b13b352-0970-461e-972b-12f4a1872980" in namespace "emptydir-5564" to be "Succeeded or Failed"
Jun 21 16:16:43.181: INFO: Pod "pod-3b13b352-0970-461e-972b-12f4a1872980": Phase="Pending", Reason="", readiness=false. Elapsed: 40.893214ms
Jun 21 16:16:45.210: INFO: Pod "pod-3b13b352-0970-461e-972b-12f4a1872980": Phase="Pending", Reason="", readiness=false. Elapsed: 2.070044643s
Jun 21 16:16:47.205: INFO: Pod "pod-3b13b352-0970-461e-972b-12f4a1872980": Phase="Pending", Reason="", readiness=false. Elapsed: 4.065646299s
Jun 21 16:16:49.207: INFO: Pod "pod-3b13b352-0970-461e-972b-12f4a1872980": Phase="Pending", Reason="", readiness=false. Elapsed: 6.067379871s
Jun 21 16:16:51.212: INFO: Pod "pod-3b13b352-0970-461e-972b-12f4a1872980": Phase="Pending", Reason="", readiness=false. Elapsed: 8.072735464s
Jun 21 16:16:53.205: INFO: Pod "pod-3b13b352-0970-461e-972b-12f4a1872980": Phase="Pending", Reason="", readiness=false. Elapsed: 10.065709045s
Jun 21 16:16:55.205: INFO: Pod "pod-3b13b352-0970-461e-972b-12f4a1872980": Phase="Succeeded", Reason="", readiness=false. Elapsed: 12.065555581s
STEP: Saw pod success
Jun 21 16:16:55.205: INFO: Pod "pod-3b13b352-0970-461e-972b-12f4a1872980" satisfied condition "Succeeded or Failed"
Jun 21 16:16:55.233: INFO: Trying to get logs from node nodes-us-west3-a-12tt pod pod-3b13b352-0970-461e-972b-12f4a1872980 container test-container: <nil>
STEP: delete the pod
Jun 21 16:16:55.300: INFO: Waiting for pod pod-3b13b352-0970-461e-972b-12f4a1872980 to disappear
Jun 21 16:16:55.323: INFO: Pod pod-3b13b352-0970-461e-972b-12f4a1872980 no longer exists
[AfterEach] [sig-storage] EmptyDir volumes
  test/e2e/framework/framework.go:187
... skipping 4 lines ...
• [SLOW TEST:12.550 seconds]
[sig-storage] EmptyDir volumes
test/e2e/common/storage/framework.go:23
  should support (non-root,0644,tmpfs) [LinuxOnly] [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-storage] EmptyDir volumes should support (non-root,0644,tmpfs) [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":6,"skipped":34,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:16:55.405: INFO: Driver local doesn't support GenericEphemeralVolume -- skipping
... skipping 116 lines ...
Jun 21 16:16:44.732: INFO: PersistentVolumeClaim pvc-l2wxv found but phase is Pending instead of Bound.
Jun 21 16:16:46.769: INFO: PersistentVolumeClaim pvc-l2wxv found and phase=Bound (4.101765487s)
Jun 21 16:16:46.769: INFO: Waiting up to 3m0s for PersistentVolume local-jj576 to have phase Bound
Jun 21 16:16:46.797: INFO: PersistentVolume local-jj576 found and phase=Bound (27.962429ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-tt7s
STEP: Creating a pod to test subpath
Jun 21 16:16:46.880: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-tt7s" in namespace "provisioning-4161" to be "Succeeded or Failed"
Jun 21 16:16:46.909: INFO: Pod "pod-subpath-test-preprovisionedpv-tt7s": Phase="Pending", Reason="", readiness=false. Elapsed: 28.6835ms
Jun 21 16:16:48.939: INFO: Pod "pod-subpath-test-preprovisionedpv-tt7s": Phase="Pending", Reason="", readiness=false. Elapsed: 2.058240677s
Jun 21 16:16:50.935: INFO: Pod "pod-subpath-test-preprovisionedpv-tt7s": Phase="Pending", Reason="", readiness=false. Elapsed: 4.054377836s
Jun 21 16:16:52.934: INFO: Pod "pod-subpath-test-preprovisionedpv-tt7s": Phase="Pending", Reason="", readiness=false. Elapsed: 6.053774093s
Jun 21 16:16:54.934: INFO: Pod "pod-subpath-test-preprovisionedpv-tt7s": Phase="Pending", Reason="", readiness=false. Elapsed: 8.053653394s
Jun 21 16:16:56.944: INFO: Pod "pod-subpath-test-preprovisionedpv-tt7s": Phase="Pending", Reason="", readiness=false. Elapsed: 10.063491446s
Jun 21 16:16:58.941: INFO: Pod "pod-subpath-test-preprovisionedpv-tt7s": Phase="Succeeded", Reason="", readiness=false. Elapsed: 12.060732267s
STEP: Saw pod success
Jun 21 16:16:58.941: INFO: Pod "pod-subpath-test-preprovisionedpv-tt7s" satisfied condition "Succeeded or Failed"
Jun 21 16:16:58.966: INFO: Trying to get logs from node nodes-us-west3-a-tw9s pod pod-subpath-test-preprovisionedpv-tt7s container test-container-subpath-preprovisionedpv-tt7s: <nil>
STEP: delete the pod
Jun 21 16:16:59.030: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-tt7s to disappear
Jun 21 16:16:59.057: INFO: Pod pod-subpath-test-preprovisionedpv-tt7s no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-tt7s
Jun 21 16:16:59.057: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-tt7s" in namespace "provisioning-4161"
... skipping 21 lines ...
  test/e2e/storage/in_tree_volumes.go:63
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    test/e2e/storage/framework/testsuite.go:50
      should support readOnly directory specified in the volumeMount
      test/e2e/storage/testsuites/subpath.go:367
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir-link-bindmounted] [Testpattern: Pre-provisioned PV (default fs)] subPath should support readOnly directory specified in the volumeMount","total":-1,"completed":6,"skipped":60,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (default fs)] volumes
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:16:59.483: INFO: Only supported for node OS distro [gci ubuntu custom] (not debian)
[AfterEach] [Testpattern: Dynamic PV (default fs)] volumes
  test/e2e/framework/framework.go:187

... skipping 86 lines ...
• [SLOW TEST:114.411 seconds]
[sig-apps] CronJob
test/e2e/apps/framework.go:23
  should replace jobs when ReplaceConcurrent [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-apps] CronJob should replace jobs when ReplaceConcurrent [Conformance]","total":-1,"completed":5,"skipped":14,"failed":0}

SSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:17:00.695: INFO: Only supported for providers [azure] (not gce)
... skipping 67 lines ...
• [SLOW TEST:8.616 seconds]
[sig-api-machinery] ResourceQuota
test/e2e/apimachinery/framework.go:23
  should verify ResourceQuota with cross namespace pod affinity scope using scope-selectors.
  test/e2e/apimachinery/resource_quota.go:1446
------------------------------
{"msg":"PASSED [sig-api-machinery] ResourceQuota should verify ResourceQuota with cross namespace pod affinity scope using scope-selectors.","total":-1,"completed":5,"skipped":29,"failed":0}

SS
------------------------------
[BeforeEach] [sig-node] Pods Extended
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
... skipping 4 lines ...
[BeforeEach] Pod Container lifecycle
  test/e2e/node/pods.go:228
[It] should not create extra sandbox if all containers are done
  test/e2e/node/pods.go:232
STEP: creating the pod that should always exit 0
STEP: submitting the pod to kubernetes
Jun 21 16:16:50.580: INFO: Waiting up to 5m0s for pod "pod-always-succeed22420f44-cc5f-4c31-967b-712d8105e521" in namespace "pods-7245" to be "Succeeded or Failed"
Jun 21 16:16:50.604: INFO: Pod "pod-always-succeed22420f44-cc5f-4c31-967b-712d8105e521": Phase="Pending", Reason="", readiness=false. Elapsed: 23.996332ms
Jun 21 16:16:52.630: INFO: Pod "pod-always-succeed22420f44-cc5f-4c31-967b-712d8105e521": Phase="Pending", Reason="", readiness=false. Elapsed: 2.049787008s
Jun 21 16:16:54.629: INFO: Pod "pod-always-succeed22420f44-cc5f-4c31-967b-712d8105e521": Phase="Pending", Reason="", readiness=false. Elapsed: 4.048373792s
Jun 21 16:16:56.629: INFO: Pod "pod-always-succeed22420f44-cc5f-4c31-967b-712d8105e521": Phase="Pending", Reason="", readiness=false. Elapsed: 6.048732216s
Jun 21 16:16:58.632: INFO: Pod "pod-always-succeed22420f44-cc5f-4c31-967b-712d8105e521": Phase="Pending", Reason="", readiness=false. Elapsed: 8.051923265s
Jun 21 16:17:00.634: INFO: Pod "pod-always-succeed22420f44-cc5f-4c31-967b-712d8105e521": Phase="Succeeded", Reason="", readiness=false. Elapsed: 10.054067605s
STEP: Saw pod success
Jun 21 16:17:00.634: INFO: Pod "pod-always-succeed22420f44-cc5f-4c31-967b-712d8105e521" satisfied condition "Succeeded or Failed"
STEP: Getting events about the pod
STEP: Checking events about the pod
STEP: deleting the pod
[AfterEach] [sig-node] Pods Extended
  test/e2e/framework/framework.go:187
Jun 21 16:17:02.735: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
... skipping 5 lines ...
test/e2e/node/framework.go:23
  Pod Container lifecycle
  test/e2e/node/pods.go:226
    should not create extra sandbox if all containers are done
    test/e2e/node/pods.go:232
------------------------------
{"msg":"PASSED [sig-node] Pods Extended Pod Container lifecycle should not create extra sandbox if all containers are done","total":-1,"completed":5,"skipped":49,"failed":0}

SSSS
------------------------------
[BeforeEach] [sig-network] Services
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
... skipping 11 lines ...
STEP: Destroying namespace "services-3234" for this suite.
[AfterEach] [sig-network] Services
  test/e2e/network/service.go:762

•
------------------------------
{"msg":"PASSED [sig-network] Services should provide secure master service  [Conformance]","total":-1,"completed":6,"skipped":53,"failed":0}

SSSS
------------------------------
[BeforeEach] [sig-cli] Kubectl client
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
... skipping 33 lines ...
test/e2e/kubectl/framework.go:23
  Kubectl validation
  test/e2e/kubectl/kubectl.go:1033
    should create/apply a valid CR for CRD with validation schema
    test/e2e/kubectl/kubectl.go:1052
------------------------------
{"msg":"PASSED [sig-cli] Kubectl client Kubectl validation should create/apply a valid CR for CRD with validation schema","total":-1,"completed":13,"skipped":111,"failed":0}

S
------------------------------
[BeforeEach] [sig-cli] Kubectl client
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
... skipping 9 lines ...
Jun 21 16:16:34.771: INFO: Running '/logs/artifacts/b29e4240-f17b-11ec-9ac1-d2ba5eb345d8/kubectl --server=https://34.106.151.197 --kubeconfig=/root/.kube/config --namespace=kubectl-7524 create -f -'
Jun 21 16:16:35.076: INFO: stderr: ""
Jun 21 16:16:35.076: INFO: stdout: "pod/httpd created\n"
Jun 21 16:16:35.076: INFO: Waiting up to 5m0s for 1 pods to be running and ready: [httpd]
Jun 21 16:16:35.076: INFO: Waiting up to 5m0s for pod "httpd" in namespace "kubectl-7524" to be "running and ready"
Jun 21 16:16:35.099: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 23.013021ms
Jun 21 16:16:35.099: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'nodes-us-west3-a-12tt' to be 'Running' but was 'Pending'
Jun 21 16:16:37.126: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2.050350544s
Jun 21 16:16:37.126: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'nodes-us-west3-a-12tt' to be 'Running' but was 'Pending'
Jun 21 16:16:39.123: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 4.047009124s
Jun 21 16:16:39.123: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'nodes-us-west3-a-12tt' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC  }]
Jun 21 16:16:41.124: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 6.047911406s
Jun 21 16:16:41.124: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'nodes-us-west3-a-12tt' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC  }]
Jun 21 16:16:43.154: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 8.078126834s
Jun 21 16:16:43.154: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'nodes-us-west3-a-12tt' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC  }]
Jun 21 16:16:45.124: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 10.048509454s
Jun 21 16:16:45.124: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'nodes-us-west3-a-12tt' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC  }]
Jun 21 16:16:47.122: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 12.046672268s
Jun 21 16:16:47.122: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'nodes-us-west3-a-12tt' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC  }]
Jun 21 16:16:49.122: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 14.04620794s
Jun 21 16:16:49.122: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'nodes-us-west3-a-12tt' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC  }]
Jun 21 16:16:51.124: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 16.048407378s
Jun 21 16:16:51.124: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'nodes-us-west3-a-12tt' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC  }]
Jun 21 16:16:53.123: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 18.047476427s
Jun 21 16:16:53.123: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'nodes-us-west3-a-12tt' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC  }]
Jun 21 16:16:55.123: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 20.047301924s
Jun 21 16:16:55.123: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'nodes-us-west3-a-12tt' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC  }]
Jun 21 16:16:57.122: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 22.046134136s
Jun 21 16:16:57.122: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'nodes-us-west3-a-12tt' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC  }]
Jun 21 16:16:59.122: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 24.046529836s
Jun 21 16:16:59.122: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'nodes-us-west3-a-12tt' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC  }]
Jun 21 16:17:01.123: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 26.047364799s
Jun 21 16:17:01.123: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'nodes-us-west3-a-12tt' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC  }]
Jun 21 16:17:03.140: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 28.063769356s
Jun 21 16:17:03.140: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'nodes-us-west3-a-12tt' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC  }]
Jun 21 16:17:05.123: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 30.047596832s
Jun 21 16:17:05.123: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'nodes-us-west3-a-12tt' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-06-21 16:16:35 +0000 UTC  }]
Jun 21 16:17:07.123: INFO: Pod "httpd": Phase="Running", Reason="", readiness=true. Elapsed: 32.047327291s
Jun 21 16:17:07.123: INFO: Pod "httpd" satisfied condition "running and ready"
Jun 21 16:17:07.123: INFO: Wanted all 1 pods to be running and ready. Result: true. Pods: [httpd]
[It] should support exec
  test/e2e/kubectl/kubectl.go:419
STEP: executing a command in the container
... skipping 35 lines ...
test/e2e/kubectl/framework.go:23
  Simple pod
  test/e2e/kubectl/kubectl.go:407
    should support exec
    test/e2e/kubectl/kubectl.go:419
------------------------------
{"msg":"PASSED [sig-cli] Kubectl client Simple pod should support exec","total":-1,"completed":11,"skipped":66,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] volumes
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:17:09.602: INFO: Only supported for providers [azure] (not gce)
... skipping 184 lines ...
• [SLOW TEST:86.404 seconds]
[sig-apps] DisruptionController
test/e2e/apps/framework.go:23
  should observe that the PodDisruptionBudget status is not updated for unmanaged pods
  test/e2e/apps/disruption.go:194
------------------------------
{"msg":"PASSED [sig-apps] DisruptionController should observe that the PodDisruptionBudget status is not updated for unmanaged pods","total":-1,"completed":4,"skipped":15,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (delayed binding)] topology
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:17:11.441: INFO: Only supported for providers [vsphere] (not gce)
... skipping 209 lines ...
test/e2e/common/network/framework.go:23
  Granular Checks: Pods
  test/e2e/common/network/networking.go:32
    should function for intra-pod communication: http [NodeConformance] [Conformance]
    test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-network] Networking Granular Checks: Pods should function for intra-pod communication: http [NodeConformance] [Conformance]","total":-1,"completed":6,"skipped":61,"failed":0}
[BeforeEach] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:17:14.782: INFO: Driver hostPath doesn't support GenericEphemeralVolume -- skipping
[AfterEach] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral
  test/e2e/framework/framework.go:187

... skipping 44 lines ...
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[BeforeEach] [sig-storage] Downward API volume
  test/e2e/common/storage/downwardapi_volume.go:43
[It] should set DefaultMode on files [LinuxOnly] [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
STEP: Creating a pod to test downward API volume plugin
Jun 21 16:16:46.745: INFO: Waiting up to 5m0s for pod "downwardapi-volume-660bb1c7-ac6d-4158-8df4-9ed5d9527f5f" in namespace "downward-api-3669" to be "Succeeded or Failed"
Jun 21 16:16:46.777: INFO: Pod "downwardapi-volume-660bb1c7-ac6d-4158-8df4-9ed5d9527f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 31.819992ms
Jun 21 16:16:48.808: INFO: Pod "downwardapi-volume-660bb1c7-ac6d-4158-8df4-9ed5d9527f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 2.063144397s
Jun 21 16:16:50.802: INFO: Pod "downwardapi-volume-660bb1c7-ac6d-4158-8df4-9ed5d9527f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 4.056510386s
Jun 21 16:16:52.801: INFO: Pod "downwardapi-volume-660bb1c7-ac6d-4158-8df4-9ed5d9527f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 6.056449851s
Jun 21 16:16:54.802: INFO: Pod "downwardapi-volume-660bb1c7-ac6d-4158-8df4-9ed5d9527f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 8.056897829s
Jun 21 16:16:56.802: INFO: Pod "downwardapi-volume-660bb1c7-ac6d-4158-8df4-9ed5d9527f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 10.057388612s
... skipping 4 lines ...
Jun 21 16:17:06.802: INFO: Pod "downwardapi-volume-660bb1c7-ac6d-4158-8df4-9ed5d9527f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 20.05678991s
Jun 21 16:17:08.803: INFO: Pod "downwardapi-volume-660bb1c7-ac6d-4158-8df4-9ed5d9527f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 22.058432338s
Jun 21 16:17:10.802: INFO: Pod "downwardapi-volume-660bb1c7-ac6d-4158-8df4-9ed5d9527f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 24.056862573s
Jun 21 16:17:12.803: INFO: Pod "downwardapi-volume-660bb1c7-ac6d-4158-8df4-9ed5d9527f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 26.057590284s
Jun 21 16:17:14.801: INFO: Pod "downwardapi-volume-660bb1c7-ac6d-4158-8df4-9ed5d9527f5f": Phase="Succeeded", Reason="", readiness=false. Elapsed: 28.055780448s
STEP: Saw pod success
Jun 21 16:17:14.801: INFO: Pod "downwardapi-volume-660bb1c7-ac6d-4158-8df4-9ed5d9527f5f" satisfied condition "Succeeded or Failed"
Jun 21 16:17:14.824: INFO: Trying to get logs from node nodes-us-west3-a-rbw1 pod downwardapi-volume-660bb1c7-ac6d-4158-8df4-9ed5d9527f5f container client-container: <nil>
STEP: delete the pod
Jun 21 16:17:14.897: INFO: Waiting for pod downwardapi-volume-660bb1c7-ac6d-4158-8df4-9ed5d9527f5f to disappear
Jun 21 16:17:14.920: INFO: Pod downwardapi-volume-660bb1c7-ac6d-4158-8df4-9ed5d9527f5f no longer exists
[AfterEach] [sig-storage] Downward API volume
  test/e2e/framework/framework.go:187
... skipping 4 lines ...
• [SLOW TEST:28.454 seconds]
[sig-storage] Downward API volume
test/e2e/common/storage/framework.go:23
  should set DefaultMode on files [LinuxOnly] [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-storage] Downward API volume should set DefaultMode on files [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":7,"skipped":95,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ext4)] volumes
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:17:14.996: INFO: Only supported for providers [azure] (not gce)
... skipping 114 lines ...
• [SLOW TEST:13.637 seconds]
[sig-apps] ReplicaSet
test/e2e/apps/framework.go:23
  should validate Replicaset Status endpoints [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-apps] ReplicaSet should validate Replicaset Status endpoints [Conformance]","total":-1,"completed":6,"skipped":31,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] volumes
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:17:16.198: INFO: Driver local doesn't support InlineVolume -- skipping
... skipping 24 lines ...
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[BeforeEach] [sig-storage] Downward API volume
  test/e2e/common/storage/downwardapi_volume.go:43
[It] should provide container's memory request [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
STEP: Creating a pod to test downward API volume plugin
Jun 21 16:17:09.943: INFO: Waiting up to 5m0s for pod "downwardapi-volume-4799c30b-8721-4815-890a-a244912803ce" in namespace "downward-api-8019" to be "Succeeded or Failed"
Jun 21 16:17:09.967: INFO: Pod "downwardapi-volume-4799c30b-8721-4815-890a-a244912803ce": Phase="Pending", Reason="", readiness=false. Elapsed: 23.85003ms
Jun 21 16:17:11.992: INFO: Pod "downwardapi-volume-4799c30b-8721-4815-890a-a244912803ce": Phase="Pending", Reason="", readiness=false. Elapsed: 2.048585249s
Jun 21 16:17:13.994: INFO: Pod "downwardapi-volume-4799c30b-8721-4815-890a-a244912803ce": Phase="Pending", Reason="", readiness=false. Elapsed: 4.050801572s
Jun 21 16:17:15.991: INFO: Pod "downwardapi-volume-4799c30b-8721-4815-890a-a244912803ce": Phase="Pending", Reason="", readiness=false. Elapsed: 6.046998378s
Jun 21 16:17:17.992: INFO: Pod "downwardapi-volume-4799c30b-8721-4815-890a-a244912803ce": Phase="Succeeded", Reason="", readiness=false. Elapsed: 8.048893278s
STEP: Saw pod success
Jun 21 16:17:17.992: INFO: Pod "downwardapi-volume-4799c30b-8721-4815-890a-a244912803ce" satisfied condition "Succeeded or Failed"
Jun 21 16:17:18.016: INFO: Trying to get logs from node nodes-us-west3-a-tw9s pod downwardapi-volume-4799c30b-8721-4815-890a-a244912803ce container client-container: <nil>
STEP: delete the pod
Jun 21 16:17:18.074: INFO: Waiting for pod downwardapi-volume-4799c30b-8721-4815-890a-a244912803ce to disappear
Jun 21 16:17:18.119: INFO: Pod downwardapi-volume-4799c30b-8721-4815-890a-a244912803ce no longer exists
[AfterEach] [sig-storage] Downward API volume
  test/e2e/framework/framework.go:187
... skipping 4 lines ...
• [SLOW TEST:8.449 seconds]
[sig-storage] Downward API volume
test/e2e/common/storage/framework.go:23
  should provide container's memory request [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-storage] Downward API volume should provide container's memory request [NodeConformance] [Conformance]","total":-1,"completed":12,"skipped":86,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:17:18.219: INFO: Driver csi-hostpath doesn't support PreprovisionedPV -- skipping
... skipping 160 lines ...
STEP: Building a namespace api object, basename emptydir
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[It] should support (non-root,0666,default) [LinuxOnly] [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
STEP: Creating a pod to test emptydir 0666 on node default medium
Jun 21 16:16:45.389: INFO: Waiting up to 5m0s for pod "pod-4c63d1e3-4535-44ce-b92e-c707f7bca7d5" in namespace "emptydir-1986" to be "Succeeded or Failed"
Jun 21 16:16:45.415: INFO: Pod "pod-4c63d1e3-4535-44ce-b92e-c707f7bca7d5": Phase="Pending", Reason="", readiness=false. Elapsed: 25.101621ms
Jun 21 16:16:47.445: INFO: Pod "pod-4c63d1e3-4535-44ce-b92e-c707f7bca7d5": Phase="Pending", Reason="", readiness=false. Elapsed: 2.055112464s
Jun 21 16:16:49.440: INFO: Pod "pod-4c63d1e3-4535-44ce-b92e-c707f7bca7d5": Phase="Pending", Reason="", readiness=false. Elapsed: 4.050904229s
Jun 21 16:16:51.455: INFO: Pod "pod-4c63d1e3-4535-44ce-b92e-c707f7bca7d5": Phase="Pending", Reason="", readiness=false. Elapsed: 6.065867236s
Jun 21 16:16:53.444: INFO: Pod "pod-4c63d1e3-4535-44ce-b92e-c707f7bca7d5": Phase="Pending", Reason="", readiness=false. Elapsed: 8.054051729s
Jun 21 16:16:55.440: INFO: Pod "pod-4c63d1e3-4535-44ce-b92e-c707f7bca7d5": Phase="Pending", Reason="", readiness=false. Elapsed: 10.050753254s
... skipping 8 lines ...
Jun 21 16:17:13.441: INFO: Pod "pod-4c63d1e3-4535-44ce-b92e-c707f7bca7d5": Phase="Pending", Reason="", readiness=false. Elapsed: 28.051833857s
Jun 21 16:17:15.439: INFO: Pod "pod-4c63d1e3-4535-44ce-b92e-c707f7bca7d5": Phase="Pending", Reason="", readiness=false. Elapsed: 30.050007816s
Jun 21 16:17:17.441: INFO: Pod "pod-4c63d1e3-4535-44ce-b92e-c707f7bca7d5": Phase="Pending", Reason="", readiness=false. Elapsed: 32.051856559s
Jun 21 16:17:19.440: INFO: Pod "pod-4c63d1e3-4535-44ce-b92e-c707f7bca7d5": Phase="Pending", Reason="", readiness=false. Elapsed: 34.050181179s
Jun 21 16:17:21.441: INFO: Pod "pod-4c63d1e3-4535-44ce-b92e-c707f7bca7d5": Phase="Succeeded", Reason="", readiness=false. Elapsed: 36.051321173s
STEP: Saw pod success
Jun 21 16:17:21.441: INFO: Pod "pod-4c63d1e3-4535-44ce-b92e-c707f7bca7d5" satisfied condition "Succeeded or Failed"
Jun 21 16:17:21.465: INFO: Trying to get logs from node nodes-us-west3-a-12tt pod pod-4c63d1e3-4535-44ce-b92e-c707f7bca7d5 container test-container: <nil>
STEP: delete the pod
Jun 21 16:17:21.531: INFO: Waiting for pod pod-4c63d1e3-4535-44ce-b92e-c707f7bca7d5 to disappear
Jun 21 16:17:21.555: INFO: Pod pod-4c63d1e3-4535-44ce-b92e-c707f7bca7d5 no longer exists
[AfterEach] [sig-storage] EmptyDir volumes
  test/e2e/framework/framework.go:187
... skipping 4 lines ...
• [SLOW TEST:36.431 seconds]
[sig-storage] EmptyDir volumes
test/e2e/common/storage/framework.go:23
  should support (non-root,0666,default) [LinuxOnly] [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-storage] EmptyDir volumes should support (non-root,0666,default) [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":5,"skipped":50,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] volumeLimits
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:17:21.637: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 191 lines ...
  test/e2e/storage/persistent_volumes-local.go:194
    Two pods mounting a local volume one after the other
    test/e2e/storage/persistent_volumes-local.go:256
      should be able to write from pod1 and read from pod2
      test/e2e/storage/persistent_volumes-local.go:257
------------------------------
{"msg":"PASSED [sig-storage] PersistentVolumes-local  [Volume type: blockfswithoutformat] Two pods mounting a local volume one after the other should be able to write from pod1 and read from pod2","total":-1,"completed":5,"skipped":40,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (ext3)] volumes
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:17:24.787: INFO: Only supported for providers [vsphere] (not gce)
... skipping 35 lines ...
  test/e2e/framework/framework.go:187
Jun 21 16:17:25.154: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "svcaccounts-9204" for this suite.

•
------------------------------
{"msg":"PASSED [sig-auth] ServiceAccounts should run through the lifecycle of a ServiceAccount [Conformance]","total":-1,"completed":6,"skipped":48,"failed":0}

SSS
------------------------------
[BeforeEach] [sig-api-machinery] Garbage collector
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
... skipping 144 lines ...
• [SLOW TEST:44.142 seconds]
[sig-api-machinery] Garbage collector
test/e2e/apimachinery/framework.go:23
  should orphan pods created by rc if delete options say so [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-api-machinery] Garbage collector should orphan pods created by rc if delete options say so [Conformance]","total":-1,"completed":5,"skipped":29,"failed":0}

SSSSS
------------------------------
[BeforeEach] [sig-apps] DisruptionController
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
... skipping 16 lines ...
• [SLOW TEST:16.394 seconds]
[sig-apps] DisruptionController
test/e2e/apps/framework.go:23
  evictions: too few pods, absolute => should not allow an eviction
  test/e2e/apps/disruption.go:289
------------------------------
{"msg":"PASSED [sig-apps] DisruptionController evictions: too few pods, absolute =\u003e should not allow an eviction","total":-1,"completed":5,"skipped":18,"failed":0}

SSSS
------------------------------
[BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:17:27.896: INFO: Driver local doesn't support GenericEphemeralVolume -- skipping
... skipping 77 lines ...
      Driver emptydir doesn't support DynamicPV -- skipping

      test/e2e/storage/framework/testsuite.go:116
------------------------------
SSS
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir-link-bindmounted] [Testpattern: Pre-provisioned PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]","total":-1,"completed":5,"skipped":50,"failed":0}
[BeforeEach] [sig-node] Events
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
Jun 21 16:17:14.551: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename events
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 28 lines ...
• [SLOW TEST:14.446 seconds]
[sig-node] Events
test/e2e/node/framework.go:23
  should be sent by kubelets and the scheduler about pods scheduling and running 
  test/e2e/node/events.go:41
------------------------------
{"msg":"PASSED [sig-node] Events should be sent by kubelets and the scheduler about pods scheduling and running ","total":-1,"completed":6,"skipped":50,"failed":0}

SSSSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
... skipping 41 lines ...
Jun 21 16:17:15.589: INFO: PersistentVolumeClaim pvc-ktfz6 found but phase is Pending instead of Bound.
Jun 21 16:17:17.614: INFO: PersistentVolumeClaim pvc-ktfz6 found and phase=Bound (10.150783932s)
Jun 21 16:17:17.614: INFO: Waiting up to 3m0s for PersistentVolume local-xcw9z to have phase Bound
Jun 21 16:17:17.638: INFO: PersistentVolume local-xcw9z found and phase=Bound (24.182197ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-p7gw
STEP: Creating a pod to test subpath
Jun 21 16:17:17.710: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-p7gw" in namespace "provisioning-4429" to be "Succeeded or Failed"
Jun 21 16:17:17.733: INFO: Pod "pod-subpath-test-preprovisionedpv-p7gw": Phase="Pending", Reason="", readiness=false. Elapsed: 23.525684ms
Jun 21 16:17:19.770: INFO: Pod "pod-subpath-test-preprovisionedpv-p7gw": Phase="Pending", Reason="", readiness=false. Elapsed: 2.059639633s
Jun 21 16:17:21.760: INFO: Pod "pod-subpath-test-preprovisionedpv-p7gw": Phase="Pending", Reason="", readiness=false. Elapsed: 4.049861606s
Jun 21 16:17:23.758: INFO: Pod "pod-subpath-test-preprovisionedpv-p7gw": Phase="Pending", Reason="", readiness=false. Elapsed: 6.048405115s
Jun 21 16:17:25.760: INFO: Pod "pod-subpath-test-preprovisionedpv-p7gw": Phase="Pending", Reason="", readiness=false. Elapsed: 8.050208409s
Jun 21 16:17:27.759: INFO: Pod "pod-subpath-test-preprovisionedpv-p7gw": Phase="Succeeded", Reason="", readiness=false. Elapsed: 10.04916275s
STEP: Saw pod success
Jun 21 16:17:27.759: INFO: Pod "pod-subpath-test-preprovisionedpv-p7gw" satisfied condition "Succeeded or Failed"
Jun 21 16:17:27.783: INFO: Trying to get logs from node nodes-us-west3-a-kkxs pod pod-subpath-test-preprovisionedpv-p7gw container test-container-volume-preprovisionedpv-p7gw: <nil>
STEP: delete the pod
Jun 21 16:17:27.876: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-p7gw to disappear
Jun 21 16:17:27.900: INFO: Pod pod-subpath-test-preprovisionedpv-p7gw no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-p7gw
Jun 21 16:17:27.900: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-p7gw" in namespace "provisioning-4429"
... skipping 30 lines ...
  test/e2e/storage/in_tree_volumes.go:63
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    test/e2e/storage/framework/testsuite.go:50
      should support non-existent path
      test/e2e/storage/testsuites/subpath.go:196
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: block] [Testpattern: Pre-provisioned PV (default fs)] subPath should support non-existent path","total":-1,"completed":5,"skipped":38,"failed":0}

SSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] volumeLimits
  test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] volumeLimits
... skipping 110 lines ...
  test/e2e/storage/csi_volumes.go:40
    [Testpattern: Dynamic PV (filesystem volmode)] volumeLimits
    test/e2e/storage/framework/testsuite.go:50
      should verify that all csinodes have volume limits
      test/e2e/storage/testsuites/volumelimits.go:249
------------------------------
{"msg":"PASSED [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (filesystem volmode)] volumeLimits should verify that all csinodes have volume limits","total":-1,"completed":6,"skipped":29,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:17:32.941: INFO: Only supported for providers [azure] (not gce)
... skipping 176 lines ...
• [SLOW TEST:66.569 seconds]
[sig-apps] Deployment
test/e2e/apps/framework.go:23
  iterative rollouts should eventually progress
  test/e2e/apps/deployment.go:135
------------------------------
{"msg":"PASSED [sig-apps] Deployment iterative rollouts should eventually progress","total":-1,"completed":2,"skipped":13,"failed":0}

SSS
------------------------------
[BeforeEach] [sig-network] Ingress API
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
... skipping 27 lines ...
  test/e2e/framework/framework.go:187
Jun 21 16:17:34.143: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "ingress-1762" for this suite.

•
------------------------------
{"msg":"PASSED [sig-network] Ingress API should support creating Ingress API operations [Conformance]","total":-1,"completed":3,"skipped":16,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:17:34.221: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 206 lines ...
  test/e2e/storage/in_tree_volumes.go:63
    [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
    test/e2e/storage/framework/testsuite.go:50
      should not mount / map unused volumes in a pod [LinuxOnly]
      test/e2e/storage/testsuites/volumemode.go:354
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]","total":-1,"completed":2,"skipped":36,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:17:35.296: INFO: Driver hostPath doesn't support DynamicPV -- skipping
[AfterEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand
  test/e2e/framework/framework.go:187

... skipping 68 lines ...
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[It] should be consumable from pods in volume as non-root with defaultMode and fsGroup set [LinuxOnly] [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
STEP: Creating secret with name secret-test-fa734f90-466f-4bb5-ad8b-916b8a200206
STEP: Creating a pod to test consume secrets
Jun 21 16:17:29.834: INFO: Waiting up to 5m0s for pod "pod-secrets-7fb6adc4-4811-48d9-a602-65f96fd91381" in namespace "secrets-4849" to be "Succeeded or Failed"
Jun 21 16:17:29.860: INFO: Pod "pod-secrets-7fb6adc4-4811-48d9-a602-65f96fd91381": Phase="Pending", Reason="", readiness=false. Elapsed: 26.059052ms
Jun 21 16:17:31.891: INFO: Pod "pod-secrets-7fb6adc4-4811-48d9-a602-65f96fd91381": Phase="Pending", Reason="", readiness=false. Elapsed: 2.056870168s
Jun 21 16:17:33.886: INFO: Pod "pod-secrets-7fb6adc4-4811-48d9-a602-65f96fd91381": Phase="Pending", Reason="", readiness=false. Elapsed: 4.051648543s
Jun 21 16:17:35.886: INFO: Pod "pod-secrets-7fb6adc4-4811-48d9-a602-65f96fd91381": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.052321014s
STEP: Saw pod success
Jun 21 16:17:35.886: INFO: Pod "pod-secrets-7fb6adc4-4811-48d9-a602-65f96fd91381" satisfied condition "Succeeded or Failed"
Jun 21 16:17:35.912: INFO: Trying to get logs from node nodes-us-west3-a-tw9s pod pod-secrets-7fb6adc4-4811-48d9-a602-65f96fd91381 container secret-volume-test: <nil>
STEP: delete the pod
Jun 21 16:17:35.967: INFO: Waiting for pod pod-secrets-7fb6adc4-4811-48d9-a602-65f96fd91381 to disappear
Jun 21 16:17:35.991: INFO: Pod pod-secrets-7fb6adc4-4811-48d9-a602-65f96fd91381 no longer exists
[AfterEach] [sig-storage] Secrets
  test/e2e/framework/framework.go:187
... skipping 4 lines ...
• [SLOW TEST:6.428 seconds]
[sig-storage] Secrets
test/e2e/common/storage/framework.go:23
  should be consumable from pods in volume as non-root with defaultMode and fsGroup set [LinuxOnly] [NodeConformance] [Conformance]
  test/e2e/framework/framework.go:647
------------------------------
{"msg":"PASSED [sig-storage] Secrets should be consumable from pods in volume as non-root with defaultMode and fsGroup set [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":6,"skipped":48,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] volumes
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:17:36.069: INFO: Only supported for providers [azure] (not gce)
... skipping 245 lines ...
STEP: Destroying namespace "apply-723" for this suite.
[AfterEach] [sig-api-machinery] ServerSideApply
  test/e2e/apimachinery/apply.go:59

•
------------------------------
{"msg":"PASSED [sig-api-machinery] ServerSideApply should remove a field if it is owned but removed in the apply request","total":-1,"completed":6,"skipped":35,"failed":0}

SS
------------------------------
[BeforeEach] [sig-network] Services
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
... skipping 134 lines ...
• [SLOW TEST:69.052 seconds]
[sig-network] Services
test/e2e/network/common/framework.go:23
  should be able to update service type to NodePort listening on same port number but different protocols
  test/e2e/network/service.go:1244
------------------------------
{"msg":"PASSED [sig-network] Services should be able to update service type to NodePort listening on same port number but different protocols","total":-1,"completed":8,"skipped":28,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (default fs)] volumes
  test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (default fs)] volumes
  test/e2e/framework/framework.go:186
STEP: Creating a kubernetes client
Jun 21 16:17:38.710: INFO: >>> kubeConfig: /root/.kube/config
... skipping 34 lines ...
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[BeforeEach] when FSGroup is specified [LinuxOnly] [NodeFeature:FSGroup]
  test/e2e/common/storage/empty_dir.go:50
[It] volume on default medium should have the correct mode using FSGroup
  test/e2e/common/storage/empty_dir.go:71
STEP: Creating a pod to test emptydir volume type on node default medium
Jun 21 16:17:27.015: INFO: Waiting up to 5m0s for pod "pod-c67dd167-6595-4722-bc8e-bedf2d9653b4" in namespace "emptydir-2296" to be "Succeeded or Failed"
Jun 21 16:17:27.040: INFO: Pod "pod-c67dd167-6595-4722-bc8e-bedf2d9653b4": Phase="Pending", Reason="", readiness=false. Elapsed: 24.258507ms
Jun 21 16:17:29.065: INFO: Pod "pod-c67dd167-6595-4722-bc8e-bedf2d9653b4": Phase="Pending", Reason="", readiness=false. Elapsed: 2.049823749s
Jun 21 16:17:31.075: INFO: Pod "pod-c67dd167-6595-4722-bc8e-bedf2d9653b4": Phase="Pending", Reason="", readiness=false. Elapsed: 4.059902242s
Jun 21 16:17:33.064: INFO: Pod "pod-c67dd167-6595-4722-bc8e-bedf2d9653b4": Phase="Pending", Reason="", readiness=false. Elapsed: 6.049037344s
Jun 21 16:17:35.064: INFO: Pod "pod-c67dd167-6595-4722-bc8e-bedf2d9653b4": Phase="Pending", Reason="", readiness=false. Elapsed: 8.049089515s
Jun 21 16:17:37.065: INFO: Pod "pod-c67dd167-6595-4722-bc8e-bedf2d9653b4": Phase="Pending", Reason="", readiness=false. Elapsed: 10.049874413s
Jun 21 16:17:39.065: INFO: Pod "pod-c67dd167-6595-4722-bc8e-bedf2d9653b4": Phase="Succeeded", Reason="", readiness=false. Elapsed: 12.049854199s
STEP: Saw pod success
Jun 21 16:17:39.065: INFO: Pod "pod-c67dd167-6595-4722-bc8e-bedf2d9653b4" satisfied condition "Succeeded or Failed"
Jun 21 16:17:39.089: INFO: Trying to get logs from node nodes-us-west3-a-tw9s pod pod-c67dd167-6595-4722-bc8e-bedf2d9653b4 container test-container: <nil>
STEP: delete the pod
Jun 21 16:17:39.157: INFO: Waiting for pod pod-c67dd167-6595-4722-bc8e-bedf2d9653b4 to disappear
Jun 21 16:17:39.183: INFO: Pod pod-c67dd167-6595-4722-bc8e-bedf2d9653b4 no longer exists
[AfterEach] [sig-storage] EmptyDir volumes
  test/e2e/framework/framework.go:187
... skipping 6 lines ...
test/e2e/common/storage/framework.go:23
  when FSGroup is specified [LinuxOnly] [NodeFeature:FSGroup]
  test/e2e/common/storage/empty_dir.go:48
    volume on default medium should have the correct mode using FSGroup
    test/e2e/common/storage/empty_dir.go:71
------------------------------
{"msg":"PASSED [sig-storage] EmptyDir volumes when FSGroup is specified [LinuxOnly] [NodeFeature:FSGroup] volume on default medium should have the correct mode using FSGroup","total":-1,"completed":6,"skipped":34,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (ext4)] volumes
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:17:39.259: INFO: Driver emptydir doesn't support PreprovisionedPV -- skipping
... skipping 81 lines ...
• [SLOW TEST:5.025 seconds]
[sig-node] PrivilegedPod [NodeConformance]
test/e2e/common/node/framework.go:23
  should enable privileged commands [LinuxOnly]
  test/e2e/common/node/privileged.go:52
------------------------------
{"msg":"PASSED [sig-node] PrivilegedPod [NodeConformance] should enable privileged commands [LinuxOnly]","total":-1,"completed":4,"skipped":36,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] volumes
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:17:39.356: INFO: Only supported for providers [vsphere] (not gce)
... skipping 154 lines ...
• [SLOW TEST:10.811 seconds]
[sig-auth] Certificates API [Privileged:ClusterAdmin]
test/e2e/auth/framework.go:23
  should support building a client with a CSR
  test/e2e/auth/certificates.go:59
------------------------------
{"msg":"PASSED [sig-auth] Certificates API [Privileged:ClusterAdmin] should support building a client with a CSR","total":-1,"completed":7,"skipped":56,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (ext4)] volumes
  test/e2e/storage/framework/testsuite.go:51
Jun 21 16:17:39.882: INFO: Driver hostPath doesn't support PreprovisionedPV -- skipping
... skipping 118 lines ...
  test/e2e/kubectl/kubectl.go:272
[It] should check if cluster-info dump succeeds
  test/e2e/kubectl/kubectl.go:1253
STEP: running cluster-info dump
Jun 21 16:17:39.484: INFO: Running '/logs/artifacts/b29e4240-f17b-11ec-9ac1-d2ba5eb345d8/kubectl --server=https://34.106.151.197 --kubeconfig=/root/.kube/config --namespace=kubectl-4180 cluster-info dump'
Jun 21 16:17:41.295: INFO: stderr: ""
Jun 21 16:17:41.297: INFO: stdout: "{\n    \"kind\": \"NodeList\",\n    \"apiVersion\": \"v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"8508\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"master-us-west3-a-r9rv\",\n                \"uid\": \"56b5306e-ee50-484c-8976-732b0c6e9403\",\n                \"resourceVersion\": \"5397\",\n                \"creationTimestamp\": \"2022-06-21T16:10:03Z\",\n                \"labels\": {\n                    \"beta.kubernetes.io/arch\": \"amd64\",\n                    \"beta.kubernetes.io/instance-type\": \"e2-standard-2\",\n                    \"beta.kubernetes.io/os\": \"linux\",\n                    \"cloud.google.com/metadata-proxy-ready\": \"true\",\n                    \"failure-domain.beta.kubernetes.io/region\": \"us-west3\",\n                    \"failure-domain.beta.kubernetes.io/zone\": \"us-west3-a\",\n                    \"kops.k8s.io/instancegroup\": \"master-us-west3-a\",\n                    \"kops.k8s.io/kops-controller-pki\": \"\",\n                    \"kubernetes.io/arch\": \"amd64\",\n                    \"kubernetes.io/hostname\": \"master-us-west3-a-r9rv\",\n                    \"kubernetes.io/os\": \"linux\",\n                    \"node-role.kubernetes.io/control-plane\": \"\",\n                    \"node.kubernetes.io/exclude-from-external-load-balancers\": \"\",\n                    \"node.kubernetes.io/instance-type\": \"e2-standard-2\",\n                    \"topology.gke.io/zone\": \"us-west3-a\",\n                    \"topology.kubernetes.io/region\": \"us-west3\",\n                    \"topology.kubernetes.io/zone\": \"us-west3-a\"\n                },\n                \"annotations\": {\n                    \"csi.volume.kubernetes.io/nodeid\": \"{\\\"pd.csi.storage.gke.io\\\":\\\"projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/master-us-west3-a-r9rv\\\"}\",\n                    \"node.alpha.kubernetes.io/ttl\": \"0\",\n                    \"volumes.kubernetes.io/controller-managed-attach-detach\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"podCIDR\": \"100.96.0.0/24\",\n                \"podCIDRs\": [\n                    \"100.96.0.0/24\"\n                ],\n                \"providerID\": \"gce://gce-gci-upg-1-4-1-3-ctl-skew/us-west3-a/master-us-west3-a-r9rv\",\n                \"taints\": [\n                    {\n                        \"key\": \"node-role.kubernetes.io/control-plane\",\n                        \"effect\": \"NoSchedule\"\n                    }\n                ]\n            },\n            \"status\": {\n                \"capacity\": {\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"48600704Ki\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"8145396Ki\",\n                    \"pods\": \"110\"\n                },\n                \"allocatable\": {\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"44790408733\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"8042996Ki\",\n                    \"pods\": \"110\"\n                },\n                \"conditions\": [\n                    {\n                        \"type\": \"NetworkUnavailable\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2022-06-21T16:10:57Z\",\n                        \"lastTransitionTime\": \"2022-06-21T16:10:57Z\",\n                        \"reason\": \"RouteCreated\",\n                        \"message\": \"RouteController created a route\"\n                    },\n                    {\n                        \"type\": \"MemoryPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2022-06-21T16:16:32Z\",\n                        \"lastTransitionTime\": \"2022-06-21T16:10:03Z\",\n                        \"reason\": \"KubeletHasSufficientMemory\",\n                        \"message\": \"kubelet has sufficient memory available\"\n                    },\n                    {\n                        \"type\": \"DiskPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2022-06-21T16:16:32Z\",\n                        \"lastTransitionTime\": \"2022-06-21T16:10:03Z\",\n                        \"reason\": \"KubeletHasNoDiskPressure\",\n                        \"message\": \"kubelet has no disk pressure\"\n                    },\n                    {\n                        \"type\": \"PIDPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2022-06-21T16:16:32Z\",\n                        \"lastTransitionTime\": \"2022-06-21T16:10:03Z\",\n                        \"reason\": \"KubeletHasSufficientPID\",\n                        \"message\": \"kubelet has sufficient PID available\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastHeartbeatTime\": \"2022-06-21T16:16:32Z\",\n                        \"lastTransitionTime\": \"2022-06-21T16:10:31Z\",\n                        \"reason\": \"KubeletReady\",\n                        \"message\": \"kubelet is posting ready status. AppArmor enabled\"\n                    }\n                ],\n                \"addresses\": [\n                    {\n                        \"type\": \"InternalIP\",\n                        \"address\": \"10.0.16.6\"\n                    },\n                    {\n                        \"type\": \"ExternalIP\",\n                        \"address\": \"34.106.201.222\"\n                    },\n                    {\n                        \"type\": \"Hostname\",\n                        \"address\": \"master-us-west3-a-r9rv\"\n                    }\n                ],\n                \"daemonEndpoints\": {\n                    \"kubeletEndpoint\": {\n                        \"Port\": 10250\n                    }\n                },\n                \"nodeInfo\": {\n                    \"machineID\": \"83268c274d8a160ed310f95d99fd72c5\",\n                    \"systemUUID\": \"83268c27-4d8a-160e-d310-f95d99fd72c5\",\n                    \"bootID\": \"ebba7d9a-3c45-4c9a-bf3b-e9424b2f7e17\",\n                    \"kernelVersion\": \"5.11.0-1028-gcp\",\n                    \"osImage\": \"Ubuntu 20.04.3 LTS\",\n                    \"containerRuntimeVersion\": \"containerd://1.6.6\",\n                    \"kubeletVersion\": \"v1.25.0-alpha.1\",\n                    \"kubeProxyVersion\": \"v1.25.0-alpha.1\",\n                    \"operatingSystem\": \"linux\",\n                    \"architecture\": \"amd64\"\n                },\n                \"images\": [\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/etcdadm/etcd-manager@sha256:0c7f0f377fe216f3687a7690dffa82fc419e1ef1e3f409e95cf4cef528d83d0e\",\n                            \"registry.k8s.io/etcdadm/etcd-manager:v3.0.20220617\"\n                        ],\n                        \"sizeBytes\": 216301173\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/kube-apiserver-amd64@sha256:d4c3cad3403c59c95837e40f55afe96fd832e23a05c12f92829b050c4ef5a4b2\",\n                            \"registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.1\"\n                        ],\n                        \"sizeBytes\": 123743095\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/kube-proxy-amd64@sha256:012e1a75e246463f6b28e544844e4f6e420c3b6846acecc56460ceafb108d707\",\n                            \"registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1\"\n                        ],\n                        \"sizeBytes\": 110667317\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7\",\n                            \"registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4\"\n                        ],\n                        \"sizeBytes\": 69998657\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/kube-scheduler-amd64@sha256:591f068fd800c97e17301c9e87d2ba47e22f76759da95b2fd62033927cf71883\",\n                            \"registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.1\"\n                        ],\n                        \"sizeBytes\": 51087672\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/kops/kops-controller:1.24.0-beta.1\"\n                        ],\n                        \"sizeBytes\": 41589641\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/kops/dns-controller:1.24.0-beta.1\"\n                        ],\n                        \"sizeBytes\": 41096815\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/kube-controller-manager-amd64@sha256:af17d2792986389543fd283c97492af20fc5581a2d115a3f932501be89a74c7f\",\n                            \"registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.1\"\n                        ],\n                        \"sizeBytes\": 31002416\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2\",\n                            \"registry.k8s.io/sig-storage/csi-provisioner:v2.1.0\"\n                        ],\n                        \"sizeBytes\": 21205045\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09\",\n                            \"registry.k8s.io/sig-storage/csi-attacher:v3.1.0\"\n                        ],\n                        \"sizeBytes\": 20103959\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a\",\n                            \"registry.k8s.io/sig-storage/csi-resizer:v1.1.0\"\n                        ],\n                        \"sizeBytes\": 20096832\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7\",\n                            \"registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3\"\n                        ],\n                        \"sizeBytes\": 19500777\n                    },\n                    {\n                        \"names\": [\n                            \"docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9\",\n                            \"docker.io/k8scloudprovidergcp/cloud-controller-manager:latest\"\n                        ],\n                        \"sizeBytes\": 18702875\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e\",\n                            \"k8s.gcr.io/prometheus-to-sd:v0.5.0\"\n                        ],\n                        \"sizeBytes\": 9515805\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f\",\n                            \"registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0\"\n                        ],\n                        \"sizeBytes\": 9068367\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a\",\n                            \"k8s.gcr.io/metadata-proxy:v0.1.12\"\n                        ],\n                        \"sizeBytes\": 5301657\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/kops/kube-apiserver-healthcheck:1.24.0-beta.1\"\n                        ],\n                        \"sizeBytes\": 5136182\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5\",\n                            \"k8s.gcr.io/k8s-custom-iptables:1.0\"\n                        ],\n                        \"sizeBytes\": 3335579\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db\",\n                            \"registry.k8s.io/pause:3.6\"\n                        ],\n                        \"sizeBytes\": 301773\n                    }\n                ]\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"nodes-us-west3-a-12tt\",\n                \"uid\": \"f1c0ebf7-12e6-4ad8-9f72-7099567d2ef5\",\n                \"resourceVersion\": \"8395\",\n                \"creationTimestamp\": \"2022-06-21T16:10:59Z\",\n                \"labels\": {\n                    \"beta.kubernetes.io/arch\": \"amd64\",\n                    \"beta.kubernetes.io/instance-type\": \"n1-standard-2\",\n                    \"beta.kubernetes.io/os\": \"linux\",\n                    \"cloud.google.com/metadata-proxy-ready\": \"true\",\n                    \"failure-domain.beta.kubernetes.io/region\": \"us-west3\",\n                    \"failure-domain.beta.kubernetes.io/zone\": \"us-west3-a\",\n                    \"kops.k8s.io/instancegroup\": \"nodes-us-west3-a\",\n                    \"kubernetes.io/arch\": \"amd64\",\n                    \"kubernetes.io/hostname\": \"nodes-us-west3-a-12tt\",\n                    \"kubernetes.io/os\": \"linux\",\n                    \"node-role.kubernetes.io/node\": \"\",\n                    \"node.kubernetes.io/instance-type\": \"n1-standard-2\",\n                    \"topology.gke.io/zone\": \"us-west3-a\",\n                    \"topology.hostpath.csi/node\": \"nodes-us-west3-a-12tt\",\n                    \"topology.kubernetes.io/region\": \"us-west3\",\n                    \"topology.kubernetes.io/zone\": \"us-west3-a\"\n                },\n                \"annotations\": {\n                    \"csi.volume.kubernetes.io/nodeid\": \"{\\\"csi-hostpath-provisioning-1825\\\":\\\"nodes-us-west3-a-12tt\\\",\\\"pd.csi.storage.gke.io\\\":\\\"projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/nodes-us-west3-a-12tt\\\"}\",\n                    \"node.alpha.kubernetes.io/ttl\": \"0\",\n                    \"volumes.kubernetes.io/controller-managed-attach-detach\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"podCIDR\": \"100.96.3.0/24\",\n                \"podCIDRs\": [\n                    \"100.96.3.0/24\"\n                ],\n                \"providerID\": \"gce://gce-gci-upg-1-4-1-3-ctl-skew/us-west3-a/nodes-us-west3-a-12tt\"\n            },\n            \"status\": {\n                \"capacity\": {\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"48600704Ki\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"7629296Ki\",\n                    \"pods\": \"110\"\n                },\n                \"allocatable\": {\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"44790408733\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"7526896Ki\",\n                    \"pods\": \"110\"\n                },\n                \"conditions\": [\n                    {\n                        \"type\": \"NetworkUnavailable\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2022-06-21T16:11:18Z\",\n                        \"lastTransitionTime\": \"2022-06-21T16:11:18Z\",\n                        \"reason\": \"RouteCreated\",\n                        \"message\": \"RouteController created a route\"\n                    },\n                    {\n                        \"type\": \"MemoryPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2022-06-21T16:17:36Z\",\n                        \"lastTransitionTime\": \"2022-06-21T16:10:58Z\",\n                        \"reason\": \"KubeletHasSufficientMemory\",\n                        \"message\": \"kubelet has sufficient memory available\"\n                    },\n                    {\n                        \"type\": \"DiskPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2022-06-21T16:17:36Z\",\n                        \"lastTransitionTime\": \"2022-06-21T16:10:58Z\",\n                        \"reason\": \"KubeletHasNoDiskPressure\",\n                        \"message\": \"kubelet has no disk pressure\"\n                    },\n                    {\n                        \"type\": \"PIDPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2022-06-21T16:17:36Z\",\n                        \"lastTransitionTime\": \"2022-06-21T16:10:58Z\",\n                        \"reason\": \"KubeletHasSufficientPID\",\n                        \"message\": \"kubelet has sufficient PID available\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastHeartbeatTime\": \"2022-06-21T16:17:36Z\",\n                        \"lastTransitionTime\": \"2022-06-21T16:11:09Z\",\n                        \"reason\": \"KubeletReady\",\n                        \"message\": \"kubelet is posting ready status. AppArmor enabled\"\n                    }\n                ],\n                \"addresses\": [\n                    {\n                        \"type\": \"InternalIP\",\n                        \"address\": \"10.0.16.5\"\n                    },\n                    {\n                        \"type\": \"ExternalIP\",\n                        \"address\": \"34.106.12.233\"\n                    },\n                    {\n                        \"type\": \"Hostname\",\n                        \"address\": \"nodes-us-west3-a-12tt\"\n                    }\n                ],\n                \"daemonEndpoints\": {\n                    \"kubeletEndpoint\": {\n                        \"Port\": 10250\n                    }\n                },\n                \"nodeInfo\": {\n                    \"machineID\": \"b85b2a8bd05044367c497c543f479d0b\",\n                    \"systemUUID\": \"b85b2a8b-d050-4436-7c49-7c543f479d0b\",\n                    \"bootID\": \"87c721aa-5b23-40f6-9fda-70ea2d470845\",\n                    \"kernelVersion\": \"5.11.0-1028-gcp\",\n                    \"osImage\": \"Ubuntu 20.04.3 LTS\",\n                    \"containerRuntimeVersion\": \"containerd://1.6.6\",\n                    \"kubeletVersion\": \"v1.25.0-alpha.1\",\n                    \"kubeProxyVersion\": \"v1.25.0-alpha.1\",\n                    \"operatingSystem\": \"linux\",\n                    \"architecture\": \"amd64\"\n                },\n                \"images\": [\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e\",\n                            \"registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5\"\n                        ],\n                        \"sizeBytes\": 112030526\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1\"\n                        ],\n                        \"sizeBytes\": 110667317\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7\",\n                            \"registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4\"\n                        ],\n                        \"sizeBytes\": 69998657\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e\",\n                            \"registry.k8s.io/e2e-test-images/agnhost:2.39\"\n                        ],\n                        \"sizeBytes\": 51105200\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6\",\n                            \"registry.k8s.io/e2e-test-images/httpd:2.4.39-2\"\n                        ],\n                        \"sizeBytes\": 41902010\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3\",\n                            \"registry.k8s.io/e2e-test-images/httpd:2.4.38-2\"\n                        ],\n                        \"sizeBytes\": 40764680\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119\",\n                            \"registry.k8s.io/sig-storage/csi-provisioner:v3.1.0\"\n                        ],\n                        \"sizeBytes\": 23345856\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4\",\n                            \"registry.k8s.io/sig-storage/csi-resizer:v1.4.0\"\n                        ],\n                        \"sizeBytes\": 22381475\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709\",\n                            \"registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1\"\n                        ],\n                        \"sizeBytes\": 22163966\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b\",\n                            \"registry.k8s.io/sig-storage/csi-attacher:v3.4.0\"\n                        ],\n                        \"sizeBytes\": 22085298\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18\",\n                            \"registry.k8s.io/sig-storage/hostpathplugin:v1.7.3\"\n                        ],\n                        \"sizeBytes\": 15224494\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e\",\n                            \"k8s.gcr.io/prometheus-to-sd:v0.5.0\"\n                        ],\n                        \"sizeBytes\": 9515805\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6\",\n                            \"registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0\"\n                        ],\n                        \"sizeBytes\": 9132637\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f\",\n                            \"registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0\"\n                        ],\n                        \"sizeBytes\": 9068367\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932\",\n                            \"registry.k8s.io/sig-storage/livenessprobe:v2.6.0\"\n                        ],\n                        \"sizeBytes\": 8240918\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443\",\n                            \"registry.k8s.io/e2e-test-images/nginx:1.14-2\"\n                        ],\n                        \"sizeBytes\": 6979041\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a\",\n                            \"k8s.gcr.io/metadata-proxy:v0.1.12\"\n                        ],\n                        \"sizeBytes\": 5301657\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5\",\n                            \"k8s.gcr.io/k8s-custom-iptables:1.0\"\n                        ],\n                        \"sizeBytes\": 3335579\n                    },\n                    {\n                        \"names\": [\n                            \"gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0\",\n                            \"gcr.io/authenticated-image-pulling/alpine:3.7\"\n                        ],\n                        \"sizeBytes\": 2110879\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf\",\n                            \"registry.k8s.io/e2e-test-images/busybox:1.29-2\"\n                        ],\n                        \"sizeBytes\": 732424\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c\",\n                            \"registry.k8s.io/pause:3.7\"\n                        ],\n                        \"sizeBytes\": 311278\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db\",\n                            \"registry.k8s.io/pause:3.6\"\n                        ],\n                        \"sizeBytes\": 301773\n                    }\n                ],\n                \"volumesInUse\": [\n                    \"kubernetes.io/csi/csi-hostpath-provisioning-1825^9563b454-f17d-11ec-85f2-0e457268526e\",\n                    \"kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/disks/pvc-dc667f95-f55f-4960-920a-3bdc59715b2f\"\n                ],\n                \"volumesAttached\": [\n                    {\n                        \"name\": \"kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/disks/pvc-dc667f95-f55f-4960-920a-3bdc59715b2f\",\n                        \"devicePath\": \"\"\n                    },\n                    {\n                        \"name\": \"kubernetes.io/csi/csi-hostpath-provisioning-1825^9563b454-f17d-11ec-85f2-0e457268526e\",\n                        \"devicePath\": \"\"\n                    }\n                ]\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"nodes-us-west3-a-kkxs\",\n                \"uid\": \"c1f7f7b7-5c99-4dc6-9420-ba8aa33795d7\",\n                \"resourceVersion\": \"7869\",\n                \"creationTimestamp\": \"2022-06-21T16:10:55Z\",\n                \"labels\": {\n                    \"beta.kubernetes.io/arch\": \"amd64\",\n                    \"beta.kubernetes.io/instance-type\": \"n1-standard-2\",\n                    \"beta.kubernetes.io/os\": \"linux\",\n                    \"cloud.google.com/metadata-proxy-ready\": \"true\",\n                    \"failure-domain.beta.kubernetes.io/region\": \"us-west3\",\n                    \"failure-domain.beta.kubernetes.io/zone\": \"us-west3-a\",\n                    \"kops.k8s.io/instancegroup\": \"nodes-us-west3-a\",\n                    \"kubernetes.io/arch\": \"amd64\",\n                    \"kubernetes.io/hostname\": \"nodes-us-west3-a-kkxs\",\n                    \"kubernetes.io/os\": \"linux\",\n                    \"node-role.kubernetes.io/node\": \"\",\n                    \"node.kubernetes.io/instance-type\": \"n1-standard-2\",\n                    \"topology.gke.io/zone\": \"us-west3-a\",\n                    \"topology.hostpath.csi/node\": \"nodes-us-west3-a-kkxs\",\n                    \"topology.kubernetes.io/region\": \"us-west3\",\n                    \"topology.kubernetes.io/zone\": \"us-west3-a\"\n                },\n                \"annotations\": {\n                    \"csi.volume.kubernetes.io/nodeid\": \"{\\\"csi-hostpath-ephemeral-4768\\\":\\\"nodes-us-west3-a-kkxs\\\",\\\"pd.csi.storage.gke.io\\\":\\\"projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/nodes-us-west3-a-kkxs\\\"}\",\n                    \"node.alpha.kubernetes.io/ttl\": \"0\",\n                    \"volumes.kubernetes.io/controller-managed-attach-detach\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"podCIDR\": \"100.96.1.0/24\",\n                \"podCIDRs\": [\n                    \"100.96.1.0/24\"\n                ],\n                \"providerID\": \"gce://gce-gci-upg-1-4-1-3-ctl-skew/us-west3-a/nodes-us-west3-a-kkxs\"\n            },\n            \"status\": {\n                \"capacity\": {\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"48600704Ki\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"7629296Ki\",\n                    \"pods\": \"110\"\n                },\n                \"allocatable\": {\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"44790408733\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"7526896Ki\",\n                    \"pods\": \"110\"\n                },\n                \"conditions\": [\n                    {\n                        \"type\": \"NetworkUnavailable\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2022-06-21T16:11:04Z\",\n                        \"lastTransitionTime\": \"2022-06-21T16:11:04Z\",\n                        \"reason\": \"RouteCreated\",\n                        \"message\": \"RouteController created a route\"\n                    },\n                    {\n                        \"type\": \"MemoryPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2022-06-21T16:16:52Z\",\n                        \"lastTransitionTime\": \"2022-06-21T16:10:55Z\",\n                        \"reason\": \"KubeletHasSufficientMemory\",\n                        \"message\": \"kubelet has sufficient memory available\"\n                    },\n                    {\n                        \"type\": \"DiskPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2022-06-21T16:16:52Z\",\n                        \"lastTransitionTime\": \"2022-06-21T16:10:55Z\",\n                        \"reason\": \"KubeletHasNoDiskPressure\",\n                        \"message\": \"kubelet has no disk pressure\"\n                    },\n                    {\n                        \"type\": \"PIDPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2022-06-21T16:16:52Z\",\n                        \"lastTransitionTime\": \"2022-06-21T16:10:55Z\",\n                        \"reason\": \"KubeletHasSufficientPID\",\n                        \"message\": \"kubelet has sufficient PID available\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastHeartbeatTime\": \"2022-06-21T16:16:52Z\",\n                        \"lastTransitionTime\": \"2022-06-21T16:10:56Z\",\n                        \"reason\": \"KubeletReady\",\n                        \"message\": \"kubelet is posting ready status. AppArmor enabled\"\n                    }\n                ],\n                \"addresses\": [\n                    {\n                        \"type\": \"InternalIP\",\n                        \"address\": \"10.0.16.3\"\n                    },\n                    {\n                        \"type\": \"ExternalIP\",\n                        \"address\": \"34.106.139.147\"\n                    },\n                    {\n                        \"type\": \"Hostname\",\n                        \"address\": \"nodes-us-west3-a-kkxs\"\n                    }\n                ],\n                \"daemonEndpoints\": {\n                    \"kubeletEndpoint\": {\n                        \"Port\": 10250\n                    }\n                },\n                \"nodeInfo\": {\n                    \"machineID\": \"3aa8351b9fd8a9d2d14bb34d98a88ce9\",\n                    \"systemUUID\": \"3aa8351b-9fd8-a9d2-d14b-b34d98a88ce9\",\n                    \"bootID\": \"441be8c4-8967-4f5f-99f7-5bb72b75da2f\",\n                    \"kernelVersion\": \"5.11.0-1028-gcp\",\n                    \"osImage\": \"Ubuntu 20.04.3 LTS\",\n                    \"containerRuntimeVersion\": \"containerd://1.6.6\",\n                    \"kubeletVersion\": \"v1.25.0-alpha.1\",\n                    \"kubeProxyVersion\": \"v1.25.0-alpha.1\",\n                    \"operatingSystem\": \"linux\",\n                    \"architecture\": \"amd64\"\n                },\n                \"images\": [\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1\"\n                        ],\n                        \"sizeBytes\": 110667317\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7\",\n                            \"registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4\"\n                        ],\n                        \"sizeBytes\": 69998657\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e\",\n                            \"registry.k8s.io/e2e-test-images/agnhost:2.39\"\n                        ],\n                        \"sizeBytes\": 51105200\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6\",\n                            \"registry.k8s.io/e2e-test-images/httpd:2.4.39-2\"\n                        ],\n                        \"sizeBytes\": 41902010\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3\",\n                            \"registry.k8s.io/e2e-test-images/httpd:2.4.38-2\"\n                        ],\n                        \"sizeBytes\": 40764680\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa\",\n                            \"registry.k8s.io/sig-storage/csi-provisioner:v3.0.0\"\n                        ],\n                        \"sizeBytes\": 22728994\n                    },\n                    {\n                        \"names\": [\n                            \"gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727\",\n                            \"gcr.io/k8s-authenticated-test/agnhost:2.6\"\n                        ],\n                        \"sizeBytes\": 18352698\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18\",\n                            \"registry.k8s.io/sig-storage/hostpathplugin:v1.7.3\"\n                        ],\n                        \"sizeBytes\": 15224494\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def\",\n                            \"registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4\"\n                        ],\n                        \"sizeBytes\": 15209393\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e\",\n                            \"registry.k8s.io/coredns/coredns:v1.8.6\"\n                        ],\n                        \"sizeBytes\": 13585107\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e\",\n                            \"k8s.gcr.io/prometheus-to-sd:v0.5.0\"\n                        ],\n                        \"sizeBytes\": 9515805\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f\",\n                            \"registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0\"\n                        ],\n                        \"sizeBytes\": 9068367\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405\",\n                            \"registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0\"\n                        ],\n                        \"sizeBytes\": 8582494\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443\",\n                            \"registry.k8s.io/e2e-test-images/nginx:1.14-2\"\n                        ],\n                        \"sizeBytes\": 6979041\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a\",\n                            \"k8s.gcr.io/metadata-proxy:v0.1.12\"\n                        ],\n                        \"sizeBytes\": 5301657\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5\",\n                            \"k8s.gcr.io/k8s-custom-iptables:1.0\"\n                        ],\n                        \"sizeBytes\": 3335579\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf\",\n                            \"registry.k8s.io/e2e-test-images/busybox:1.29-2\"\n                        ],\n                        \"sizeBytes\": 732424\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c\",\n                            \"registry.k8s.io/pause:3.7\"\n                        ],\n                        \"sizeBytes\": 311278\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db\",\n                            \"registry.k8s.io/pause:3.6\"\n                        ],\n                        \"sizeBytes\": 301773\n                    }\n                ],\n                \"volumesInUse\": [\n                    \"kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/disks/pvc-f5668ac3-7271-41b8-bdce-754497e9c765\"\n                ],\n                \"volumesAttached\": [\n                    {\n                        \"name\": \"kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/disks/pvc-f5668ac3-7271-41b8-bdce-754497e9c765\",\n                        \"devicePath\": \"\"\n                    }\n                ]\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"nodes-us-west3-a-rbw1\",\n                \"uid\": \"f04931c2-c4fc-4458-a6d2-44da08f780cd\",\n                \"resourceVersion\": \"8252\",\n                \"creationTimestamp\": \"2022-06-21T16:11:00Z\",\n                \"labels\": {\n                    \"beta.kubernetes.io/arch\": \"amd64\",\n                    \"beta.kubernetes.io/instance-type\": \"n1-standard-2\",\n                    \"beta.kubernetes.io/os\": \"linux\",\n                    \"cloud.google.com/metadata-proxy-ready\": \"true\",\n                    \"failure-domain.beta.kubernetes.io/region\": \"us-west3\",\n                    \"failure-domain.beta.kubernetes.io/zone\": \"us-west3-a\",\n                    \"kops.k8s.io/instancegroup\": \"nodes-us-west3-a\",\n                    \"kubernetes.io/arch\": \"amd64\",\n                    \"kubernetes.io/hostname\": \"nodes-us-west3-a-rbw1\",\n                    \"kubernetes.io/os\": \"linux\",\n                    \"node-role.kubernetes.io/node\": \"\",\n                    \"node.kubernetes.io/instance-type\": \"n1-standard-2\",\n                    \"topology.gke.io/zone\": \"us-west3-a\",\n                    \"topology.hostpath.csi/node\": \"nodes-us-west3-a-rbw1\",\n                    \"topology.kubernetes.io/region\": \"us-west3\",\n                    \"topology.kubernetes.io/zone\": \"us-west3-a\"\n                },\n                \"annotations\": {\n                    \"csi.volume.kubernetes.io/nodeid\": \"{\\\"pd.csi.storage.gke.io\\\":\\\"projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/nodes-us-west3-a-rbw1\\\"}\",\n                    \"node.alpha.kubernetes.io/ttl\": \"0\",\n                    \"volumes.kubernetes.io/controller-managed-attach-detach\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"podCIDR\": \"100.96.4.0/24\",\n                \"podCIDRs\": [\n                    \"100.96.4.0/24\"\n                ],\n                \"providerID\": \"gce://gce-gci-upg-1-4-1-3-ctl-skew/us-west3-a/nodes-us-west3-a-rbw1\"\n            },\n            \"status\": {\n                \"capacity\": {\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"48600704Ki\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"7629304Ki\",\n                    \"pods\": \"110\"\n                },\n                \"allocatable\": {\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"44790408733\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"7526904Ki\",\n                    \"pods\": \"110\"\n                },\n                \"conditions\": [\n                    {\n                        \"type\": \"NetworkUnavailable\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2022-06-21T16:11:18Z\",\n                        \"lastTransitionTime\": \"2022-06-21T16:11:18Z\",\n                        \"reason\": \"RouteCreated\",\n                        \"message\": \"RouteController created a route\"\n                    },\n                    {\n                        \"type\": \"MemoryPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2022-06-21T16:17:17Z\",\n                        \"lastTransitionTime\": \"2022-06-21T16:10:59Z\",\n                        \"reason\": \"KubeletHasSufficientMemory\",\n                        \"message\": \"kubelet has sufficient memory available\"\n                    },\n                    {\n                        \"type\": \"DiskPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2022-06-21T16:17:17Z\",\n                        \"lastTransitionTime\": \"2022-06-21T16:10:59Z\",\n                        \"reason\": \"KubeletHasNoDiskPressure\",\n                        \"message\": \"kubelet has no disk pressure\"\n                    },\n                    {\n                        \"type\": \"PIDPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2022-06-21T16:17:17Z\",\n                        \"lastTransitionTime\": \"2022-06-21T16:10:59Z\",\n                        \"reason\": \"KubeletHasSufficientPID\",\n                        \"message\": \"kubelet has sufficient PID available\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastHeartbeatTime\": \"2022-06-21T16:17:17Z\",\n                        \"lastTransitionTime\": \"2022-06-21T16:11:06Z\",\n                        \"reason\": \"KubeletReady\",\n                        \"message\": \"kubelet is posting ready status. AppArmor enabled\"\n                    }\n                ],\n                \"addresses\": [\n                    {\n                        \"type\": \"InternalIP\",\n                        \"address\": \"10.0.16.2\"\n                    },\n                    {\n                        \"type\": \"ExternalIP\",\n                        \"address\": \"34.106.56.49\"\n                    },\n                    {\n                        \"type\": \"Hostname\",\n                        \"address\": \"nodes-us-west3-a-rbw1\"\n                    }\n                ],\n                \"daemonEndpoints\": {\n                    \"kubeletEndpoint\": {\n                        \"Port\": 10250\n                    }\n                },\n                \"nodeInfo\": {\n                    \"machineID\": \"ce5c9676156efd17c3ff4b362b38a1eb\",\n                    \"systemUUID\": \"ce5c9676-156e-fd17-c3ff-4b362b38a1eb\",\n                    \"bootID\": \"76bc3012-2061-40c8-b317-198fbd1c4756\",\n                    \"kernelVersion\": \"5.11.0-1028-gcp\",\n                    \"osImage\": \"Ubuntu 20.04.3 LTS\",\n                    \"containerRuntimeVersion\": \"containerd://1.6.6\",\n                    \"kubeletVersion\": \"v1.25.0-alpha.1\",\n                    \"kubeProxyVersion\": \"v1.25.0-alpha.1\",\n                    \"operatingSystem\": \"linux\",\n                    \"architecture\": \"amd64\"\n                },\n                \"images\": [\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1\"\n                        ],\n                        \"sizeBytes\": 110667317\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7\",\n                            \"registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4\"\n                        ],\n                        \"sizeBytes\": 69998657\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e\",\n                            \"registry.k8s.io/e2e-test-images/agnhost:2.39\"\n                        ],\n                        \"sizeBytes\": 51105200\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3\",\n                            \"registry.k8s.io/e2e-test-images/httpd:2.4.38-2\"\n                        ],\n                        \"sizeBytes\": 40764680\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119\",\n                            \"registry.k8s.io/sig-storage/csi-provisioner:v3.1.0\"\n                        ],\n                        \"sizeBytes\": 23345856\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa\",\n                            \"registry.k8s.io/sig-storage/csi-provisioner:v3.0.0\"\n                        ],\n                        \"sizeBytes\": 22728994\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4\",\n                            \"registry.k8s.io/sig-storage/csi-resizer:v1.4.0\"\n                        ],\n                        \"sizeBytes\": 22381475\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709\",\n                            \"registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1\"\n                        ],\n                        \"sizeBytes\": 22163966\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b\",\n                            \"registry.k8s.io/sig-storage/csi-attacher:v3.4.0\"\n                        ],\n                        \"sizeBytes\": 22085298\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb\",\n                            \"registry.k8s.io/sig-storage/csi-resizer:v1.3.0\"\n                        ],\n                        \"sizeBytes\": 21671340\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a\",\n                            \"registry.k8s.io/sig-storage/csi-attacher:v3.3.0\"\n                        ],\n                        \"sizeBytes\": 21444261\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18\",\n                            \"registry.k8s.io/sig-storage/hostpathplugin:v1.7.3\"\n                        ],\n                        \"sizeBytes\": 15224494\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e\",\n                            \"k8s.gcr.io/prometheus-to-sd:v0.5.0\"\n                        ],\n                        \"sizeBytes\": 9515805\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6\",\n                            \"registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0\"\n                        ],\n                        \"sizeBytes\": 9132637\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f\",\n                            \"registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0\"\n                        ],\n                        \"sizeBytes\": 9068367\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405\",\n                            \"registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0\"\n                        ],\n                        \"sizeBytes\": 8582494\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932\",\n                            \"registry.k8s.io/sig-storage/livenessprobe:v2.6.0\"\n                        ],\n                        \"sizeBytes\": 8240918\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443\",\n                            \"registry.k8s.io/e2e-test-images/nginx:1.14-2\"\n                        ],\n                        \"sizeBytes\": 6979041\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a\",\n                            \"k8s.gcr.io/metadata-proxy:v0.1.12\"\n                        ],\n                        \"sizeBytes\": 5301657\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5\",\n                            \"k8s.gcr.io/k8s-custom-iptables:1.0\"\n                        ],\n                        \"sizeBytes\": 3335579\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf\",\n                            \"registry.k8s.io/e2e-test-images/busybox:1.29-2\"\n                        ],\n                        \"sizeBytes\": 732424\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c\",\n                            \"registry.k8s.io/pause:3.7\"\n                        ],\n                        \"sizeBytes\": 311278\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db\",\n                            \"registry.k8s.io/pause:3.6\"\n                        ],\n                        \"sizeBytes\": 301773\n                    }\n                ],\n                \"volumesInUse\": [\n                    \"kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/disks/pvc-9f92e5bc-ce87-4dba-add6-61354371f8a3\"\n                ],\n                \"volumesAttached\": [\n                    {\n                        \"name\": \"kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/disks/pvc-9f92e5bc-ce87-4dba-add6-61354371f8a3\",\n                        \"devicePath\": \"\"\n                    }\n                ]\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"nodes-us-west3-a-tw9s\",\n                \"uid\": \"acfb55b2-d927-43ce-961c-a270f826f316\",\n                \"resourceVersion\": \"7340\",\n                \"creationTimestamp\": \"2022-06-21T16:10:58Z\",\n                \"labels\": {\n                    \"beta.kubernetes.io/arch\": \"amd64\",\n                    \"beta.kubernetes.io/instance-type\": \"n1-standard-2\",\n                    \"beta.kubernetes.io/os\": \"linux\",\n                    \"cloud.google.com/metadata-proxy-ready\": \"true\",\n                    \"failure-domain.beta.kubernetes.io/region\": \"us-west3\",\n                    \"failure-domain.beta.kubernetes.io/zone\": \"us-west3-a\",\n                    \"kops.k8s.io/instancegroup\": \"nodes-us-west3-a\",\n                    \"kubernetes.io/arch\": \"amd64\",\n                    \"kubernetes.io/hostname\": \"nodes-us-west3-a-tw9s\",\n                    \"kubernetes.io/os\": \"linux\",\n                    \"node-role.kubernetes.io/node\": \"\",\n                    \"node.kubernetes.io/instance-type\": \"n1-standard-2\",\n                    \"topology.gke.io/zone\": \"us-west3-a\",\n                    \"topology.kubernetes.io/region\": \"us-west3\",\n                    \"topology.kubernetes.io/zone\": \"us-west3-a\"\n                },\n                \"annotations\": {\n                    \"csi.volume.kubernetes.io/nodeid\": \"{\\\"pd.csi.storage.gke.io\\\":\\\"projects/gce-gci-upg-1-4-1-3-ctl-skew/zones/us-west3-a/instances/nodes-us-west3-a-tw9s\\\"}\",\n                    \"node.alpha.kubernetes.io/ttl\": \"0\",\n                    \"volumes.kubernetes.io/controller-managed-attach-detach\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"podCIDR\": \"100.96.2.0/24\",\n                \"podCIDRs\": [\n                    \"100.96.2.0/24\"\n                ],\n                \"providerID\": \"gce://gce-gci-upg-1-4-1-3-ctl-skew/us-west3-a/nodes-us-west3-a-tw9s\"\n            },\n            \"status\": {\n                \"capacity\": {\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"48600704Ki\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"7629296Ki\",\n                    \"pods\": \"110\"\n                },\n                \"allocatable\": {\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"44790408733\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"7526896Ki\",\n                    \"pods\": \"110\"\n                },\n                \"conditions\": [\n                    {\n                        \"type\": \"NetworkUnavailable\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2022-06-21T16:11:18Z\",\n                        \"lastTransitionTime\": \"2022-06-21T16:11:18Z\",\n                        \"reason\": \"RouteCreated\",\n                        \"message\": \"RouteController created a route\"\n                    },\n                    {\n                        \"type\": \"MemoryPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2022-06-21T16:17:07Z\",\n                        \"lastTransitionTime\": \"2022-06-21T16:10:58Z\",\n                        \"reason\": \"KubeletHasSufficientMemory\",\n                        \"message\": \"kubelet has sufficient memory available\"\n                    },\n                    {\n                        \"type\": \"DiskPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2022-06-21T16:17:07Z\",\n                        \"lastTransitionTime\": \"2022-06-21T16:10:58Z\",\n                        \"reason\": \"KubeletHasNoDiskPressure\",\n                        \"message\": \"kubelet has no disk pressure\"\n                    },\n                    {\n                        \"type\": \"PIDPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2022-06-21T16:17:07Z\",\n                        \"lastTransitionTime\": \"2022-06-21T16:10:58Z\",\n                        \"reason\": \"KubeletHasSufficientPID\",\n                        \"message\": \"kubelet has sufficient PID available\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastHeartbeatTime\": \"2022-06-21T16:17:07Z\",\n                        \"lastTransitionTime\": \"2022-06-21T16:11:01Z\",\n                        \"reason\": \"KubeletReady\",\n                        \"message\": \"kubelet is posting ready status. AppArmor enabled\"\n                    }\n                ],\n                \"addresses\": [\n                    {\n                        \"type\": \"InternalIP\",\n                        \"address\": \"10.0.16.4\"\n                    },\n                    {\n                        \"type\": \"ExternalIP\",\n                        \"address\": \"34.106.103.20\"\n                    },\n                    {\n                        \"type\": \"Hostname\",\n                        \"address\": \"nodes-us-west3-a-tw9s\"\n                    }\n                ],\n                \"daemonEndpoints\": {\n                    \"kubeletEndpoint\": {\n                        \"Port\": 10250\n                    }\n                },\n                \"nodeInfo\": {\n                    \"machineID\": \"cc6c2e39fe1bea26362b292a5e8e0164\",\n                    \"systemUUID\": \"cc6c2e39-fe1b-ea26-362b-292a5e8e0164\",\n                    \"bootID\": \"135ab336-8357-4df8-b83d-1fd1a214c63c\",\n                    \"kernelVersion\": \"5.11.0-1028-gcp\",\n                    \"osImage\": \"Ubuntu 20.04.3 LTS\",\n                    \"containerRuntimeVersion\": \"containerd://1.6.6\",\n                    \"kubeletVersion\": \"v1.25.0-alpha.1\",\n                    \"kubeProxyVersion\": \"v1.25.0-alpha.1\",\n                    \"operatingSystem\": \"linux\",\n                    \"architecture\": \"amd64\"\n                },\n                \"images\": [\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1\"\n                        ],\n                        \"sizeBytes\": 110667317\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7\",\n                            \"registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4\"\n                        ],\n                        \"sizeBytes\": 69998657\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e\",\n                            \"registry.k8s.io/e2e-test-images/agnhost:2.39\"\n                        ],\n                        \"sizeBytes\": 51105200\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6\",\n                            \"registry.k8s.io/e2e-test-images/httpd:2.4.39-2\"\n                        ],\n                        \"sizeBytes\": 41902010\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3\",\n                            \"registry.k8s.io/e2e-test-images/httpd:2.4.38-2\"\n                        ],\n                        \"sizeBytes\": 40764680\n                    },\n                    {\n                        \"names\": [\n                            \"gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727\",\n                            \"gcr.io/k8s-authenticated-test/agnhost:2.6\"\n                        ],\n                        \"sizeBytes\": 18352698\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e\",\n                            \"k8s.gcr.io/prometheus-to-sd:v0.5.0\"\n                        ],\n                        \"sizeBytes\": 9515805\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f\",\n                            \"registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0\"\n                        ],\n                        \"sizeBytes\": 9068367\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443\",\n                            \"registry.k8s.io/e2e-test-images/nginx:1.14-2\"\n                        ],\n                        \"sizeBytes\": 6979041\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a\",\n                            \"k8s.gcr.io/metadata-proxy:v0.1.12\"\n                        ],\n                        \"sizeBytes\": 5301657\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5\",\n                            \"k8s.gcr.io/k8s-custom-iptables:1.0\"\n                        ],\n                        \"sizeBytes\": 3335579\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf\",\n                            \"registry.k8s.io/e2e-test-images/busybox:1.29-2\"\n                        ],\n                        \"sizeBytes\": 732424\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c\",\n                            \"registry.k8s.io/pause:3.7\"\n                        ],\n                        \"sizeBytes\": 311278\n                    },\n                    {\n                        \"names\": [\n                            \"registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db\",\n                            \"registry.k8s.io/pause:3.6\"\n                        ],\n                        \"sizeBytes\": 301773\n                    }\n                ]\n            }\n        }\n    ]\n}\n{\n    \"kind\": \"EventList\",\n    \"apiVersion\": \"v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"5376\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"cloud-controller-manager-csw8w.16faaea3d10121e1\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"8a635aeb-eb3e-48bb-8c32-d185a17b0ca9\",\n                \"resourceVersion\": \"79\",\n                \"creationTimestamp\": \"2022-06-21T16:10:31Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cloud-controller-manager-csw8w\",\n                \"uid\": \"f0351e8c-a4d5-477c-a34c-8ac66e653813\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"352\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/cloud-controller-manager-csw8w to master-us-west3-a-r9rv\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:31Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:31Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cloud-controller-manager-csw8w.16faaea3f7f7c959\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"29195d66-99aa-40e6-863e-433aee0dd82d\",\n                \"resourceVersion\": \"97\",\n                \"creationTimestamp\": \"2022-06-21T16:10:32Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cloud-controller-manager-csw8w\",\n                \"uid\": \"f0351e8c-a4d5-477c-a34c-8ac66e653813\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"354\",\n                \"fieldPath\": \"spec.containers{cloud-controller-manager}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8scloudprovidergcp/cloud-controller-manager:latest\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:32Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:32Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cloud-controller-manager-csw8w.16faaea4b5b1773b\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"adff5570-7b9e-440d-a7fc-4e1955dc70eb\",\n                \"resourceVersion\": \"106\",\n                \"creationTimestamp\": \"2022-06-21T16:10:35Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cloud-controller-manager-csw8w\",\n                \"uid\": \"f0351e8c-a4d5-477c-a34c-8ac66e653813\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"354\",\n                \"fieldPath\": \"spec.containers{cloud-controller-manager}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8scloudprovidergcp/cloud-controller-manager:latest\\\" in 3.183047209s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:35Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:35Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cloud-controller-manager-csw8w.16faaea4b865ceee\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"eec8baec-6a85-4986-a4db-944b7277cd82\",\n                \"resourceVersion\": \"107\",\n                \"creationTimestamp\": \"2022-06-21T16:10:35Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cloud-controller-manager-csw8w\",\n                \"uid\": \"f0351e8c-a4d5-477c-a34c-8ac66e653813\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"354\",\n                \"fieldPath\": \"spec.containers{cloud-controller-manager}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container cloud-controller-manager\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:35Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:35Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cloud-controller-manager-csw8w.16faaea4c06183cb\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"fc5e5553-038a-4dcb-bdd7-183e784728e0\",\n                \"resourceVersion\": \"108\",\n                \"creationTimestamp\": \"2022-06-21T16:10:35Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cloud-controller-manager-csw8w\",\n                \"uid\": \"f0351e8c-a4d5-477c-a34c-8ac66e653813\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"354\",\n                \"fieldPath\": \"spec.containers{cloud-controller-manager}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container cloud-controller-manager\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:35Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:35Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cloud-controller-manager.16faaea3d00122e9\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"a94f6821-ad7f-4ec6-8d07-24301e41e1a3\",\n                \"resourceVersion\": \"78\",\n                \"creationTimestamp\": \"2022-06-21T16:10:31Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"DaemonSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cloud-controller-manager\",\n                \"uid\": \"0b464305-32c3-446a-953c-d654a4b6bf8f\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"204\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: cloud-controller-manager-csw8w\",\n            \"source\": {\n                \"component\": \"daemonset-controller\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:31Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:31Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cloud-controller-manager.16faaea509656124\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"dc28026f-9013-4df7-ac00-d175461bc7a2\",\n                \"resourceVersion\": \"109\",\n                \"creationTimestamp\": \"2022-06-21T16:10:36Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Lease\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cloud-controller-manager\",\n                \"uid\": \"99a4ecd5-9efe-43ca-8f5f-cc10ed092c85\",\n                \"apiVersion\": \"coordination.k8s.io/v1\",\n                \"resourceVersion\": \"443\"\n            },\n            \"reason\": \"LeaderElection\",\n            \"message\": \"master-us-west3-a-r9rv_28b0fc0b-05e6-41f3-95ce-e24b38a8eb11 became leader\",\n            \"source\": {\n                \"component\": \"cloud-controller-manager\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:36Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:36Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-5d4dbc7b59-d42gf.16faaea3e4a0f7b1\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"16aba673-a7b5-4802-afd9-8db20ff3b9ec\",\n                \"resourceVersion\": \"88\",\n                \"creationTimestamp\": \"2022-06-21T16:10:31Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-5d4dbc7b59-d42gf\",\n                \"uid\": \"2014365f-ad4f-4230-9f1b-a3045fef97ef\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"395\"\n            },\n            \"reason\": \"FailedScheduling\",\n            \"message\": \"0/1 nodes are available: 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:31Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:31Z\",\n            \"count\": 1,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-5d4dbc7b59-d42gf.16faaeab77e22c6a\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"270ae6a2-a405-40a9-b17d-164530c483c4\",\n                \"resourceVersion\": \"222\",\n                \"creationTimestamp\": \"2022-06-21T16:11:04Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-5d4dbc7b59-d42gf\",\n                \"uid\": \"2014365f-ad4f-4230-9f1b-a3045fef97ef\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"403\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/coredns-autoscaler-5d4dbc7b59-d42gf to nodes-us-west3-a-kkxs\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:04Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:04Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-5d4dbc7b59-d42gf.16faaeaba4caf7d7\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"9a060dc7-9c71-40aa-8777-a2d1ac5baea6\",\n                \"resourceVersion\": \"338\",\n                \"creationTimestamp\": \"2022-06-21T16:11:09Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-5d4dbc7b59-d42gf\",\n                \"uid\": \"2014365f-ad4f-4230-9f1b-a3045fef97ef\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"641\",\n                \"fieldPath\": \"spec.containers{autoscaler}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-kkxs\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:05Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:05Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-5d4dbc7b59-d42gf.16faaeac66283e8a\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"1f1c731e-8e46-45ba-8c77-9d6494fc29fc\",\n                \"resourceVersion\": \"368\",\n                \"creationTimestamp\": \"2022-06-21T16:11:10Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-5d4dbc7b59-d42gf\",\n                \"uid\": \"2014365f-ad4f-4230-9f1b-a3045fef97ef\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"641\",\n                \"fieldPath\": \"spec.containers{autoscaler}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4\\\" in 3.244100534s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-kkxs\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:08Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:08Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-5d4dbc7b59-d42gf.16faaeac67782580\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"9e6390b7-fd35-4c13-8bd4-3b9c511f2dd0\",\n                \"resourceVersion\": \"373\",\n                \"creationTimestamp\": \"2022-06-21T16:11:10Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-5d4dbc7b59-d42gf\",\n                \"uid\": \"2014365f-ad4f-4230-9f1b-a3045fef97ef\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"641\",\n                \"fieldPath\": \"spec.containers{autoscaler}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container autoscaler\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-kkxs\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:08Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:08Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-5d4dbc7b59-d42gf.16faaeac6bb3f4c5\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f51a767f-c870-4295-9aa0-32dbf936d54d\",\n                \"resourceVersion\": \"377\",\n                \"creationTimestamp\": \"2022-06-21T16:11:11Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-5d4dbc7b59-d42gf\",\n                \"uid\": \"2014365f-ad4f-4230-9f1b-a3045fef97ef\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"641\",\n                \"fieldPath\": \"spec.containers{autoscaler}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container autoscaler\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-kkxs\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:08Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:08Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-5d4dbc7b59.16faaea3e454a9c8\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"7f4ba96d-5c80-4fa7-8d1f-5ffd5454b78f\",\n                \"resourceVersion\": \"87\",\n                \"creationTimestamp\": \"2022-06-21T16:10:31Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"ReplicaSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-5d4dbc7b59\",\n                \"uid\": \"dd3029b5-7dfd-451c-bd6e-ea13b1f97ccb\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"380\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: coredns-autoscaler-5d4dbc7b59-d42gf\",\n            \"source\": {\n                \"component\": \"replicaset-controller\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:31Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:31Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler.16faaea3db7559de\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"66e821f2-f8b3-49a3-bc03-a7045e9658c8\",\n                \"resourceVersion\": \"84\",\n                \"creationTimestamp\": \"2022-06-21T16:10:31Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Deployment\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler\",\n                \"uid\": \"859f30d6-4d64-442f-ab5a-9a97b1527a05\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"226\"\n            },\n            \"reason\": \"ScalingReplicaSet\",\n            \"message\": \"Scaled up replica set coredns-autoscaler-5d4dbc7b59 to 1\",\n            \"source\": {\n                \"component\": \"deployment-controller\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:31Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:31Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-dd657c749-cdwz4.16faaeac7dd7d7f4\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"b29dbe54-9424-4dda-be6c-946752f98565\",\n                \"resourceVersion\": \"327\",\n                \"creationTimestamp\": \"2022-06-21T16:11:08Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-dd657c749-cdwz4\",\n                \"uid\": \"3b8f8820-9eda-4bba-9740-d32f956d83d9\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"695\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/coredns-dd657c749-cdwz4 to nodes-us-west3-a-kkxs\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:08Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:08Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-dd657c749-cdwz4.16faaeac9c9849d4\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f931059b-60ac-486a-9a8e-2c2d4322d89d\",\n                \"resourceVersion\": \"380\",\n                \"creationTimestamp\": \"2022-06-21T16:11:11Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-dd657c749-cdwz4\",\n                \"uid\": \"3b8f8820-9eda-4bba-9740-d32f956d83d9\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"698\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"registry.k8s.io/coredns/coredns:v1.8.6\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-kkxs\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:09Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:09Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-dd657c749-cdwz4.16faaeac9dda983e\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"9d6d40d9-36c3-409a-96d6-59aa3561a62a\",\n                \"resourceVersion\": \"383\",\n                \"creationTimestamp\": \"2022-06-21T16:11:11Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-dd657c749-cdwz4\",\n                \"uid\": \"3b8f8820-9eda-4bba-9740-d32f956d83d9\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"698\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container coredns\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-kkxs\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:09Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:09Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-dd657c749-cdwz4.16faaeaca32cce83\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"e738fe14-9890-412e-865b-ec10f1869235\",\n                \"resourceVersion\": \"386\",\n                \"creationTimestamp\": \"2022-06-21T16:11:11Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-dd657c749-cdwz4\",\n                \"uid\": \"3b8f8820-9eda-4bba-9740-d32f956d83d9\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"698\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container coredns\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-kkxs\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:09Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:09Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-dd657c749-jtxhs.16faaea3e2d2e39d\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"1f5cdf4d-3122-46b6-af5e-b40b946be64a\",\n                \"resourceVersion\": \"85\",\n                \"creationTimestamp\": \"2022-06-21T16:10:31Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-dd657c749-jtxhs\",\n                \"uid\": \"16bc8887-b5aa-4d6f-b40d-2ba6002923f8\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"393\"\n            },\n            \"reason\": \"FailedScheduling\",\n            \"message\": \"0/1 nodes are available: 1 node(s) had untolerated taint {node-role.kubernetes.io/control-plane: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:31Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:31Z\",\n            \"count\": 1,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-dd657c749-jtxhs.16faaeab7823148c\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"cb14da69-32c9-44e0-905c-30e03fc5a4a9\",\n                \"resourceVersion\": \"224\",\n                \"creationTimestamp\": \"2022-06-21T16:11:04Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-dd657c749-jtxhs\",\n                \"uid\": \"16bc8887-b5aa-4d6f-b40d-2ba6002923f8\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"397\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/coredns-dd657c749-jtxhs to nodes-us-west3-a-kkxs\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:04Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:04Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-dd657c749-jtxhs.16faaeaba4c9f57d\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"c93627f2-f437-4638-96df-869636aaeccd\",\n                \"resourceVersion\": \"334\",\n                \"creationTimestamp\": \"2022-06-21T16:11:09Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-dd657c749-jtxhs\",\n                \"uid\": \"16bc8887-b5aa-4d6f-b40d-2ba6002923f8\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"642\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"registry.k8s.io/coredns/coredns:v1.8.6\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-kkxs\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:05Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:05Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-dd657c749-jtxhs.16faaeac119e5b34\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"49f4ce0d-ac39-4f28-a57a-1f5460879725\",\n                \"resourceVersion\": \"355\",\n                \"creationTimestamp\": \"2022-06-21T16:11:10Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-dd657c749-jtxhs\",\n                \"uid\": \"16bc8887-b5aa-4d6f-b40d-2ba6002923f8\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"642\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"registry.k8s.io/coredns/coredns:v1.8.6\\\" in 1.82583895s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-kkxs\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:07Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:07Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-dd657c749-jtxhs.16faaeac12f6eefc\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f8855955-5516-4c72-bc1d-b31bd9e335d3\",\n                \"resourceVersion\": \"359\",\n                \"creationTimestamp\": \"2022-06-21T16:11:10Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-dd657c749-jtxhs\",\n                \"uid\": \"16bc8887-b5aa-4d6f-b40d-2ba6002923f8\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"642\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container coredns\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-kkxs\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:07Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:07Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-dd657c749-jtxhs.16faaeac1862efe5\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"1e828fee-00d1-40e8-9a0f-401c5857609e\",\n                \"resourceVersion\": \"364\",\n                \"creationTimestamp\": \"2022-06-21T16:11:10Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-dd657c749-jtxhs\",\n                \"uid\": \"16bc8887-b5aa-4d6f-b40d-2ba6002923f8\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"642\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container coredns\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-kkxs\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:07Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:07Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-dd657c749.16faaea3e5d6dcf5\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"12a84c9e-b8a2-4605-a86b-db69bd4358f3\",\n                \"resourceVersion\": \"94\",\n                \"creationTimestamp\": \"2022-06-21T16:10:32Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"ReplicaSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-dd657c749\",\n                \"uid\": \"e7182e96-2f1f-4369-b820-8b62585e888b\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"379\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: coredns-dd657c749-jtxhs\",\n            \"source\": {\n                \"component\": \"replicaset-controller\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:31Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:31Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-dd657c749.16faaeac7d25a39a\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"b902bd2b-c203-4525-b817-bf6f659fbc31\",\n                \"resourceVersion\": \"326\",\n                \"creationTimestamp\": \"2022-06-21T16:11:08Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"ReplicaSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-dd657c749\",\n                \"uid\": \"e7182e96-2f1f-4369-b820-8b62585e888b\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"694\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: coredns-dd657c749-cdwz4\",\n            \"source\": {\n                \"component\": \"replicaset-controller\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:08Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:08Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns.16faaea3db6fdd46\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"abe32c0e-f66b-4886-ad6b-a4942f5058e7\",\n                \"resourceVersion\": \"82\",\n                \"creationTimestamp\": \"2022-06-21T16:10:31Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Deployment\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns\",\n                \"uid\": \"00638054-2edd-4a0d-9230-dbdc24b58b7c\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"219\"\n            },\n            \"reason\": \"ScalingReplicaSet\",\n            \"message\": \"Scaled up replica set coredns-dd657c749 to 1\",\n            \"source\": {\n                \"component\": \"deployment-controller\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:31Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:31Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns.16faaeac7c633b34\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"ab734de3-cf67-4b8d-91ab-eb5ed521f962\",\n                \"resourceVersion\": \"324\",\n                \"creationTimestamp\": \"2022-06-21T16:11:08Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Deployment\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns\",\n                \"uid\": \"00638054-2edd-4a0d-9230-dbdc24b58b7c\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"693\"\n            },\n            \"reason\": \"ScalingReplicaSet\",\n            \"message\": \"Scaled up replica set coredns-dd657c749 to 2 from 1\",\n            \"source\": {\n                \"component\": \"deployment-controller\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:08Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:08Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-78bc9bdd66-w477l.16faaea3e3e54eb0\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"e2ae1803-2784-435e-b1d2-c5cc0c70cfc0\",\n                \"resourceVersion\": \"86\",\n                \"creationTimestamp\": \"2022-06-21T16:10:31Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"dns-controller-78bc9bdd66-w477l\",\n                \"uid\": \"d1a2b4b1-8eea-4dd7-87cc-00bd030db984\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"392\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/dns-controller-78bc9bdd66-w477l to master-us-west3-a-r9rv\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:31Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:31Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-78bc9bdd66-w477l.16faaea41c79c8e0\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"5c11d619-0aae-4f0c-b852-da3d2bb53288\",\n                \"resourceVersion\": \"101\",\n                \"creationTimestamp\": \"2022-06-21T16:10:32Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"dns-controller-78bc9bdd66-w477l\",\n                \"uid\": \"d1a2b4b1-8eea-4dd7-87cc-00bd030db984\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"396\",\n                \"fieldPath\": \"spec.containers{dns-controller}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"registry.k8s.io/kops/dns-controller:1.24.0-beta.1\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:32Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:32Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-78bc9bdd66-w477l.16faaea41e45793d\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"96fc4749-8346-4896-8ef4-4b37f8f93150\",\n                \"resourceVersion\": \"102\",\n                \"creationTimestamp\": \"2022-06-21T16:10:32Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"dns-controller-78bc9bdd66-w477l\",\n                \"uid\": \"d1a2b4b1-8eea-4dd7-87cc-00bd030db984\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"396\",\n                \"fieldPath\": \"spec.containers{dns-controller}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container dns-controller\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:32Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:32Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-78bc9bdd66-w477l.16faaea424510400\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"a501ddeb-e3a1-4fa2-ba76-8e2fb96bea8c\",\n                \"resourceVersion\": \"103\",\n                \"creationTimestamp\": \"2022-06-21T16:10:33Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"dns-controller-78bc9bdd66-w477l\",\n                \"uid\": \"d1a2b4b1-8eea-4dd7-87cc-00bd030db984\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"396\",\n                \"fieldPath\": \"spec.containers{dns-controller}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container dns-controller\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:33Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:33Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-78bc9bdd66.16faaea3e5a68b86\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"22911f12-ad90-422b-9052-5f2cbcab2f43\",\n                \"resourceVersion\": \"90\",\n                \"creationTimestamp\": \"2022-06-21T16:10:32Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"ReplicaSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"dns-controller-78bc9bdd66\",\n                \"uid\": \"dcfdfc36-6c4f-46ff-b652-354a3d065ac4\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"384\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: dns-controller-78bc9bdd66-w477l\",\n            \"source\": {\n                \"component\": \"replicaset-controller\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:31Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:31Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller.16faaea3dc013003\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"8e72fc09-10a7-490c-9e32-fd2e75459808\",\n                \"resourceVersion\": \"92\",\n                \"creationTimestamp\": \"2022-06-21T16:10:32Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Deployment\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"dns-controller\",\n                \"uid\": \"1984c573-291b-4056-86b5-f2cf7cb2e782\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"271\"\n            },\n            \"reason\": \"ScalingReplicaSet\",\n            \"message\": \"Scaled up replica set dns-controller-78bc9bdd66 to 1\",\n            \"source\": {\n                \"component\": \"deployment-controller\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:31Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:31Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-events-master-us-west3-a-r9rv.16faae8ded81ac89\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"5a2717e6-6e92-44a6-9374-3986f8358215\",\n                \"resourceVersion\": \"30\",\n                \"creationTimestamp\": \"2022-06-21T16:10:06Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-events-master-us-west3-a-r9rv\",\n                \"uid\": \"b4adf7aafb8882f8999a2f7bc95f17f4\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"registry.k8s.io/etcdadm/etcd-manager:v3.0.20220617\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:08:57Z\",\n            \"lastTimestamp\": \"2022-06-21T16:08:57Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-events-master-us-west3-a-r9rv.16faae94e8362365\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"7780ecc4-ed19-484a-b5ee-f06cc7f49c3c\",\n                \"resourceVersion\": \"47\",\n                \"creationTimestamp\": \"2022-06-21T16:10:09Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-events-master-us-west3-a-r9rv\",\n                \"uid\": \"b4adf7aafb8882f8999a2f7bc95f17f4\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"registry.k8s.io/etcdadm/etcd-manager:v3.0.20220617\\\" in 29.975912063s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:09:27Z\",\n            \"lastTimestamp\": \"2022-06-21T16:09:27Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-events-master-us-west3-a-r9rv.16faae94ea27af19\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"e5daa6ed-e5ad-4dda-9d80-342a4082e196\",\n                \"resourceVersion\": \"48\",\n                \"creationTimestamp\": \"2022-06-21T16:10:09Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-events-master-us-west3-a-r9rv\",\n                \"uid\": \"b4adf7aafb8882f8999a2f7bc95f17f4\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container etcd-manager\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:09:27Z\",\n            \"lastTimestamp\": \"2022-06-21T16:09:27Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-events-master-us-west3-a-r9rv.16faae94f04e48ba\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"08ea2ae7-225a-4b45-beb7-281770b290b5\",\n                \"resourceVersion\": \"49\",\n                \"creationTimestamp\": \"2022-06-21T16:10:10Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-events-master-us-west3-a-r9rv\",\n                \"uid\": \"b4adf7aafb8882f8999a2f7bc95f17f4\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container etcd-manager\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:09:27Z\",\n            \"lastTimestamp\": \"2022-06-21T16:09:27Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-main-master-us-west3-a-r9rv.16faae8def20a44c\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"0be56b42-8d41-42d8-8b5a-9aed89f79b94\",\n                \"resourceVersion\": \"31\",\n                \"creationTimestamp\": \"2022-06-21T16:10:06Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-main-master-us-west3-a-r9rv\",\n                \"uid\": \"c6fa4860c9664184ce974ea04eda29de\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"registry.k8s.io/etcdadm/etcd-manager:v3.0.20220617\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:08:57Z\",\n            \"lastTimestamp\": \"2022-06-21T16:08:57Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-main-master-us-west3-a-r9rv.16faae94f29f6c18\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d413c067-2dc5-41cb-afc6-7fe3ada06453\",\n                \"resourceVersion\": \"50\",\n                \"creationTimestamp\": \"2022-06-21T16:10:10Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-main-master-us-west3-a-r9rv\",\n                \"uid\": \"c6fa4860c9664184ce974ea04eda29de\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"registry.k8s.io/etcdadm/etcd-manager:v3.0.20220617\\\" in 30.123395663s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:09:27Z\",\n            \"lastTimestamp\": \"2022-06-21T16:09:27Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-main-master-us-west3-a-r9rv.16faae94f509f132\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"793a2289-4c25-4758-a8ec-5225e78d530d\",\n                \"resourceVersion\": \"51\",\n                \"creationTimestamp\": \"2022-06-21T16:10:10Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-main-master-us-west3-a-r9rv\",\n                \"uid\": \"c6fa4860c9664184ce974ea04eda29de\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container etcd-manager\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:09:27Z\",\n            \"lastTimestamp\": \"2022-06-21T16:09:27Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-main-master-us-west3-a-r9rv.16faae94faec1546\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"c7d94803-518f-45ae-ba6f-4fb233201abd\",\n                \"resourceVersion\": \"52\",\n                \"creationTimestamp\": \"2022-06-21T16:10:10Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-main-master-us-west3-a-r9rv\",\n                \"uid\": \"c6fa4860c9664184ce974ea04eda29de\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container etcd-manager\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:09:27Z\",\n            \"lastTimestamp\": \"2022-06-21T16:09:27Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller-leader.16faaea404cbea77\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"2fb0ef1d-4748-4f27-a176-e90124c56e79\",\n                \"resourceVersion\": \"99\",\n                \"creationTimestamp\": \"2022-06-21T16:10:32Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Lease\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kops-controller-leader\",\n                \"uid\": \"dccdcee9-b354-49b3-8b26-d15348e0f0e4\",\n                \"apiVersion\": \"coordination.k8s.io/v1\",\n                \"resourceVersion\": \"418\"\n            },\n            \"reason\": \"LeaderElection\",\n            \"message\": \"master-us-west3-a-r9rv_3184c376-e2a3-49ee-bc22-90615a56e010 became leader\",\n            \"source\": {\n                \"component\": \"master-us-west3-a-r9rv_3184c376-e2a3-49ee-bc22-90615a56e010\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:32Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:32Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller-tg4pc.16faaea3c9fc49c3\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"6ca2cef0-1b1e-4f6f-9b44-cbfc304f16eb\",\n                \"resourceVersion\": \"77\",\n                \"creationTimestamp\": \"2022-06-21T16:10:31Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kops-controller-tg4pc\",\n                \"uid\": \"1a135518-bb72-42df-9b34-50bc4382b6fd\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"345\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/kops-controller-tg4pc to master-us-west3-a-r9rv\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:31Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:31Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller-tg4pc.16faaea3f5373bdf\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"85c81493-8106-445b-b41f-09e2996b68b2\",\n                \"resourceVersion\": \"95\",\n                \"creationTimestamp\": \"2022-06-21T16:10:32Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kops-controller-tg4pc\",\n                \"uid\": \"1a135518-bb72-42df-9b34-50bc4382b6fd\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"348\",\n                \"fieldPath\": \"spec.containers{kops-controller}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"registry.k8s.io/kops/kops-controller:1.24.0-beta.1\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:32Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:32Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller-tg4pc.16faaea3f779aa32\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"8fe06665-5dc2-49e9-94fb-e59851c33694\",\n                \"resourceVersion\": \"96\",\n                \"creationTimestamp\": \"2022-06-21T16:10:32Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kops-controller-tg4pc\",\n                \"uid\": \"1a135518-bb72-42df-9b34-50bc4382b6fd\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"348\",\n                \"fieldPath\": \"spec.containers{kops-controller}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kops-controller\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:32Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:32Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller-tg4pc.16faaea3ff79fed7\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"646e4e0a-3b42-4f3e-bae6-deb73be09fca\",\n                \"resourceVersion\": \"98\",\n                \"creationTimestamp\": \"2022-06-21T16:10:32Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kops-controller-tg4pc\",\n                \"uid\": \"1a135518-bb72-42df-9b34-50bc4382b6fd\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"348\",\n                \"fieldPath\": \"spec.containers{kops-controller}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kops-controller\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:32Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:32Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller.16faaea3c94c8a03\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"ef9b576b-7587-4ab4-8454-fa0bed86df0b\",\n                \"resourceVersion\": \"75\",\n                \"creationTimestamp\": \"2022-06-21T16:10:31Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"DaemonSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kops-controller\",\n                \"uid\": \"a2622863-3a45-44bd-80d2-abeca9b345f4\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"260\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: kops-controller-tg4pc\",\n            \"source\": {\n                \"component\": \"daemonset-controller\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:31Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:31Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-master-us-west3-a-r9rv.16faae8ded813351\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"6a330fc7-0fdd-458c-a7bb-69c64a894a6b\",\n                \"resourceVersion\": \"29\",\n                \"creationTimestamp\": \"2022-06-21T16:10:06Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-apiserver-master-us-west3-a-r9rv\",\n                \"uid\": \"2297c46584e8c3c73a93ef572c640fa1\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-apiserver}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.1\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:08:57Z\",\n            \"lastTimestamp\": \"2022-06-21T16:08:57Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-master-us-west3-a-r9rv.16faae92b96defa5\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"b9d02f11-821d-45f1-918b-0593959e482a\",\n                \"resourceVersion\": \"38\",\n                \"creationTimestamp\": \"2022-06-21T16:10:07Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-apiserver-master-us-west3-a-r9rv\",\n                \"uid\": \"2297c46584e8c3c73a93ef572c640fa1\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-apiserver}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.1\\\" in 20.601138783s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:09:18Z\",\n            \"lastTimestamp\": \"2022-06-21T16:09:18Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-master-us-west3-a-r9rv.16faae92bb985c09\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"815fe2ed-e84b-4e3d-87c5-09c1855336b5\",\n                \"resourceVersion\": \"61\",\n                \"creationTimestamp\": \"2022-06-21T16:10:08Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-apiserver-master-us-west3-a-r9rv\",\n                \"uid\": \"2297c46584e8c3c73a93ef572c640fa1\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-apiserver}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-apiserver\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:09:18Z\",\n            \"lastTimestamp\": \"2022-06-21T16:09:39Z\",\n            \"count\": 2,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-master-us-west3-a-r9rv.16faae92c242ea54\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"ca0c5766-39bd-4d36-a2bb-ef8c5adbd99b\",\n                \"resourceVersion\": \"62\",\n                \"creationTimestamp\": \"2022-06-21T16:10:08Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-apiserver-master-us-west3-a-r9rv\",\n                \"uid\": \"2297c46584e8c3c73a93ef572c640fa1\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-apiserver}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-apiserver\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:09:18Z\",\n            \"lastTimestamp\": \"2022-06-21T16:09:39Z\",\n            \"count\": 2,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-master-us-west3-a-r9rv.16faae92c25260bc\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"e6369975-cabe-4898-9e4b-ac87ef5dfe64\",\n                \"resourceVersion\": \"41\",\n                \"creationTimestamp\": \"2022-06-21T16:10:08Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-apiserver-master-us-west3-a-r9rv\",\n                \"uid\": \"2297c46584e8c3c73a93ef572c640fa1\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{healthcheck}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"registry.k8s.io/kops/kube-apiserver-healthcheck:1.24.0-beta.1\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:09:18Z\",\n            \"lastTimestamp\": \"2022-06-21T16:09:18Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-master-us-west3-a-r9rv.16faae92c5d8f8fd\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"b5131b0f-b4aa-494f-9c68-df51c4ad1c9a\",\n                \"resourceVersion\": \"42\",\n                \"creationTimestamp\": \"2022-06-21T16:10:08Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-apiserver-master-us-west3-a-r9rv\",\n                \"uid\": \"2297c46584e8c3c73a93ef572c640fa1\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{healthcheck}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container healthcheck\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:09:18Z\",\n            \"lastTimestamp\": \"2022-06-21T16:09:18Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-master-us-west3-a-r9rv.16faae92cff0ff3b\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"6934b469-6a59-467c-881d-d169cc905292\",\n                \"resourceVersion\": \"43\",\n                \"creationTimestamp\": \"2022-06-21T16:10:08Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-apiserver-master-us-west3-a-r9rv\",\n                \"uid\": \"2297c46584e8c3c73a93ef572c640fa1\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{healthcheck}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container healthcheck\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:09:18Z\",\n            \"lastTimestamp\": \"2022-06-21T16:09:18Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-master-us-west3-a-r9rv.16faae97a0022240\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"559b544e-77ec-4555-9fe8-ec9c24f05ddf\",\n                \"resourceVersion\": \"60\",\n                \"creationTimestamp\": \"2022-06-21T16:10:12Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-apiserver-master-us-west3-a-r9rv\",\n                \"uid\": \"2297c46584e8c3c73a93ef572c640fa1\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-apiserver}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.1\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:09:39Z\",\n            \"lastTimestamp\": \"2022-06-21T16:09:39Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-controller-manager-master-us-west3-a-r9rv.16faae8ded3e1727\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"1510d322-c85f-438a-ae2e-35a21b641723\",\n                \"resourceVersion\": \"28\",\n                \"creationTimestamp\": \"2022-06-21T16:10:06Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-controller-manager-master-us-west3-a-r9rv\",\n                \"uid\": \"e66f719851dd2c0b7b99a35fd671b7d9\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-controller-manager}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.1\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:08:57Z\",\n            \"lastTimestamp\": \"2022-06-21T16:08:57Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-controller-manager-master-us-west3-a-r9rv.16faae912f4300ec\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"221a3b8a-02f9-4777-9057-c0f23444b6d2\",\n                \"resourceVersion\": \"34\",\n                \"creationTimestamp\": \"2022-06-21T16:10:07Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-controller-manager-master-us-west3-a-r9rv\",\n                \"uid\": \"e66f719851dd2c0b7b99a35fd671b7d9\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-controller-manager}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.1\\\" in 13.992500932s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:09:11Z\",\n            \"lastTimestamp\": \"2022-06-21T16:09:11Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-controller-manager-master-us-west3-a-r9rv.16faae917fd60610\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"c5c1c9e5-6efe-4b21-bd9f-b31030d9e91b\",\n                \"resourceVersion\": \"69\",\n                \"creationTimestamp\": \"2022-06-21T16:10:07Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-controller-manager-master-us-west3-a-r9rv\",\n                \"uid\": \"e66f719851dd2c0b7b99a35fd671b7d9\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-controller-manager}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-controller-manager\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:09:12Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:17Z\",\n            \"count\": 4,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-controller-manager-master-us-west3-a-r9rv.16faae918da3c6d8\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"40cf341c-f220-46e6-914b-d6f8a0d64122\",\n                \"resourceVersion\": \"70\",\n                \"creationTimestamp\": \"2022-06-21T16:10:07Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-controller-manager-master-us-west3-a-r9rv\",\n                \"uid\": \"e66f719851dd2c0b7b99a35fd671b7d9\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-controller-manager}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-controller-manager\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:09:13Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:17Z\",\n            \"count\": 4,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-controller-manager-master-us-west3-a-r9rv.16faae92f3451b07\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d970ac4f-17f8-4784-a24a-6f5cdc40cc3c\",\n                \"resourceVersion\": \"68\",\n                \"creationTimestamp\": \"2022-06-21T16:10:09Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-controller-manager-master-us-west3-a-r9rv\",\n                \"uid\": \"e66f719851dd2c0b7b99a35fd671b7d9\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-controller-manager}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.1\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:09:19Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:17Z\",\n            \"count\": 3,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-controller-manager-master-us-west3-a-r9rv.16faae96ec2e2005\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"34c289d7-19ee-4187-8545-1b2776720cc2\",\n                \"resourceVersion\": \"67\",\n                \"creationTimestamp\": \"2022-06-21T16:10:12Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-controller-manager-master-us-west3-a-r9rv\",\n                \"uid\": \"e66f719851dd2c0b7b99a35fd671b7d9\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-controller-manager}\"\n            },\n            \"reason\": \"BackOff\",\n            \"message\": \"Back-off restarting failed container\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:09:36Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:02Z\",\n            \"count\": 3,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-controller-manager-master-us-west3-a-r9rv.16faaea3cb1157c9\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"9f4bc0b5-678d-42a2-b14c-18e3443982e8\",\n                \"resourceVersion\": \"76\",\n                \"creationTimestamp\": \"2022-06-21T16:10:31Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-controller-manager-master-us-west3-a-r9rv\",\n                \"uid\": \"6fa4a700-38ea-417d-ac80-42d1f8fd1843\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"297\"\n            },\n            \"reason\": \"NodeNotReady\",\n            \"message\": \"Node is not ready\",\n            \"source\": {\n                \"component\": \"node-controller\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:31Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:31Z\",\n            \"count\": 1,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-controller-manager.16faaea0b5488120\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"c5d9cb0f-d717-4f4c-b6a0-b364e62399d2\",\n                \"resourceVersion\": \"71\",\n                \"creationTimestamp\": \"2022-06-21T16:10:18Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Lease\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-controller-manager\",\n                \"uid\": \"d50760a2-0c64-42b2-86b1-1b20f4cac9e9\",\n                \"apiVersion\": \"coordination.k8s.io/v1\",\n                \"resourceVersion\": \"286\"\n            },\n            \"reason\": \"LeaderElection\",\n            \"message\": \"master-us-west3-a-r9rv_0d8fa198-5e7a-4aa6-8cb7-4ac9649ff3af became leader\",\n            \"source\": {\n                \"component\": \"kube-controller-manager\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:18Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:18Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-dns.16faaea3d35fc71c\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"2d79cc23-7f81-48be-84f0-90ecde488155\",\n                \"resourceVersion\": \"83\",\n                \"creationTimestamp\": \"2022-06-21T16:10:31Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"PodDisruptionBudget\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-dns\",\n                \"uid\": \"12f10fbd-dedc-41a8-929f-993baaee5853\",\n                \"apiVersion\": \"policy/v1\",\n                \"resourceVersion\": \"222\"\n            },\n            \"reason\": \"NoPods\",\n            \"message\": \"No matching pods found\",\n            \"source\": {\n                \"component\": \"controllermanager\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:31Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:31Z\",\n            \"count\": 2,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-master-us-west3-a-r9rv.16faae8dfe55b930\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3a7e7dcd-94e4-4df0-8bae-92efd11b1790\",\n                \"resourceVersion\": \"32\",\n                \"creationTimestamp\": \"2022-06-21T16:10:06Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-master-us-west3-a-r9rv\",\n                \"uid\": \"9c3ce56ef3d3b39239938dbe8b72bd89\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:08:57Z\",\n            \"lastTimestamp\": \"2022-06-21T16:08:57Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-master-us-west3-a-r9rv.16faae9500c12669\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"c8d2cc20-3b7a-4601-882d-69b5c1e5eac3\",\n                \"resourceVersion\": \"53\",\n                \"creationTimestamp\": \"2022-06-21T16:10:10Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-master-us-west3-a-r9rv\",\n                \"uid\": \"9c3ce56ef3d3b39239938dbe8b72bd89\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1\\\" in 30.105346081s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:09:27Z\",\n            \"lastTimestamp\": \"2022-06-21T16:09:27Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-master-us-west3-a-r9rv.16faae9502664ac7\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"9ca03f95-e52b-4b16-8509-2745baceab53\",\n                \"resourceVersion\": \"54\",\n                \"creationTimestamp\": \"2022-06-21T16:10:11Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-master-us-west3-a-r9rv\",\n                \"uid\": \"9c3ce56ef3d3b39239938dbe8b72bd89\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:09:28Z\",\n            \"lastTimestamp\": \"2022-06-21T16:09:28Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-master-us-west3-a-r9rv.16faae95089b87be\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"acaf2207-0605-4d6c-a03f-3cf68643c269\",\n                \"resourceVersion\": \"55\",\n                \"creationTimestamp\": \"2022-06-21T16:10:11Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-master-us-west3-a-r9rv\",\n                \"uid\": \"9c3ce56ef3d3b39239938dbe8b72bd89\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:09:28Z\",\n            \"lastTimestamp\": \"2022-06-21T16:09:28Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-nodes-us-west3-a-12tt.16faaea7e1d64ca6\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"4a173eb8-2b71-4027-9c4b-ba00de220357\",\n                \"resourceVersion\": \"293\",\n                \"creationTimestamp\": \"2022-06-21T16:11:07Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-nodes-us-west3-a-12tt\",\n                \"uid\": \"0ca802dcd1823fa9d738dbdfb9f1b936\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-12tt\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:49Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:49Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-nodes-us-west3-a-12tt.16faaea7e3acb255\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"7e970bc0-50b2-4abb-b1c7-46e07662dd0a\",\n                \"resourceVersion\": \"297\",\n                \"creationTimestamp\": \"2022-06-21T16:11:07Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-nodes-us-west3-a-12tt\",\n                \"uid\": \"0ca802dcd1823fa9d738dbdfb9f1b936\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-12tt\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:49Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:49Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-nodes-us-west3-a-12tt.16faaea7ea0ecc41\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"6621585e-3911-480b-ab12-c3ec84404047\",\n                \"resourceVersion\": \"306\",\n                \"creationTimestamp\": \"2022-06-21T16:11:08Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-nodes-us-west3-a-12tt\",\n                \"uid\": \"0ca802dcd1823fa9d738dbdfb9f1b936\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-12tt\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:49Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:49Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-nodes-us-west3-a-kkxs.16faaea8fa9814b9\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"6d7fde2e-6ac7-4c6d-855b-ae07d3975639\",\n                \"resourceVersion\": \"238\",\n                \"creationTimestamp\": \"2022-06-21T16:11:05Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-nodes-us-west3-a-kkxs\",\n                \"uid\": \"16cc5bef3f1cdb02a6f1af724e9096be\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-kkxs\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:53Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:53Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-nodes-us-west3-a-kkxs.16faaea8fc28d1ea\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"fefe5d47-b78c-482e-a13d-68fff2e1afb5\",\n                \"resourceVersion\": \"240\",\n                \"creationTimestamp\": \"2022-06-21T16:11:05Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-nodes-us-west3-a-kkxs\",\n                \"uid\": \"16cc5bef3f1cdb02a6f1af724e9096be\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-kkxs\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:53Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:53Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-nodes-us-west3-a-kkxs.16faaea9030a5aae\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"793f16f4-e55b-4aac-8025-54b5418b4590\",\n                \"resourceVersion\": \"252\",\n                \"creationTimestamp\": \"2022-06-21T16:11:05Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-nodes-us-west3-a-kkxs\",\n                \"uid\": \"16cc5bef3f1cdb02a6f1af724e9096be\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-kkxs\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:53Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:53Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-nodes-us-west3-a-rbw1.16faaea88420485f\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d23c7764-ccfb-42ad-9ef6-1a6d2d01694e\",\n                \"resourceVersion\": \"320\",\n                \"creationTimestamp\": \"2022-06-21T16:11:08Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-nodes-us-west3-a-rbw1\",\n                \"uid\": \"19e6fc35da11e030ac6049153565a0a4\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-rbw1\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:51Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:51Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-nodes-us-west3-a-rbw1.16faaea8862c908f\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"bff87262-ad01-4da4-8cf7-ef82e81a2af7\",\n                \"resourceVersion\": \"325\",\n                \"creationTimestamp\": \"2022-06-21T16:11:08Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-nodes-us-west3-a-rbw1\",\n                \"uid\": \"19e6fc35da11e030ac6049153565a0a4\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-rbw1\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:51Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:51Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-nodes-us-west3-a-rbw1.16faaea88c579491\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"c1033cc7-cb36-4a44-a3ce-76dc55908a3c\",\n                \"resourceVersion\": \"332\",\n                \"creationTimestamp\": \"2022-06-21T16:11:09Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-nodes-us-west3-a-rbw1\",\n                \"uid\": \"19e6fc35da11e030ac6049153565a0a4\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-rbw1\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:51Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:51Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-nodes-us-west3-a-tw9s.16faaea901e57491\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3c28ec81-6747-4a5c-b048-24f45900a271\",\n                \"resourceVersion\": \"342\",\n                \"creationTimestamp\": \"2022-06-21T16:11:09Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-nodes-us-west3-a-tw9s\",\n                \"uid\": \"93b89b83b61195b9dae65a681b893113\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-tw9s\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:53Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:53Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-nodes-us-west3-a-tw9s.16faaea903c9809c\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"1569e29b-0be7-4c90-a264-14cd560191b0\",\n                \"resourceVersion\": \"346\",\n                \"creationTimestamp\": \"2022-06-21T16:11:09Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-nodes-us-west3-a-tw9s\",\n                \"uid\": \"93b89b83b61195b9dae65a681b893113\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-tw9s\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:53Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:53Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-nodes-us-west3-a-tw9s.16faaea908bff018\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"86252676-1442-457d-8261-46e4400559da\",\n                \"resourceVersion\": \"363\",\n                \"creationTimestamp\": \"2022-06-21T16:11:10Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-nodes-us-west3-a-tw9s\",\n                \"uid\": \"93b89b83b61195b9dae65a681b893113\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-tw9s\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:54Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:54Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-scheduler-master-us-west3-a-r9rv.16faae8e12c233c5\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"2a20ff58-8bc7-429c-9d97-1abc3dc3f39f\",\n                \"resourceVersion\": \"33\",\n                \"creationTimestamp\": \"2022-06-21T16:10:07Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-scheduler-master-us-west3-a-r9rv\",\n                \"uid\": \"4da98fa462c1f2897b783fb76b4e44ed\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-scheduler}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.1\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:08:58Z\",\n            \"lastTimestamp\": \"2022-06-21T16:08:58Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-scheduler-master-us-west3-a-r9rv.16faae9512ee8451\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"253383c6-2abd-4f00-955e-3a0bb31bb4a4\",\n                \"resourceVersion\": \"56\",\n                \"creationTimestamp\": \"2022-06-21T16:10:11Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-scheduler-master-us-west3-a-r9rv\",\n                \"uid\": \"4da98fa462c1f2897b783fb76b4e44ed\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-scheduler}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.1\\\" in 30.067659182s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:09:28Z\",\n            \"lastTimestamp\": \"2022-06-21T16:09:28Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-scheduler-master-us-west3-a-r9rv.16faae951477629d\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"893a2728-d68d-4e93-b7b8-c3725884b4df\",\n                \"resourceVersion\": \"57\",\n                \"creationTimestamp\": \"2022-06-21T16:10:11Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-scheduler-master-us-west3-a-r9rv\",\n                \"uid\": \"4da98fa462c1f2897b783fb76b4e44ed\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-scheduler}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-scheduler\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:09:28Z\",\n            \"lastTimestamp\": \"2022-06-21T16:09:28Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-scheduler-master-us-west3-a-r9rv.16faae951ae6ebb6\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"90d3f95f-2560-47a3-b95e-ca1211e09ab4\",\n                \"resourceVersion\": \"58\",\n                \"creationTimestamp\": \"2022-06-21T16:10:11Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-scheduler-master-us-west3-a-r9rv\",\n                \"uid\": \"4da98fa462c1f2897b783fb76b4e44ed\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-scheduler}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-scheduler\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:09:28Z\",\n            \"lastTimestamp\": \"2022-06-21T16:09:28Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-scheduler.16faae9d3e2f9c64\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"11eb7a44-4ec9-4ea1-988b-9b8fc9d1ebec\",\n                \"resourceVersion\": \"14\",\n                \"creationTimestamp\": \"2022-06-21T16:10:03Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Lease\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-scheduler\",\n                \"uid\": \"dc6cf4bb-1392-4135-8db4-eb52b7dc0bf9\",\n                \"apiVersion\": \"coordination.k8s.io/v1\",\n                \"resourceVersion\": \"195\"\n            },\n            \"reason\": \"LeaderElection\",\n            \"message\": \"master-us-west3-a-r9rv_9380d873-bdad-48e6-b44d-297a27a3321b became leader\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:03Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:03Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-4rwqt.16faaea9e4418e82\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"4d937c5b-08a8-4dfe-b0d3-52a2e14737a7\",\n                \"resourceVersion\": \"164\",\n                \"creationTimestamp\": \"2022-06-21T16:10:57Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-4rwqt\",\n                \"uid\": \"d0fa7525-7b9c-4c57-b7fb-53ae1153ba22\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"554\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/metadata-proxy-v0.12-4rwqt to nodes-us-west3-a-kkxs\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:57Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:57Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-4rwqt.16faaeaa24f61161\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"82fce5e1-148e-4d65-8a41-977f767252d3\",\n                \"resourceVersion\": \"259\",\n                \"creationTimestamp\": \"2022-06-21T16:11:05Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-4rwqt\",\n                \"uid\": \"d0fa7525-7b9c-4c57-b7fb-53ae1153ba22\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"555\",\n                \"fieldPath\": \"spec.initContainers{update-ipdtables}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/k8s-custom-iptables:1.0\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-kkxs\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:58Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:58Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-4rwqt.16faaeaa5dd16596\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"b7644c4a-91c3-46e3-b806-5027028b1ffc\",\n                \"resourceVersion\": \"275\",\n                \"creationTimestamp\": \"2022-06-21T16:11:06Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-4rwqt\",\n                \"uid\": \"d0fa7525-7b9c-4c57-b7fb-53ae1153ba22\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"555\",\n                \"fieldPath\": \"spec.initContainers{update-ipdtables}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/k8s-custom-iptables:1.0\\\" in 953.871156ms\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-kkxs\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:59Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:59Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-4rwqt.16faaeaa5f394110\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"56b9101a-2d33-44e4-9109-35dba8e330c9\",\n                \"resourceVersion\": \"283\",\n                \"creationTimestamp\": \"2022-06-21T16:11:07Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-4rwqt\",\n                \"uid\": \"d0fa7525-7b9c-4c57-b7fb-53ae1153ba22\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"555\",\n                \"fieldPath\": \"spec.initContainers{update-ipdtables}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container update-ipdtables\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-kkxs\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:59Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:59Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-4rwqt.16faaeaa66b40406\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"6cd268d3-c49d-4942-a511-110a5f44d2ee\",\n                \"resourceVersion\": \"292\",\n                \"creationTimestamp\": \"2022-06-21T16:11:07Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-4rwqt\",\n                \"uid\": \"d0fa7525-7b9c-4c57-b7fb-53ae1153ba22\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"555\",\n                \"fieldPath\": \"spec.initContainers{update-ipdtables}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container update-ipdtables\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-kkxs\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:59Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:59Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-4rwqt.16faaeaa9228443a\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"ca8f4ee5-be8f-4327-bda5-a8eb277635c3\",\n                \"resourceVersion\": \"296\",\n                \"creationTimestamp\": \"2022-06-21T16:11:07Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-4rwqt\",\n                \"uid\": \"d0fa7525-7b9c-4c57-b7fb-53ae1153ba22\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"555\",\n                \"fieldPath\": \"spec.containers{metadata-proxy}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/metadata-proxy:v0.1.12\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-kkxs\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:00Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:00Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-4rwqt.16faaeab7417777a\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"8da6ef93-c113-4b2c-9945-77abffd3b58f\",\n                \"resourceVersion\": \"313\",\n                \"creationTimestamp\": \"2022-06-21T16:11:08Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-4rwqt\",\n                \"uid\": \"d0fa7525-7b9c-4c57-b7fb-53ae1153ba22\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"555\",\n                \"fieldPath\": \"spec.containers{metadata-proxy}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/metadata-proxy:v0.1.12\\\" in 3.790531994s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-kkxs\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:04Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:04Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-4rwqt.16faaeab757caad0\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"2e090a17-6658-418a-8184-028c79ef1a21\",\n                \"resourceVersion\": \"318\",\n                \"creationTimestamp\": \"2022-06-21T16:11:08Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-4rwqt\",\n                \"uid\": \"d0fa7525-7b9c-4c57-b7fb-53ae1153ba22\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"555\",\n                \"fieldPath\": \"spec.containers{metadata-proxy}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container metadata-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-kkxs\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:04Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:04Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-4rwqt.16faaeab7cbefeda\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"12014b26-09e4-4971-ab10-a5a2480c21dc\",\n                \"resourceVersion\": \"322\",\n                \"creationTimestamp\": \"2022-06-21T16:11:08Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-4rwqt\",\n                \"uid\": \"d0fa7525-7b9c-4c57-b7fb-53ae1153ba22\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"555\",\n                \"fieldPath\": \"spec.containers{metadata-proxy}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container metadata-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-kkxs\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:04Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:04Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-4rwqt.16faaeab7cca8222\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"6a8c984f-5288-424f-95a9-acf84dae3c19\",\n                \"resourceVersion\": \"330\",\n                \"creationTimestamp\": \"2022-06-21T16:11:08Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-4rwqt\",\n                \"uid\": \"d0fa7525-7b9c-4c57-b7fb-53ae1153ba22\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"555\",\n                \"fieldPath\": \"spec.containers{prometheus-to-sd-exporter}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/prometheus-to-sd:v0.5.0\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-kkxs\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:04Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:04Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-4rwqt.16faaeabbccc0e28\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"93a1b70a-0642-4e9d-ab1d-bb014db030cb\",\n                \"resourceVersion\": \"343\",\n                \"creationTimestamp\": \"2022-06-21T16:11:09Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-4rwqt\",\n                \"uid\": \"d0fa7525-7b9c-4c57-b7fb-53ae1153ba22\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"555\",\n                \"fieldPath\": \"spec.containers{prometheus-to-sd-exporter}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/prometheus-to-sd:v0.5.0\\\" in 1.073826134s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-kkxs\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:05Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:05Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-4rwqt.16faaeabbe770759\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"87a33827-2ebb-4faa-bf79-cde9533343f6\",\n                \"resourceVersion\": \"347\",\n                \"creationTimestamp\": \"2022-06-21T16:11:09Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-4rwqt\",\n                \"uid\": \"d0fa7525-7b9c-4c57-b7fb-53ae1153ba22\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"555\",\n                \"fieldPath\": \"spec.containers{prometheus-to-sd-exporter}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container prometheus-to-sd-exporter\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-kkxs\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:05Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:05Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-4rwqt.16faaeabca44cefa\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"13e89762-d359-471f-98ce-9f0e542a5b0b\",\n                \"resourceVersion\": \"351\",\n                \"creationTimestamp\": \"2022-06-21T16:11:09Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-4rwqt\",\n                \"uid\": \"d0fa7525-7b9c-4c57-b7fb-53ae1153ba22\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"555\",\n                \"fieldPath\": \"spec.containers{prometheus-to-sd-exporter}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container prometheus-to-sd-exporter\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-kkxs\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:05Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:05Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-7rr44.16faaea7e5805be5\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"0fe72769-2c62-4e39-9fdb-0a53a7721ebf\",\n                \"resourceVersion\": \"141\",\n                \"creationTimestamp\": \"2022-06-21T16:10:49Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-7rr44\",\n                \"uid\": \"151c4523-5bcd-41d5-8901-0b323416c62e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"493\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/metadata-proxy-v0.12-7rr44 to master-us-west3-a-r9rv\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:49Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:49Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-7rr44.16faaea801af2bc0\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"ff735692-ef48-4039-a0b5-ab692f5b4326\",\n                \"resourceVersion\": \"142\",\n                \"creationTimestamp\": \"2022-06-21T16:10:49Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-7rr44\",\n                \"uid\": \"151c4523-5bcd-41d5-8901-0b323416c62e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"494\",\n                \"fieldPath\": \"spec.initContainers{update-ipdtables}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/k8s-custom-iptables:1.0\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:49Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:49Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-7rr44.16faaea8465318d9\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"11b73843-5696-4693-8385-36f0f8ba9653\",\n                \"resourceVersion\": \"146\",\n                \"creationTimestamp\": \"2022-06-21T16:10:50Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-7rr44\",\n                \"uid\": \"151c4523-5bcd-41d5-8901-0b323416c62e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"494\",\n                \"fieldPath\": \"spec.initContainers{update-ipdtables}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/k8s-custom-iptables:1.0\\\" in 1.151576328s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:50Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:50Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-7rr44.16faaea8481da156\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"a91a8161-198e-4d3c-ad63-485316869e3f\",\n                \"resourceVersion\": \"147\",\n                \"creationTimestamp\": \"2022-06-21T16:10:50Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-7rr44\",\n                \"uid\": \"151c4523-5bcd-41d5-8901-0b323416c62e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"494\",\n                \"fieldPath\": \"spec.initContainers{update-ipdtables}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container update-ipdtables\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:50Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:50Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-7rr44.16faaea85087b484\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"a904dcc6-ab40-4a24-83dd-bb3743b5f9ef\",\n                \"resourceVersion\": \"149\",\n                \"creationTimestamp\": \"2022-06-21T16:10:50Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-7rr44\",\n                \"uid\": \"151c4523-5bcd-41d5-8901-0b323416c62e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"494\",\n                \"fieldPath\": \"spec.initContainers{update-ipdtables}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container update-ipdtables\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:50Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:50Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-7rr44.16faaea963cbbba1\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"474b642b-f86f-45f3-9953-e3fda74f0a6e\",\n                \"resourceVersion\": \"153\",\n                \"creationTimestamp\": \"2022-06-21T16:10:55Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-7rr44\",\n                \"uid\": \"151c4523-5bcd-41d5-8901-0b323416c62e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"494\",\n                \"fieldPath\": \"spec.containers{metadata-proxy}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/metadata-proxy:v0.1.12\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:55Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:55Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-7rr44.16faaea9a1ce7fc4\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"a2bd7dc2-57b4-41b3-9bd5-be207e5c2397\",\n                \"resourceVersion\": \"157\",\n                \"creationTimestamp\": \"2022-06-21T16:10:56Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-7rr44\",\n                \"uid\": \"151c4523-5bcd-41d5-8901-0b323416c62e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"494\",\n                \"fieldPath\": \"spec.containers{metadata-proxy}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/metadata-proxy:v0.1.12\\\" in 1.040345784s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:56Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:56Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-7rr44.16faaea9a3c7f751\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"6e0bcf46-317e-4d88-a23b-7f6cfde6b243\",\n                \"resourceVersion\": \"158\",\n                \"creationTimestamp\": \"2022-06-21T16:10:56Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-7rr44\",\n                \"uid\": \"151c4523-5bcd-41d5-8901-0b323416c62e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"494\",\n                \"fieldPath\": \"spec.containers{metadata-proxy}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container metadata-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:56Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:56Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-7rr44.16faaea9ab133459\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"32cfc918-047e-4e72-9a0d-b9fc6f3c915d\",\n                \"resourceVersion\": \"159\",\n                \"creationTimestamp\": \"2022-06-21T16:10:56Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-7rr44\",\n                \"uid\": \"151c4523-5bcd-41d5-8901-0b323416c62e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"494\",\n                \"fieldPath\": \"spec.containers{metadata-proxy}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container metadata-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:56Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:56Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-7rr44.16faaea9ab6a13d3\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f4aa68f3-ff24-467b-9e20-64b3cf032001\",\n                \"resourceVersion\": \"160\",\n                \"creationTimestamp\": \"2022-06-21T16:10:56Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-7rr44\",\n                \"uid\": \"151c4523-5bcd-41d5-8901-0b323416c62e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"494\",\n                \"fieldPath\": \"spec.containers{prometheus-to-sd-exporter}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/prometheus-to-sd:v0.5.0\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:56Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:56Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-7rr44.16faaea9f6873a5d\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"b7a95059-5219-47eb-a09f-c364cc3f22e7\",\n                \"resourceVersion\": \"165\",\n                \"creationTimestamp\": \"2022-06-21T16:10:58Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-7rr44\",\n                \"uid\": \"151c4523-5bcd-41d5-8901-0b323416c62e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"494\",\n                \"fieldPath\": \"spec.containers{prometheus-to-sd-exporter}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/prometheus-to-sd:v0.5.0\\\" in 1.260173431s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:58Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:58Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-7rr44.16faaea9f8007dc5\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"13fd6ab0-7717-4d00-a6c3-87409167a0b5\",\n                \"resourceVersion\": \"166\",\n                \"creationTimestamp\": \"2022-06-21T16:10:58Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-7rr44\",\n                \"uid\": \"151c4523-5bcd-41d5-8901-0b323416c62e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"494\",\n                \"fieldPath\": \"spec.containers{prometheus-to-sd-exporter}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container prometheus-to-sd-exporter\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:58Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:58Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-7rr44.16faaeaa09a1272c\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3e4d2a3c-8975-4693-bd1a-c971b3da6841\",\n                \"resourceVersion\": \"167\",\n                \"creationTimestamp\": \"2022-06-21T16:10:58Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-7rr44\",\n                \"uid\": \"151c4523-5bcd-41d5-8901-0b323416c62e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"494\",\n                \"fieldPath\": \"spec.containers{prometheus-to-sd-exporter}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container prometheus-to-sd-exporter\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"master-us-west3-a-r9rv\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:58Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:58Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-ntrfh.16faaeaaa2cfa604\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"94926ee0-344a-45fe-abde-f42fe9d4194c\",\n                \"resourceVersion\": \"182\",\n                \"creationTimestamp\": \"2022-06-21T16:11:00Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-ntrfh\",\n                \"uid\": \"7f421014-01fa-4182-a30b-0d3e540851d4\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"613\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/metadata-proxy-v0.12-ntrfh to nodes-us-west3-a-tw9s\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:00Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:00Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-ntrfh.16faaeaadb0d7ea2\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"14777576-6af1-4e9b-b6be-da7bb3cd65d2\",\n                \"resourceVersion\": \"371\",\n                \"creationTimestamp\": \"2022-06-21T16:11:10Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-ntrfh\",\n                \"uid\": \"7f421014-01fa-4182-a30b-0d3e540851d4\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"614\",\n                \"fieldPath\": \"spec.initContainers{update-ipdtables}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/k8s-custom-iptables:1.0\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-tw9s\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:01Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:01Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-ntrfh.16faaeab0560f1a3\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"5e8fc96a-e3c3-4263-a2e1-80ed63352fed\",\n                \"resourceVersion\": \"379\",\n                \"creationTimestamp\": \"2022-06-21T16:11:11Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-ntrfh\",\n                \"uid\": \"7f421014-01fa-4182-a30b-0d3e540851d4\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"614\",\n                \"fieldPath\": \"spec.initContainers{update-ipdtables}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/k8s-custom-iptables:1.0\\\" in 710.093038ms\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-tw9s\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:02Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:02Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-ntrfh.16faaeab072edb75\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f40cd2e9-4a13-4c8f-b03f-765ea05765e6\",\n                \"resourceVersion\": \"382\",\n                \"creationTimestamp\": \"2022-06-21T16:11:11Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-ntrfh\",\n                \"uid\": \"7f421014-01fa-4182-a30b-0d3e540851d4\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"614\",\n                \"fieldPath\": \"spec.initContainers{update-ipdtables}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container update-ipdtables\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-tw9s\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:02Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:02Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-ntrfh.16faaeab0dc277f5\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"8929c459-2297-4ebd-adcc-7d107da53124\",\n                \"resourceVersion\": \"385\",\n                \"creationTimestamp\": \"2022-06-21T16:11:11Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-ntrfh\",\n                \"uid\": \"7f421014-01fa-4182-a30b-0d3e540851d4\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"614\",\n                \"fieldPath\": \"spec.initContainers{update-ipdtables}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container update-ipdtables\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-tw9s\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:02Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:02Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-ntrfh.16faaeab4596b3c4\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f9d9a8a3-4c64-4eae-8e9c-0fa5f8ed35f4\",\n                \"resourceVersion\": \"388\",\n                \"creationTimestamp\": \"2022-06-21T16:11:11Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-ntrfh\",\n                \"uid\": \"7f421014-01fa-4182-a30b-0d3e540851d4\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"614\",\n                \"fieldPath\": \"spec.containers{metadata-proxy}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/metadata-proxy:v0.1.12\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-tw9s\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:03Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:03Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-ntrfh.16faaeab7c92bc48\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"5982565f-ff43-4bf0-9ca0-bbe8389587b4\",\n                \"resourceVersion\": \"395\",\n                \"creationTimestamp\": \"2022-06-21T16:11:12Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-ntrfh\",\n                \"uid\": \"7f421014-01fa-4182-a30b-0d3e540851d4\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"614\",\n                \"fieldPath\": \"spec.containers{metadata-proxy}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/metadata-proxy:v0.1.12\\\" in 922.471622ms\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-tw9s\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:04Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:04Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-ntrfh.16faaeab7e1ba5bf\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"6ac57b3e-acbc-4af7-9848-1e31a45edff0\",\n                \"resourceVersion\": \"399\",\n                \"creationTimestamp\": \"2022-06-21T16:11:13Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-ntrfh\",\n                \"uid\": \"7f421014-01fa-4182-a30b-0d3e540851d4\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"614\",\n                \"fieldPath\": \"spec.containers{metadata-proxy}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container metadata-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-tw9s\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:04Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:04Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-ntrfh.16faaeab83e64f6b\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"736561e7-4a62-4fd9-9061-2fbf7d9f1df7\",\n                \"resourceVersion\": \"400\",\n                \"creationTimestamp\": \"2022-06-21T16:11:13Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-ntrfh\",\n                \"uid\": \"7f421014-01fa-4182-a30b-0d3e540851d4\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"614\",\n                \"fieldPath\": \"spec.containers{metadata-proxy}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container metadata-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-tw9s\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:04Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:04Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-ntrfh.16faaeab83f1be58\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3c765705-f165-4003-a3fa-a6ff515fee07\",\n                \"resourceVersion\": \"401\",\n                \"creationTimestamp\": \"2022-06-21T16:11:13Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-ntrfh\",\n                \"uid\": \"7f421014-01fa-4182-a30b-0d3e540851d4\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"614\",\n                \"fieldPath\": \"spec.containers{prometheus-to-sd-exporter}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/prometheus-to-sd:v0.5.0\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-tw9s\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:04Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:04Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-ntrfh.16faaeac84cecc02\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"a2c40d16-ab35-41a6-ab28-a6e0d2425344\",\n                \"resourceVersion\": \"409\",\n                \"creationTimestamp\": \"2022-06-21T16:11:14Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-ntrfh\",\n                \"uid\": \"7f421014-01fa-4182-a30b-0d3e540851d4\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"614\",\n                \"fieldPath\": \"spec.containers{prometheus-to-sd-exporter}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/prometheus-to-sd:v0.5.0\\\" in 4.309436638s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-tw9s\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:08Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:08Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-ntrfh.16faaeac86276d1b\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"55b22a51-5b97-4928-890f-7c6bb17cf50a\",\n                \"resourceVersion\": \"410\",\n                \"creationTimestamp\": \"2022-06-21T16:11:14Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-ntrfh\",\n                \"uid\": \"7f421014-01fa-4182-a30b-0d3e540851d4\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"614\",\n                \"fieldPath\": \"spec.containers{prometheus-to-sd-exporter}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container prometheus-to-sd-exporter\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-tw9s\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:09Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:09Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-ntrfh.16faaeac903a9d3d\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d713c4d3-3a5b-4714-a3a2-200c4c1936d3\",\n                \"resourceVersion\": \"411\",\n                \"creationTimestamp\": \"2022-06-21T16:11:14Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-ntrfh\",\n                \"uid\": \"7f421014-01fa-4182-a30b-0d3e540851d4\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"614\",\n                \"fieldPath\": \"spec.containers{prometheus-to-sd-exporter}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container prometheus-to-sd-exporter\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-tw9s\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:09Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:09Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-qtnbn.16faaeab039668f7\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"928851a9-439f-4d84-a45f-c8e094b2aae9\",\n                \"resourceVersion\": \"204\",\n                \"creationTimestamp\": \"2022-06-21T16:11:02Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-qtnbn\",\n                \"uid\": \"e712b7d3-bd56-43ab-a694-b91090365cdc\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"624\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/metadata-proxy-v0.12-qtnbn to nodes-us-west3-a-12tt\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:02Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:02Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-qtnbn.16faaeab2163c4d1\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"486c1505-d174-4ba8-a59d-61637390892b\",\n                \"resourceVersion\": \"335\",\n                \"creationTimestamp\": \"2022-06-21T16:11:09Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-qtnbn\",\n                \"uid\": \"e712b7d3-bd56-43ab-a694-b91090365cdc\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"625\",\n                \"fieldPath\": \"spec.initContainers{update-ipdtables}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/k8s-custom-iptables:1.0\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-12tt\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:03Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:03Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-qtnbn.16faaeabe5c94e32\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"c91b93b9-0def-4035-8d1d-cc0e77dd61a2\",\n                \"resourceVersion\": \"352\",\n                \"creationTimestamp\": \"2022-06-21T16:11:10Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-qtnbn\",\n                \"uid\": \"e712b7d3-bd56-43ab-a694-b91090365cdc\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"625\",\n                \"fieldPath\": \"spec.initContainers{update-ipdtables}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/k8s-custom-iptables:1.0\\\" in 3.294930526s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-12tt\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:06Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:06Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-qtnbn.16faaeabe76adbc5\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"706d962e-9539-416f-95d7-ed736f5e5e27\",\n                \"resourceVersion\": \"356\",\n                \"creationTimestamp\": \"2022-06-21T16:11:10Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-qtnbn\",\n                \"uid\": \"e712b7d3-bd56-43ab-a694-b91090365cdc\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"625\",\n                \"fieldPath\": \"spec.initContainers{update-ipdtables}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container update-ipdtables\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-12tt\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:06Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:06Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-qtnbn.16faaeabeeb6adfa\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"4e5fb145-5e71-489e-91e4-ae4ff1f8e880\",\n                \"resourceVersion\": \"361\",\n                \"creationTimestamp\": \"2022-06-21T16:11:10Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-qtnbn\",\n                \"uid\": \"e712b7d3-bd56-43ab-a694-b91090365cdc\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"625\",\n                \"fieldPath\": \"spec.initContainers{update-ipdtables}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container update-ipdtables\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-12tt\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:06Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:06Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-qtnbn.16faaeac646082cc\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"00a382a9-0de3-428c-b48e-bd7b6488dc83\",\n                \"resourceVersion\": \"365\",\n                \"creationTimestamp\": \"2022-06-21T16:11:10Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-qtnbn\",\n                \"uid\": \"e712b7d3-bd56-43ab-a694-b91090365cdc\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"625\",\n                \"fieldPath\": \"spec.containers{metadata-proxy}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/metadata-proxy:v0.1.12\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-12tt\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:08Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:08Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-qtnbn.16faaeac9a15eff5\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"607ecc18-2925-42fa-87f8-c5987217f7b9\",\n                \"resourceVersion\": \"369\",\n                \"creationTimestamp\": \"2022-06-21T16:11:10Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-qtnbn\",\n                \"uid\": \"e712b7d3-bd56-43ab-a694-b91090365cdc\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"625\",\n                \"fieldPath\": \"spec.containers{metadata-proxy}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/metadata-proxy:v0.1.12\\\" in 901.064711ms\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-12tt\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:09Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:09Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-qtnbn.16faaeac9c54925d\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"58a7b990-13e2-45bd-8726-7acad45fb6fd\",\n                \"resourceVersion\": \"374\",\n                \"creationTimestamp\": \"2022-06-21T16:11:11Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-qtnbn\",\n                \"uid\": \"e712b7d3-bd56-43ab-a694-b91090365cdc\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"625\",\n                \"fieldPath\": \"spec.containers{metadata-proxy}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container metadata-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-12tt\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:09Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:09Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-qtnbn.16faaeaca41fdeb9\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"7e97cdf6-72bd-457e-9d11-d695defde0eb\",\n                \"resourceVersion\": \"378\",\n                \"creationTimestamp\": \"2022-06-21T16:11:11Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-qtnbn\",\n                \"uid\": \"e712b7d3-bd56-43ab-a694-b91090365cdc\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"625\",\n                \"fieldPath\": \"spec.containers{metadata-proxy}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container metadata-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-12tt\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:09Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:09Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-qtnbn.16faaeaca42f216a\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"c1f269e6-d012-446f-b641-e6a549926aee\",\n                \"resourceVersion\": \"381\",\n                \"creationTimestamp\": \"2022-06-21T16:11:11Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-qtnbn\",\n                \"uid\": \"e712b7d3-bd56-43ab-a694-b91090365cdc\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"625\",\n                \"fieldPath\": \"spec.containers{prometheus-to-sd-exporter}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/prometheus-to-sd:v0.5.0\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-12tt\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:09Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:09Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-qtnbn.16faaeacdad4d0c1\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"525d8c0f-e7af-4f4b-ab78-d42f71392c33\",\n                \"resourceVersion\": \"384\",\n                \"creationTimestamp\": \"2022-06-21T16:11:11Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-qtnbn\",\n                \"uid\": \"e712b7d3-bd56-43ab-a694-b91090365cdc\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"625\",\n                \"fieldPath\": \"spec.containers{prometheus-to-sd-exporter}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/prometheus-to-sd:v0.5.0\\\" in 916.773308ms\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-12tt\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:10Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:10Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-qtnbn.16faaeacdc4d5160\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3e130627-6265-40dc-90ec-3fb8d510b518\",\n                \"resourceVersion\": \"387\",\n                \"creationTimestamp\": \"2022-06-21T16:11:11Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-qtnbn\",\n                \"uid\": \"e712b7d3-bd56-43ab-a694-b91090365cdc\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"625\",\n                \"fieldPath\": \"spec.containers{prometheus-to-sd-exporter}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container prometheus-to-sd-exporter\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-12tt\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:10Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:10Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-qtnbn.16faaeacf17c7991\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"c9edadfc-136f-49b6-ba20-d8cf8a491e23\",\n                \"resourceVersion\": \"389\",\n                \"creationTimestamp\": \"2022-06-21T16:11:12Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-qtnbn\",\n                \"uid\": \"e712b7d3-bd56-43ab-a694-b91090365cdc\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"625\",\n                \"fieldPath\": \"spec.containers{prometheus-to-sd-exporter}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container prometheus-to-sd-exporter\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-12tt\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:10Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:10Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-xg8wq.16faaeab62b2bc58\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"0d055848-fac5-48bb-ac5b-c255f5fd58a0\",\n                \"resourceVersion\": \"214\",\n                \"creationTimestamp\": \"2022-06-21T16:11:04Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-xg8wq\",\n                \"uid\": \"1c2f30d1-9e35-47f4-bae9-1e4686ed668b\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"636\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/metadata-proxy-v0.12-xg8wq to nodes-us-west3-a-rbw1\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:04Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:04Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-xg8wq.16faaeac30bfa866\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f2567c47-12f5-4175-a813-3ef0bd325717\",\n                \"resourceVersion\": \"340\",\n                \"creationTimestamp\": \"2022-06-21T16:11:09Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-xg8wq\",\n                \"uid\": \"1c2f30d1-9e35-47f4-bae9-1e4686ed668b\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"637\",\n                \"fieldPath\": \"spec.initContainers{update-ipdtables}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/k8s-custom-iptables:1.0\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-rbw1\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:07Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:07Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-xg8wq.16faaeac9815f9f2\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"160b763b-dec0-4cfb-9c9c-49b92d79847e\",\n                \"resourceVersion\": \"362\",\n                \"creationTimestamp\": \"2022-06-21T16:11:10Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-xg8wq\",\n                \"uid\": \"1c2f30d1-9e35-47f4-bae9-1e4686ed668b\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"637\",\n                \"fieldPath\": \"spec.initContainers{update-ipdtables}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/k8s-custom-iptables:1.0\\\" in 1.733673706s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-rbw1\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:09Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:09Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-xg8wq.16faaeac99b3c1cd\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"215a68fa-5419-4b84-91a0-65e284385eea\",\n                \"resourceVersion\": \"366\",\n                \"creationTimestamp\": \"2022-06-21T16:11:10Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-xg8wq\",\n                \"uid\": \"1c2f30d1-9e35-47f4-bae9-1e4686ed668b\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"637\",\n                \"fieldPath\": \"spec.initContainers{update-ipdtables}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container update-ipdtables\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-rbw1\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:09Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:09Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-xg8wq.16faaeac9fc41d6b\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"afc9708a-5736-4fa7-aa3d-19d8a8419379\",\n                \"resourceVersion\": \"370\",\n                \"creationTimestamp\": \"2022-06-21T16:11:10Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-xg8wq\",\n                \"uid\": \"1c2f30d1-9e35-47f4-bae9-1e4686ed668b\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"637\",\n                \"fieldPath\": \"spec.initContainers{update-ipdtables}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container update-ipdtables\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-rbw1\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:09Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:09Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-xg8wq.16faaeace2565fd8\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f061b384-239b-4851-b89f-4ed7b634e005\",\n                \"resourceVersion\": \"375\",\n                \"creationTimestamp\": \"2022-06-21T16:11:11Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-xg8wq\",\n                \"uid\": \"1c2f30d1-9e35-47f4-bae9-1e4686ed668b\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"637\",\n                \"fieldPath\": \"spec.containers{metadata-proxy}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/metadata-proxy:v0.1.12\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-rbw1\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:10Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:10Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-xg8wq.16faaeada6b3cc9c\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"fb0ef1c6-1d03-4e52-a861-46e6f6843d02\",\n                \"resourceVersion\": \"403\",\n                \"creationTimestamp\": \"2022-06-21T16:11:13Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-xg8wq\",\n                \"uid\": \"1c2f30d1-9e35-47f4-bae9-1e4686ed668b\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"637\",\n                \"fieldPath\": \"spec.containers{metadata-proxy}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/metadata-proxy:v0.1.12\\\" in 3.294432492s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-rbw1\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:13Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:13Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-xg8wq.16faaeada8d3e64d\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"39eb5199-c08f-46e9-9564-6e5e2ddce7be\",\n                \"resourceVersion\": \"404\",\n                \"creationTimestamp\": \"2022-06-21T16:11:13Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-xg8wq\",\n                \"uid\": \"1c2f30d1-9e35-47f4-bae9-1e4686ed668b\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"637\",\n                \"fieldPath\": \"spec.containers{metadata-proxy}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container metadata-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-rbw1\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:13Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:13Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-xg8wq.16faaeadaf367763\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"7cdc9a3a-9d06-4696-8fbd-067cdb616d33\",\n                \"resourceVersion\": \"406\",\n                \"creationTimestamp\": \"2022-06-21T16:11:14Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-xg8wq\",\n                \"uid\": \"1c2f30d1-9e35-47f4-bae9-1e4686ed668b\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"637\",\n                \"fieldPath\": \"spec.containers{metadata-proxy}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container metadata-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-rbw1\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:14Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:14Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-xg8wq.16faaeadaf47ac1e\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"cfa945a7-a1bc-4f26-8202-8085eca10c09\",\n                \"resourceVersion\": \"407\",\n                \"creationTimestamp\": \"2022-06-21T16:11:14Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-xg8wq\",\n                \"uid\": \"1c2f30d1-9e35-47f4-bae9-1e4686ed668b\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"637\",\n                \"fieldPath\": \"spec.containers{prometheus-to-sd-exporter}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/prometheus-to-sd:v0.5.0\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-rbw1\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:14Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:14Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-xg8wq.16faaeade5ceb27e\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"e7acdb0b-e372-45e4-ac31-9e20c92e4029\",\n                \"resourceVersion\": \"412\",\n                \"creationTimestamp\": \"2022-06-21T16:11:14Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-xg8wq\",\n                \"uid\": \"1c2f30d1-9e35-47f4-bae9-1e4686ed668b\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"637\",\n                \"fieldPath\": \"spec.containers{prometheus-to-sd-exporter}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/prometheus-to-sd:v0.5.0\\\" in 914.78738ms\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-rbw1\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:14Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:14Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-xg8wq.16faaeade71009c7\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"e382b165-1d56-4278-98cd-1a68f86ea7d3\",\n                \"resourceVersion\": \"413\",\n                \"creationTimestamp\": \"2022-06-21T16:11:14Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-xg8wq\",\n                \"uid\": \"1c2f30d1-9e35-47f4-bae9-1e4686ed668b\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"637\",\n                \"fieldPath\": \"spec.containers{prometheus-to-sd-exporter}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container prometheus-to-sd-exporter\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-rbw1\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:14Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:14Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-xg8wq.16faaeadf92d4762\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f364f3c1-6317-4af2-8abf-9e3ad7afaf3f\",\n                \"resourceVersion\": \"415\",\n                \"creationTimestamp\": \"2022-06-21T16:11:15Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12-xg8wq\",\n                \"uid\": \"1c2f30d1-9e35-47f4-bae9-1e4686ed668b\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"637\",\n                \"fieldPath\": \"spec.containers{prometheus-to-sd-exporter}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container prometheus-to-sd-exporter\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"nodes-us-west3-a-rbw1\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:15Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:15Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12.16faaea7e306d463\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"2b311872-2dfd-4072-9273-53cdc2e07255\",\n                \"resourceVersion\": \"140\",\n                \"creationTimestamp\": \"2022-06-21T16:10:49Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"DaemonSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12\",\n                \"uid\": \"f9de8f0d-bec4-40bc-a36e-d8e1026bdc09\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"336\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: metadata-proxy-v0.12-7rr44\",\n            \"source\": {\n                \"component\": \"daemonset-controller\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:49Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:49Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12.16faaea9e39f7371\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"2a9a1961-296d-4db0-8d0a-47088134f803\",\n                \"resourceVersion\": \"163\",\n                \"creationTimestamp\": \"2022-06-21T16:10:57Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"DaemonSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12\",\n                \"uid\": \"f9de8f0d-bec4-40bc-a36e-d8e1026bdc09\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"497\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: metadata-proxy-v0.12-4rwqt\",\n            \"source\": {\n                \"component\": \"daemonset-controller\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:10:57Z\",\n            \"lastTimestamp\": \"2022-06-21T16:10:57Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12.16faaeaaa24b9718\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"c4a2aab9-739d-4ec8-a90e-4b7c9933e5a3\",\n                \"resourceVersion\": \"181\",\n                \"creationTimestamp\": \"2022-06-21T16:11:00Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"DaemonSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12\",\n                \"uid\": \"f9de8f0d-bec4-40bc-a36e-d8e1026bdc09\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"562\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: metadata-proxy-v0.12-ntrfh\",\n            \"source\": {\n                \"component\": \"daemonset-controller\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:00Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:00Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12.16faaeab026d3799\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"c204b61b-72f6-497c-b776-73ff6ae53c03\",\n                \"resourceVersion\": \"202\",\n                \"creationTimestamp\": \"2022-06-21T16:11:02Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"DaemonSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12\",\n                \"uid\": \"f9de8f0d-bec4-40bc-a36e-d8e1026bdc09\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"615\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: metadata-proxy-v0.12-qtnbn\",\n            \"source\": {\n                \"component\": \"daemonset-controller\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:02Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:02Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12.16faaeab61ea7690\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"5d01c3ae-0103-453c-a0a5-cd5835e3e982\",\n                \"resourceVersion\": \"213\",\n                \"creationTimestamp\": \"2022-06-21T16:11:04Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"DaemonSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"metadata-proxy-v0.12\",\n                \"uid\": \"f9de8f0d-bec4-40bc-a36e-d8e1026bdc09\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"627\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: metadata-proxy-v0.12-xg8wq\",\n            \"source\": {\n                \"component\": \"daemonset-controller\"\n            },\n            \"firstTimestamp\": \"2022-06-21T16:11:04Z\",\n            \"lastTimestamp\": \"2022-06-21T16:11:04Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        }\n    ]\n}\n{\n    \"kind\": \"ReplicationControllerList\",\n    \"apiVersion\": \"v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"8518\"\n    },\n    \"items\": []\n}\n{\n    \"kind\": \"ServiceList\",\n    \"apiVersion\": \"v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"8521\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"api-internal\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"b753b5c1-fc66-4523-8622-b1117cb4d6e4\",\n                \"resourceVersion\": \"266\",\n                \"creationTimestamp\": \"2022-06-21T16:10:08Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"kops-controller.addons.k8s.io\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"discovery.kops.k8s.io/internal-name\": \"api.internal.e2e-e2e-kops-gce-stable.k8s.local\",\n                    \"k8s-addon\": \"kops-controller.addons.k8s.io\"\n                }\n            },\n            \"spec\": {\n                \"ports\": [\n                    {\n                        \"name\": \"https\",\n                        \"protocol\": \"TCP\",\n                        \"port\": 443,\n                        \"targetPort\": 443\n                    }\n                ],\n                \"selector\": {\n                    \"k8s-app\": \"kops-controller\"\n                },\n                \"clusterIP\": \"None\",\n                \"clusterIPs\": [\n                    \"None\"\n                ],\n                \"type\": \"ClusterIP\",\n                \"sessionAffinity\": \"None\",\n                \"ipFamilies\": [\n                    \"IPv4\"\n                ],\n                \"ipFamilyPolicy\": \"SingleStack\",\n                \"internalTrafficPolicy\": \"Cluster\"\n            },\n            \"status\": {\n                \"loadBalancer\": {}\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller-internal\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"6913e465-9312-40de-96e6-b0a1ffd2edce\",\n                \"resourceVersion\": \"267\",\n                \"creationTimestamp\": \"2022-06-21T16:10:08Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"kops-controller.addons.k8s.io\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"discovery.kops.k8s.io/internal-name\": \"kops-controller.internal.e2e-e2e-kops-gce-stable.k8s.local\",\n                    \"k8s-addon\": \"kops-controller.addons.k8s.io\"\n                }\n            },\n            \"spec\": {\n                \"ports\": [\n                    {\n                        \"name\": \"https\",\n                        \"protocol\": \"TCP\",\n                        \"port\": 3988,\n                        \"targetPort\": 3988\n                    }\n                ],\n                \"selector\": {\n                    \"k8s-app\": \"kops-controller\"\n                },\n                \"clusterIP\": \"None\",\n                \"clusterIPs\": [\n                    \"None\"\n                ],\n                \"type\": \"ClusterIP\",\n                \"sessionAffinity\": \"None\",\n                \"ipFamilies\": [\n                    \"IPv4\"\n                ],\n                \"ipFamilyPolicy\": \"SingleStack\",\n                \"internalTrafficPolicy\": \"Cluster\"\n            },\n            \"status\": {\n                \"loadBalancer\": {}\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-dns\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"9b281610-faa5-4357-a408-d83f2d84f7b6\",\n                \"resourceVersion\": \"221\",\n                \"creationTimestamp\": \"2022-06-21T16:10:06Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"coredns.addons.k8s.io\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"k8s-addon\": \"coredns.addons.k8s.io\",\n                    \"k8s-app\": \"kube-dns\",\n                    \"kubernetes.io/cluster-service\": \"true\",\n                    \"kubernetes.io/name\": \"CoreDNS\"\n                },\n                \"annotations\": {\n                    \"prometheus.io/port\": \"9153\",\n                    \"prometheus.io/scrape\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"ports\": [\n                    {\n                        \"name\": \"dns\",\n                        \"protocol\": \"UDP\",\n                        \"port\": 53,\n                        \"targetPort\": 53\n                    },\n                    {\n                        \"name\": \"dns-tcp\",\n                        \"protocol\": \"TCP\",\n                        \"port\": 53,\n                        \"targetPort\": 53\n                    },\n                    {\n                        \"name\": \"metrics\",\n                        \"protocol\": \"TCP\",\n                        \"port\": 9153,\n                        \"targetPort\": 9153\n                    }\n                ],\n                \"selector\": {\n                    \"k8s-app\": \"kube-dns\"\n                },\n                \"clusterIP\": \"100.64.0.10\",\n                \"clusterIPs\": [\n                    \"100.64.0.10\"\n                ],\n                \"type\": \"ClusterIP\",\n                \"sessionAffinity\": \"None\",\n                \"ipFamilies\": [\n                    \"IPv4\"\n                ],\n                \"ipFamilyPolicy\": \"SingleStack\",\n                \"internalTrafficPolicy\": \"Cluster\"\n            },\n            \"status\": {\n                \"loadBalancer\": {}\n            }\n        }\n    ]\n}\n{\n    \"kind\": \"DaemonSetList\",\n    \"apiVersion\": \"apps/v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"8522\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"cloud-controller-manager\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"0b464305-32c3-446a-953c-d654a4b6bf8f\",\n                \"resourceVersion\": \"441\",\n                \"generation\": 1,\n                \"creationTimestamp\": \"2022-06-21T16:10:06Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"gcp-cloud-controller.addons.k8s.io\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"component\": \"cloud-controller-manager\",\n                    \"k8s-addon\": \"gcp-cloud-controller.addons.k8s.io\"\n                },\n                \"annotations\": {\n                    \"deprecated.daemonset.template.generation\": \"1\"\n                }\n            },\n            \"spec\": {\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"component\": \"cloud-controller-manager\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"component\": \"cloud-controller-manager\",\n                            \"kops.k8s.io/managed-by\": \"kops\",\n                            \"tier\": \"control-plane\"\n                        }\n                    },\n                    \"spec\": {\n                        \"volumes\": [\n                            {\n                                \"name\": \"cloudconfig\",\n                                \"hostPath\": {\n                                    \"path\": \"/etc/kubernetes/cloud.config\",\n                                    \"type\": \"\"\n                                }\n                            }\n                        ],\n                        \"containers\": [\n                            {\n                                \"name\": \"cloud-controller-manager\",\n                                \"image\": \"k8scloudprovidergcp/cloud-controller-manager:latest\",\n                                \"command\": [\n                                    \"/usr/local/bin/cloud-controller-manager\"\n                                ],\n                                \"args\": [\n                                    \"--allocate-node-cidrs=true\",\n                                    \"--cidr-allocator-type=CloudAllocator\",\n                                    \"--cluster-cidr=100.96.0.0/11\",\n                                    \"--cluster-name=e2e-e2e-kops-gce-stable-k8s-local\",\n                                    \"--leader-elect=true\",\n                                    \"--v=2\",\n                                    \"--cloud-provider=gce\",\n                                    \"--use-service-account-credentials=true\",\n                                    \"--cloud-config=/etc/kubernetes/cloud.config\"\n                                ],\n                                \"env\": [\n                                    {\n                                        \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                        \"value\": \"127.0.0.1\"\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"requests\": {\n                                        \"cpu\": \"200m\"\n                                    }\n                                },\n                                \"volumeMounts\": [\n                                    {\n                                        \"name\": \"cloudconfig\",\n                                        \"readOnly\": true,\n                                        \"mountPath\": \"/etc/kubernetes/cloud.config\"\n                                    }\n                                ],\n                                \"livenessProbe\": {\n                                    \"httpGet\": {\n                                        \"path\": \"/healthz\",\n                                        \"port\": 10258,\n                                        \"host\": \"127.0.0.1\",\n                                        \"scheme\": \"HTTPS\"\n                                    },\n                                    \"initialDelaySeconds\": 15,\n                                    \"timeoutSeconds\": 15,\n                                    \"periodSeconds\": 10,\n                                    \"successThreshold\": 1,\n                                    \"failureThreshold\": 3\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\"\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"ClusterFirst\",\n                        \"serviceAccountName\": \"cloud-controller-manager\",\n                        \"serviceAccount\": \"cloud-controller-manager\",\n                        \"hostNetwork\": true,\n                        \"securityContext\": {},\n                        \"affinity\": {\n                            \"nodeAffinity\": {\n                                \"requiredDuringSchedulingIgnoredDuringExecution\": {\n                                    \"nodeSelectorTerms\": [\n                                        {\n                                            \"matchExpressions\": [\n                                                {\n                                                    \"key\": \"node-role.kubernetes.io/control-plane\",\n                                                    \"operator\": \"Exists\"\n                                                }\n                                            ]\n                                        },\n                                        {\n                                            \"matchExpressions\": [\n                                                {\n                                                    \"key\": \"node-role.kubernetes.io/master\",\n                                                    \"operator\": \"Exists\"\n                                                }\n                                            ]\n                                        }\n                                    ]\n                                }\n                            }\n                        },\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"key\": \"node.cloudprovider.kubernetes.io/uninitialized\",\n                                \"value\": \"true\",\n                                \"effect\": \"NoSchedule\"\n                            },\n                            {\n                                \"key\": \"node.kubernetes.io/not-ready\",\n                                \"effect\": \"NoSchedule\"\n                            },\n                            {\n                                \"key\": \"node-role.kubernetes.io/master\",\n                                \"effect\": \"NoSchedule\"\n                            },\n                            {\n                                \"key\": \"node-role.kubernetes.io/control-plane\",\n                                \"effect\": \"NoSchedule\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\"\n                    }\n                },\n                \"updateStrategy\": {\n                    \"type\": \"RollingUpdate\",\n                    \"rollingUpdate\": {\n                        \"maxUnavailable\": 1,\n                        \"maxSurge\": 0\n                    }\n                },\n                \"revisionHistoryLimit\": 10\n            },\n            \"status\": {\n                \"currentNumberScheduled\": 1,\n                \"numberMisscheduled\": 0,\n                \"desiredNumberScheduled\": 1,\n                \"numberReady\": 1,\n                \"observedGeneration\": 1,\n                \"updatedNumberScheduled\": 1,\n                \"numberAvailable\": 1\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"a2622863-3a45-44bd-80d2-abeca9b345f4\",\n                \"resourceVersion\": \"426\",\n                \"generation\": 1,\n                \"creationTimestamp\": \"2022-06-21T16:10:08Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"kops-controller.addons.k8s.io\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"k8s-addon\": \"kops-controller.addons.k8s.io\",\n                    \"k8s-app\": \"kops-controller\",\n                    \"version\": \"v1.24.0-beta.1\"\n                },\n                \"annotations\": {\n                    \"deprecated.daemonset.template.generation\": \"1\"\n                }\n            },\n            \"spec\": {\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"kops-controller\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-addon\": \"kops-controller.addons.k8s.io\",\n                            \"k8s-app\": \"kops-controller\",\n                            \"kops.k8s.io/managed-by\": \"kops\",\n                            \"version\": \"v1.24.0-beta.1\"\n                        },\n                        \"annotations\": {\n                            \"dns.alpha.kubernetes.io/internal\": \"kops-controller.internal.e2e-e2e-kops-gce-stable.k8s.local\"\n                        }\n                    },\n                    \"spec\": {\n                        \"volumes\": [\n                            {\n                                \"name\": \"kops-controller-config\",\n                                \"configMap\": {\n                                    \"name\": \"kops-controller\",\n                                    \"defaultMode\": 420\n                                }\n                            },\n                            {\n                                \"name\": \"kops-controller-pki\",\n                                \"hostPath\": {\n                                    \"path\": \"/etc/kubernetes/kops-controller/\",\n                                    \"type\": \"Directory\"\n                                }\n                            }\n                        ],\n                        \"containers\": [\n                            {\n                                \"name\": \"kops-controller\",\n                                \"image\": \"registry.k8s.io/kops/kops-controller:1.24.0-beta.1\",\n                                \"args\": [\n                                    \"--v=2\",\n                                    \"--conf=/etc/kubernetes/kops-controller/config/config.yaml\"\n                                ],\n                                \"env\": [\n                                    {\n                                        \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                        \"value\": \"127.0.0.1\"\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"requests\": {\n                                        \"cpu\": \"50m\",\n                                        \"memory\": \"50Mi\"\n                                    }\n                                },\n                                \"volumeMounts\": [\n                                    {\n                                        \"name\": \"kops-controller-config\",\n                                        \"mountPath\": \"/etc/kubernetes/kops-controller/config/\"\n                                    },\n                                    {\n                                        \"name\": \"kops-controller-pki\",\n                                        \"mountPath\": \"/etc/kubernetes/kops-controller/pki/\"\n                                    }\n                                ],\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\",\n                                \"securityContext\": {\n                                    \"runAsUser\": 10011,\n                                    \"runAsNonRoot\": true\n                                }\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"Default\",\n                        \"serviceAccountName\": \"kops-controller\",\n                        \"serviceAccount\": \"kops-controller\",\n                        \"hostNetwork\": true,\n                        \"securityContext\": {},\n                        \"affinity\": {\n                            \"nodeAffinity\": {\n                                \"requiredDuringSchedulingIgnoredDuringExecution\": {\n                                    \"nodeSelectorTerms\": [\n                                        {\n                                            \"matchExpressions\": [\n                                                {\n                                                    \"key\": \"node-role.kubernetes.io/control-plane\",\n                                                    \"operator\": \"Exists\"\n                                                },\n                                                {\n                                                    \"key\": \"kops.k8s.io/kops-controller-pki\",\n                                                    \"operator\": \"Exists\"\n                                                }\n                                            ]\n                                        },\n                                        {\n                                            \"matchExpressions\": [\n                                                {\n                                                    \"key\": \"node-role.kubernetes.io/master\",\n                                                    \"operator\": \"Exists\"\n                                                },\n                                                {\n                                                    \"key\": \"kops.k8s.io/kops-controller-pki\",\n                                                    \"operator\": \"Exists\"\n                                                }\n                                            ]\n                                        }\n                                    ]\n                                }\n                            }\n                        },\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"key\": \"node.cloudprovider.kubernetes.io/uninitialized\",\n                                \"operator\": \"Exists\"\n                            },\n                            {\n                                \"key\": \"node.kubernetes.io/not-ready\",\n                                \"operator\": \"Exists\"\n                            },\n                            {\n                                \"key\": \"node-role.kubernetes.io/master\",\n                                \"operator\": \"Exists\"\n                            },\n                            {\n                                \"key\": \"node-role.kubernetes.io/control-plane\",\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\"\n                    }\n                },\n                \"updateStrategy\": {\n                    \"type\": \"OnDelete\"\n                },\n                \"revisionHistoryLimit\": 10\n            },\n            \"status\": {\n                \"currentNumberScheduled\": 1,\n                \"numberMisscheduled\": 0,\n                \"desiredNumberScheduled\": 1,\n                \"numberReady\": 1,\n                \"observedGeneration\": 1,\n                \"updatedNumberScheduled\": 1,\n                \"numberAvailable\": 1\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f9de8f0d-bec4-40bc-a36e-d8e1026bdc09\",\n                \"resourceVersion\": \"752\",\n                \"generation\": 1,\n                \"creationTimestamp\": \"2022-06-21T16:10:07Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"metadata-proxy.addons.k8s.io\",\n                    \"addonmanager.kubernetes.io/mode\": \"Reconcile\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"k8s-addon\": \"metadata-proxy.addons.k8s.io\",\n                    \"k8s-app\": \"metadata-proxy\",\n                    \"kubernetes.io/cluster-service\": \"true\",\n                    \"version\": \"v0.12\"\n                },\n                \"annotations\": {\n                    \"deprecated.daemonset.template.generation\": \"1\"\n                }\n            },\n            \"spec\": {\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"metadata-proxy\",\n                        \"version\": \"v0.12\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-app\": \"metadata-proxy\",\n                            \"kops.k8s.io/managed-by\": \"kops\",\n                            \"kubernetes.io/cluster-service\": \"true\",\n                            \"version\": \"v0.12\"\n                        }\n                    },\n                    \"spec\": {\n                        \"volumes\": [\n                            {\n                                \"name\": \"host\",\n                                \"hostPath\": {\n                                    \"path\": \"/\",\n                                    \"type\": \"Directory\"\n                                }\n                            }\n                        ],\n                        \"initContainers\": [\n                            {\n                                \"name\": \"update-ipdtables\",\n                                \"image\": \"k8s.gcr.io/k8s-custom-iptables:1.0\",\n                                \"command\": [\n                                    \"/bin/sh\",\n                                    \"-c\",\n                                    \"set -e\\nset -x\\n\\nif (ip link show ens4); then\\n  PRIMARY_DEV=ens4\\nelse\\n  PRIMARY_DEV=eth0\\nfi\\n\\nip addr add dev lo 169.254.169.252/32\\niptables -w -t nat -I PREROUTING -p tcp -d 169.254.169.254 ! -i \\\"${PRIMARY_DEV}\\\" --dport 80 -m comment --comment \\\"metadata-concealment: bridge traffic to metadata server goes to metadata proxy\\\" -j DNAT --to-destination 169.254.169.252:988\\niptables -w -t nat -I PREROUTING -p tcp -d 169.254.169.254 ! -i \\\"${PRIMARY_DEV}\\\" --dport 8080 -m comment --comment \\\"metadata-concealment: bridge traffic to metadata server goes to metadata proxy\\\" -j DNAT --to-destination 169.254.169.252:987\\n\"\n                                ],\n                                \"resources\": {},\n                                \"volumeMounts\": [\n                                    {\n                                        \"name\": \"host\",\n                                        \"mountPath\": \"/host\"\n                                    }\n                                ],\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"Always\",\n                                \"securityContext\": {\n                                    \"privileged\": true\n                                }\n                            }\n                        ],\n                        \"containers\": [\n                            {\n                                \"name\": \"metadata-proxy\",\n                                \"image\": \"k8s.gcr.io/metadata-proxy:v0.1.12\",\n                                \"args\": [\n                                    \"-addr=169.254.169.252:988\"\n                                ],\n                                \"resources\": {\n                                    \"limits\": {\n                                        \"cpu\": \"30m\",\n                                        \"memory\": \"25Mi\"\n                                    },\n                                    \"requests\": {\n                                        \"cpu\": \"30m\",\n                                        \"memory\": \"25Mi\"\n                                    }\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\",\n                                \"securityContext\": {\n                                    \"privileged\": true\n                                }\n                            },\n                            {\n                                \"name\": \"prometheus-to-sd-exporter\",\n                                \"image\": \"k8s.gcr.io/prometheus-to-sd:v0.5.0\",\n                                \"command\": [\n                                    \"/monitor\",\n                                    \"--stackdriver-prefix=custom.googleapis.com/addons\",\n                                    \"--source=metadata_proxy:http://127.0.0.1:989?whitelisted=request_count\",\n                                    \"--pod-id=$(POD_NAME)\",\n                                    \"--namespace-id=$(POD_NAMESPACE)\"\n                                ],\n                                \"env\": [\n                                    {\n                                        \"name\": \"POD_NAME\",\n                                        \"valueFrom\": {\n                                            \"fieldRef\": {\n                                                \"apiVersion\": \"v1\",\n                                                \"fieldPath\": \"metadata.name\"\n                                            }\n                                        }\n                                    },\n                                    {\n                                        \"name\": \"POD_NAMESPACE\",\n                                        \"valueFrom\": {\n                                            \"fieldRef\": {\n                                                \"apiVersion\": \"v1\",\n                                                \"fieldPath\": \"metadata.namespace\"\n                                            }\n                                        }\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"limits\": {\n                                        \"cpu\": \"2m\",\n                                        \"memory\": \"20Mi\"\n                                    },\n                                    \"requests\": {\n                                        \"cpu\": \"2m\",\n                                        \"memory\": \"20Mi\"\n                                    }\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\"\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"Default\",\n                        \"nodeSelector\": {\n                            \"beta.kubernetes.io/os\": \"linux\",\n                            \"cloud.google.com/metadata-proxy-ready\": \"true\"\n                        },\n                        \"serviceAccountName\": \"metadata-proxy\",\n                        \"serviceAccount\": \"metadata-proxy\",\n                        \"hostNetwork\": true,\n                        \"securityContext\": {},\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"operator\": \"Exists\",\n                                \"effect\": \"NoExecute\"\n                            },\n                            {\n                                \"operator\": \"Exists\",\n                                \"effect\": \"NoSchedule\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-node-critical\"\n                    }\n                },\n                \"updateStrategy\": {\n                    \"type\": \"RollingUpdate\",\n                    \"rollingUpdate\": {\n                        \"maxUnavailable\": 1,\n                        \"maxSurge\": 0\n                    }\n                },\n                \"revisionHistoryLimit\": 10\n            },\n            \"status\": {\n                \"currentNumberScheduled\": 5,\n                \"numberMisscheduled\": 0,\n                \"desiredNumberScheduled\": 5,\n                \"numberReady\": 5,\n                \"observedGeneration\": 1,\n                \"updatedNumberScheduled\": 5,\n                \"numberAvailable\": 5\n            }\n        }\n    ]\n}\n{\n    \"kind\": \"DeploymentList\",\n    \"apiVersion\": \"apps/v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"8522\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"coredns\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"00638054-2edd-4a0d-9230-dbdc24b58b7c\",\n                \"resourceVersion\": \"720\",\n                \"generation\": 2,\n                \"creationTimestamp\": \"2022-06-21T16:10:06Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"coredns.addons.k8s.io\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"k8s-addon\": \"coredns.addons.k8s.io\",\n                    \"k8s-app\": \"kube-dns\",\n                    \"kubernetes.io/cluster-service\": \"true\",\n                    \"kubernetes.io/name\": \"CoreDNS\"\n                },\n                \"annotations\": {\n                    \"deployment.kubernetes.io/revision\": \"1\"\n                }\n            },\n            \"spec\": {\n                \"replicas\": 2,\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"kube-dns\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-app\": \"kube-dns\",\n                            \"kops.k8s.io/managed-by\": \"kops\"\n                        }\n                    },\n                    \"spec\": {\n                        \"volumes\": [\n                            {\n                                \"name\": \"config-volume\",\n                                \"configMap\": {\n                                    \"name\": \"coredns\",\n                                    \"defaultMode\": 420\n                                }\n                            }\n                        ],\n                        \"containers\": [\n                            {\n                                \"name\": \"coredns\",\n                                \"image\": \"registry.k8s.io/coredns/coredns:v1.8.6\",\n                                \"args\": [\n                                    \"-conf\",\n                                    \"/etc/coredns/Corefile\"\n                                ],\n                                \"ports\": [\n                                    {\n                                        \"name\": \"dns\",\n                                        \"containerPort\": 53,\n                                        \"protocol\": \"UDP\"\n                                    },\n                                    {\n                                        \"name\": \"dns-tcp\",\n                                        \"containerPort\": 53,\n                                        \"protocol\": \"TCP\"\n                                    },\n                                    {\n                                        \"name\": \"metrics\",\n                                        \"containerPort\": 9153,\n                                        \"protocol\": \"TCP\"\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"limits\": {\n                                        \"memory\": \"170Mi\"\n                                    },\n                                    \"requests\": {\n                                        \"cpu\": \"100m\",\n                                        \"memory\": \"70Mi\"\n                                    }\n                                },\n                                \"volumeMounts\": [\n                                    {\n                                        \"name\": \"config-volume\",\n                                        \"readOnly\": true,\n                                        \"mountPath\": \"/etc/coredns\"\n                                    }\n                                ],\n                                \"livenessProbe\": {\n                                    \"httpGet\": {\n                                        \"path\": \"/health\",\n                                        \"port\": 8080,\n                                        \"scheme\": \"HTTP\"\n                                    },\n                                    \"initialDelaySeconds\": 60,\n                                    \"timeoutSeconds\": 5,\n                                    \"periodSeconds\": 10,\n                                    \"successThreshold\": 1,\n                                    \"failureThreshold\": 5\n                                },\n                                \"readinessProbe\": {\n                                    \"httpGet\": {\n                                        \"path\": \"/ready\",\n                                        \"port\": 8181,\n                                        \"scheme\": \"HTTP\"\n                                    },\n                                    \"timeoutSeconds\": 1,\n                                    \"periodSeconds\": 10,\n                                    \"successThreshold\": 1,\n                                    \"failureThreshold\": 3\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\",\n                                \"securityContext\": {\n                                    \"capabilities\": {\n                                        \"add\": [\n                                            \"NET_BIND_SERVICE\"\n                                        ],\n                                        \"drop\": [\n                                            \"all\"\n                                        ]\n                                    },\n                                    \"readOnlyRootFilesystem\": true,\n                                    \"allowPrivilegeEscalation\": false\n                                }\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"Default\",\n                        \"nodeSelector\": {\n                            \"kubernetes.io/os\": \"linux\"\n                        },\n                        \"serviceAccountName\": \"coredns\",\n                        \"serviceAccount\": \"coredns\",\n                        \"securityContext\": {},\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"key\": \"CriticalAddonsOnly\",\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\",\n                        \"topologySpreadConstraints\": [\n                            {\n                                \"maxSkew\": 1,\n                                \"topologyKey\": \"topology.kubernetes.io/zone\",\n                                \"whenUnsatisfiable\": \"ScheduleAnyway\",\n                                \"labelSelector\": {\n                                    \"matchLabels\": {\n                                        \"k8s-app\": \"kube-dns\"\n                                    }\n                                }\n                            },\n                            {\n                                \"maxSkew\": 1,\n                                \"topologyKey\": \"kubernetes.io/hostname\",\n                                \"whenUnsatisfiable\": \"ScheduleAnyway\",\n                                \"labelSelector\": {\n                                    \"matchLabels\": {\n                                        \"k8s-app\": \"kube-dns\"\n                                    }\n                                }\n                            }\n                        ]\n                    }\n                },\n                \"strategy\": {\n                    \"type\": \"RollingUpdate\",\n                    \"rollingUpdate\": {\n                        \"maxUnavailable\": 1,\n                        \"maxSurge\": \"10%\"\n                    }\n                },\n                \"revisionHistoryLimit\": 10,\n                \"progressDeadlineSeconds\": 600\n            },\n            \"status\": {\n                \"observedGeneration\": 2,\n                \"replicas\": 2,\n                \"updatedReplicas\": 2,\n                \"readyReplicas\": 2,\n                \"availableReplicas\": 2,\n                \"conditions\": [\n                    {\n                        \"type\": \"Available\",\n                        \"status\": \"True\",\n                        \"lastUpdateTime\": \"2022-06-21T16:10:31Z\",\n                        \"lastTransitionTime\": \"2022-06-21T16:10:31Z\",\n                        \"reason\": \"MinimumReplicasAvailable\",\n                        \"message\": \"Deployment has minimum availability.\"\n                    },\n                    {\n                        \"type\": \"Progressing\",\n                        \"status\": \"True\",\n                        \"lastUpdateTime\": \"2022-06-21T16:11:07Z\",\n                        \"lastTransitionTime\": \"2022-06-21T16:10:31Z\",\n                        \"reason\": \"NewReplicaSetAvailable\",\n                        \"message\": \"ReplicaSet \\\"coredns-dd657c749\\\" has successfully progressed.\"\n                    }\n                ]\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"859f30d6-4d64-442f-ab5a-9a97b1527a05\",\n                \"resourceVersion\": \"691\",\n                \"generation\": 1,\n                \"creationTimestamp\": \"2022-06-21T16:10:06Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"coredns.addons.k8s.io\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"k8s-addon\": \"coredns.addons.k8s.io\",\n                    \"k8s-app\": \"coredns-autoscaler\",\n                    \"kubernetes.io/cluster-service\": \"true\"\n                },\n                \"annotations\": {\n                    \"deployment.kubernetes.io/revision\": \"1\"\n                }\n            },\n            \"spec\": {\n                \"replicas\": 1,\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"coredns-autoscaler\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-app\": \"coredns-autoscaler\",\n                            \"kops.k8s.io/managed-by\": \"kops\"\n                        },\n                        \"annotations\": {\n                            \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                        }\n                    },\n                    \"spec\": {\n                        \"containers\": [\n                            {\n                                \"name\": \"autoscaler\",\n                                \"image\": \"registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4\",\n                                \"command\": [\n                                    \"/cluster-proportional-autoscaler\",\n                                    \"--namespace=kube-system\",\n                                    \"--configmap=coredns-autoscaler\",\n                                    \"--target=Deployment/coredns\",\n                                    \"--default-params={\\\"linear\\\":{\\\"coresPerReplica\\\":256,\\\"nodesPerReplica\\\":16,\\\"preventSinglePointFailure\\\":true}}\",\n                                    \"--logtostderr=true\",\n                                    \"--v=2\"\n                                ],\n                                \"resources\": {\n                                    \"requests\": {\n                                        \"cpu\": \"20m\",\n                                        \"memory\": \"10Mi\"\n                                    }\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\"\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"ClusterFirst\",\n                        \"nodeSelector\": {\n                            \"kubernetes.io/os\": \"linux\"\n                        },\n                        \"serviceAccountName\": \"coredns-autoscaler\",\n                        \"serviceAccount\": \"coredns-autoscaler\",\n                        \"securityContext\": {},\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"key\": \"CriticalAddonsOnly\",\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\"\n                    }\n                },\n                \"strategy\": {\n                    \"type\": \"RollingUpdate\",\n                    \"rollingUpdate\": {\n                        \"maxUnavailable\": \"25%\",\n                        \"maxSurge\": \"25%\"\n                    }\n                },\n                \"revisionHistoryLimit\": 10,\n                \"progressDeadlineSeconds\": 600\n            },\n            \"status\": {\n                \"observedGeneration\": 1,\n                \"replicas\": 1,\n                \"updatedReplicas\": 1,\n                \"readyReplicas\": 1,\n                \"availableReplicas\": 1,\n                \"conditions\": [\n                    {\n                        \"type\": \"Available\",\n                        \"status\": \"True\",\n                        \"lastUpdateTime\": \"2022-06-21T16:11:08Z\",\n                        \"lastTransitionTime\": \"2022-06-21T16:11:08Z\",\n                        \"reason\": \"MinimumReplicasAvailable\",\n                        \"message\": \"Deployment has minimum availability.\"\n                    },\n                    {\n                        \"type\": \"Progressing\",\n                        \"status\": \"True\",\n                        \"lastUpdateTime\": \"2022-06-21T16:11:08Z\",\n                        \"lastTransitionTime\": \"2022-06-21T16:10:31Z\",\n                        \"reason\": \"NewReplicaSetAvailable\",\n                        \"message\": \"ReplicaSet \\\"coredns-autoscaler-5d4dbc7b59\\\" has successfully progressed.\"\n                    }\n                ]\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"1984c573-291b-4056-86b5-f2cf7cb2e782\",\n                \"resourceVersion\": \"434\",\n                \"generation\": 1,\n                \"creationTimestamp\": \"2022-06-21T16:10:08Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"dns-controller.addons.k8s.io\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"k8s-addon\": \"dns-controller.addons.k8s.io\",\n                    \"k8s-app\": \"dns-controller\",\n                    \"version\": \"v1.24.0-beta.1\"\n                },\n                \"annotations\": {\n                    \"deployment.kubernetes.io/revision\": \"1\"\n                }\n            },\n            \"spec\": {\n                \"replicas\": 1,\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"dns-controller\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-addon\": \"dns-controller.addons.k8s.io\",\n                            \"k8s-app\": \"dns-controller\",\n                            \"kops.k8s.io/managed-by\": \"kops\",\n                            \"version\": \"v1.24.0-beta.1\"\n                        },\n                        \"annotations\": {\n                            \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                        }\n                    },\n                    \"spec\": {\n                        \"containers\": [\n                            {\n                                \"name\": \"dns-controller\",\n                                \"image\": \"registry.k8s.io/kops/dns-controller:1.24.0-beta.1\",\n                                \"args\": [\n                                    \"--watch-ingress=false\",\n                                    \"--dns=gossip\",\n                                    \"--gossip-seed=127.0.0.1:3999\",\n                                    \"--gossip-protocol-secondary=memberlist\",\n                                    \"--gossip-listen-secondary=0.0.0.0:3993\",\n                                    \"--gossip-seed-secondary=127.0.0.1:4000\",\n                                    \"--internal-ipv4\",\n                                    \"--zone=*/*\",\n                                    \"-v=2\"\n                                ],\n                                \"env\": [\n                                    {\n                                        \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                        \"value\": \"127.0.0.1\"\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"requests\": {\n                                        \"cpu\": \"50m\",\n                                        \"memory\": \"50Mi\"\n                                    }\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\",\n                                \"securityContext\": {\n                                    \"runAsNonRoot\": true\n                                }\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"Default\",\n                        \"serviceAccountName\": \"dns-controller\",\n                        \"serviceAccount\": \"dns-controller\",\n                        \"hostNetwork\": true,\n                        \"securityContext\": {},\n                        \"affinity\": {\n                            \"nodeAffinity\": {\n                                \"requiredDuringSchedulingIgnoredDuringExecution\": {\n                                    \"nodeSelectorTerms\": [\n                                        {\n                                            \"matchExpressions\": [\n                                                {\n                                                    \"key\": \"node-role.kubernetes.io/control-plane\",\n                                                    \"operator\": \"Exists\"\n                                                }\n                                            ]\n                                        },\n                                        {\n                                            \"matchExpressions\": [\n                                                {\n                                                    \"key\": \"node-role.kubernetes.io/master\",\n                                                    \"operator\": \"Exists\"\n                                                }\n                                            ]\n                                        }\n                                    ]\n                                }\n                            }\n                        },\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"key\": \"node.cloudprovider.kubernetes.io/uninitialized\",\n                                \"operator\": \"Exists\"\n                            },\n                            {\n                                \"key\": \"node.kubernetes.io/not-ready\",\n                                \"operator\": \"Exists\"\n                            },\n                            {\n                                \"key\": \"node-role.kubernetes.io/control-plane\",\n                                \"operator\": \"Exists\"\n                            },\n                            {\n                                \"key\": \"node-role.kubernetes.io/master\",\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\"\n                    }\n                },\n                \"strategy\": {\n                    \"type\": \"Recreate\"\n                },\n                \"revisionHistoryLimit\": 10,\n                \"progressDeadlineSeconds\": 600\n            },\n            \"status\": {\n                \"observedGeneration\": 1,\n                \"replicas\": 1,\n                \"updatedReplicas\": 1,\n                \"readyReplicas\": 1,\n                \"availableReplicas\": 1,\n                \"conditions\": [\n                    {\n                        \"type\": \"Available\",\n                        \"status\": \"True\",\n                        \"lastUpdateTime\": \"2022-06-21T16:10:34Z\",\n                        \"lastTransitionTime\": \"2022-06-21T16:10:34Z\",\n                        \"reason\": \"MinimumReplicasAvailable\",\n                        \"message\": \"Deployment has minimum availability.\"\n                    },\n                    {\n                        \"type\": \"Progressing\",\n                        \"status\": \"True\",\n                        \"lastUpdateTime\": \"2022-06-21T16:10:34Z\",\n                        \"lastTransitionTime\": \"2022-06-21T16:10:31Z\",\n                        \"reason\": \"NewReplicaSetAvailable\",\n                        \"message\": \"ReplicaSet \\\"dns-controller-78bc9bdd66\\\" has successfully progressed.\"\n                    }\n                ]\n            }\n        }\n    ]\n}\n{\n    \"kind\": \"ReplicaSetList\",\n    \"apiVersion\": \"apps/v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"8524\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-5d4dbc7b59\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"dd3029b5-7dfd-451c-bd6e-ea13b1f97ccb\",\n                \"resourceVersion\": \"690\",\n                \"generation\": 1,\n                \"creationTimestamp\": \"2022-06-21T16:10:31Z\",\n                \"labels\": {\n                    \"k8s-app\": \"coredns-autoscaler\",\n                    \"kops.k8s.io/managed-by\": \"kops\",\n                    \"pod-template-hash\": \"5d4dbc7b59\"\n                },\n                \"annotations\": {\n                    \"deployment.kubernetes.io/desired-replicas\": \"1\",\n                    \"deployment.kubernetes.io/max-replicas\": \"2\",\n                    \"deployment.kubernetes.io/revision\": \"1\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"Deployment\",\n                        \"name\": \"coredns-autoscaler\",\n                        \"uid\": \"859f30d6-4d64-442f-ab5a-9a97b1527a05\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"replicas\": 1,\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"coredns-autoscaler\",\n                        \"pod-template-hash\": \"5d4dbc7b59\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-app\": \"coredns-autoscaler\",\n                            \"kops.k8s.io/managed-by\": \"kops\",\n                            \"pod-template-hash\": \"5d4dbc7b59\"\n                        },\n                        \"annotations\": {\n                            \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                        }\n                    },\n                    \"spec\": {\n                        \"containers\": [\n                            {\n                                \"name\": \"autoscaler\",\n                                \"image\": \"registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4\",\n                                \"command\": [\n                                    \"/cluster-proportional-autoscaler\",\n                                    \"--namespace=kube-system\",\n                                    \"--configmap=coredns-autoscaler\",\n                                    \"--target=Deployment/coredns\",\n                                    \"--default-params={\\\"linear\\\":{\\\"coresPerReplica\\\":256,\\\"nodesPerReplica\\\":16,\\\"preventSinglePointFailure\\\":true}}\",\n                                    \"--logtostderr=true\",\n                                    \"--v=2\"\n                                ],\n                                \"resources\": {\n                                    \"requests\": {\n                                        \"cpu\": \"20m\",\n                                        \"memory\": \"10Mi\"\n                                    }\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\"\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"ClusterFirst\",\n                        \"nodeSelector\": {\n                            \"kubernetes.io/os\": \"linux\"\n                        },\n                        \"serviceAccountName\": \"coredns-autoscaler\",\n                        \"serviceAccount\": \"coredns-autoscaler\",\n                        \"securityContext\": {},\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"key\": \"CriticalAddonsOnly\",\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\"\n                    }\n                }\n            },\n            \"status\": {\n                \"replicas\": 1,\n                \"fullyLabeledReplicas\": 1,\n                \"readyReplicas\": 1,\n                \"availableReplicas\": 1,\n                \"observedGeneration\": 1\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-dd657c749\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"e7182e96-2f1f-4369-b820-8b62585e888b\",\n                \"resourceVersion\": \"719\",\n                \"generation\": 2,\n                \"creationTimestamp\": \"2022-06-21T16:10:31Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-dns\",\n                    \"kops.k8s.io/managed-by\": \"kops\",\n                    \"pod-template-hash\": \"dd657c749\"\n                },\n                \"annotations\": {\n                    \"deployment.kubernetes.io/desired-replicas\": \"2\",\n                    \"deployment.kubernetes.io/max-replicas\": \"3\",\n                    \"deployment.kubernetes.io/revision\": \"1\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"Deployment\",\n                        \"name\": \"coredns\",\n                        \"uid\": \"00638054-2edd-4a0d-9230-dbdc24b58b7c\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"replicas\": 2,\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"kube-dns\",\n                        \"pod-template-hash\": \"dd657c749\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-app\": \"kube-dns\",\n                            \"kops.k8s.io/managed-by\": \"kops\",\n                            \"pod-template-hash\": \"dd657c749\"\n                        }\n                    },\n                    \"spec\": {\n                        \"volumes\": [\n                            {\n                                \"name\": \"config-volume\",\n                                \"configMap\": {\n                                    \"name\": \"coredns\",\n                                    \"defaultMode\": 420\n                                }\n                            }\n                        ],\n                        \"containers\": [\n                            {\n                                \"name\": \"coredns\",\n                                \"image\": \"registry.k8s.io/coredns/coredns:v1.8.6\",\n                                \"args\": [\n                                    \"-conf\",\n                                    \"/etc/coredns/Corefile\"\n                                ],\n                                \"ports\": [\n                                    {\n                                        \"name\": \"dns\",\n                                        \"containerPort\": 53,\n                                        \"protocol\": \"UDP\"\n                                    },\n                                    {\n                                        \"name\": \"dns-tcp\",\n                                        \"containerPort\": 53,\n                                        \"protocol\": \"TCP\"\n                                    },\n                                    {\n                                        \"name\": \"metrics\",\n                                        \"containerPort\": 9153,\n                                        \"protocol\": \"TCP\"\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"limits\": {\n                                        \"memory\": \"170Mi\"\n                                    },\n                                    \"requests\": {\n                                        \"cpu\": \"100m\",\n                                        \"memory\": \"70Mi\"\n                                    }\n                                },\n                                \"volumeMounts\": [\n                                    {\n                                        \"name\": \"config-volume\",\n                                        \"readOnly\": true,\n                                        \"mountPath\": \"/etc/coredns\"\n                                    }\n                                ],\n                                \"livenessProbe\": {\n                                    \"httpGet\": {\n                                        \"path\": \"/health\",\n                                        \"port\": 8080,\n                                        \"scheme\": \"HTTP\"\n                                    },\n                                    \"initialDelaySeconds\": 60,\n                                    \"timeoutSeconds\": 5,\n                                    \"periodSeconds\": 10,\n                                    \"successThreshold\": 1,\n                                    \"failureThreshold\": 5\n                                },\n                                \"readinessProbe\": {\n                                    \"httpGet\": {\n                                        \"path\": \"/ready\",\n                                        \"port\": 8181,\n                                        \"scheme\": \"HTTP\"\n                                    },\n                                    \"timeoutSeconds\": 1,\n                                    \"periodSeconds\": 10,\n                                    \"successThreshold\": 1,\n                                    \"failureThreshold\": 3\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\",\n                                \"securityContext\": {\n                                    \"capabilities\": {\n                                        \"add\": [\n                                            \"NET_BIND_SERVICE\"\n                                        ],\n                                        \"drop\": [\n                                            \"all\"\n                                        ]\n                                    },\n                                    \"readOnlyRootFilesystem\": true,\n                                    \"allowPrivilegeEscalation\": false\n                                }\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"Default\",\n                        \"nodeSelector\": {\n                            \"kubernetes.io/os\": \"linux\"\n                        },\n                        \"serviceAccountName\": \"coredns\",\n                        \"serviceAccount\": \"coredns\",\n                        \"securityContext\": {},\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"key\": \"CriticalAddonsOnly\",\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\",\n                        \"topologySpreadConstraints\": [\n                            {\n                                \"maxSkew\": 1,\n                                \"topologyKey\": \"topology.kubernetes.io/zone\",\n                                \"whenUnsatisfiable\": \"ScheduleAnyway\",\n                                \"labelSelector\": {\n                                    \"matchLabels\": {\n                                        \"k8s-app\": \"kube-dns\"\n                                    }\n                                }\n                            },\n                            {\n                                \"maxSkew\": 1,\n                                \"topologyKey\": \"kubernetes.io/hostname\",\n                                \"whenUnsatisfiable\": \"ScheduleAnyway\",\n                                \"labelSelector\": {\n                                    \"matchLabels\": {\n                                        \"k8s-app\": \"kube-dns\"\n                                    }\n                                }\n                            }\n                        ]\n                    }\n                }\n            },\n            \"status\": {\n                \"replicas\": 2,\n                \"fullyLabeledReplicas\": 2,\n                \"readyReplicas\": 2,\n                \"availableReplicas\": 2,\n                \"observedGeneration\": 2\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-78bc9bdd66\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"dcfdfc36-6c4f-46ff-b652-354a3d065ac4\",\n                \"resourceVersion\": \"433\",\n                \"generation\": 1,\n                \"creationTimestamp\": \"2022-06-21T16:10:31Z\",\n                \"labels\": {\n                    \"k8s-addon\": \"dns-controller.addons.k8s.io\",\n                    \"k8s-app\": \"dns-controller\",\n                    \"kops.k8s.io/managed-by\": \"kops\",\n                    \"pod-template-hash\": \"78bc9bdd66\",\n                    \"version\": \"v1.24.0-beta.1\"\n                },\n                \"annotations\": {\n                    \"deployment.kubernetes.io/desired-replicas\": \"1\",\n                    \"deployment.kubernetes.io/max-replicas\": \"1\",\n                    \"deployment.kubernetes.io/revision\": \"1\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"Deployment\",\n                        \"name\": \"dns-controller\",\n                        \"uid\": \"1984c573-291b-4056-86b5-f2cf7cb2e782\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"replicas\": 1,\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"dns-controller\",\n                        \"pod-template-hash\": \"78bc9bdd66\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-addon\": \"dns-controller.addons.k8s.io\",\n                            \"k8s-app\": \"dns-controller\",\n                            \"kops.k8s.io/managed-by\": \"kops\",\n                            \"pod-template-hash\": \"78bc9bdd66\",\n                            \"version\": \"v1.24.0-beta.1\"\n                        },\n                        \"annotations\": {\n                            \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                        }\n                    },\n                    \"spec\": {\n                        \"containers\": [\n                            {\n                                \"name\": \"dns-controller\",\n                                \"image\": \"registry.k8s.io/kops/dns-controller:1.24.0-beta.1\",\n                                \"args\": [\n                                    \"--watch-ingress=false\",\n                                    \"--dns=gossip\",\n                                    \"--gossip-seed=127.0.0.1:3999\",\n                                    \"--gossip-protocol-secondary=memberlist\",\n                                    \"--gossip-listen-secondary=0.0.0.0:3993\",\n                                    \"--gossip-seed-secondary=127.0.0.1:4000\",\n                                    \"--internal-ipv4\",\n                                    \"--zone=*/*\",\n                                    \"-v=2\"\n                                ],\n                                \"env\": [\n                                    {\n                                        \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                        \"value\": \"127.0.0.1\"\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"requests\": {\n                                        \"cpu\": \"50m\",\n                                        \"memory\": \"50Mi\"\n                                    }\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\",\n                                \"securityContext\": {\n                                    \"runAsNonRoot\": true\n                                }\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"Default\",\n                        \"serviceAccountName\": \"dns-controller\",\n                        \"serviceAccount\": \"dns-controller\",\n                        \"hostNetwork\": true,\n                        \"securityContext\": {},\n                        \"affinity\": {\n                            \"nodeAffinity\": {\n                                \"requiredDuringSchedulingIgnoredDuringExecution\": {\n                                    \"nodeSelectorTerms\": [\n                                        {\n                                            \"matchExpressions\": [\n                                                {\n                                                    \"key\": \"node-role.kubernetes.io/control-plane\",\n                                                    \"operator\": \"Exists\"\n                                                }\n                                            ]\n                                        },\n                                        {\n                                            \"matchExpressions\": [\n                                                {\n                                                    \"key\": \"node-role.kubernetes.io/master\",\n                                                    \"operator\": \"Exists\"\n                                                }\n                                            ]\n                                        }\n                                    ]\n                                }\n                            }\n                        },\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"key\": \"node.cloudprovider.kubernetes.io/uninitialized\",\n                                \"operator\": \"Exists\"\n                            },\n                            {\n                                \"key\": \"node.kubernetes.io/not-ready\",\n                                \"operator\": \"Exists\"\n                            },\n                            {\n                                \"key\": \"node-role.kubernetes.io/control-plane\",\n                                \"operator\": \"Exists\"\n                            },\n                            {\n                                \"key\": \"node-role.kubernetes.io/master\",\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\"\n                    }\n                }\n            },\n            \"status\": {\n                \"replicas\": 1,\n                \"fullyLabeledReplicas\": 1,\n                \"readyReplicas\": 1,\n                \"availableReplicas\": 1,\n                \"observedGeneration\": 1\n            }\n        }\n    ]\n}\n{\n    \"kind\": \"PodList\",\n    \"apiVersion\": \"v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"8524\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"cloud-controller-manager-csw8w\",\n                \"generateName\": \"cloud-controller-manager-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f0351e8c-a4d5-477c-a34c-8ac66e653813\",\n                \"resourceVersion\": \"440\",\n                \"creationTimestamp\": \"2022-06-21T16:10:31Z\",\n                \"labels\": {\n                    \"component\": \"cloud-controller-manager\",\n                    \"controller-revision-hash\": \"58f854fb86\",\n                    \"kops.k8s.io/managed-by\": \"kops\",\n                    \"pod-template-generation\": \"1\",\n                    \"tier\": \"control-plane\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"DaemonSet\",\n                        \"name\": \"cloud-controller-manager\",\n                        \"uid\": \"0b464305-32c3-446a-953c-d654a4b6bf8f\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"cloudconfig\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/kubernetes/cloud.config\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-tkh9q\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"cloud-controller-manager\",\n                        \"image\": \"k8scloudprovidergcp/cloud-controller-manager:latest\",\n                        \"command\": [\n                            \"/usr/local/bin/cloud-controller-manager\"\n                        ],\n                        \"args\": [\n                            \"--allocate-node-cidrs=true\",\n                            \"--cidr-allocator-type=CloudAllocator\",\n                            \"--cluster-cidr=100.96.0.0/11\",\n                            \"--cluster-name=e2e-e2e-kops-gce-stable-k8s-local\",\n                            \"--leader-elect=true\",\n                            \"--v=2\",\n                            \"--cloud-provider=gce\",\n                            \"--use-service-account-credentials=true\",\n                            \"--cloud-config=/etc/kubernetes/cloud.config\"\n                        ],\n                        \"env\": [\n                            {\n                                \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                \"value\": \"127.0.0.1\"\n                            }\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"200m\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"cloudconfig\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/kubernetes/cloud.config\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-tkh9q\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"livenessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/healthz\",\n                                \"port\": 10258,\n                                \"host\": \"127.0.0.1\",\n                                \"scheme\": \"HTTPS\"\n                            },\n                            \"initialDelaySeconds\": 15,\n                            \"timeoutSeconds\": 15,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 3\n                        },\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\"\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"serviceAccountName\": \"cloud-controller-manager\",\n                \"serviceAccount\": \"cloud-controller-manager\",\n                \"nodeName\": \"master-us-west3-a-r9rv\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"affinity\": {\n                    \"nodeAffinity\": {\n                        \"requiredDuringSchedulingIgnoredDuringExecution\": {\n                            \"nodeSelectorTerms\": [\n                                {\n                                    \"matchFields\": [\n                                        {\n                                            \"key\": \"metadata.name\",\n                                            \"operator\": \"In\",\n                                            \"values\": [\n                                                \"master-us-west3-a-r9rv\"\n                                            ]\n                                        }\n                                    ]\n                                }\n                            ]\n                        }\n                    }\n                },\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"node.cloudprovider.kubernetes.io/uninitialized\",\n                        \"value\": \"true\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node-role.kubernetes.io/master\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node-role.kubernetes.io/control-plane\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/disk-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/memory-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/pid-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unschedulable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/network-unavailable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:31Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:36Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:36Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:31Z\"\n                    }\n                ],\n                \"hostIP\": \"10.0.16.6\",\n                \"podIP\": \"10.0.16.6\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"10.0.16.6\"\n                    }\n                ],\n                \"startTime\": \"2022-06-21T16:10:31Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"cloud-controller-manager\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2022-06-21T16:10:35Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"docker.io/k8scloudprovidergcp/cloud-controller-manager:latest\",\n                        \"imageID\": \"docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9\",\n                        \"containerID\": \"containerd://745ab7097dd743765772da4b5b5f0638b547de423de9cb79ae983bb78ed444e2\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-5d4dbc7b59-d42gf\",\n                \"generateName\": \"coredns-autoscaler-5d4dbc7b59-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"2014365f-ad4f-4230-9f1b-a3045fef97ef\",\n                \"resourceVersion\": \"689\",\n                \"creationTimestamp\": \"2022-06-21T16:10:31Z\",\n                \"labels\": {\n                    \"k8s-app\": \"coredns-autoscaler\",\n                    \"kops.k8s.io/managed-by\": \"kops\",\n                    \"pod-template-hash\": \"5d4dbc7b59\"\n                },\n                \"annotations\": {\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"ReplicaSet\",\n                        \"name\": \"coredns-autoscaler-5d4dbc7b59\",\n                        \"uid\": \"dd3029b5-7dfd-451c-bd6e-ea13b1f97ccb\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"kube-api-access-5ds55\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"autoscaler\",\n                        \"image\": \"registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4\",\n                        \"command\": [\n                            \"/cluster-proportional-autoscaler\",\n                            \"--namespace=kube-system\",\n                            \"--configmap=coredns-autoscaler\",\n                            \"--target=Deployment/coredns\",\n                            \"--default-params={\\\"linear\\\":{\\\"coresPerReplica\\\":256,\\\"nodesPerReplica\\\":16,\\\"preventSinglePointFailure\\\":true}}\",\n                            \"--logtostderr=true\",\n                            \"--v=2\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"20m\",\n                                \"memory\": \"10Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"kube-api-access-5ds55\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\"\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeSelector\": {\n                    \"kubernetes.io/os\": \"linux\"\n                },\n                \"serviceAccountName\": \"coredns-autoscaler\",\n                \"serviceAccount\": \"coredns-autoscaler\",\n                \"nodeName\": \"nodes-us-west3-a-kkxs\",\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\",\n                        \"tolerationSeconds\": 300\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\",\n                        \"tolerationSeconds\": 300\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:11:04Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:11:08Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:11:08Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:11:04Z\"\n                    }\n                ],\n                \"hostIP\": \"10.0.16.3\",\n                \"podIP\": \"100.96.1.2\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"100.96.1.2\"\n                    }\n                ],\n                \"startTime\": \"2022-06-21T16:11:04Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"autoscaler\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2022-06-21T16:11:08Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4\",\n                        \"imageID\": \"registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def\",\n                        \"containerID\": \"containerd://001352397be877474ca1863b99fab489ee2f9b0e42683548da3d795e99e0baeb\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-dd657c749-cdwz4\",\n                \"generateName\": \"coredns-dd657c749-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3b8f8820-9eda-4bba-9740-d32f956d83d9\",\n                \"resourceVersion\": \"715\",\n                \"creationTimestamp\": \"2022-06-21T16:11:08Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-dns\",\n                    \"kops.k8s.io/managed-by\": \"kops\",\n                    \"pod-template-hash\": \"dd657c749\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"ReplicaSet\",\n                        \"name\": \"coredns-dd657c749\",\n                        \"uid\": \"e7182e96-2f1f-4369-b820-8b62585e888b\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"config-volume\",\n                        \"configMap\": {\n                            \"name\": \"coredns\",\n                            \"defaultMode\": 420\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-slcf6\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"coredns\",\n                        \"image\": \"registry.k8s.io/coredns/coredns:v1.8.6\",\n                        \"args\": [\n                            \"-conf\",\n                            \"/etc/coredns/Corefile\"\n                        ],\n                        \"ports\": [\n                            {\n                                \"name\": \"dns\",\n                                \"containerPort\": 53,\n                                \"protocol\": \"UDP\"\n                            },\n                            {\n                                \"name\": \"dns-tcp\",\n                                \"containerPort\": 53,\n                                \"protocol\": \"TCP\"\n                            },\n                            {\n                                \"name\": \"metrics\",\n                                \"containerPort\": 9153,\n                                \"protocol\": \"TCP\"\n                            }\n                        ],\n                        \"resources\": {\n                            \"limits\": {\n                                \"memory\": \"170Mi\"\n                            },\n                            \"requests\": {\n                                \"cpu\": \"100m\",\n                                \"memory\": \"70Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"config-volume\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/coredns\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-slcf6\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"livenessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/health\",\n                                \"port\": 8080,\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"initialDelaySeconds\": 60,\n                            \"timeoutSeconds\": 5,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 5\n                        },\n                        \"readinessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/ready\",\n                                \"port\": 8181,\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"timeoutSeconds\": 1,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 3\n                        },\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"capabilities\": {\n                                \"add\": [\n                                    \"NET_BIND_SERVICE\"\n                                ],\n                                \"drop\": [\n                                    \"all\"\n                                ]\n                            },\n                            \"readOnlyRootFilesystem\": true,\n                            \"allowPrivilegeEscalation\": false\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"Default\",\n                \"nodeSelector\": {\n                    \"kubernetes.io/os\": \"linux\"\n                },\n                \"serviceAccountName\": \"coredns\",\n                \"serviceAccount\": \"coredns\",\n                \"nodeName\": \"nodes-us-west3-a-kkxs\",\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\",\n                        \"tolerationSeconds\": 300\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\",\n                        \"tolerationSeconds\": 300\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\",\n                \"topologySpreadConstraints\": [\n                    {\n                        \"maxSkew\": 1,\n                        \"topologyKey\": \"topology.kubernetes.io/zone\",\n                        \"whenUnsatisfiable\": \"ScheduleAnyway\",\n                        \"labelSelector\": {\n                            \"matchLabels\": {\n                                \"k8s-app\": \"kube-dns\"\n                            }\n                        }\n                    },\n                    {\n                        \"maxSkew\": 1,\n                        \"topologyKey\": \"kubernetes.io/hostname\",\n                        \"whenUnsatisfiable\": \"ScheduleAnyway\",\n                        \"labelSelector\": {\n                            \"matchLabels\": {\n                                \"k8s-app\": \"kube-dns\"\n                            }\n                        }\n                    }\n                ]\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:11:08Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:11:09Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:11:09Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:11:08Z\"\n                    }\n                ],\n                \"hostIP\": \"10.0.16.3\",\n                \"podIP\": \"100.96.1.4\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"100.96.1.4\"\n                    }\n                ],\n                \"startTime\": \"2022-06-21T16:11:08Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"coredns\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2022-06-21T16:11:09Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"registry.k8s.io/coredns/coredns:v1.8.6\",\n                        \"imageID\": \"registry.k8s.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e\",\n                        \"containerID\": \"containerd://03f26d23f79fd650e82c34eb3de822930a466c12d56c7761c824b1487687c583\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-dd657c749-jtxhs\",\n                \"generateName\": \"coredns-dd657c749-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"16bc8887-b5aa-4d6f-b40d-2ba6002923f8\",\n                \"resourceVersion\": \"674\",\n                \"creationTimestamp\": \"2022-06-21T16:10:31Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-dns\",\n                    \"kops.k8s.io/managed-by\": \"kops\",\n                    \"pod-template-hash\": \"dd657c749\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"ReplicaSet\",\n                        \"name\": \"coredns-dd657c749\",\n                        \"uid\": \"e7182e96-2f1f-4369-b820-8b62585e888b\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"config-volume\",\n                        \"configMap\": {\n                            \"name\": \"coredns\",\n                            \"defaultMode\": 420\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-lkc59\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"coredns\",\n                        \"image\": \"registry.k8s.io/coredns/coredns:v1.8.6\",\n                        \"args\": [\n                            \"-conf\",\n                            \"/etc/coredns/Corefile\"\n                        ],\n                        \"ports\": [\n                            {\n                                \"name\": \"dns\",\n                                \"containerPort\": 53,\n                                \"protocol\": \"UDP\"\n                            },\n                            {\n                                \"name\": \"dns-tcp\",\n                                \"containerPort\": 53,\n                                \"protocol\": \"TCP\"\n                            },\n                            {\n                                \"name\": \"metrics\",\n                                \"containerPort\": 9153,\n                                \"protocol\": \"TCP\"\n                            }\n                        ],\n                        \"resources\": {\n                            \"limits\": {\n                                \"memory\": \"170Mi\"\n                            },\n                            \"requests\": {\n                                \"cpu\": \"100m\",\n                                \"memory\": \"70Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"config-volume\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/coredns\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-lkc59\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"livenessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/health\",\n                                \"port\": 8080,\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"initialDelaySeconds\": 60,\n                            \"timeoutSeconds\": 5,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 5\n                        },\n                        \"readinessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/ready\",\n                                \"port\": 8181,\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"timeoutSeconds\": 1,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 3\n                        },\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"capabilities\": {\n                                \"add\": [\n                                    \"NET_BIND_SERVICE\"\n                                ],\n                                \"drop\": [\n                                    \"all\"\n                                ]\n                            },\n                            \"readOnlyRootFilesystem\": true,\n                            \"allowPrivilegeEscalation\": false\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"Default\",\n                \"nodeSelector\": {\n                    \"kubernetes.io/os\": \"linux\"\n                },\n                \"serviceAccountName\": \"coredns\",\n                \"serviceAccount\": \"coredns\",\n                \"nodeName\": \"nodes-us-west3-a-kkxs\",\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\",\n                        \"tolerationSeconds\": 300\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\",\n                        \"tolerationSeconds\": 300\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\",\n                \"topologySpreadConstraints\": [\n                    {\n                        \"maxSkew\": 1,\n                        \"topologyKey\": \"topology.kubernetes.io/zone\",\n                        \"whenUnsatisfiable\": \"ScheduleAnyway\",\n                        \"labelSelector\": {\n                            \"matchLabels\": {\n                                \"k8s-app\": \"kube-dns\"\n                            }\n                        }\n                    },\n                    {\n                        \"maxSkew\": 1,\n                        \"topologyKey\": \"kubernetes.io/hostname\",\n                        \"whenUnsatisfiable\": \"ScheduleAnyway\",\n                        \"labelSelector\": {\n                            \"matchLabels\": {\n                                \"k8s-app\": \"kube-dns\"\n                            }\n                        }\n                    }\n                ]\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:11:04Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:11:07Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:11:07Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:11:04Z\"\n                    }\n                ],\n                \"hostIP\": \"10.0.16.3\",\n                \"podIP\": \"100.96.1.3\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"100.96.1.3\"\n                    }\n                ],\n                \"startTime\": \"2022-06-21T16:11:04Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"coredns\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2022-06-21T16:11:07Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"registry.k8s.io/coredns/coredns:v1.8.6\",\n                        \"imageID\": \"registry.k8s.io/coredns/coredns@sha256:5b6ec0d6de9baaf3e92d0f66cd96a25b9edbce8716f5f15dcd1a616b3abd590e\",\n                        \"containerID\": \"containerd://407a8a3e1e1b454ae975b16f46417e9ded40ba552b5b3f832fe4cc0da5fabb00\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-78bc9bdd66-w477l\",\n                \"generateName\": \"dns-controller-78bc9bdd66-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d1a2b4b1-8eea-4dd7-87cc-00bd030db984\",\n                \"resourceVersion\": \"432\",\n                \"creationTimestamp\": \"2022-06-21T16:10:31Z\",\n                \"labels\": {\n                    \"k8s-addon\": \"dns-controller.addons.k8s.io\",\n                    \"k8s-app\": \"dns-controller\",\n                    \"kops.k8s.io/managed-by\": \"kops\",\n                    \"pod-template-hash\": \"78bc9bdd66\",\n                    \"version\": \"v1.24.0-beta.1\"\n                },\n                \"annotations\": {\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"ReplicaSet\",\n                        \"name\": \"dns-controller-78bc9bdd66\",\n                        \"uid\": \"dcfdfc36-6c4f-46ff-b652-354a3d065ac4\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"kube-api-access-rb7s2\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"dns-controller\",\n                        \"image\": \"registry.k8s.io/kops/dns-controller:1.24.0-beta.1\",\n                        \"args\": [\n                            \"--watch-ingress=false\",\n                            \"--dns=gossip\",\n                            \"--gossip-seed=127.0.0.1:3999\",\n                            \"--gossip-protocol-secondary=memberlist\",\n                            \"--gossip-listen-secondary=0.0.0.0:3993\",\n                            \"--gossip-seed-secondary=127.0.0.1:4000\",\n                            \"--internal-ipv4\",\n                            \"--zone=*/*\",\n                            \"-v=2\"\n                        ],\n                        \"env\": [\n                            {\n                                \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                \"value\": \"127.0.0.1\"\n                            }\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"50m\",\n                                \"memory\": \"50Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"kube-api-access-rb7s2\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"runAsNonRoot\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"Default\",\n                \"serviceAccountName\": \"dns-controller\",\n                \"serviceAccount\": \"dns-controller\",\n                \"nodeName\": \"master-us-west3-a-r9rv\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"affinity\": {\n                    \"nodeAffinity\": {\n                        \"requiredDuringSchedulingIgnoredDuringExecution\": {\n                            \"nodeSelectorTerms\": [\n                                {\n                                    \"matchExpressions\": [\n                                        {\n                                            \"key\": \"node-role.kubernetes.io/control-plane\",\n                                            \"operator\": \"Exists\"\n                                        }\n                                    ]\n                                },\n                                {\n                                    \"matchExpressions\": [\n                                        {\n                                            \"key\": \"node-role.kubernetes.io/master\",\n                                            \"operator\": \"Exists\"\n                                        }\n                                    ]\n                                }\n                            ]\n                        }\n                    }\n                },\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"node.cloudprovider.kubernetes.io/uninitialized\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node-role.kubernetes.io/control-plane\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node-role.kubernetes.io/master\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\",\n                        \"tolerationSeconds\": 300\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:31Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:33Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:33Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:31Z\"\n                    }\n                ],\n                \"hostIP\": \"10.0.16.6\",\n                \"podIP\": \"10.0.16.6\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"10.0.16.6\"\n                    }\n                ],\n                \"startTime\": \"2022-06-21T16:10:31Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"dns-controller\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2022-06-21T16:10:33Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"registry.k8s.io/kops/dns-controller:1.24.0-beta.1\",\n                        \"imageID\": \"sha256:a29bae8267a3a2a81384fe9ac5544b475553bf46b7e7868e096e0ca7759435e1\",\n                        \"containerID\": \"containerd://2a78151f499cf508237cd6f4c40fa4390b8dff8fb4f8a62184069eea7588a204\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-events-master-us-west3-a-r9rv\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"73e3fadd-189d-4e0c-b6ac-3955ae1e6385\",\n                \"resourceVersion\": \"466\",\n                \"creationTimestamp\": \"2022-06-21T16:10:40Z\",\n                \"labels\": {\n                    \"k8s-app\": \"etcd-manager-events\"\n                },\n                \"annotations\": {\n                    \"kubernetes.io/config.hash\": \"b4adf7aafb8882f8999a2f7bc95f17f4\",\n                    \"kubernetes.io/config.mirror\": \"b4adf7aafb8882f8999a2f7bc95f17f4\",\n                    \"kubernetes.io/config.seen\": \"2022-06-21T16:08:53.095987821Z\",\n                    \"kubernetes.io/config.source\": \"file\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"master-us-west3-a-r9rv\",\n                        \"uid\": \"56b5306e-ee50-484c-8976-732b0c6e9403\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"rootfs\",\n                        \"hostPath\": {\n                            \"path\": \"/\",\n                            \"type\": \"Directory\"\n                        }\n                    },\n                    {\n                        \"name\": \"run\",\n                        \"hostPath\": {\n                            \"path\": \"/run\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"pki\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/kubernetes/pki/etcd-manager-events\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"varlogetcd\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/etcd-events.log\",\n                            \"type\": \"FileOrCreate\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"etcd-manager\",\n                        \"image\": \"registry.k8s.io/etcdadm/etcd-manager:v3.0.20220617\",\n                        \"command\": [\n                            \"/bin/sh\",\n                            \"-c\",\n                            \"mkfifo /tmp/pipe; (tee -a /var/log/etcd.log \\u003c /tmp/pipe \\u0026 ) ; exec /etcd-manager --backup-store=gs://gce-gci-upg-1-4-1-3-ctl-skew-state-b2/e2e-e2e-kops-gce-stable.k8s.local/backups/etcd/events --client-urls=https://__name__:4002 --cluster-name=etcd-events --containerized=true --dns-suffix=internal.e2e-e2e-kops-gce-stable.k8s.local --grpc-port=3997 --peer-urls=https://__name__:2381 --quarantine-client-urls=https://__name__:3995 --v=6 --volume-name-tag=k8s-io-etcd-events --volume-provider=gce --volume-tag=k8s-io-cluster-name=e2e-e2e-kops-gce-stable-k8s-local --volume-tag=k8s-io-etcd-events --volume-tag=k8s-io-role-master=master \\u003e /tmp/pipe 2\\u003e\\u00261\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"100m\",\n                                \"memory\": \"100Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"rootfs\",\n                                \"mountPath\": \"/rootfs\"\n                            },\n                            {\n                                \"name\": \"run\",\n                                \"mountPath\": \"/run\"\n                            },\n                            {\n                                \"name\": \"pki\",\n                                \"mountPath\": \"/etc/kubernetes/pki/etcd-manager\"\n                            },\n                            {\n                                \"name\": \"varlogetcd\",\n                                \"mountPath\": \"/var/log/etcd.log\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"master-us-west3-a-r9rv\",\n                \"hostNetwork\": true,\n                \"hostPID\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:08:55Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:09:28Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:09:28Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:08:55Z\"\n                    }\n                ],\n                \"hostIP\": \"10.0.16.6\",\n                \"podIP\": \"10.0.16.6\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"10.0.16.6\"\n                    }\n                ],\n                \"startTime\": \"2022-06-21T16:08:55Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"etcd-manager\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2022-06-21T16:09:27Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"registry.k8s.io/etcdadm/etcd-manager:v3.0.20220617\",\n                        \"imageID\": \"registry.k8s.io/etcdadm/etcd-manager@sha256:0c7f0f377fe216f3687a7690dffa82fc419e1ef1e3f409e95cf4cef528d83d0e\",\n                        \"containerID\": \"containerd://95861955de6c4e73018f9902df0c2f186384bc791d01d29ce91b529255af0bc7\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-main-master-us-west3-a-r9rv\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"da30efdf-977c-4112-80c8-6b9f4a06e872\",\n                \"resourceVersion\": \"467\",\n                \"creationTimestamp\": \"2022-06-21T16:10:38Z\",\n                \"labels\": {\n                    \"k8s-app\": \"etcd-manager-main\"\n                },\n                \"annotations\": {\n                    \"kubernetes.io/config.hash\": \"c6fa4860c9664184ce974ea04eda29de\",\n                    \"kubernetes.io/config.mirror\": \"c6fa4860c9664184ce974ea04eda29de\",\n                    \"kubernetes.io/config.seen\": \"2022-06-21T16:08:53.096048203Z\",\n                    \"kubernetes.io/config.source\": \"file\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"master-us-west3-a-r9rv\",\n                        \"uid\": \"56b5306e-ee50-484c-8976-732b0c6e9403\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"rootfs\",\n                        \"hostPath\": {\n                            \"path\": \"/\",\n                            \"type\": \"Directory\"\n                        }\n                    },\n                    {\n                        \"name\": \"run\",\n                        \"hostPath\": {\n                            \"path\": \"/run\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"pki\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/kubernetes/pki/etcd-manager-main\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"varlogetcd\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/etcd.log\",\n                            \"type\": \"FileOrCreate\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"etcd-manager\",\n                        \"image\": \"registry.k8s.io/etcdadm/etcd-manager:v3.0.20220617\",\n                        \"command\": [\n                            \"/bin/sh\",\n                            \"-c\",\n                            \"mkfifo /tmp/pipe; (tee -a /var/log/etcd.log \\u003c /tmp/pipe \\u0026 ) ; exec /etcd-manager --backup-store=gs://gce-gci-upg-1-4-1-3-ctl-skew-state-b2/e2e-e2e-kops-gce-stable.k8s.local/backups/etcd/main --client-urls=https://__name__:4001 --cluster-name=etcd --containerized=true --dns-suffix=internal.e2e-e2e-kops-gce-stable.k8s.local --grpc-port=3996 --peer-urls=https://__name__:2380 --quarantine-client-urls=https://__name__:3994 --v=6 --volume-name-tag=k8s-io-etcd-main --volume-provider=gce --volume-tag=k8s-io-cluster-name=e2e-e2e-kops-gce-stable-k8s-local --volume-tag=k8s-io-etcd-main --volume-tag=k8s-io-role-master=master \\u003e /tmp/pipe 2\\u003e\\u00261\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"200m\",\n                                \"memory\": \"100Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"rootfs\",\n                                \"mountPath\": \"/rootfs\"\n                            },\n                            {\n                                \"name\": \"run\",\n                                \"mountPath\": \"/run\"\n                            },\n                            {\n                                \"name\": \"pki\",\n                                \"mountPath\": \"/etc/kubernetes/pki/etcd-manager\"\n                            },\n                            {\n                                \"name\": \"varlogetcd\",\n                                \"mountPath\": \"/var/log/etcd.log\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"master-us-west3-a-r9rv\",\n                \"hostNetwork\": true,\n                \"hostPID\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:08:55Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:09:28Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:09:28Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:08:55Z\"\n                    }\n                ],\n                \"hostIP\": \"10.0.16.6\",\n                \"podIP\": \"10.0.16.6\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"10.0.16.6\"\n                    }\n                ],\n                \"startTime\": \"2022-06-21T16:08:55Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"etcd-manager\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2022-06-21T16:09:27Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"registry.k8s.io/etcdadm/etcd-manager:v3.0.20220617\",\n                        \"imageID\": \"registry.k8s.io/etcdadm/etcd-manager@sha256:0c7f0f377fe216f3687a7690dffa82fc419e1ef1e3f409e95cf4cef528d83d0e\",\n                        \"containerID\": \"containerd://31881d0ff81ce48d86f1e0e72c7e2170b4cec8e99b970ca7b172d686da1f4f1d\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller-tg4pc\",\n                \"generateName\": \"kops-controller-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"1a135518-bb72-42df-9b34-50bc4382b6fd\",\n                \"resourceVersion\": \"424\",\n                \"creationTimestamp\": \"2022-06-21T16:10:31Z\",\n                \"labels\": {\n                    \"controller-revision-hash\": \"76f46ff48c\",\n                    \"k8s-addon\": \"kops-controller.addons.k8s.io\",\n                    \"k8s-app\": \"kops-controller\",\n                    \"kops.k8s.io/managed-by\": \"kops\",\n                    \"pod-template-generation\": \"1\",\n                    \"version\": \"v1.24.0-beta.1\"\n                },\n                \"annotations\": {\n                    \"dns.alpha.kubernetes.io/internal\": \"kops-controller.internal.e2e-e2e-kops-gce-stable.k8s.local\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"DaemonSet\",\n                        \"name\": \"kops-controller\",\n                        \"uid\": \"a2622863-3a45-44bd-80d2-abeca9b345f4\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"kops-controller-config\",\n                        \"configMap\": {\n                            \"name\": \"kops-controller\",\n                            \"defaultMode\": 420\n                        }\n                    },\n                    {\n                        \"name\": \"kops-controller-pki\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/kubernetes/kops-controller/\",\n                            \"type\": \"Directory\"\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-gftgg\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kops-controller\",\n                        \"image\": \"registry.k8s.io/kops/kops-controller:1.24.0-beta.1\",\n                        \"args\": [\n                            \"--v=2\",\n                            \"--conf=/etc/kubernetes/kops-controller/config/config.yaml\"\n                        ],\n                        \"env\": [\n                            {\n                                \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                \"value\": \"127.0.0.1\"\n                            }\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"50m\",\n                                \"memory\": \"50Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"kops-controller-config\",\n                                \"mountPath\": \"/etc/kubernetes/kops-controller/config/\"\n                            },\n                            {\n                                \"name\": \"kops-controller-pki\",\n                                \"mountPath\": \"/etc/kubernetes/kops-controller/pki/\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-gftgg\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"runAsUser\": 10011,\n                            \"runAsNonRoot\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"Default\",\n                \"serviceAccountName\": \"kops-controller\",\n                \"serviceAccount\": \"kops-controller\",\n                \"nodeName\": \"master-us-west3-a-r9rv\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"affinity\": {\n                    \"nodeAffinity\": {\n                        \"requiredDuringSchedulingIgnoredDuringExecution\": {\n                            \"nodeSelectorTerms\": [\n                                {\n                                    \"matchFields\": [\n                                        {\n                                            \"key\": \"metadata.name\",\n                                            \"operator\": \"In\",\n                                            \"values\": [\n                                                \"master-us-west3-a-r9rv\"\n                                            ]\n                                        }\n                                    ]\n                                }\n                            ]\n                        }\n                    }\n                },\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"node.cloudprovider.kubernetes.io/uninitialized\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node-role.kubernetes.io/master\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node-role.kubernetes.io/control-plane\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/disk-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/memory-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/pid-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unschedulable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/network-unavailable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:31Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:33Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:33Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:31Z\"\n                    }\n                ],\n                \"hostIP\": \"10.0.16.6\",\n                \"podIP\": \"10.0.16.6\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"10.0.16.6\"\n                    }\n                ],\n                \"startTime\": \"2022-06-21T16:10:31Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"kops-controller\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2022-06-21T16:10:32Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"registry.k8s.io/kops/kops-controller:1.24.0-beta.1\",\n                        \"imageID\": \"sha256:ea1aaf782ea6104df2ebb9884e57c0a37f2183214fd309f18c4fb3d643bd4e42\",\n                        \"containerID\": \"containerd://07a71a759f22e557a30ce6eeca0d0bcc0ecda8ef6e01319100e209426ab9c74f\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-master-us-west3-a-r9rv\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"2f68cc21-b09c-4cf1-8d17-e4c716f13df4\",\n                \"resourceVersion\": \"520\",\n                \"creationTimestamp\": \"2022-06-21T16:10:48Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-apiserver\"\n                },\n                \"annotations\": {\n                    \"dns.alpha.kubernetes.io/internal\": \"api.internal.e2e-e2e-kops-gce-stable.k8s.local\",\n                    \"kubectl.kubernetes.io/default-container\": \"kube-apiserver\",\n                    \"kubernetes.io/config.hash\": \"2297c46584e8c3c73a93ef572c640fa1\",\n                    \"kubernetes.io/config.mirror\": \"2297c46584e8c3c73a93ef572c640fa1\",\n                    \"kubernetes.io/config.seen\": \"2022-06-21T16:08:53.096050453Z\",\n                    \"kubernetes.io/config.source\": \"file\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"master-us-west3-a-r9rv\",\n                        \"uid\": \"56b5306e-ee50-484c-8976-732b0c6e9403\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"logfile\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/kube-apiserver.log\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etcssl\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/ssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etcpkitls\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/pki/tls\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etcpkica-trust\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/pki/ca-trust\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"usrsharessl\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/share/ssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"usrssl\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/ssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"usrlibssl\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/lib/ssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"usrlocalopenssl\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/local/openssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"varssl\",\n                        \"hostPath\": {\n                            \"path\": \"/var/ssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etcopenssl\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/openssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"cloudconfig\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/kubernetes/in-tree-cloud.config\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"kubernetesca\",\n                        \"hostPath\": {\n                            \"path\": \"/srv/kubernetes/ca.crt\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"srvkapi\",\n                        \"hostPath\": {\n                            \"path\": \"/srv/kubernetes/kube-apiserver\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"srvsshproxy\",\n                        \"hostPath\": {\n                            \"path\": \"/srv/sshproxy\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"healthcheck-secrets\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/kubernetes/kube-apiserver-healthcheck/secrets\",\n                            \"type\": \"Directory\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kube-apiserver\",\n                        \"image\": \"registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.1\",\n                        \"command\": [\n                            \"/go-runner\"\n                        ],\n                        \"args\": [\n                            \"--log-file=/var/log/kube-apiserver.log\",\n                            \"--also-stdout\",\n                            \"/usr/local/bin/kube-apiserver\",\n                            \"--allow-privileged=true\",\n                            \"--anonymous-auth=false\",\n                            \"--api-audiences=kubernetes.svc.default\",\n                            \"--apiserver-count=1\",\n                            \"--authorization-mode=Node,RBAC\",\n                            \"--bind-address=0.0.0.0\",\n                            \"--client-ca-file=/srv/kubernetes/ca.crt\",\n                            \"--cloud-config=/etc/kubernetes/in-tree-cloud.config\",\n                            \"--cloud-provider=external\",\n                            \"--enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,NodeRestriction,ResourceQuota\",\n                            \"--etcd-cafile=/srv/kubernetes/kube-apiserver/etcd-ca.crt\",\n                            \"--etcd-certfile=/srv/kubernetes/kube-apiserver/etcd-client.crt\",\n                            \"--etcd-keyfile=/srv/kubernetes/kube-apiserver/etcd-client.key\",\n                            \"--etcd-servers-overrides=/events#https://127.0.0.1:4002\",\n                            \"--etcd-servers=https://127.0.0.1:4001\",\n                            \"--kubelet-client-certificate=/srv/kubernetes/kube-apiserver/kubelet-api.crt\",\n                            \"--kubelet-client-key=/srv/kubernetes/kube-apiserver/kubelet-api.key\",\n                            \"--kubelet-preferred-address-types=InternalIP,Hostname,ExternalIP\",\n                            \"--proxy-client-cert-file=/srv/kubernetes/kube-apiserver/apiserver-aggregator.crt\",\n                            \"--proxy-client-key-file=/srv/kubernetes/kube-apiserver/apiserver-aggregator.key\",\n                            \"--requestheader-allowed-names=aggregator\",\n                            \"--requestheader-client-ca-file=/srv/kubernetes/kube-apiserver/apiserver-aggregator-ca.crt\",\n                            \"--requestheader-extra-headers-prefix=X-Remote-Extra-\",\n                            \"--requestheader-group-headers=X-Remote-Group\",\n                            \"--requestheader-username-headers=X-Remote-User\",\n                            \"--secure-port=443\",\n                            \"--service-account-issuer=https://api.internal.e2e-e2e-kops-gce-stable.k8s.local\",\n                            \"--service-account-jwks-uri=https://api.internal.e2e-e2e-kops-gce-stable.k8s.local/openid/v1/jwks\",\n                            \"--service-account-key-file=/srv/kubernetes/kube-apiserver/service-account.pub\",\n                            \"--service-account-signing-key-file=/srv/kubernetes/kube-apiserver/service-account.key\",\n                            \"--service-cluster-ip-range=100.64.0.0/13\",\n                            \"--storage-backend=etcd3\",\n                            \"--tls-cert-file=/srv/kubernetes/kube-apiserver/server.crt\",\n                            \"--tls-private-key-file=/srv/kubernetes/kube-apiserver/server.key\",\n                            \"--v=2\"\n                        ],\n                        \"ports\": [\n                            {\n                                \"name\": \"https\",\n                                \"hostPort\": 443,\n                                \"containerPort\": 443,\n                                \"protocol\": \"TCP\"\n                            }\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"150m\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"logfile\",\n                                \"mountPath\": \"/var/log/kube-apiserver.log\"\n                            },\n                            {\n                                \"name\": \"etcssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/ssl\"\n                            },\n                            {\n                                \"name\": \"etcpkitls\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/pki/tls\"\n                            },\n                            {\n                                \"name\": \"etcpkica-trust\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/pki/ca-trust\"\n                            },\n                            {\n                                \"name\": \"usrsharessl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/usr/share/ssl\"\n                            },\n                            {\n                                \"name\": \"usrssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/usr/ssl\"\n                            },\n                            {\n                                \"name\": \"usrlibssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/usr/lib/ssl\"\n                            },\n                            {\n                                \"name\": \"usrlocalopenssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/usr/local/openssl\"\n                            },\n                            {\n                                \"name\": \"varssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/ssl\"\n                            },\n                            {\n                                \"name\": \"etcopenssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/openssl\"\n                            },\n                            {\n                                \"name\": \"cloudconfig\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/kubernetes/in-tree-cloud.config\"\n                            },\n                            {\n                                \"name\": \"kubernetesca\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/srv/kubernetes/ca.crt\"\n                            },\n                            {\n                                \"name\": \"srvkapi\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/srv/kubernetes/kube-apiserver\"\n                            },\n                            {\n                                \"name\": \"srvsshproxy\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/srv/sshproxy\"\n                            }\n                        ],\n                        \"livenessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/healthz\",\n                                \"port\": 3990,\n                                \"host\": \"127.0.0.1\",\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"initialDelaySeconds\": 45,\n                            \"timeoutSeconds\": 15,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 3\n                        },\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\"\n                    },\n                    {\n                        \"name\": \"healthcheck\",\n                        \"image\": \"registry.k8s.io/kops/kube-apiserver-healthcheck:1.24.0-beta.1\",\n                        \"args\": [\n                            \"--ca-cert=/secrets/ca.crt\",\n                            \"--client-cert=/secrets/client.crt\",\n                            \"--client-key=/secrets/client.key\"\n                        ],\n                        \"resources\": {},\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"healthcheck-secrets\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/secrets\"\n                            }\n                        ],\n                        \"livenessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/.kube-apiserver-healthcheck/healthz\",\n                                \"port\": 3990,\n                                \"host\": \"127.0.0.1\",\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"initialDelaySeconds\": 5,\n                            \"timeoutSeconds\": 5,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 3\n                        },\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"runAsUser\": 10012,\n                            \"runAsNonRoot\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"master-us-west3-a-r9rv\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:08:55Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:09:40Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:09:40Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:08:55Z\"\n                    }\n                ],\n                \"hostIP\": \"10.0.16.6\",\n                \"podIP\": \"10.0.16.6\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"10.0.16.6\"\n                    }\n                ],\n                \"startTime\": \"2022-06-21T16:08:55Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"healthcheck\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2022-06-21T16:09:18Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"registry.k8s.io/kops/kube-apiserver-healthcheck:1.24.0-beta.1\",\n                        \"imageID\": \"sha256:eb55e59b79f173f34417ed9342c9a2efc65a1a2b0504a40d373b82bccdd4bd0b\",\n                        \"containerID\": \"containerd://7c9342e4911166f9833c31d80414a0ec41c66010e2f3c084a11d0e99e758727c\",\n                        \"started\": true\n                    },\n                    {\n                        \"name\": \"kube-apiserver\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2022-06-21T16:09:39Z\"\n                            }\n                        },\n                        \"lastState\": {\n                            \"terminated\": {\n                                \"exitCode\": 1,\n                                \"reason\": \"Error\",\n                                \"startedAt\": \"2022-06-21T16:09:18Z\",\n                                \"finishedAt\": \"2022-06-21T16:09:39Z\",\n                                \"containerID\": \"containerd://ea72354b332a05a3033457c14e051aba85140fdcd98cc9a5c481ed224d510542\"\n                            }\n                        },\n                        \"ready\": true,\n                        \"restartCount\": 1,\n                        \"image\": \"registry.k8s.io/kube-apiserver-amd64:v1.25.0-alpha.1\",\n                        \"imageID\": \"registry.k8s.io/kube-apiserver-amd64@sha256:d4c3cad3403c59c95837e40f55afe96fd832e23a05c12f92829b050c4ef5a4b2\",\n                        \"containerID\": \"containerd://928c5d293c4380e44545a3adbb0f5b5f6015e2b27fa2738dbfab076b18c8fd79\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-controller-manager-master-us-west3-a-r9rv\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"6fa4a700-38ea-417d-ac80-42d1f8fd1843\",\n                \"resourceVersion\": \"437\",\n                \"creationTimestamp\": \"2022-06-21T16:10:17Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-controller-manager\"\n                },\n                \"annotations\": {\n                    \"kubernetes.io/config.hash\": \"e66f719851dd2c0b7b99a35fd671b7d9\",\n                    \"kubernetes.io/config.mirror\": \"e66f719851dd2c0b7b99a35fd671b7d9\",\n                    \"kubernetes.io/config.seen\": \"2022-06-21T16:08:53.096054477Z\",\n                    \"kubernetes.io/config.source\": \"file\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"master-us-west3-a-r9rv\",\n                        \"uid\": \"56b5306e-ee50-484c-8976-732b0c6e9403\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"logfile\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/kube-controller-manager.log\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etcssl\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/ssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etcpkitls\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/pki/tls\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etcpkica-trust\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/pki/ca-trust\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"usrsharessl\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/share/ssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"usrssl\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/ssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"usrlibssl\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/lib/ssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"usrlocalopenssl\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/local/openssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"varssl\",\n                        \"hostPath\": {\n                            \"path\": \"/var/ssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etcopenssl\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/openssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"cloudconfig\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/kubernetes/in-tree-cloud.config\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"cabundle\",\n                        \"hostPath\": {\n                            \"path\": \"/srv/kubernetes/ca.crt\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"srvkcm\",\n                        \"hostPath\": {\n                            \"path\": \"/srv/kubernetes/kube-controller-manager\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"varlibkcm\",\n                        \"hostPath\": {\n                            \"path\": \"/var/lib/kube-controller-manager\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"volplugins\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/libexec/kubernetes/kubelet-plugins/volume/exec/\",\n                            \"type\": \"\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kube-controller-manager\",\n                        \"image\": \"registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.1\",\n                        \"command\": [\n                            \"/go-runner\"\n                        ],\n                        \"args\": [\n                            \"--log-file=/var/log/kube-controller-manager.log\",\n                            \"--also-stdout\",\n                            \"/usr/local/bin/kube-controller-manager\",\n                            \"--allocate-node-cidrs=true\",\n                            \"--attach-detach-reconcile-sync-period=1m0s\",\n                            \"--authentication-kubeconfig=/var/lib/kube-controller-manager/kubeconfig\",\n                            \"--authorization-kubeconfig=/var/lib/kube-controller-manager/kubeconfig\",\n                            \"--cloud-config=/etc/kubernetes/in-tree-cloud.config\",\n                            \"--cloud-provider=external\",\n                            \"--cluster-cidr=100.96.0.0/11\",\n                            \"--cluster-name=e2e-e2e-kops-gce-stable.k8s.local\",\n                            \"--cluster-signing-cert-file=/srv/kubernetes/kube-controller-manager/ca.crt\",\n                            \"--cluster-signing-key-file=/srv/kubernetes/kube-controller-manager/ca.key\",\n                            \"--configure-cloud-routes=true\",\n                            \"--flex-volume-plugin-dir=/usr/libexec/kubernetes/kubelet-plugins/volume/exec/\",\n                            \"--kubeconfig=/var/lib/kube-controller-manager/kubeconfig\",\n                            \"--leader-elect=true\",\n                            \"--root-ca-file=/srv/kubernetes/ca.crt\",\n                            \"--service-account-private-key-file=/srv/kubernetes/kube-controller-manager/service-account.key\",\n                            \"--tls-cert-file=/srv/kubernetes/kube-controller-manager/server.crt\",\n                            \"--tls-private-key-file=/srv/kubernetes/kube-controller-manager/server.key\",\n                            \"--use-service-account-credentials=true\",\n                            \"--v=2\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"100m\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"logfile\",\n                                \"mountPath\": \"/var/log/kube-controller-manager.log\"\n                            },\n                            {\n                                \"name\": \"etcssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/ssl\"\n                            },\n                            {\n                                \"name\": \"etcpkitls\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/pki/tls\"\n                            },\n                            {\n                                \"name\": \"etcpkica-trust\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/pki/ca-trust\"\n                            },\n                            {\n                                \"name\": \"usrsharessl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/usr/share/ssl\"\n                            },\n                            {\n                                \"name\": \"usrssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/usr/ssl\"\n                            },\n                            {\n                                \"name\": \"usrlibssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/usr/lib/ssl\"\n                            },\n                            {\n                                \"name\": \"usrlocalopenssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/usr/local/openssl\"\n                            },\n                            {\n                                \"name\": \"varssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/ssl\"\n                            },\n                            {\n                                \"name\": \"etcopenssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/openssl\"\n                            },\n                            {\n                                \"name\": \"cloudconfig\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/kubernetes/in-tree-cloud.config\"\n                            },\n                            {\n                                \"name\": \"cabundle\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/srv/kubernetes/ca.crt\"\n                            },\n                            {\n                                \"name\": \"srvkcm\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/srv/kubernetes/kube-controller-manager\"\n                            },\n                            {\n                                \"name\": \"varlibkcm\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/lib/kube-controller-manager\"\n                            },\n                            {\n                                \"name\": \"volplugins\",\n                                \"mountPath\": \"/usr/libexec/kubernetes/kubelet-plugins/volume/exec/\"\n                            }\n                        ],\n                        \"livenessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/healthz\",\n                                \"port\": 10257,\n                                \"host\": \"127.0.0.1\",\n                                \"scheme\": \"HTTPS\"\n                            },\n                            \"initialDelaySeconds\": 15,\n                            \"timeoutSeconds\": 15,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 3\n                        },\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\"\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"master-us-west3-a-r9rv\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:08:55Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:18Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:18Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:08:55Z\"\n                    }\n                ],\n                \"hostIP\": \"10.0.16.6\",\n                \"podIP\": \"10.0.16.6\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"10.0.16.6\"\n                    }\n                ],\n                \"startTime\": \"2022-06-21T16:08:55Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"kube-controller-manager\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2022-06-21T16:10:17Z\"\n                            }\n                        },\n                        \"lastState\": {\n                            \"terminated\": {\n                                \"exitCode\": 1,\n                                \"reason\": \"Error\",\n                                \"startedAt\": \"2022-06-21T16:09:42Z\",\n                                \"finishedAt\": \"2022-06-21T16:09:53Z\",\n                                \"containerID\": \"containerd://42dd76ed70a4244423b62b35aabad150956a31f69ced7a5f959fa5bef46b9ee3\"\n                            }\n                        },\n                        \"ready\": true,\n                        \"restartCount\": 3,\n                        \"image\": \"registry.k8s.io/kube-controller-manager-amd64:v1.25.0-alpha.1\",\n                        \"imageID\": \"registry.k8s.io/kube-controller-manager-amd64@sha256:af17d2792986389543fd283c97492af20fc5581a2d115a3f932501be89a74c7f\",\n                        \"containerID\": \"containerd://b0f76d101d56ffe07230c75d5713d93f2766a7392993ed718b8faf072868cefa\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-master-us-west3-a-r9rv\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"14dc1dff-8292-421a-b985-74c59141686d\",\n                \"resourceVersion\": \"465\",\n                \"creationTimestamp\": \"2022-06-21T16:10:37Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-proxy\",\n                    \"kubernetes.io/managed-by\": \"nodeup\",\n                    \"tier\": \"node\"\n                },\n                \"annotations\": {\n                    \"kubernetes.io/config.hash\": \"9c3ce56ef3d3b39239938dbe8b72bd89\",\n                    \"kubernetes.io/config.mirror\": \"9c3ce56ef3d3b39239938dbe8b72bd89\",\n                    \"kubernetes.io/config.seen\": \"2022-06-21T16:08:53.096056622Z\",\n                    \"kubernetes.io/config.source\": \"file\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"master-us-west3-a-r9rv\",\n                        \"uid\": \"56b5306e-ee50-484c-8976-732b0c6e9403\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"logfile\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/kube-proxy.log\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"kubeconfig\",\n                        \"hostPath\": {\n                            \"path\": \"/var/lib/kube-proxy/kubeconfig\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"modules\",\n                        \"hostPath\": {\n                            \"path\": \"/lib/modules\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"ssl-certs-hosts\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/share/ca-certificates\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etchosts\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/hosts\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"iptableslock\",\n                        \"hostPath\": {\n                            \"path\": \"/run/xtables.lock\",\n                            \"type\": \"FileOrCreate\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kube-proxy\",\n                        \"image\": \"registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1\",\n                        \"command\": [\n                            \"/go-runner\"\n                        ],\n                        \"args\": [\n                            \"--log-file=/var/log/kube-proxy.log\",\n                            \"--also-stdout\",\n                            \"/usr/local/bin/kube-proxy\",\n                            \"--cluster-cidr=100.96.0.0/11\",\n                            \"--conntrack-max-per-core=131072\",\n                            \"--hostname-override=master-us-west3-a-r9rv\",\n                            \"--kubeconfig=/var/lib/kube-proxy/kubeconfig\",\n                            \"--master=https://127.0.0.1\",\n                            \"--oom-score-adj=-998\",\n                            \"--v=2\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"100m\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"logfile\",\n                                \"mountPath\": \"/var/log/kube-proxy.log\"\n                            },\n                            {\n                                \"name\": \"kubeconfig\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/lib/kube-proxy/kubeconfig\"\n                            },\n                            {\n                                \"name\": \"modules\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/lib/modules\"\n                            },\n                            {\n                                \"name\": \"ssl-certs-hosts\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/ssl/certs\"\n                            },\n                            {\n                                \"name\": \"etchosts\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/hosts\"\n                            },\n                            {\n                                \"name\": \"iptableslock\",\n                                \"mountPath\": \"/run/xtables.lock\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"master-us-west3-a-r9rv\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:08:55Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:09:28Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:09:28Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:08:55Z\"\n                    }\n                ],\n                \"hostIP\": \"10.0.16.6\",\n                \"podIP\": \"10.0.16.6\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"10.0.16.6\"\n                    }\n                ],\n                \"startTime\": \"2022-06-21T16:08:55Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"kube-proxy\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2022-06-21T16:09:28Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1\",\n                        \"imageID\": \"registry.k8s.io/kube-proxy-amd64@sha256:012e1a75e246463f6b28e544844e4f6e420c3b6846acecc56460ceafb108d707\",\n                        \"containerID\": \"containerd://38f2da71c3cf569b9aa75ada4dcaf0954ce4ec52565459f24d45dd9ce6a494f3\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-nodes-us-west3-a-12tt\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"b3a398ba-007e-4672-a8eb-8bab0d084143\",\n                \"resourceVersion\": \"938\",\n                \"creationTimestamp\": \"2022-06-21T16:12:05Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-proxy\",\n                    \"kubernetes.io/managed-by\": \"nodeup\",\n                    \"tier\": \"node\"\n                },\n                \"annotations\": {\n                    \"kubernetes.io/config.hash\": \"0ca802dcd1823fa9d738dbdfb9f1b936\",\n                    \"kubernetes.io/config.mirror\": \"0ca802dcd1823fa9d738dbdfb9f1b936\",\n                    \"kubernetes.io/config.seen\": \"2022-06-21T16:10:45.964013325Z\",\n                    \"kubernetes.io/config.source\": \"file\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"nodes-us-west3-a-12tt\",\n                        \"uid\": \"f1c0ebf7-12e6-4ad8-9f72-7099567d2ef5\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"logfile\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/kube-proxy.log\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"kubeconfig\",\n                        \"hostPath\": {\n                            \"path\": \"/var/lib/kube-proxy/kubeconfig\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"modules\",\n                        \"hostPath\": {\n                            \"path\": \"/lib/modules\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"ssl-certs-hosts\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/share/ca-certificates\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etchosts\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/hosts\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"iptableslock\",\n                        \"hostPath\": {\n                            \"path\": \"/run/xtables.lock\",\n                            \"type\": \"FileOrCreate\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kube-proxy\",\n                        \"image\": \"registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1\",\n                        \"command\": [\n                            \"/go-runner\"\n                        ],\n                        \"args\": [\n                            \"--log-file=/var/log/kube-proxy.log\",\n                            \"--also-stdout\",\n                            \"/usr/local/bin/kube-proxy\",\n                            \"--cluster-cidr=100.96.0.0/11\",\n                            \"--conntrack-max-per-core=131072\",\n                            \"--hostname-override=nodes-us-west3-a-12tt\",\n                            \"--kubeconfig=/var/lib/kube-proxy/kubeconfig\",\n                            \"--master=https://api.internal.e2e-e2e-kops-gce-stable.k8s.local\",\n                            \"--oom-score-adj=-998\",\n                            \"--v=2\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"100m\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"logfile\",\n                                \"mountPath\": \"/var/log/kube-proxy.log\"\n                            },\n                            {\n                                \"name\": \"kubeconfig\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/lib/kube-proxy/kubeconfig\"\n                            },\n                            {\n                                \"name\": \"modules\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/lib/modules\"\n                            },\n                            {\n                                \"name\": \"ssl-certs-hosts\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/ssl/certs\"\n                            },\n                            {\n                                \"name\": \"etchosts\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/hosts\"\n                            },\n                            {\n                                \"name\": \"iptableslock\",\n                                \"mountPath\": \"/run/xtables.lock\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"nodes-us-west3-a-12tt\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:47Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:49Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:49Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:47Z\"\n                    }\n                ],\n                \"hostIP\": \"10.0.16.5\",\n                \"podIP\": \"10.0.16.5\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"10.0.16.5\"\n                    }\n                ],\n                \"startTime\": \"2022-06-21T16:10:47Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"kube-proxy\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2022-06-21T16:10:49Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1\",\n                        \"imageID\": \"sha256:4968be58436782433141cb249803b8c2183e3779a9f395a5a29580ce1201edf9\",\n                        \"containerID\": \"containerd://8776997e8e4e7715e95e3cb7ce3a758fc0f69197b22b4f0c3c47ad60ced2946f\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-nodes-us-west3-a-kkxs\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"99cb438b-7326-4bb9-bf2c-ff8a2589149e\",\n                \"resourceVersion\": \"1019\",\n                \"creationTimestamp\": \"2022-06-21T16:12:23Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-proxy\",\n                    \"kubernetes.io/managed-by\": \"nodeup\",\n                    \"tier\": \"node\"\n                },\n                \"annotations\": {\n                    \"kubernetes.io/config.hash\": \"16cc5bef3f1cdb02a6f1af724e9096be\",\n                    \"kubernetes.io/config.mirror\": \"16cc5bef3f1cdb02a6f1af724e9096be\",\n                    \"kubernetes.io/config.seen\": \"2022-06-21T16:10:49.025247815Z\",\n                    \"kubernetes.io/config.source\": \"file\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"nodes-us-west3-a-kkxs\",\n                        \"uid\": \"c1f7f7b7-5c99-4dc6-9420-ba8aa33795d7\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"logfile\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/kube-proxy.log\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"kubeconfig\",\n                        \"hostPath\": {\n                            \"path\": \"/var/lib/kube-proxy/kubeconfig\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"modules\",\n                        \"hostPath\": {\n                            \"path\": \"/lib/modules\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"ssl-certs-hosts\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/share/ca-certificates\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etchosts\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/hosts\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"iptableslock\",\n                        \"hostPath\": {\n                            \"path\": \"/run/xtables.lock\",\n                            \"type\": \"FileOrCreate\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kube-proxy\",\n                        \"image\": \"registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1\",\n                        \"command\": [\n                            \"/go-runner\"\n                        ],\n                        \"args\": [\n                            \"--log-file=/var/log/kube-proxy.log\",\n                            \"--also-stdout\",\n                            \"/usr/local/bin/kube-proxy\",\n                            \"--cluster-cidr=100.96.0.0/11\",\n                            \"--conntrack-max-per-core=131072\",\n                            \"--hostname-override=nodes-us-west3-a-kkxs\",\n                            \"--kubeconfig=/var/lib/kube-proxy/kubeconfig\",\n                            \"--master=https://api.internal.e2e-e2e-kops-gce-stable.k8s.local\",\n                            \"--oom-score-adj=-998\",\n                            \"--v=2\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"100m\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"logfile\",\n                                \"mountPath\": \"/var/log/kube-proxy.log\"\n                            },\n                            {\n                                \"name\": \"kubeconfig\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/lib/kube-proxy/kubeconfig\"\n                            },\n                            {\n                                \"name\": \"modules\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/lib/modules\"\n                            },\n                            {\n                                \"name\": \"ssl-certs-hosts\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/ssl/certs\"\n                            },\n                            {\n                                \"name\": \"etchosts\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/hosts\"\n                            },\n                            {\n                                \"name\": \"iptableslock\",\n                                \"mountPath\": \"/run/xtables.lock\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"nodes-us-west3-a-kkxs\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:52Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:54Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:54Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:52Z\"\n                    }\n                ],\n                \"hostIP\": \"10.0.16.3\",\n                \"podIP\": \"10.0.16.3\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"10.0.16.3\"\n                    }\n                ],\n                \"startTime\": \"2022-06-21T16:10:52Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"kube-proxy\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2022-06-21T16:10:53Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1\",\n                        \"imageID\": \"sha256:4968be58436782433141cb249803b8c2183e3779a9f395a5a29580ce1201edf9\",\n                        \"containerID\": \"containerd://4fe7e7cf3aaa799ff518c3a2cd2ac6118208a2bc2ba48f3b1ba253d5e0116f94\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-nodes-us-west3-a-rbw1\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f9c0ec2e-8b60-4a3e-a2e8-b913bcd8c3db\",\n                \"resourceVersion\": \"942\",\n                \"creationTimestamp\": \"2022-06-21T16:11:57Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-proxy\",\n                    \"kubernetes.io/managed-by\": \"nodeup\",\n                    \"tier\": \"node\"\n                },\n                \"annotations\": {\n                    \"kubernetes.io/config.hash\": \"19e6fc35da11e030ac6049153565a0a4\",\n                    \"kubernetes.io/config.mirror\": \"19e6fc35da11e030ac6049153565a0a4\",\n                    \"kubernetes.io/config.seen\": \"2022-06-21T16:10:47.069798556Z\",\n                    \"kubernetes.io/config.source\": \"file\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"nodes-us-west3-a-rbw1\",\n                        \"uid\": \"f04931c2-c4fc-4458-a6d2-44da08f780cd\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"logfile\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/kube-proxy.log\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"kubeconfig\",\n                        \"hostPath\": {\n                            \"path\": \"/var/lib/kube-proxy/kubeconfig\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"modules\",\n                        \"hostPath\": {\n                            \"path\": \"/lib/modules\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"ssl-certs-hosts\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/share/ca-certificates\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etchosts\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/hosts\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"iptableslock\",\n                        \"hostPath\": {\n                            \"path\": \"/run/xtables.lock\",\n                            \"type\": \"FileOrCreate\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kube-proxy\",\n                        \"image\": \"registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1\",\n                        \"command\": [\n                            \"/go-runner\"\n                        ],\n                        \"args\": [\n                            \"--log-file=/var/log/kube-proxy.log\",\n                            \"--also-stdout\",\n                            \"/usr/local/bin/kube-proxy\",\n                            \"--cluster-cidr=100.96.0.0/11\",\n                            \"--conntrack-max-per-core=131072\",\n                            \"--hostname-override=nodes-us-west3-a-rbw1\",\n                            \"--kubeconfig=/var/lib/kube-proxy/kubeconfig\",\n                            \"--master=https://api.internal.e2e-e2e-kops-gce-stable.k8s.local\",\n                            \"--oom-score-adj=-998\",\n                            \"--v=2\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"100m\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"logfile\",\n                                \"mountPath\": \"/var/log/kube-proxy.log\"\n                            },\n                            {\n                                \"name\": \"kubeconfig\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/lib/kube-proxy/kubeconfig\"\n                            },\n                            {\n                                \"name\": \"modules\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/lib/modules\"\n                            },\n                            {\n                                \"name\": \"ssl-certs-hosts\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/ssl/certs\"\n                            },\n                            {\n                                \"name\": \"etchosts\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/hosts\"\n                            },\n                            {\n                                \"name\": \"iptableslock\",\n                                \"mountPath\": \"/run/xtables.lock\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"nodes-us-west3-a-rbw1\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:50Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:52Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:52Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:50Z\"\n                    }\n                ],\n                \"hostIP\": \"10.0.16.2\",\n                \"podIP\": \"10.0.16.2\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"10.0.16.2\"\n                    }\n                ],\n                \"startTime\": \"2022-06-21T16:10:50Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"kube-proxy\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2022-06-21T16:10:51Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1\",\n                        \"imageID\": \"sha256:4968be58436782433141cb249803b8c2183e3779a9f395a5a29580ce1201edf9\",\n                        \"containerID\": \"containerd://dd90949a9fd6f79dc93e5149d63134dceadacc469d6000a105ec71b0a7da43ef\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-nodes-us-west3-a-tw9s\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3141e7bd-3c7d-426f-b3ec-bed2f46b437c\",\n                \"resourceVersion\": \"996\",\n                \"creationTimestamp\": \"2022-06-21T16:12:12Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-proxy\",\n                    \"kubernetes.io/managed-by\": \"nodeup\",\n                    \"tier\": \"node\"\n                },\n                \"annotations\": {\n                    \"kubernetes.io/config.hash\": \"93b89b83b61195b9dae65a681b893113\",\n                    \"kubernetes.io/config.mirror\": \"93b89b83b61195b9dae65a681b893113\",\n                    \"kubernetes.io/config.seen\": \"2022-06-21T16:10:52.404590021Z\",\n                    \"kubernetes.io/config.source\": \"file\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"nodes-us-west3-a-tw9s\",\n                        \"uid\": \"acfb55b2-d927-43ce-961c-a270f826f316\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"logfile\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/kube-proxy.log\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"kubeconfig\",\n                        \"hostPath\": {\n                            \"path\": \"/var/lib/kube-proxy/kubeconfig\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"modules\",\n                        \"hostPath\": {\n                            \"path\": \"/lib/modules\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"ssl-certs-hosts\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/share/ca-certificates\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etchosts\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/hosts\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"iptableslock\",\n                        \"hostPath\": {\n                            \"path\": \"/run/xtables.lock\",\n                            \"type\": \"FileOrCreate\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kube-proxy\",\n                        \"image\": \"registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1\",\n                        \"command\": [\n                            \"/go-runner\"\n                        ],\n                        \"args\": [\n                            \"--log-file=/var/log/kube-proxy.log\",\n                            \"--also-stdout\",\n                            \"/usr/local/bin/kube-proxy\",\n                            \"--cluster-cidr=100.96.0.0/11\",\n                            \"--conntrack-max-per-core=131072\",\n                            \"--hostname-override=nodes-us-west3-a-tw9s\",\n                            \"--kubeconfig=/var/lib/kube-proxy/kubeconfig\",\n                            \"--master=https://api.internal.e2e-e2e-kops-gce-stable.k8s.local\",\n                            \"--oom-score-adj=-998\",\n                            \"--v=2\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"100m\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"logfile\",\n                                \"mountPath\": \"/var/log/kube-proxy.log\"\n                            },\n                            {\n                                \"name\": \"kubeconfig\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/lib/kube-proxy/kubeconfig\"\n                            },\n                            {\n                                \"name\": \"modules\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/lib/modules\"\n                            },\n                            {\n                                \"name\": \"ssl-certs-hosts\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/ssl/certs\"\n                            },\n                            {\n                                \"name\": \"etchosts\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/hosts\"\n                            },\n                            {\n                                \"name\": \"iptableslock\",\n                                \"mountPath\": \"/run/xtables.lock\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"nodes-us-west3-a-tw9s\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:52Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:54Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:54Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:52Z\"\n                    }\n                ],\n                \"hostIP\": \"10.0.16.4\",\n                \"podIP\": \"10.0.16.4\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"10.0.16.4\"\n                    }\n                ],\n                \"startTime\": \"2022-06-21T16:10:52Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"kube-proxy\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2022-06-21T16:10:54Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"registry.k8s.io/kube-proxy-amd64:v1.25.0-alpha.1\",\n                        \"imageID\": \"sha256:4968be58436782433141cb249803b8c2183e3779a9f395a5a29580ce1201edf9\",\n                        \"containerID\": \"containerd://b2c6fceb0051d185477939bff6292c372663a35ede17faeaf6a615bf4d5456be\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-scheduler-master-us-west3-a-r9rv\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"22a0f58b-a5a7-4144-996c-a37b9b2b5f0b\",\n                \"resourceVersion\": \"519\",\n                \"creationTimestamp\": \"2022-06-21T16:10:52Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-scheduler\"\n                },\n                \"annotations\": {\n                    \"kubernetes.io/config.hash\": \"4da98fa462c1f2897b783fb76b4e44ed\",\n                    \"kubernetes.io/config.mirror\": \"4da98fa462c1f2897b783fb76b4e44ed\",\n                    \"kubernetes.io/config.seen\": \"2022-06-21T16:08:53.096058454Z\",\n                    \"kubernetes.io/config.source\": \"file\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"master-us-west3-a-r9rv\",\n                        \"uid\": \"56b5306e-ee50-484c-8976-732b0c6e9403\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"varlibkubescheduler\",\n                        \"hostPath\": {\n                            \"path\": \"/var/lib/kube-scheduler\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"srvscheduler\",\n                        \"hostPath\": {\n                            \"path\": \"/srv/kubernetes/kube-scheduler\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"logfile\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/kube-scheduler.log\",\n                            \"type\": \"\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kube-scheduler\",\n                        \"image\": \"registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.1\",\n                        \"command\": [\n                            \"/go-runner\"\n                        ],\n                        \"args\": [\n                            \"--log-file=/var/log/kube-scheduler.log\",\n                            \"--also-stdout\",\n                            \"/usr/local/bin/kube-scheduler\",\n                            \"--authentication-kubeconfig=/var/lib/kube-scheduler/kubeconfig\",\n                            \"--authorization-kubeconfig=/var/lib/kube-scheduler/kubeconfig\",\n                            \"--config=/var/lib/kube-scheduler/config.yaml\",\n                            \"--leader-elect=true\",\n                            \"--tls-cert-file=/srv/kubernetes/kube-scheduler/server.crt\",\n                            \"--tls-private-key-file=/srv/kubernetes/kube-scheduler/server.key\",\n                            \"--v=2\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"100m\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"varlibkubescheduler\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/lib/kube-scheduler\"\n                            },\n                            {\n                                \"name\": \"srvscheduler\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/srv/kubernetes/kube-scheduler\"\n                            },\n                            {\n                                \"name\": \"logfile\",\n                                \"mountPath\": \"/var/log/kube-scheduler.log\"\n                            }\n                        ],\n                        \"livenessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/healthz\",\n                                \"port\": 10259,\n                                \"host\": \"127.0.0.1\",\n                                \"scheme\": \"HTTPS\"\n                            },\n                            \"initialDelaySeconds\": 15,\n                            \"timeoutSeconds\": 15,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 3\n                        },\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\"\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"master-us-west3-a-r9rv\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:08:55Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:09:29Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:09:29Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:08:55Z\"\n                    }\n                ],\n                \"hostIP\": \"10.0.16.6\",\n                \"podIP\": \"10.0.16.6\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"10.0.16.6\"\n                    }\n                ],\n                \"startTime\": \"2022-06-21T16:08:55Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"kube-scheduler\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2022-06-21T16:09:28Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"registry.k8s.io/kube-scheduler-amd64:v1.25.0-alpha.1\",\n                        \"imageID\": \"registry.k8s.io/kube-scheduler-amd64@sha256:591f068fd800c97e17301c9e87d2ba47e22f76759da95b2fd62033927cf71883\",\n                        \"containerID\": \"containerd://00ea3674367afc9ddb14328c820a728263431335e340387e79155e1dd92eb987\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-4rwqt\",\n                \"generateName\": \"metadata-proxy-v0.12-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d0fa7525-7b9c-4c57-b7fb-53ae1153ba22\",\n                \"resourceVersion\": \"661\",\n                \"creationTimestamp\": \"2022-06-21T16:10:57Z\",\n                \"labels\": {\n                    \"controller-revision-hash\": \"7fff5c5848\",\n                    \"k8s-app\": \"metadata-proxy\",\n                    \"kops.k8s.io/managed-by\": \"kops\",\n                    \"kubernetes.io/cluster-service\": \"true\",\n                    \"pod-template-generation\": \"1\",\n                    \"version\": \"v0.12\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"DaemonSet\",\n                        \"name\": \"metadata-proxy-v0.12\",\n                        \"uid\": \"f9de8f0d-bec4-40bc-a36e-d8e1026bdc09\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"host\",\n                        \"hostPath\": {\n                            \"path\": \"/\",\n                            \"type\": \"Directory\"\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-lpd45\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"initContainers\": [\n                    {\n                        \"name\": \"update-ipdtables\",\n                        \"image\": \"k8s.gcr.io/k8s-custom-iptables:1.0\",\n                        \"command\": [\n                            \"/bin/sh\",\n                            \"-c\",\n                            \"set -e\\nset -x\\n\\nif (ip link show ens4); then\\n  PRIMARY_DEV=ens4\\nelse\\n  PRIMARY_DEV=eth0\\nfi\\n\\nip addr add dev lo 169.254.169.252/32\\niptables -w -t nat -I PREROUTING -p tcp -d 169.254.169.254 ! -i \\\"${PRIMARY_DEV}\\\" --dport 80 -m comment --comment \\\"metadata-concealment: bridge traffic to metadata server goes to metadata proxy\\\" -j DNAT --to-destination 169.254.169.252:988\\niptables -w -t nat -I PREROUTING -p tcp -d 169.254.169.254 ! -i \\\"${PRIMARY_DEV}\\\" --dport 8080 -m comment --comment \\\"metadata-concealment: bridge traffic to metadata server goes to metadata proxy\\\" -j DNAT --to-destination 169.254.169.252:987\\n\"\n                        ],\n                        \"resources\": {},\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"host\",\n                                \"mountPath\": \"/host\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-lpd45\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"Always\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"metadata-proxy\",\n                        \"image\": \"k8s.gcr.io/metadata-proxy:v0.1.12\",\n                        \"args\": [\n                            \"-addr=169.254.169.252:988\"\n                        ],\n                        \"resources\": {\n                            \"limits\": {\n                                \"cpu\": \"30m\",\n                                \"memory\": \"25Mi\"\n                            },\n                            \"requests\": {\n                                \"cpu\": \"30m\",\n                                \"memory\": \"25Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"kube-api-access-lpd45\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    },\n                    {\n                        \"name\": \"prometheus-to-sd-exporter\",\n                        \"image\": \"k8s.gcr.io/prometheus-to-sd:v0.5.0\",\n                        \"command\": [\n                            \"/monitor\",\n                            \"--stackdriver-prefix=custom.googleapis.com/addons\",\n                            \"--source=metadata_proxy:http://127.0.0.1:989?whitelisted=request_count\",\n                            \"--pod-id=$(POD_NAME)\",\n                            \"--namespace-id=$(POD_NAMESPACE)\"\n                        ],\n                        \"env\": [\n                            {\n                                \"name\": \"POD_NAME\",\n                                \"valueFrom\": {\n                                    \"fieldRef\": {\n                                        \"apiVersion\": \"v1\",\n                                        \"fieldPath\": \"metadata.name\"\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"POD_NAMESPACE\",\n                                \"valueFrom\": {\n                                    \"fieldRef\": {\n                                        \"apiVersion\": \"v1\",\n                                        \"fieldPath\": \"metadata.namespace\"\n                                    }\n                                }\n                            }\n                        ],\n                        \"resources\": {\n                            \"limits\": {\n                                \"cpu\": \"2m\",\n                                \"memory\": \"20Mi\"\n                            },\n                            \"requests\": {\n                                \"cpu\": \"2m\",\n                                \"memory\": \"20Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"kube-api-access-lpd45\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\"\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"Default\",\n                \"nodeSelector\": {\n                    \"beta.kubernetes.io/os\": \"linux\",\n                    \"cloud.google.com/metadata-proxy-ready\": \"true\"\n                },\n                \"serviceAccountName\": \"metadata-proxy\",\n                \"serviceAccount\": \"metadata-proxy\",\n                \"nodeName\": \"nodes-us-west3-a-kkxs\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"affinity\": {\n                    \"nodeAffinity\": {\n                        \"requiredDuringSchedulingIgnoredDuringExecution\": {\n                            \"nodeSelectorTerms\": [\n                                {\n                                    \"matchFields\": [\n                                        {\n                                            \"key\": \"metadata.name\",\n                                            \"operator\": \"In\",\n                                            \"values\": [\n                                                \"nodes-us-west3-a-kkxs\"\n                                            ]\n                                        }\n                                    ]\n                                }\n                            ]\n                        }\n                    }\n                },\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/disk-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/memory-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/pid-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unschedulable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/network-unavailable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:11:00Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:11:06Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:11:06Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:57Z\"\n                    }\n                ],\n                \"hostIP\": \"10.0.16.3\",\n                \"podIP\": \"10.0.16.3\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"10.0.16.3\"\n                    }\n                ],\n                \"startTime\": \"2022-06-21T16:10:57Z\",\n                \"initContainerStatuses\": [\n                    {\n                        \"name\": \"update-ipdtables\",\n                        \"state\": {\n                            \"terminated\": {\n                                \"exitCode\": 0,\n                                \"reason\": \"Completed\",\n                                \"startedAt\": \"2022-06-21T16:10:59Z\",\n                                \"finishedAt\": \"2022-06-21T16:10:59Z\",\n                                \"containerID\": \"containerd://5cb6a43784c66f0b36120cea69aee8cfa223bbf093e2ff62f09f24f57f7bb8ae\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/k8s-custom-iptables:1.0\",\n                        \"imageID\": \"k8s.gcr.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5\",\n                        \"containerID\": \"containerd://5cb6a43784c66f0b36120cea69aee8cfa223bbf093e2ff62f09f24f57f7bb8ae\"\n                    }\n                ],\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"metadata-proxy\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2022-06-21T16:11:04Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/metadata-proxy:v0.1.12\",\n                        \"imageID\": \"k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a\",\n                        \"containerID\": \"containerd://a55e9e8db8238759ee0420cd5812e7728634c9f4adaf5f6facd75217f34edd29\",\n                        \"started\": true\n                    },\n                    {\n                        \"name\": \"prometheus-to-sd-exporter\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2022-06-21T16:11:05Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/prometheus-to-sd:v0.5.0\",\n                        \"imageID\": \"k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e\",\n                        \"containerID\": \"containerd://4976bb00fda71d7c2f6cadc4c0fb040797e47c58486d977dc9c96fca0539b25e\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-7rr44\",\n                \"generateName\": \"metadata-proxy-v0.12-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"151c4523-5bcd-41d5-8901-0b323416c62e\",\n                \"resourceVersion\": \"561\",\n                \"creationTimestamp\": \"2022-06-21T16:10:49Z\",\n                \"labels\": {\n                    \"controller-revision-hash\": \"7fff5c5848\",\n                    \"k8s-app\": \"metadata-proxy\",\n                    \"kops.k8s.io/managed-by\": \"kops\",\n                    \"kubernetes.io/cluster-service\": \"true\",\n                    \"pod-template-generation\": \"1\",\n                    \"version\": \"v0.12\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"DaemonSet\",\n                        \"name\": \"metadata-proxy-v0.12\",\n                        \"uid\": \"f9de8f0d-bec4-40bc-a36e-d8e1026bdc09\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"host\",\n                        \"hostPath\": {\n                            \"path\": \"/\",\n                            \"type\": \"Directory\"\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-vz2lx\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"initContainers\": [\n                    {\n                        \"name\": \"update-ipdtables\",\n                        \"image\": \"k8s.gcr.io/k8s-custom-iptables:1.0\",\n                        \"command\": [\n                            \"/bin/sh\",\n                            \"-c\",\n                            \"set -e\\nset -x\\n\\nif (ip link show ens4); then\\n  PRIMARY_DEV=ens4\\nelse\\n  PRIMARY_DEV=eth0\\nfi\\n\\nip addr add dev lo 169.254.169.252/32\\niptables -w -t nat -I PREROUTING -p tcp -d 169.254.169.254 ! -i \\\"${PRIMARY_DEV}\\\" --dport 80 -m comment --comment \\\"metadata-concealment: bridge traffic to metadata server goes to metadata proxy\\\" -j DNAT --to-destination 169.254.169.252:988\\niptables -w -t nat -I PREROUTING -p tcp -d 169.254.169.254 ! -i \\\"${PRIMARY_DEV}\\\" --dport 8080 -m comment --comment \\\"metadata-concealment: bridge traffic to metadata server goes to metadata proxy\\\" -j DNAT --to-destination 169.254.169.252:987\\n\"\n                        ],\n                        \"resources\": {},\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"host\",\n                                \"mountPath\": \"/host\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-vz2lx\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"Always\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"metadata-proxy\",\n                        \"image\": \"k8s.gcr.io/metadata-proxy:v0.1.12\",\n                        \"args\": [\n                            \"-addr=169.254.169.252:988\"\n                        ],\n                        \"resources\": {\n                            \"limits\": {\n                                \"cpu\": \"30m\",\n                                \"memory\": \"25Mi\"\n                            },\n                            \"requests\": {\n                                \"cpu\": \"30m\",\n                                \"memory\": \"25Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"kube-api-access-vz2lx\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    },\n                    {\n                        \"name\": \"prometheus-to-sd-exporter\",\n                        \"image\": \"k8s.gcr.io/prometheus-to-sd:v0.5.0\",\n                        \"command\": [\n                            \"/monitor\",\n                            \"--stackdriver-prefix=custom.googleapis.com/addons\",\n                            \"--source=metadata_proxy:http://127.0.0.1:989?whitelisted=request_count\",\n                            \"--pod-id=$(POD_NAME)\",\n                            \"--namespace-id=$(POD_NAMESPACE)\"\n                        ],\n                        \"env\": [\n                            {\n                                \"name\": \"POD_NAME\",\n                                \"valueFrom\": {\n                                    \"fieldRef\": {\n                                        \"apiVersion\": \"v1\",\n                                        \"fieldPath\": \"metadata.name\"\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"POD_NAMESPACE\",\n                                \"valueFrom\": {\n                                    \"fieldRef\": {\n                                        \"apiVersion\": \"v1\",\n                                        \"fieldPath\": \"metadata.namespace\"\n                                    }\n                                }\n                            }\n                        ],\n                        \"resources\": {\n                            \"limits\": {\n                                \"cpu\": \"2m\",\n                                \"memory\": \"20Mi\"\n                            },\n                            \"requests\": {\n                                \"cpu\": \"2m\",\n                                \"memory\": \"20Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"kube-api-access-vz2lx\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\"\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"Default\",\n                \"nodeSelector\": {\n                    \"beta.kubernetes.io/os\": \"linux\",\n                    \"cloud.google.com/metadata-proxy-ready\": \"true\"\n                },\n                \"serviceAccountName\": \"metadata-proxy\",\n                \"serviceAccount\": \"metadata-proxy\",\n                \"nodeName\": \"master-us-west3-a-r9rv\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"affinity\": {\n                    \"nodeAffinity\": {\n                        \"requiredDuringSchedulingIgnoredDuringExecution\": {\n                            \"nodeSelectorTerms\": [\n                                {\n                                    \"matchFields\": [\n                                        {\n                                            \"key\": \"metadata.name\",\n                                            \"operator\": \"In\",\n                                            \"values\": [\n                                                \"master-us-west3-a-r9rv\"\n                                            ]\n                                        }\n                                    ]\n                                }\n                            ]\n                        }\n                    }\n                },\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/disk-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/memory-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/pid-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unschedulable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/network-unavailable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:55Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:58Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:58Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2022-06-21T16:10:49Z\"\n                    }\n                ],\n                \"hostIP\": \"10.0.16.6\",\n                \"podIP\": \"10.0.16.6\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"10.0.16.6\"\n                    }\n                ],\n                \"startTime\": \"2022-06-21T16:10:49Z\",\n                \"initContainerStatuses\": [\n                    {\n                        \"name\": \"update-ipdtables\",\n                        \"state\": {\n                            \"terminated\": {\n                                \"exitCode\": 0,\n                                \"reason\": \"Completed\",\n                                \"startedAt\": \"2022-06-21T16:10:50Z\",\n                                \"finishedAt\": \"2022-06-21T16:10:50Z\",\n                                \"containerID\": \"containerd://555b9e6905c5a7c3c96e5a6a94d375fff726172f9d28d6126c2d6b59a563238e\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/k8s-custom-iptables:1.0\",\n                        \"imageID\": \"k8s.gcr.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5\",\n                        \"containerID\": \"containerd://555b9e6905c5a7c3c96e5a6a94d375fff726172f9d28d6126c2d6b59a563238e\"\n                    }\n                ],\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"metadata-proxy\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2022-06-21T16:10:56Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/metadata-proxy:v0.1.12\",\n                        \"imageID\": \"k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a\",\n                        \"containerID\": \"containerd://e2e85803336252707cdca656192c477e8fe630f1fdafe026b1232c402d31aaa0\",\n                        \"started\": true\n                    },\n                    {\n                        \"name\": \"prometheus-to-sd-exporter\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2022-06-21T16:10:58Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/prometheus-to-sd:v0.5.0\",\n                        \"imageID\": \"k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e\",\n                        \"containerID\": \"containerd://e1fef73b274ce7e0b39011a006db93eff31cd1f2c3b6f43203e2cdd4c21d0771\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"metadata-proxy-v0.12-ntrfh\",\n                \"generateName\": \"metadata-proxy-v0.12-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"7f421014-01fa-4182-a30b-0d3e540851d4\",\n                \"resourceVersion\": \"710\",\n                \"creationTimestamp\": \"2022-06-21T16:11:00Z\",\n                \"labels\": {\n                    \"controller-revision-hash\": \"7fff5c5848\",\n                    \"k8s-app\": \"metadata-proxy\",\n                    \"kops.k8s.io/managed-by\": \"kops\",\n                    \"kubernetes.io/cluster-service\": \"true\",\n                    \"pod-template-generation\": \"1\",\n                    \"version\": \"v0.12\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"DaemonSet\",\n                        \"name\": \"metadata-proxy-v0.12\",\n                        \"uid\": \"f9de8f0d-bec4-40bc-a36e-d8e1026bdc09\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"host\",\n                        \"hostPath\": {\n                            \"path\": \"/\",\n                            \"type\": \"Directory\"\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-lgnds\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"initContainers\": [\n                    {\n                        \"name\": \"update-ipdtables\",\n                        \"image\": \"k8s.gcr.io/k8s-custom-iptables:1.0\",\n                        \"command\": [\n                            \"/bin/sh\",\n                            \"-c\",\n                            \"set -e\\nset -x\\n\\nif (ip link show ens4); then\\n  PRIMARY_DEV=ens4\\nelse\\n  PRIMARY_DEV=eth0\\nfi\\n\\nip addr add dev lo 169.254.169.252/32\\niptables -w -t nat -I PREROUTING -p tcp -d 169.254.169.254 ! -i \\\"${PRIMARY_DEV}\\\" --dport 80 -m comment --comment \\\"metadata-concealment: bridge traffic to metadata server goes to metadata proxy\\\" -j DNAT --to-destination 169.254.169.252:988\\niptables -w -t nat -I PREROUTING -p tcp -d 169.254.169.254 ! -i \\\"${PRIMARY_DEV}\\\" --dport 8080 -m comment --comment \\\"metadata-concealment: bridge traffic to metadata server goes to metadata proxy\\\" -j DNAT --to-destination 169.254.169.252:987\\n\"\n                        ],\n                        \"resources\": {},\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"host\",\n                                \"mountPath\": \"/host\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-lgnds\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"Always\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"metadata-proxy\",\n                        \"image\": \"k8s.gcr.io/metadata-proxy:v0.1.12\",\n                        \"args\": [\n                            \"-addr=169.254.169.252:988\"\n                        ],\n                        \"resources\": {\n                            \"limits\": {\n                                \"cpu\": \"30m\",\n                                \"memory\": \"25Mi\"\n                            },\n                            \"requests\": {\n                                \"cpu\": \"30m\",\n                                \"memory\": \"25Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"kube-api-access-lgnds\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    },\n                    {\n                        \"name\": \"prometheus-to-sd-exporter\",\n                        \"image\": \"k8s.gcr.io/prometheus-to-sd:v0.5.0\",\n                        \"command\": [\n                            \"/monitor\",\n                            \"--stackdriver-prefix=custom.googleapis.com/addons\",\n                            \"--source=metadata_proxy:http://127.0.0.1:989?whitelisted=request_count\",\n                            \"--pod-id=$(POD_NAME)\",\n                            \"--namespace-id=$(POD_NAMESPACE)\"\n                        ],\n                        \"env\": [\n                            {\n                                \"name\": \"POD_NAME\",\n                                \"valueFrom\": {\n                                    \"fieldRef\": {\n                                        \"apiVersion\": \"v1\",\n                                        \"fieldPath\": \"metadata.name\"\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"POD_NAMESPACE\",\n                                \"valueFrom\": {\n                                    \"fieldRef\": {\n                                        \"apiVersion\": \"v1\",\n                                        \"fieldPath\": \"metadata.namespace\"\n                                    }\n                                }\n                            }\n                        ],\n                        \"resources\": {\n                            \"limits\": {\n                                \"cpu\": \"2m\",\n                                \"memory\": \"20Mi\"\n                            },\n                            \"requests\": {\n                                \"cpu\": \"2m\",\n                                \"memory\": \"20Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"kube-api-access-lgnds\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\"\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"Default\",\n                \"nodeSelector\": {\n                    \"beta.kubernetes.io/os\": \"linux\",\n                    \"cloud.google.com/metadata-proxy-ready\": \"true\"\n                },\n                \"serviceAccountName\": \"metadata-proxy\",\n                \"serviceAccount\": \"metadata-proxy\",\n                \"nodeName\": \"nodes-us-west3-a-tw9s\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"affinity\": {\n                    \"nodeAffinity\": {\n                        \"requiredDuringScheduling