This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 0 failed / 0 succeeded
Started2021-06-05 07:04
Elapsed28m25s
Revisionmaster

No Test Failures!


Error lines from build-log.txt

... skipping 124 lines ...
I0605 07:05:12.127702    4063 up.go:43] Cleaning up any leaked resources from previous cluster
I0605 07:05:12.127744    4063 dumplogs.go:38] /logs/artifacts/31b5527f-c5cc-11eb-a95e-22b332769ebd/kops toolbox dump --name e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io --dir /logs/artifacts --private-key /etc/aws-ssh/aws-ssh-private --ssh-user admin
I0605 07:05:12.142428    4082 featureflag.go:165] FeatureFlag "SpecOverrideFlag"=true
I0605 07:05:12.142520    4082 featureflag.go:165] FeatureFlag "AlphaAllowGCE"=true

Cluster.kops.k8s.io "e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io" not found
W0605 07:05:12.649775    4063 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1
I0605 07:05:12.649834    4063 down.go:48] /logs/artifacts/31b5527f-c5cc-11eb-a95e-22b332769ebd/kops delete cluster --name e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io --yes
I0605 07:05:12.664945    4092 featureflag.go:165] FeatureFlag "SpecOverrideFlag"=true
I0605 07:05:12.665031    4092 featureflag.go:165] FeatureFlag "AlphaAllowGCE"=true

error reading cluster configuration: Cluster.kops.k8s.io "e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io" not found
I0605 07:05:13.172136    4063 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip
2021/06/05 07:05:13 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404
I0605 07:05:13.181140    4063 http.go:37] curl https://ip.jsb.workers.dev
I0605 07:05:13.277442    4063 up.go:144] /logs/artifacts/31b5527f-c5cc-11eb-a95e-22b332769ebd/kops create cluster --name e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io --cloud aws --kubernetes-version https://storage.googleapis.com/kubernetes-release/release/v1.21.1 --ssh-public-key /etc/aws-ssh/aws-ssh-public --override cluster.spec.nodePortAccess=0.0.0.0/0 --yes --image=136693071363/debian-10-amd64-20210329-591 --channel=alpha --networking=cilium --container-runtime=containerd --admin-access 35.232.62.107/32 --master-count 1 --master-volume-size 48 --node-count 4 --node-volume-size 48 --zones ca-central-1a --master-size c5.large
I0605 07:05:13.292480    4102 featureflag.go:165] FeatureFlag "SpecOverrideFlag"=true
I0605 07:05:13.292566    4102 featureflag.go:165] FeatureFlag "AlphaAllowGCE"=true
I0605 07:05:13.338724    4102 create_cluster.go:728] Using SSH public key: /etc/aws-ssh/aws-ssh-public
I0605 07:05:13.957726    4102 new_cluster.go:1022]  Cloud Provider ID = aws
... skipping 41 lines ...

I0605 07:05:37.493297    4063 up.go:181] /logs/artifacts/31b5527f-c5cc-11eb-a95e-22b332769ebd/kops validate cluster --name e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io --count 10 --wait 15m0s
I0605 07:05:37.512046    4123 featureflag.go:165] FeatureFlag "SpecOverrideFlag"=true
I0605 07:05:37.512273    4123 featureflag.go:165] FeatureFlag "AlphaAllowGCE"=true
Validating cluster e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io

W0605 07:05:38.473550    4123 validate_cluster.go:173] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ca-central-1a	Master	c5.large	1	1	ca-central-1a
nodes-ca-central-1a	Node	t3.medium	4	4	ca-central-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0605 07:05:48.504505    4123 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ca-central-1a	Master	c5.large	1	1	ca-central-1a
nodes-ca-central-1a	Node	t3.medium	4	4	ca-central-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0605 07:05:58.534765    4123 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ca-central-1a	Master	c5.large	1	1	ca-central-1a
nodes-ca-central-1a	Node	t3.medium	4	4	ca-central-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0605 07:06:08.563987    4123 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ca-central-1a	Master	c5.large	1	1	ca-central-1a
nodes-ca-central-1a	Node	t3.medium	4	4	ca-central-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0605 07:06:18.598418    4123 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ca-central-1a	Master	c5.large	1	1	ca-central-1a
nodes-ca-central-1a	Node	t3.medium	4	4	ca-central-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0605 07:06:28.650033    4123 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ca-central-1a	Master	c5.large	1	1	ca-central-1a
nodes-ca-central-1a	Node	t3.medium	4	4	ca-central-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0605 07:06:38.695777    4123 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ca-central-1a	Master	c5.large	1	1	ca-central-1a
nodes-ca-central-1a	Node	t3.medium	4	4	ca-central-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0605 07:06:48.726853    4123 validate_cluster.go:221] (will retry): cluster not yet healthy
W0605 07:06:58.807918    4123 validate_cluster.go:173] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ca-central-1a	Master	c5.large	1	1	ca-central-1a
nodes-ca-central-1a	Node	t3.medium	4	4	ca-central-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0605 07:07:08.839477    4123 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ca-central-1a	Master	c5.large	1	1	ca-central-1a
nodes-ca-central-1a	Node	t3.medium	4	4	ca-central-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0605 07:07:18.870544    4123 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ca-central-1a	Master	c5.large	1	1	ca-central-1a
nodes-ca-central-1a	Node	t3.medium	4	4	ca-central-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0605 07:07:28.906389    4123 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ca-central-1a	Master	c5.large	1	1	ca-central-1a
nodes-ca-central-1a	Node	t3.medium	4	4	ca-central-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0605 07:07:38.952591    4123 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ca-central-1a	Master	c5.large	1	1	ca-central-1a
nodes-ca-central-1a	Node	t3.medium	4	4	ca-central-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0605 07:07:48.998538    4123 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ca-central-1a	Master	c5.large	1	1	ca-central-1a
nodes-ca-central-1a	Node	t3.medium	4	4	ca-central-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0605 07:07:59.031084    4123 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ca-central-1a	Master	c5.large	1	1	ca-central-1a
nodes-ca-central-1a	Node	t3.medium	4	4	ca-central-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0605 07:08:09.064057    4123 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ca-central-1a	Master	c5.large	1	1	ca-central-1a
nodes-ca-central-1a	Node	t3.medium	4	4	ca-central-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0605 07:08:19.101790    4123 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ca-central-1a	Master	c5.large	1	1	ca-central-1a
nodes-ca-central-1a	Node	t3.medium	4	4	ca-central-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0605 07:08:29.134345    4123 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ca-central-1a	Master	c5.large	1	1	ca-central-1a
nodes-ca-central-1a	Node	t3.medium	4	4	ca-central-1a

... skipping 9 lines ...
Machine	i-077b3814383b4e54e								machine "i-077b3814383b4e54e" has not yet joined cluster
Pod	kube-system/cilium-25vms							system-node-critical pod "cilium-25vms" is not ready (cilium-agent)
Pod	kube-system/coredns-autoscaler-6f594f4c58-8v4pg					system-cluster-critical pod "coredns-autoscaler-6f594f4c58-8v4pg" is pending
Pod	kube-system/coredns-f45c4bf76-gr4z9						system-cluster-critical pod "coredns-f45c4bf76-gr4z9" is pending
Pod	kube-system/etcd-manager-events-ip-172-20-37-235.ca-central-1.compute.internal	system-cluster-critical pod "etcd-manager-events-ip-172-20-37-235.ca-central-1.compute.internal" is pending

Validation Failed
W0605 07:08:40.438046    4123 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ca-central-1a	Master	c5.large	1	1	ca-central-1a
nodes-ca-central-1a	Node	t3.medium	4	4	ca-central-1a

... skipping 8 lines ...
Machine	i-070c9797a5ee75576				machine "i-070c9797a5ee75576" has not yet joined cluster
Machine	i-077b3814383b4e54e				machine "i-077b3814383b4e54e" has not yet joined cluster
Pod	kube-system/cilium-25vms			system-node-critical pod "cilium-25vms" is not ready (cilium-agent)
Pod	kube-system/coredns-autoscaler-6f594f4c58-8v4pg	system-cluster-critical pod "coredns-autoscaler-6f594f4c58-8v4pg" is pending
Pod	kube-system/coredns-f45c4bf76-gr4z9		system-cluster-critical pod "coredns-f45c4bf76-gr4z9" is pending

Validation Failed
W0605 07:08:51.477360    4123 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ca-central-1a	Master	c5.large	1	1	ca-central-1a
nodes-ca-central-1a	Node	t3.medium	4	4	ca-central-1a

... skipping 12 lines ...
Pod	kube-system/cilium-25vms			system-node-critical pod "cilium-25vms" is not ready (cilium-agent)
Pod	kube-system/cilium-d9szd			system-node-critical pod "cilium-d9szd" is pending
Pod	kube-system/cilium-lnws2			system-node-critical pod "cilium-lnws2" is pending
Pod	kube-system/coredns-autoscaler-6f594f4c58-8v4pg	system-cluster-critical pod "coredns-autoscaler-6f594f4c58-8v4pg" is pending
Pod	kube-system/coredns-f45c4bf76-gr4z9		system-cluster-critical pod "coredns-f45c4bf76-gr4z9" is pending

Validation Failed
W0605 07:09:02.460116    4123 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ca-central-1a	Master	c5.large	1	1	ca-central-1a
nodes-ca-central-1a	Node	t3.medium	4	4	ca-central-1a

... skipping 16 lines ...
Pod	kube-system/cilium-lnws2			system-node-critical pod "cilium-lnws2" is pending
Pod	kube-system/cilium-swx97			system-node-critical pod "cilium-swx97" is pending
Pod	kube-system/cilium-wqwtd			system-node-critical pod "cilium-wqwtd" is pending
Pod	kube-system/coredns-autoscaler-6f594f4c58-8v4pg	system-cluster-critical pod "coredns-autoscaler-6f594f4c58-8v4pg" is pending
Pod	kube-system/coredns-f45c4bf76-gr4z9		system-cluster-critical pod "coredns-f45c4bf76-gr4z9" is pending

Validation Failed
W0605 07:09:13.364692    4123 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ca-central-1a	Master	c5.large	1	1	ca-central-1a
nodes-ca-central-1a	Node	t3.medium	4	4	ca-central-1a

... skipping 11 lines ...
Node	ip-172-20-62-33.ca-central-1.compute.internal	node "ip-172-20-62-33.ca-central-1.compute.internal" of role "node" is not ready
Pod	kube-system/cilium-swx97			system-node-critical pod "cilium-swx97" is not ready (cilium-agent)
Pod	kube-system/cilium-wqwtd			system-node-critical pod "cilium-wqwtd" is not ready (cilium-agent)
Pod	kube-system/coredns-autoscaler-6f594f4c58-8v4pg	system-cluster-critical pod "coredns-autoscaler-6f594f4c58-8v4pg" is pending
Pod	kube-system/coredns-f45c4bf76-gr4z9		system-cluster-critical pod "coredns-f45c4bf76-gr4z9" is pending

Validation Failed
W0605 07:09:24.269616    4123 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ca-central-1a	Master	c5.large	1	1	ca-central-1a
nodes-ca-central-1a	Node	t3.medium	4	4	ca-central-1a

... skipping 6 lines ...
ip-172-20-62-33.ca-central-1.compute.internal	node	True

VALIDATION ERRORS
KIND	NAME					MESSAGE
Pod	kube-system/coredns-f45c4bf76-f85fb	system-cluster-critical pod "coredns-f45c4bf76-f85fb" is pending

Validation Failed
W0605 07:09:35.161795    4123 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ca-central-1a	Master	c5.large	1	1	ca-central-1a
nodes-ca-central-1a	Node	t3.medium	4	4	ca-central-1a

... skipping 746 lines ...
STEP: Destroying namespace "services-2681" for this suite.
[AfterEach] [sig-network] Services
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:750

•
------------------------------
{"msg":"PASSED [sig-network] Services should check NodePort out-of-range","total":-1,"completed":1,"skipped":1,"failed":0}

SSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:11:53.961: INFO: Driver emptydir doesn't support PreprovisionedPV -- skipping
... skipping 75 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Jun  5 07:11:53.965: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "configmap-2803" for this suite.

•
------------------------------
{"msg":"PASSED [sig-storage] ConfigMap should be immutable if `immutable` field is set [Conformance]","total":-1,"completed":1,"skipped":0,"failed":0}

SSSSS
------------------------------
[BeforeEach] [sig-apps] ReplicationController
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 132 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Jun  5 07:11:56.107: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "svcaccounts-1648" for this suite.

•
------------------------------
{"msg":"PASSED [sig-auth] ServiceAccounts should allow opting out of API token automount  [Conformance]","total":-1,"completed":1,"skipped":2,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:11:56.217: INFO: Only supported for providers [gce gke] (not aws)
... skipping 146 lines ...
• [SLOW TEST:10.303 seconds]
[sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  works for CRD preserving unknown fields in an embedded object [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for CRD preserving unknown fields in an embedded object [Conformance]","total":-1,"completed":1,"skipped":4,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:12:03.560: INFO: Driver csi-hostpath doesn't support PreprovisionedPV -- skipping
... skipping 95 lines ...
Jun  5 07:11:53.541: INFO: No PodSecurityPolicies found; assuming PodSecurityPolicy is disabled.
STEP: Waiting for a default service account to be provisioned in namespace
[It] should be consumable from pods in volume with mappings as non-root [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating configMap with name projected-configmap-test-volume-map-b45361c8-2575-41d2-baae-c4742f64987b
STEP: Creating a pod to test consume configMaps
Jun  5 07:11:53.729: INFO: Waiting up to 5m0s for pod "pod-projected-configmaps-dc836a5c-167e-4b8e-9236-0b8b23369a58" in namespace "projected-2612" to be "Succeeded or Failed"
Jun  5 07:11:53.788: INFO: Pod "pod-projected-configmaps-dc836a5c-167e-4b8e-9236-0b8b23369a58": Phase="Pending", Reason="", readiness=false. Elapsed: 58.845712ms
Jun  5 07:11:55.824: INFO: Pod "pod-projected-configmaps-dc836a5c-167e-4b8e-9236-0b8b23369a58": Phase="Pending", Reason="", readiness=false. Elapsed: 2.094872061s
Jun  5 07:11:57.856: INFO: Pod "pod-projected-configmaps-dc836a5c-167e-4b8e-9236-0b8b23369a58": Phase="Pending", Reason="", readiness=false. Elapsed: 4.126915454s
Jun  5 07:11:59.888: INFO: Pod "pod-projected-configmaps-dc836a5c-167e-4b8e-9236-0b8b23369a58": Phase="Pending", Reason="", readiness=false. Elapsed: 6.159089111s
Jun  5 07:12:01.929: INFO: Pod "pod-projected-configmaps-dc836a5c-167e-4b8e-9236-0b8b23369a58": Phase="Pending", Reason="", readiness=false. Elapsed: 8.199855115s
Jun  5 07:12:03.961: INFO: Pod "pod-projected-configmaps-dc836a5c-167e-4b8e-9236-0b8b23369a58": Phase="Pending", Reason="", readiness=false. Elapsed: 10.232204991s
Jun  5 07:12:05.994: INFO: Pod "pod-projected-configmaps-dc836a5c-167e-4b8e-9236-0b8b23369a58": Phase="Pending", Reason="", readiness=false. Elapsed: 12.264849194s
Jun  5 07:12:08.026: INFO: Pod "pod-projected-configmaps-dc836a5c-167e-4b8e-9236-0b8b23369a58": Phase="Succeeded", Reason="", readiness=false. Elapsed: 14.296657688s
STEP: Saw pod success
Jun  5 07:12:08.026: INFO: Pod "pod-projected-configmaps-dc836a5c-167e-4b8e-9236-0b8b23369a58" satisfied condition "Succeeded or Failed"
Jun  5 07:12:08.057: INFO: Trying to get logs from node ip-172-20-55-143.ca-central-1.compute.internal pod pod-projected-configmaps-dc836a5c-167e-4b8e-9236-0b8b23369a58 container agnhost-container: <nil>
STEP: delete the pod
Jun  5 07:12:08.388: INFO: Waiting for pod pod-projected-configmaps-dc836a5c-167e-4b8e-9236-0b8b23369a58 to disappear
Jun  5 07:12:08.419: INFO: Pod pod-projected-configmaps-dc836a5c-167e-4b8e-9236-0b8b23369a58 no longer exists
[AfterEach] [sig-storage] Projected configMap
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:15.129 seconds]
[sig-storage] Projected configMap
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should be consumable from pods in volume with mappings as non-root [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] Projected configMap should be consumable from pods in volume with mappings as non-root [NodeConformance] [Conformance]","total":-1,"completed":1,"skipped":2,"failed":0}

SS
------------------------------
[BeforeEach] [sig-api-machinery] ResourceQuota
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 38 lines ...
W0605 07:11:53.713948    4717 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
Jun  5 07:11:53.714: INFO: No PodSecurityPolicies found; assuming PodSecurityPolicy is disabled.
STEP: Waiting for a default service account to be provisioned in namespace
[It] should allow substituting values in a container's command [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test substitution in container's command
Jun  5 07:11:53.826: INFO: Waiting up to 5m0s for pod "var-expansion-3ec0cbd3-c799-4d2b-aecf-597b67727bf1" in namespace "var-expansion-9847" to be "Succeeded or Failed"
Jun  5 07:11:53.856: INFO: Pod "var-expansion-3ec0cbd3-c799-4d2b-aecf-597b67727bf1": Phase="Pending", Reason="", readiness=false. Elapsed: 30.750241ms
Jun  5 07:11:55.895: INFO: Pod "var-expansion-3ec0cbd3-c799-4d2b-aecf-597b67727bf1": Phase="Pending", Reason="", readiness=false. Elapsed: 2.06912385s
Jun  5 07:11:57.932: INFO: Pod "var-expansion-3ec0cbd3-c799-4d2b-aecf-597b67727bf1": Phase="Pending", Reason="", readiness=false. Elapsed: 4.106133049s
Jun  5 07:11:59.964: INFO: Pod "var-expansion-3ec0cbd3-c799-4d2b-aecf-597b67727bf1": Phase="Pending", Reason="", readiness=false. Elapsed: 6.138454676s
Jun  5 07:12:01.995: INFO: Pod "var-expansion-3ec0cbd3-c799-4d2b-aecf-597b67727bf1": Phase="Pending", Reason="", readiness=false. Elapsed: 8.16982188s
Jun  5 07:12:04.027: INFO: Pod "var-expansion-3ec0cbd3-c799-4d2b-aecf-597b67727bf1": Phase="Pending", Reason="", readiness=false. Elapsed: 10.201847218s
Jun  5 07:12:06.061: INFO: Pod "var-expansion-3ec0cbd3-c799-4d2b-aecf-597b67727bf1": Phase="Pending", Reason="", readiness=false. Elapsed: 12.235439033s
Jun  5 07:12:08.093: INFO: Pod "var-expansion-3ec0cbd3-c799-4d2b-aecf-597b67727bf1": Phase="Pending", Reason="", readiness=false. Elapsed: 14.266937549s
Jun  5 07:12:10.128: INFO: Pod "var-expansion-3ec0cbd3-c799-4d2b-aecf-597b67727bf1": Phase="Succeeded", Reason="", readiness=false. Elapsed: 16.302019267s
STEP: Saw pod success
Jun  5 07:12:10.128: INFO: Pod "var-expansion-3ec0cbd3-c799-4d2b-aecf-597b67727bf1" satisfied condition "Succeeded or Failed"
Jun  5 07:12:10.158: INFO: Trying to get logs from node ip-172-20-48-31.ca-central-1.compute.internal pod var-expansion-3ec0cbd3-c799-4d2b-aecf-597b67727bf1 container dapi-container: <nil>
STEP: delete the pod
Jun  5 07:12:10.671: INFO: Waiting for pod var-expansion-3ec0cbd3-c799-4d2b-aecf-597b67727bf1 to disappear
Jun  5 07:12:10.701: INFO: Pod var-expansion-3ec0cbd3-c799-4d2b-aecf-597b67727bf1 no longer exists
[AfterEach] [sig-node] Variable Expansion
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:17.384 seconds]
[sig-node] Variable Expansion
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  should allow substituting values in a container's command [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] Variable Expansion should allow substituting values in a container's command [NodeConformance] [Conformance]","total":-1,"completed":1,"skipped":3,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:12:10.812: INFO: Only supported for providers [vsphere] (not aws)
... skipping 89 lines ...
• [SLOW TEST:18.693 seconds]
[sig-apps] ReplicationController
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23
  should serve a basic image on each replica with a public image  [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-apps] ReplicationController should serve a basic image on each replica with a public image  [Conformance]","total":-1,"completed":1,"skipped":2,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:12:12.125: INFO: Only supported for providers [azure] (not aws)
... skipping 86 lines ...
• [SLOW TEST:22.200 seconds]
[sig-apps] DisruptionController
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23
  evictions: enough pods, absolute => should allow an eviction
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/disruption.go:267
------------------------------
{"msg":"PASSED [sig-apps] DisruptionController evictions: enough pods, absolute =\u003e should allow an eviction","total":-1,"completed":1,"skipped":10,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:12:15.682: INFO: Only supported for providers [azure] (not aws)
... skipping 70 lines ...
• [SLOW TEST:19.458 seconds]
[sig-node] Pods
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  should support remote command execution over websockets [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] Pods should support remote command execution over websockets [NodeConformance] [Conformance]","total":-1,"completed":2,"skipped":10,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:12:15.722: INFO: Only supported for providers [azure] (not aws)
... skipping 69 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  when scheduling a busybox command that always fails in a pod
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/kubelet.go:79
    should have an terminated reason [NodeConformance] [Conformance]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] Kubelet when scheduling a busybox command that always fails in a pod should have an terminated reason [NodeConformance] [Conformance]","total":-1,"completed":1,"skipped":9,"failed":0}

SSSS
------------------------------
[BeforeEach] [sig-node] Downward API
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 2 lines ...
W0605 07:11:54.317365    4859 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
Jun  5 07:11:54.317: INFO: No PodSecurityPolicies found; assuming PodSecurityPolicy is disabled.
STEP: Waiting for a default service account to be provisioned in namespace
[It] should provide host IP as an env var [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test downward api env vars
Jun  5 07:11:54.413: INFO: Waiting up to 5m0s for pod "downward-api-8fc784b4-7a86-4b70-aee2-1f67be1d535d" in namespace "downward-api-3957" to be "Succeeded or Failed"
Jun  5 07:11:54.443: INFO: Pod "downward-api-8fc784b4-7a86-4b70-aee2-1f67be1d535d": Phase="Pending", Reason="", readiness=false. Elapsed: 30.292522ms
Jun  5 07:11:56.475: INFO: Pod "downward-api-8fc784b4-7a86-4b70-aee2-1f67be1d535d": Phase="Pending", Reason="", readiness=false. Elapsed: 2.061687946s
Jun  5 07:11:58.509: INFO: Pod "downward-api-8fc784b4-7a86-4b70-aee2-1f67be1d535d": Phase="Pending", Reason="", readiness=false. Elapsed: 4.095927249s
Jun  5 07:12:00.541: INFO: Pod "downward-api-8fc784b4-7a86-4b70-aee2-1f67be1d535d": Phase="Pending", Reason="", readiness=false. Elapsed: 6.128209502s
Jun  5 07:12:02.573: INFO: Pod "downward-api-8fc784b4-7a86-4b70-aee2-1f67be1d535d": Phase="Pending", Reason="", readiness=false. Elapsed: 8.159769788s
Jun  5 07:12:04.605: INFO: Pod "downward-api-8fc784b4-7a86-4b70-aee2-1f67be1d535d": Phase="Pending", Reason="", readiness=false. Elapsed: 10.191592081s
... skipping 2 lines ...
Jun  5 07:12:10.700: INFO: Pod "downward-api-8fc784b4-7a86-4b70-aee2-1f67be1d535d": Phase="Pending", Reason="", readiness=false. Elapsed: 16.286667059s
Jun  5 07:12:12.730: INFO: Pod "downward-api-8fc784b4-7a86-4b70-aee2-1f67be1d535d": Phase="Pending", Reason="", readiness=false. Elapsed: 18.317345728s
Jun  5 07:12:14.761: INFO: Pod "downward-api-8fc784b4-7a86-4b70-aee2-1f67be1d535d": Phase="Pending", Reason="", readiness=false. Elapsed: 20.348129072s
Jun  5 07:12:16.793: INFO: Pod "downward-api-8fc784b4-7a86-4b70-aee2-1f67be1d535d": Phase="Pending", Reason="", readiness=false. Elapsed: 22.380186474s
Jun  5 07:12:18.824: INFO: Pod "downward-api-8fc784b4-7a86-4b70-aee2-1f67be1d535d": Phase="Succeeded", Reason="", readiness=false. Elapsed: 24.410959247s
STEP: Saw pod success
Jun  5 07:12:18.824: INFO: Pod "downward-api-8fc784b4-7a86-4b70-aee2-1f67be1d535d" satisfied condition "Succeeded or Failed"
Jun  5 07:12:18.857: INFO: Trying to get logs from node ip-172-20-42-252.ca-central-1.compute.internal pod downward-api-8fc784b4-7a86-4b70-aee2-1f67be1d535d container dapi-container: <nil>
STEP: delete the pod
Jun  5 07:12:19.778: INFO: Waiting for pod downward-api-8fc784b4-7a86-4b70-aee2-1f67be1d535d to disappear
Jun  5 07:12:19.808: INFO: Pod downward-api-8fc784b4-7a86-4b70-aee2-1f67be1d535d no longer exists
[AfterEach] [sig-node] Downward API
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:26.462 seconds]
[sig-node] Downward API
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  should provide host IP as an env var [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] Downward API should provide host IP as an env var [NodeConformance] [Conformance]","total":-1,"completed":1,"skipped":6,"failed":0}

SSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:12:19.928: INFO: Driver "nfs" does not support volume expansion - skipping
... skipping 44 lines ...
Jun  5 07:12:03.646: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename downward-api
STEP: Waiting for a default service account to be provisioned in namespace
[It] should provide container's limits.cpu/memory and requests.cpu/memory as env vars [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test downward api env vars
Jun  5 07:12:03.831: INFO: Waiting up to 5m0s for pod "downward-api-1296d483-b408-49b7-8994-7166f6a46464" in namespace "downward-api-2867" to be "Succeeded or Failed"
Jun  5 07:12:03.862: INFO: Pod "downward-api-1296d483-b408-49b7-8994-7166f6a46464": Phase="Pending", Reason="", readiness=false. Elapsed: 30.35318ms
Jun  5 07:12:05.893: INFO: Pod "downward-api-1296d483-b408-49b7-8994-7166f6a46464": Phase="Pending", Reason="", readiness=false. Elapsed: 2.062028141s
Jun  5 07:12:07.926: INFO: Pod "downward-api-1296d483-b408-49b7-8994-7166f6a46464": Phase="Pending", Reason="", readiness=false. Elapsed: 4.094320631s
Jun  5 07:12:09.958: INFO: Pod "downward-api-1296d483-b408-49b7-8994-7166f6a46464": Phase="Pending", Reason="", readiness=false. Elapsed: 6.126276012s
Jun  5 07:12:11.991: INFO: Pod "downward-api-1296d483-b408-49b7-8994-7166f6a46464": Phase="Pending", Reason="", readiness=false. Elapsed: 8.159268323s
Jun  5 07:12:14.022: INFO: Pod "downward-api-1296d483-b408-49b7-8994-7166f6a46464": Phase="Pending", Reason="", readiness=false. Elapsed: 10.190146501s
Jun  5 07:12:16.052: INFO: Pod "downward-api-1296d483-b408-49b7-8994-7166f6a46464": Phase="Pending", Reason="", readiness=false. Elapsed: 12.221057096s
Jun  5 07:12:18.083: INFO: Pod "downward-api-1296d483-b408-49b7-8994-7166f6a46464": Phase="Pending", Reason="", readiness=false. Elapsed: 14.251949215s
Jun  5 07:12:20.115: INFO: Pod "downward-api-1296d483-b408-49b7-8994-7166f6a46464": Phase="Pending", Reason="", readiness=false. Elapsed: 16.28360397s
Jun  5 07:12:22.147: INFO: Pod "downward-api-1296d483-b408-49b7-8994-7166f6a46464": Phase="Pending", Reason="", readiness=false. Elapsed: 18.315929734s
Jun  5 07:12:24.179: INFO: Pod "downward-api-1296d483-b408-49b7-8994-7166f6a46464": Phase="Pending", Reason="", readiness=false. Elapsed: 20.347994268s
Jun  5 07:12:26.211: INFO: Pod "downward-api-1296d483-b408-49b7-8994-7166f6a46464": Phase="Succeeded", Reason="", readiness=false. Elapsed: 22.379147884s
STEP: Saw pod success
Jun  5 07:12:26.211: INFO: Pod "downward-api-1296d483-b408-49b7-8994-7166f6a46464" satisfied condition "Succeeded or Failed"
Jun  5 07:12:26.241: INFO: Trying to get logs from node ip-172-20-42-252.ca-central-1.compute.internal pod downward-api-1296d483-b408-49b7-8994-7166f6a46464 container dapi-container: <nil>
STEP: delete the pod
Jun  5 07:12:26.321: INFO: Waiting for pod downward-api-1296d483-b408-49b7-8994-7166f6a46464 to disappear
Jun  5 07:12:26.351: INFO: Pod downward-api-1296d483-b408-49b7-8994-7166f6a46464 no longer exists
[AfterEach] [sig-node] Downward API
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:22.768 seconds]
[sig-node] Downward API
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  should provide container's limits.cpu/memory and requests.cpu/memory as env vars [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] Downward API should provide container's limits.cpu/memory and requests.cpu/memory as env vars [NodeConformance] [Conformance]","total":-1,"completed":2,"skipped":23,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:12:26.429: INFO: Driver "nfs" does not provide raw block - skipping
... skipping 57 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Jun  5 07:12:26.807: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "kubectl-3668" for this suite.

•
------------------------------
{"msg":"PASSED [sig-cli] Kubectl client Kubectl version should check is all data is printed  [Conformance]","total":-1,"completed":3,"skipped":32,"failed":0}
[BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Jun  5 07:12:26.879: INFO: >>> kubeConfig: /root/.kube/config
... skipping 76 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/framework.go:23
  With a server listening on localhost
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/portforward.go:474
    should support forwarding over websockets
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/portforward.go:490
------------------------------
{"msg":"PASSED [sig-cli] Kubectl Port forwarding With a server listening on localhost should support forwarding over websockets","total":-1,"completed":3,"skipped":21,"failed":0}

SSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:12:28.345: INFO: Only supported for providers [azure] (not aws)
... skipping 45 lines ...
STEP: Building a namespace api object, basename secrets
STEP: Waiting for a default service account to be provisioned in namespace
[It] should be consumable from pods in volume with mappings and Item Mode set [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating secret with name secret-test-map-51e962a8-47c6-4b2b-ab0f-4ba413994f9d
STEP: Creating a pod to test consume secrets
Jun  5 07:12:12.399: INFO: Waiting up to 5m0s for pod "pod-secrets-dd124eca-d142-4f5e-86a8-c91f6f9ff511" in namespace "secrets-7681" to be "Succeeded or Failed"
Jun  5 07:12:12.429: INFO: Pod "pod-secrets-dd124eca-d142-4f5e-86a8-c91f6f9ff511": Phase="Pending", Reason="", readiness=false. Elapsed: 30.29255ms
Jun  5 07:12:14.463: INFO: Pod "pod-secrets-dd124eca-d142-4f5e-86a8-c91f6f9ff511": Phase="Pending", Reason="", readiness=false. Elapsed: 2.064227292s
Jun  5 07:12:16.495: INFO: Pod "pod-secrets-dd124eca-d142-4f5e-86a8-c91f6f9ff511": Phase="Pending", Reason="", readiness=false. Elapsed: 4.096150111s
Jun  5 07:12:18.527: INFO: Pod "pod-secrets-dd124eca-d142-4f5e-86a8-c91f6f9ff511": Phase="Pending", Reason="", readiness=false. Elapsed: 6.12801464s
Jun  5 07:12:20.558: INFO: Pod "pod-secrets-dd124eca-d142-4f5e-86a8-c91f6f9ff511": Phase="Pending", Reason="", readiness=false. Elapsed: 8.159220247s
Jun  5 07:12:22.590: INFO: Pod "pod-secrets-dd124eca-d142-4f5e-86a8-c91f6f9ff511": Phase="Pending", Reason="", readiness=false. Elapsed: 10.191155527s
Jun  5 07:12:24.623: INFO: Pod "pod-secrets-dd124eca-d142-4f5e-86a8-c91f6f9ff511": Phase="Pending", Reason="", readiness=false. Elapsed: 12.224596s
Jun  5 07:12:26.655: INFO: Pod "pod-secrets-dd124eca-d142-4f5e-86a8-c91f6f9ff511": Phase="Pending", Reason="", readiness=false. Elapsed: 14.25593296s
Jun  5 07:12:28.686: INFO: Pod "pod-secrets-dd124eca-d142-4f5e-86a8-c91f6f9ff511": Phase="Succeeded", Reason="", readiness=false. Elapsed: 16.287045655s
STEP: Saw pod success
Jun  5 07:12:28.686: INFO: Pod "pod-secrets-dd124eca-d142-4f5e-86a8-c91f6f9ff511" satisfied condition "Succeeded or Failed"
Jun  5 07:12:28.717: INFO: Trying to get logs from node ip-172-20-42-252.ca-central-1.compute.internal pod pod-secrets-dd124eca-d142-4f5e-86a8-c91f6f9ff511 container secret-volume-test: <nil>
STEP: delete the pod
Jun  5 07:12:28.790: INFO: Waiting for pod pod-secrets-dd124eca-d142-4f5e-86a8-c91f6f9ff511 to disappear
Jun  5 07:12:28.820: INFO: Pod pod-secrets-dd124eca-d142-4f5e-86a8-c91f6f9ff511 no longer exists
[AfterEach] [sig-storage] Secrets
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:16.732 seconds]
[sig-storage] Secrets
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should be consumable from pods in volume with mappings and Item Mode set [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] Secrets should be consumable from pods in volume with mappings and Item Mode set [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":2,"skipped":9,"failed":0}
[BeforeEach] [Testpattern: Inline-volume (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:12:28.904: INFO: Only supported for providers [vsphere] (not aws)
[AfterEach] [Testpattern: Inline-volume (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 48 lines ...
• [SLOW TEST:10.620 seconds]
[sig-api-machinery] Watchers
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  should observe an object deletion if it stops meeting the requirements of the selector [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] Watchers should observe an object deletion if it stops meeting the requirements of the selector [Conformance]","total":-1,"completed":2,"skipped":13,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:12:30.112: INFO: Driver nfs doesn't support Block -- skipping
[AfterEach] [Testpattern: Dynamic PV (block volmode)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 11 lines ...
      Driver nfs doesn't support Block -- skipping

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/provisioning.go:105
------------------------------
S
------------------------------
{"msg":"PASSED [sig-network] Services should find a service from listing all namespaces [Conformance]","total":-1,"completed":1,"skipped":5,"failed":0}
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Jun  5 07:11:55.150: INFO: >>> kubeConfig: /root/.kube/config
... skipping 15 lines ...
Jun  5 07:12:20.790: INFO: PersistentVolumeClaim pvc-nhgdd found but phase is Pending instead of Bound.
Jun  5 07:12:22.821: INFO: PersistentVolumeClaim pvc-nhgdd found and phase=Bound (2.061561777s)
Jun  5 07:12:22.821: INFO: Waiting up to 3m0s for PersistentVolume local-84vzk to have phase Bound
Jun  5 07:12:22.851: INFO: PersistentVolume local-84vzk found and phase=Bound (30.412963ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-6q6g
STEP: Creating a pod to test subpath
Jun  5 07:12:22.945: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-6q6g" in namespace "provisioning-4504" to be "Succeeded or Failed"
Jun  5 07:12:22.975: INFO: Pod "pod-subpath-test-preprovisionedpv-6q6g": Phase="Pending", Reason="", readiness=false. Elapsed: 30.375577ms
Jun  5 07:12:25.006: INFO: Pod "pod-subpath-test-preprovisionedpv-6q6g": Phase="Pending", Reason="", readiness=false. Elapsed: 2.061321001s
Jun  5 07:12:27.038: INFO: Pod "pod-subpath-test-preprovisionedpv-6q6g": Phase="Pending", Reason="", readiness=false. Elapsed: 4.093512782s
Jun  5 07:12:29.070: INFO: Pod "pod-subpath-test-preprovisionedpv-6q6g": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.125385674s
STEP: Saw pod success
Jun  5 07:12:29.070: INFO: Pod "pod-subpath-test-preprovisionedpv-6q6g" satisfied condition "Succeeded or Failed"
Jun  5 07:12:29.100: INFO: Trying to get logs from node ip-172-20-62-33.ca-central-1.compute.internal pod pod-subpath-test-preprovisionedpv-6q6g container test-container-volume-preprovisionedpv-6q6g: <nil>
STEP: delete the pod
Jun  5 07:12:29.167: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-6q6g to disappear
Jun  5 07:12:29.198: INFO: Pod pod-subpath-test-preprovisionedpv-6q6g no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-6q6g
Jun  5 07:12:29.198: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-6q6g" in namespace "provisioning-4504"
... skipping 24 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support non-existent path
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:194
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: block] [Testpattern: Pre-provisioned PV (default fs)] subPath should support non-existent path","total":-1,"completed":2,"skipped":5,"failed":0}

SSS
------------------------------
[BeforeEach] [sig-node] PreStop
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 21 lines ...
• [SLOW TEST:40.650 seconds]
[sig-node] PreStop
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/framework.go:23
  graceful pod terminated should wait until preStop hook completes the process
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/pre_stop.go:170
------------------------------
{"msg":"PASSED [sig-node] PreStop graceful pod terminated should wait until preStop hook completes the process","total":-1,"completed":1,"skipped":1,"failed":0}

SSSSS
------------------------------
[BeforeEach] [sig-network] Services
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 38 lines ...
• [SLOW TEST:42.563 seconds]
[sig-network] Services
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/common/framework.go:23
  should be able to change the type from NodePort to ExternalName [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-network] Services should be able to change the type from NodePort to ExternalName [Conformance]","total":-1,"completed":1,"skipped":5,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] capacity
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:12:36.061: INFO: Driver emptydir doesn't support DynamicPV -- skipping
... skipping 85 lines ...
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159

      Only supported for node OS distro [gci ubuntu custom] (not debian)

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/drivers/in_tree.go:263
------------------------------
{"msg":"PASSED [sig-api-machinery] ResourceQuota should verify ResourceQuota with best effort scope. [Conformance]","total":-1,"completed":1,"skipped":4,"failed":0}
[BeforeEach] [sig-api-machinery] ResourceQuota
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Jun  5 07:12:10.779: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename resourcequota
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 18 lines ...
• [SLOW TEST:25.721 seconds]
[sig-api-machinery] ResourceQuota
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  should create a ResourceQuota and capture the life of a custom resource.
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/resource_quota.go:583
------------------------------
{"msg":"PASSED [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a custom resource.","total":-1,"completed":2,"skipped":4,"failed":0}

SSS
------------------------------
[BeforeEach] [sig-storage] Subpath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 6 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/subpath.go:38
STEP: Setting up data
[It] should support subpaths with projected pod [LinuxOnly] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating pod pod-subpath-test-projected-h5nt
STEP: Creating a pod to test atomic-volume-subpath
Jun  5 07:11:55.973: INFO: Waiting up to 5m0s for pod "pod-subpath-test-projected-h5nt" in namespace "subpath-2531" to be "Succeeded or Failed"
Jun  5 07:11:56.005: INFO: Pod "pod-subpath-test-projected-h5nt": Phase="Pending", Reason="", readiness=false. Elapsed: 31.224993ms
Jun  5 07:11:58.038: INFO: Pod "pod-subpath-test-projected-h5nt": Phase="Pending", Reason="", readiness=false. Elapsed: 2.064531581s
Jun  5 07:12:00.071: INFO: Pod "pod-subpath-test-projected-h5nt": Phase="Pending", Reason="", readiness=false. Elapsed: 4.097190891s
Jun  5 07:12:02.102: INFO: Pod "pod-subpath-test-projected-h5nt": Phase="Pending", Reason="", readiness=false. Elapsed: 6.128779215s
Jun  5 07:12:04.134: INFO: Pod "pod-subpath-test-projected-h5nt": Phase="Pending", Reason="", readiness=false. Elapsed: 8.160927818s
Jun  5 07:12:06.166: INFO: Pod "pod-subpath-test-projected-h5nt": Phase="Pending", Reason="", readiness=false. Elapsed: 10.192861751s
... skipping 10 lines ...
Jun  5 07:12:28.537: INFO: Pod "pod-subpath-test-projected-h5nt": Phase="Running", Reason="", readiness=true. Elapsed: 32.563090854s
Jun  5 07:12:30.572: INFO: Pod "pod-subpath-test-projected-h5nt": Phase="Running", Reason="", readiness=true. Elapsed: 34.598882684s
Jun  5 07:12:32.604: INFO: Pod "pod-subpath-test-projected-h5nt": Phase="Running", Reason="", readiness=true. Elapsed: 36.630668366s
Jun  5 07:12:34.636: INFO: Pod "pod-subpath-test-projected-h5nt": Phase="Running", Reason="", readiness=true. Elapsed: 38.662349532s
Jun  5 07:12:36.669: INFO: Pod "pod-subpath-test-projected-h5nt": Phase="Succeeded", Reason="", readiness=false. Elapsed: 40.695106169s
STEP: Saw pod success
Jun  5 07:12:36.669: INFO: Pod "pod-subpath-test-projected-h5nt" satisfied condition "Succeeded or Failed"
Jun  5 07:12:36.700: INFO: Trying to get logs from node ip-172-20-55-143.ca-central-1.compute.internal pod pod-subpath-test-projected-h5nt container test-container-subpath-projected-h5nt: <nil>
STEP: delete the pod
Jun  5 07:12:36.768: INFO: Waiting for pod pod-subpath-test-projected-h5nt to disappear
Jun  5 07:12:36.799: INFO: Pod pod-subpath-test-projected-h5nt no longer exists
STEP: Deleting pod pod-subpath-test-projected-h5nt
Jun  5 07:12:36.799: INFO: Deleting pod "pod-subpath-test-projected-h5nt" in namespace "subpath-2531"
... skipping 8 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  Atomic writer volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/subpath.go:34
    should support subpaths with projected pod [LinuxOnly] [Conformance]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] Subpath Atomic writer volumes should support subpaths with projected pod [LinuxOnly] [Conformance]","total":-1,"completed":1,"skipped":14,"failed":0}

SSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:12:36.961: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 71 lines ...
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] [sig-storage] Downward API volume
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/downwardapi_volume.go:41
[It] should provide container's cpu request [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test downward API volume plugin
Jun  5 07:12:20.142: INFO: Waiting up to 5m0s for pod "downwardapi-volume-bfa644e5-6f1a-4b3f-b8aa-2f8c5e500fb8" in namespace "downward-api-5604" to be "Succeeded or Failed"
Jun  5 07:12:20.173: INFO: Pod "downwardapi-volume-bfa644e5-6f1a-4b3f-b8aa-2f8c5e500fb8": Phase="Pending", Reason="", readiness=false. Elapsed: 31.19189ms
Jun  5 07:12:22.204: INFO: Pod "downwardapi-volume-bfa644e5-6f1a-4b3f-b8aa-2f8c5e500fb8": Phase="Pending", Reason="", readiness=false. Elapsed: 2.062390688s
Jun  5 07:12:24.235: INFO: Pod "downwardapi-volume-bfa644e5-6f1a-4b3f-b8aa-2f8c5e500fb8": Phase="Pending", Reason="", readiness=false. Elapsed: 4.093129143s
Jun  5 07:12:26.266: INFO: Pod "downwardapi-volume-bfa644e5-6f1a-4b3f-b8aa-2f8c5e500fb8": Phase="Pending", Reason="", readiness=false. Elapsed: 6.124279422s
Jun  5 07:12:28.296: INFO: Pod "downwardapi-volume-bfa644e5-6f1a-4b3f-b8aa-2f8c5e500fb8": Phase="Pending", Reason="", readiness=false. Elapsed: 8.15481158s
Jun  5 07:12:30.328: INFO: Pod "downwardapi-volume-bfa644e5-6f1a-4b3f-b8aa-2f8c5e500fb8": Phase="Pending", Reason="", readiness=false. Elapsed: 10.186311834s
Jun  5 07:12:32.359: INFO: Pod "downwardapi-volume-bfa644e5-6f1a-4b3f-b8aa-2f8c5e500fb8": Phase="Pending", Reason="", readiness=false. Elapsed: 12.217675873s
Jun  5 07:12:34.391: INFO: Pod "downwardapi-volume-bfa644e5-6f1a-4b3f-b8aa-2f8c5e500fb8": Phase="Pending", Reason="", readiness=false. Elapsed: 14.248944924s
Jun  5 07:12:36.422: INFO: Pod "downwardapi-volume-bfa644e5-6f1a-4b3f-b8aa-2f8c5e500fb8": Phase="Pending", Reason="", readiness=false. Elapsed: 16.280015542s
Jun  5 07:12:38.452: INFO: Pod "downwardapi-volume-bfa644e5-6f1a-4b3f-b8aa-2f8c5e500fb8": Phase="Succeeded", Reason="", readiness=false. Elapsed: 18.31055994s
STEP: Saw pod success
Jun  5 07:12:38.452: INFO: Pod "downwardapi-volume-bfa644e5-6f1a-4b3f-b8aa-2f8c5e500fb8" satisfied condition "Succeeded or Failed"
Jun  5 07:12:38.484: INFO: Trying to get logs from node ip-172-20-42-252.ca-central-1.compute.internal pod downwardapi-volume-bfa644e5-6f1a-4b3f-b8aa-2f8c5e500fb8 container client-container: <nil>
STEP: delete the pod
Jun  5 07:12:38.551: INFO: Waiting for pod downwardapi-volume-bfa644e5-6f1a-4b3f-b8aa-2f8c5e500fb8 to disappear
Jun  5 07:12:38.583: INFO: Pod downwardapi-volume-bfa644e5-6f1a-4b3f-b8aa-2f8c5e500fb8 no longer exists
[AfterEach] [sig-storage] Downward API volume
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 15 lines ...
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] when FSGroup is specified [LinuxOnly] [NodeFeature:FSGroup]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/empty_dir.go:50
[It] files with FSGroup ownership should support (root,0644,tmpfs)
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/empty_dir.go:67
STEP: Creating a pod to test emptydir 0644 on tmpfs
Jun  5 07:12:28.572: INFO: Waiting up to 5m0s for pod "pod-6082eb61-b1c7-44ca-a980-d16dc011b5c2" in namespace "emptydir-6925" to be "Succeeded or Failed"
Jun  5 07:12:28.602: INFO: Pod "pod-6082eb61-b1c7-44ca-a980-d16dc011b5c2": Phase="Pending", Reason="", readiness=false. Elapsed: 30.466944ms
Jun  5 07:12:30.633: INFO: Pod "pod-6082eb61-b1c7-44ca-a980-d16dc011b5c2": Phase="Pending", Reason="", readiness=false. Elapsed: 2.061576404s
Jun  5 07:12:32.664: INFO: Pod "pod-6082eb61-b1c7-44ca-a980-d16dc011b5c2": Phase="Pending", Reason="", readiness=false. Elapsed: 4.092121387s
Jun  5 07:12:34.695: INFO: Pod "pod-6082eb61-b1c7-44ca-a980-d16dc011b5c2": Phase="Pending", Reason="", readiness=false. Elapsed: 6.123024242s
Jun  5 07:12:36.728: INFO: Pod "pod-6082eb61-b1c7-44ca-a980-d16dc011b5c2": Phase="Pending", Reason="", readiness=false. Elapsed: 8.156412514s
Jun  5 07:12:38.759: INFO: Pod "pod-6082eb61-b1c7-44ca-a980-d16dc011b5c2": Phase="Succeeded", Reason="", readiness=false. Elapsed: 10.187157495s
STEP: Saw pod success
Jun  5 07:12:38.759: INFO: Pod "pod-6082eb61-b1c7-44ca-a980-d16dc011b5c2" satisfied condition "Succeeded or Failed"
Jun  5 07:12:38.790: INFO: Trying to get logs from node ip-172-20-62-33.ca-central-1.compute.internal pod pod-6082eb61-b1c7-44ca-a980-d16dc011b5c2 container test-container: <nil>
STEP: delete the pod
Jun  5 07:12:38.856: INFO: Waiting for pod pod-6082eb61-b1c7-44ca-a980-d16dc011b5c2 to disappear
Jun  5 07:12:38.887: INFO: Pod pod-6082eb61-b1c7-44ca-a980-d16dc011b5c2 no longer exists
[AfterEach] [sig-storage] EmptyDir volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 6 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  when FSGroup is specified [LinuxOnly] [NodeFeature:FSGroup]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/empty_dir.go:48
    files with FSGroup ownership should support (root,0644,tmpfs)
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/empty_dir.go:67
------------------------------
{"msg":"PASSED [sig-storage] EmptyDir volumes when FSGroup is specified [LinuxOnly] [NodeFeature:FSGroup] files with FSGroup ownership should support (root,0644,tmpfs)","total":-1,"completed":4,"skipped":30,"failed":0}

S
------------------------------
[BeforeEach] [sig-storage] Projected configMap
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Jun  5 07:12:30.498: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename projected
STEP: Waiting for a default service account to be provisioned in namespace
[It] should be consumable from pods in volume as non-root [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating configMap with name projected-configmap-test-volume-5b7746e7-850f-4a6c-92c1-d5f305a98d26
STEP: Creating a pod to test consume configMaps
Jun  5 07:12:30.713: INFO: Waiting up to 5m0s for pod "pod-projected-configmaps-f22894bf-82a0-43a7-9df5-4e919b6e42c4" in namespace "projected-8655" to be "Succeeded or Failed"
Jun  5 07:12:30.744: INFO: Pod "pod-projected-configmaps-f22894bf-82a0-43a7-9df5-4e919b6e42c4": Phase="Pending", Reason="", readiness=false. Elapsed: 31.005095ms
Jun  5 07:12:32.775: INFO: Pod "pod-projected-configmaps-f22894bf-82a0-43a7-9df5-4e919b6e42c4": Phase="Pending", Reason="", readiness=false. Elapsed: 2.06208833s
Jun  5 07:12:34.806: INFO: Pod "pod-projected-configmaps-f22894bf-82a0-43a7-9df5-4e919b6e42c4": Phase="Pending", Reason="", readiness=false. Elapsed: 4.092751374s
Jun  5 07:12:36.837: INFO: Pod "pod-projected-configmaps-f22894bf-82a0-43a7-9df5-4e919b6e42c4": Phase="Pending", Reason="", readiness=false. Elapsed: 6.124426287s
Jun  5 07:12:38.868: INFO: Pod "pod-projected-configmaps-f22894bf-82a0-43a7-9df5-4e919b6e42c4": Phase="Succeeded", Reason="", readiness=false. Elapsed: 8.154956088s
STEP: Saw pod success
Jun  5 07:12:38.868: INFO: Pod "pod-projected-configmaps-f22894bf-82a0-43a7-9df5-4e919b6e42c4" satisfied condition "Succeeded or Failed"
Jun  5 07:12:38.898: INFO: Trying to get logs from node ip-172-20-48-31.ca-central-1.compute.internal pod pod-projected-configmaps-f22894bf-82a0-43a7-9df5-4e919b6e42c4 container agnhost-container: <nil>
STEP: delete the pod
Jun  5 07:12:38.978: INFO: Waiting for pod pod-projected-configmaps-f22894bf-82a0-43a7-9df5-4e919b6e42c4 to disappear
Jun  5 07:12:39.012: INFO: Pod pod-projected-configmaps-f22894bf-82a0-43a7-9df5-4e919b6e42c4 no longer exists
[AfterEach] [sig-storage] Projected configMap
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:8.584 seconds]
[sig-storage] Projected configMap
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should be consumable from pods in volume as non-root [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] Projected configMap should be consumable from pods in volume as non-root [NodeConformance] [Conformance]","total":-1,"completed":3,"skipped":8,"failed":0}

SSS
------------------------------
{"msg":"PASSED [sig-storage] Downward API volume should provide container's cpu request [NodeConformance] [Conformance]","total":-1,"completed":2,"skipped":17,"failed":0}
[BeforeEach] [sig-storage] PV Protection
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Jun  5 07:12:38.655: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename pv-protection
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 46 lines ...
Jun  5 07:11:53.610: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-5683dcjrg
STEP: creating a claim
Jun  5 07:11:53.662: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-kjkm
STEP: Creating a pod to test subpath
Jun  5 07:11:53.822: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-kjkm" in namespace "provisioning-5683" to be "Succeeded or Failed"
Jun  5 07:11:53.854: INFO: Pod "pod-subpath-test-dynamicpv-kjkm": Phase="Pending", Reason="", readiness=false. Elapsed: 31.534177ms
Jun  5 07:11:55.894: INFO: Pod "pod-subpath-test-dynamicpv-kjkm": Phase="Pending", Reason="", readiness=false. Elapsed: 2.071709949s
Jun  5 07:11:57.932: INFO: Pod "pod-subpath-test-dynamicpv-kjkm": Phase="Pending", Reason="", readiness=false. Elapsed: 4.110055538s
Jun  5 07:11:59.965: INFO: Pod "pod-subpath-test-dynamicpv-kjkm": Phase="Pending", Reason="", readiness=false. Elapsed: 6.142337328s
Jun  5 07:12:01.996: INFO: Pod "pod-subpath-test-dynamicpv-kjkm": Phase="Pending", Reason="", readiness=false. Elapsed: 8.173679175s
Jun  5 07:12:04.028: INFO: Pod "pod-subpath-test-dynamicpv-kjkm": Phase="Pending", Reason="", readiness=false. Elapsed: 10.205644317s
... skipping 5 lines ...
Jun  5 07:12:16.237: INFO: Pod "pod-subpath-test-dynamicpv-kjkm": Phase="Pending", Reason="", readiness=false. Elapsed: 22.414354098s
Jun  5 07:12:18.269: INFO: Pod "pod-subpath-test-dynamicpv-kjkm": Phase="Pending", Reason="", readiness=false. Elapsed: 24.446668614s
Jun  5 07:12:20.304: INFO: Pod "pod-subpath-test-dynamicpv-kjkm": Phase="Pending", Reason="", readiness=false. Elapsed: 26.481911128s
Jun  5 07:12:22.336: INFO: Pod "pod-subpath-test-dynamicpv-kjkm": Phase="Pending", Reason="", readiness=false. Elapsed: 28.513512189s
Jun  5 07:12:24.368: INFO: Pod "pod-subpath-test-dynamicpv-kjkm": Phase="Succeeded", Reason="", readiness=false. Elapsed: 30.545191277s
STEP: Saw pod success
Jun  5 07:12:24.368: INFO: Pod "pod-subpath-test-dynamicpv-kjkm" satisfied condition "Succeeded or Failed"
Jun  5 07:12:24.398: INFO: Trying to get logs from node ip-172-20-55-143.ca-central-1.compute.internal pod pod-subpath-test-dynamicpv-kjkm container test-container-subpath-dynamicpv-kjkm: <nil>
STEP: delete the pod
Jun  5 07:12:24.476: INFO: Waiting for pod pod-subpath-test-dynamicpv-kjkm to disappear
Jun  5 07:12:24.507: INFO: Pod pod-subpath-test-dynamicpv-kjkm no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-kjkm
Jun  5 07:12:24.507: INFO: Deleting pod "pod-subpath-test-dynamicpv-kjkm" in namespace "provisioning-5683"
... skipping 20 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support readOnly file specified in the volumeMount [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:379
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]","total":-1,"completed":1,"skipped":2,"failed":0}

SS
------------------------------
[BeforeEach] [sig-node] PodTemplates
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 15 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Jun  5 07:12:40.315: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "podtemplate-7019" for this suite.

•
------------------------------
{"msg":"PASSED [sig-node] PodTemplates should delete a collection of pod templates [Conformance]","total":-1,"completed":2,"skipped":4,"failed":0}

S
------------------------------
[BeforeEach] [sig-node] kubelet
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 130 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/framework.go:23
  Clean up pods on node
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/kubelet.go:279
    kubelet should be able to delete 10 pods per node in 1m0s.
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/kubelet.go:341
------------------------------
{"msg":"PASSED [sig-node] kubelet Clean up pods on node kubelet should be able to delete 10 pods per node in 1m0s.","total":-1,"completed":1,"skipped":2,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:12:42.930: INFO: Driver local doesn't support InlineVolume -- skipping
... skipping 46 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  when scheduling a read only busybox container
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/kubelet.go:188
    should not write to root filesystem [LinuxOnly] [NodeConformance] [Conformance]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] Kubelet when scheduling a read only busybox container should not write to root filesystem [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":3,"skipped":19,"failed":0}

SSSS
------------------------------
[BeforeEach] [sig-storage] Projected secret
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Jun  5 07:12:37.020: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename projected
STEP: Waiting for a default service account to be provisioned in namespace
[It] should be consumable from pods in volume with defaultMode set [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating projection with secret that has name projected-secret-test-8f63fe6f-e4e3-4162-9c42-3e498573fe53
STEP: Creating a pod to test consume secrets
Jun  5 07:12:37.243: INFO: Waiting up to 5m0s for pod "pod-projected-secrets-490ff70d-4511-4079-98af-c6072642c12a" in namespace "projected-8816" to be "Succeeded or Failed"
Jun  5 07:12:37.275: INFO: Pod "pod-projected-secrets-490ff70d-4511-4079-98af-c6072642c12a": Phase="Pending", Reason="", readiness=false. Elapsed: 31.170484ms
Jun  5 07:12:39.307: INFO: Pod "pod-projected-secrets-490ff70d-4511-4079-98af-c6072642c12a": Phase="Pending", Reason="", readiness=false. Elapsed: 2.063811183s
Jun  5 07:12:41.347: INFO: Pod "pod-projected-secrets-490ff70d-4511-4079-98af-c6072642c12a": Phase="Pending", Reason="", readiness=false. Elapsed: 4.103277995s
Jun  5 07:12:43.379: INFO: Pod "pod-projected-secrets-490ff70d-4511-4079-98af-c6072642c12a": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.135114769s
STEP: Saw pod success
Jun  5 07:12:43.379: INFO: Pod "pod-projected-secrets-490ff70d-4511-4079-98af-c6072642c12a" satisfied condition "Succeeded or Failed"
Jun  5 07:12:43.410: INFO: Trying to get logs from node ip-172-20-48-31.ca-central-1.compute.internal pod pod-projected-secrets-490ff70d-4511-4079-98af-c6072642c12a container projected-secret-volume-test: <nil>
STEP: delete the pod
Jun  5 07:12:43.480: INFO: Waiting for pod pod-projected-secrets-490ff70d-4511-4079-98af-c6072642c12a to disappear
Jun  5 07:12:43.511: INFO: Pod pod-projected-secrets-490ff70d-4511-4079-98af-c6072642c12a no longer exists
[AfterEach] [sig-storage] Projected secret
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:6.558 seconds]
[sig-storage] Projected secret
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should be consumable from pods in volume with defaultMode set [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] Projected secret should be consumable from pods in volume with defaultMode set [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":2,"skipped":30,"failed":0}

SSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:12:43.616: INFO: Driver hostPath doesn't support DynamicPV -- skipping
... skipping 51 lines ...
• [SLOW TEST:33.555 seconds]
[sig-node] Pods
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  should support pod readiness gates [NodeFeature:PodReadinessGate]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/pods.go:777
------------------------------
{"msg":"PASSED [sig-node] Pods should support pod readiness gates [NodeFeature:PodReadinessGate]","total":-1,"completed":2,"skipped":10,"failed":0}

SSS
------------------------------
[BeforeEach] [sig-storage] ConfigMap
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Jun  5 07:12:34.026: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename configmap
STEP: Waiting for a default service account to be provisioned in namespace
[It] should be consumable from pods in volume as non-root with defaultMode and fsGroup set [LinuxOnly] [NodeFeature:FSGroup]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/configmap_volume.go:59
STEP: Creating configMap with name configmap-test-volume-b7f04e5b-9439-452c-9691-1bfbc0dbb0d0
STEP: Creating a pod to test consume configMaps
Jun  5 07:12:34.252: INFO: Waiting up to 5m0s for pod "pod-configmaps-6a3b77d0-0a11-448b-8776-1b05fd27f299" in namespace "configmap-3503" to be "Succeeded or Failed"
Jun  5 07:12:34.284: INFO: Pod "pod-configmaps-6a3b77d0-0a11-448b-8776-1b05fd27f299": Phase="Pending", Reason="", readiness=false. Elapsed: 31.332841ms
Jun  5 07:12:36.316: INFO: Pod "pod-configmaps-6a3b77d0-0a11-448b-8776-1b05fd27f299": Phase="Pending", Reason="", readiness=false. Elapsed: 2.063933617s
Jun  5 07:12:38.349: INFO: Pod "pod-configmaps-6a3b77d0-0a11-448b-8776-1b05fd27f299": Phase="Pending", Reason="", readiness=false. Elapsed: 4.096681183s
Jun  5 07:12:40.383: INFO: Pod "pod-configmaps-6a3b77d0-0a11-448b-8776-1b05fd27f299": Phase="Pending", Reason="", readiness=false. Elapsed: 6.130428867s
Jun  5 07:12:42.416: INFO: Pod "pod-configmaps-6a3b77d0-0a11-448b-8776-1b05fd27f299": Phase="Pending", Reason="", readiness=false. Elapsed: 8.163271535s
Jun  5 07:12:44.449: INFO: Pod "pod-configmaps-6a3b77d0-0a11-448b-8776-1b05fd27f299": Phase="Succeeded", Reason="", readiness=false. Elapsed: 10.196535648s
STEP: Saw pod success
Jun  5 07:12:44.449: INFO: Pod "pod-configmaps-6a3b77d0-0a11-448b-8776-1b05fd27f299" satisfied condition "Succeeded or Failed"
Jun  5 07:12:44.482: INFO: Trying to get logs from node ip-172-20-48-31.ca-central-1.compute.internal pod pod-configmaps-6a3b77d0-0a11-448b-8776-1b05fd27f299 container agnhost-container: <nil>
STEP: delete the pod
Jun  5 07:12:44.553: INFO: Waiting for pod pod-configmaps-6a3b77d0-0a11-448b-8776-1b05fd27f299 to disappear
Jun  5 07:12:44.584: INFO: Pod pod-configmaps-6a3b77d0-0a11-448b-8776-1b05fd27f299 no longer exists
[AfterEach] [sig-storage] ConfigMap
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:10.635 seconds]
[sig-storage] ConfigMap
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should be consumable from pods in volume as non-root with defaultMode and fsGroup set [LinuxOnly] [NodeFeature:FSGroup]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/configmap_volume.go:59
------------------------------
{"msg":"PASSED [sig-storage] ConfigMap should be consumable from pods in volume as non-root with defaultMode and fsGroup set [LinuxOnly] [NodeFeature:FSGroup]","total":-1,"completed":2,"skipped":6,"failed":0}

S
------------------------------
[BeforeEach] [sig-network] Networking
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 201 lines ...
[It] should support existing single file [LinuxOnly]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:219
Jun  5 07:12:40.557: INFO: In-tree plugin kubernetes.io/empty-dir is not migrated, not validating any metrics
Jun  5 07:12:40.557: INFO: Creating resource for inline volume
STEP: Creating pod pod-subpath-test-inlinevolume-r2f4
STEP: Creating a pod to test subpath
Jun  5 07:12:40.591: INFO: Waiting up to 5m0s for pod "pod-subpath-test-inlinevolume-r2f4" in namespace "provisioning-2508" to be "Succeeded or Failed"
Jun  5 07:12:40.622: INFO: Pod "pod-subpath-test-inlinevolume-r2f4": Phase="Pending", Reason="", readiness=false. Elapsed: 31.227734ms
Jun  5 07:12:42.654: INFO: Pod "pod-subpath-test-inlinevolume-r2f4": Phase="Pending", Reason="", readiness=false. Elapsed: 2.062770071s
Jun  5 07:12:44.688: INFO: Pod "pod-subpath-test-inlinevolume-r2f4": Phase="Pending", Reason="", readiness=false. Elapsed: 4.097409458s
Jun  5 07:12:46.720: INFO: Pod "pod-subpath-test-inlinevolume-r2f4": Phase="Pending", Reason="", readiness=false. Elapsed: 6.129583547s
Jun  5 07:12:48.752: INFO: Pod "pod-subpath-test-inlinevolume-r2f4": Phase="Pending", Reason="", readiness=false. Elapsed: 8.161116045s
Jun  5 07:12:50.783: INFO: Pod "pod-subpath-test-inlinevolume-r2f4": Phase="Pending", Reason="", readiness=false. Elapsed: 10.192437213s
Jun  5 07:12:52.815: INFO: Pod "pod-subpath-test-inlinevolume-r2f4": Phase="Succeeded", Reason="", readiness=false. Elapsed: 12.223780431s
STEP: Saw pod success
Jun  5 07:12:52.815: INFO: Pod "pod-subpath-test-inlinevolume-r2f4" satisfied condition "Succeeded or Failed"
Jun  5 07:12:52.846: INFO: Trying to get logs from node ip-172-20-48-31.ca-central-1.compute.internal pod pod-subpath-test-inlinevolume-r2f4 container test-container-subpath-inlinevolume-r2f4: <nil>
STEP: delete the pod
Jun  5 07:12:52.915: INFO: Waiting for pod pod-subpath-test-inlinevolume-r2f4 to disappear
Jun  5 07:12:52.945: INFO: Pod pod-subpath-test-inlinevolume-r2f4 no longer exists
STEP: Deleting pod pod-subpath-test-inlinevolume-r2f4
Jun  5 07:12:52.945: INFO: Deleting pod "pod-subpath-test-inlinevolume-r2f4" in namespace "provisioning-2508"
... skipping 12 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Inline-volume (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support existing single file [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:219
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Inline-volume (default fs)] subPath should support existing single file [LinuxOnly]","total":-1,"completed":3,"skipped":5,"failed":0}

SS
------------------------------
[BeforeEach] [sig-storage] Secrets
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Jun  5 07:12:44.427: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename secrets
STEP: Waiting for a default service account to be provisioned in namespace
[It] should be consumable in multiple volumes in a pod [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating secret with name secret-test-96e21d28-3f9a-4355-af1c-38a7499c50e3
STEP: Creating a pod to test consume secrets
Jun  5 07:12:44.651: INFO: Waiting up to 5m0s for pod "pod-secrets-92ca1c3f-71d1-429e-ac2a-cb52d5e752d5" in namespace "secrets-5915" to be "Succeeded or Failed"
Jun  5 07:12:44.682: INFO: Pod "pod-secrets-92ca1c3f-71d1-429e-ac2a-cb52d5e752d5": Phase="Pending", Reason="", readiness=false. Elapsed: 30.861187ms
Jun  5 07:12:46.714: INFO: Pod "pod-secrets-92ca1c3f-71d1-429e-ac2a-cb52d5e752d5": Phase="Pending", Reason="", readiness=false. Elapsed: 2.062372212s
Jun  5 07:12:48.746: INFO: Pod "pod-secrets-92ca1c3f-71d1-429e-ac2a-cb52d5e752d5": Phase="Pending", Reason="", readiness=false. Elapsed: 4.094585388s
Jun  5 07:12:50.777: INFO: Pod "pod-secrets-92ca1c3f-71d1-429e-ac2a-cb52d5e752d5": Phase="Pending", Reason="", readiness=false. Elapsed: 6.125223906s
Jun  5 07:12:52.808: INFO: Pod "pod-secrets-92ca1c3f-71d1-429e-ac2a-cb52d5e752d5": Phase="Pending", Reason="", readiness=false. Elapsed: 8.156414468s
Jun  5 07:12:54.840: INFO: Pod "pod-secrets-92ca1c3f-71d1-429e-ac2a-cb52d5e752d5": Phase="Succeeded", Reason="", readiness=false. Elapsed: 10.189059554s
STEP: Saw pod success
Jun  5 07:12:54.840: INFO: Pod "pod-secrets-92ca1c3f-71d1-429e-ac2a-cb52d5e752d5" satisfied condition "Succeeded or Failed"
Jun  5 07:12:54.871: INFO: Trying to get logs from node ip-172-20-48-31.ca-central-1.compute.internal pod pod-secrets-92ca1c3f-71d1-429e-ac2a-cb52d5e752d5 container secret-volume-test: <nil>
STEP: delete the pod
Jun  5 07:12:54.938: INFO: Waiting for pod pod-secrets-92ca1c3f-71d1-429e-ac2a-cb52d5e752d5 to disappear
Jun  5 07:12:54.994: INFO: Pod pod-secrets-92ca1c3f-71d1-429e-ac2a-cb52d5e752d5 no longer exists
[AfterEach] [sig-storage] Secrets
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:10.629 seconds]
[sig-storage] Secrets
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should be consumable in multiple volumes in a pod [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] Secrets should be consumable in multiple volumes in a pod [NodeConformance] [Conformance]","total":-1,"completed":3,"skipped":13,"failed":0}

SSSSSSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:12:55.098: INFO: Only supported for node OS distro [gci ubuntu custom] (not debian)
... skipping 105 lines ...
Jun  5 07:12:49.647: INFO: PersistentVolumeClaim pvc-46cvb found but phase is Pending instead of Bound.
Jun  5 07:12:51.679: INFO: PersistentVolumeClaim pvc-46cvb found and phase=Bound (4.102917349s)
Jun  5 07:12:51.679: INFO: Waiting up to 3m0s for PersistentVolume local-txq7x to have phase Bound
Jun  5 07:12:51.719: INFO: PersistentVolume local-txq7x found and phase=Bound (40.06071ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-qcsf
STEP: Creating a pod to test subpath
Jun  5 07:12:51.828: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-qcsf" in namespace "provisioning-89" to be "Succeeded or Failed"
Jun  5 07:12:51.862: INFO: Pod "pod-subpath-test-preprovisionedpv-qcsf": Phase="Pending", Reason="", readiness=false. Elapsed: 33.852351ms
Jun  5 07:12:53.898: INFO: Pod "pod-subpath-test-preprovisionedpv-qcsf": Phase="Pending", Reason="", readiness=false. Elapsed: 2.070131024s
Jun  5 07:12:55.930: INFO: Pod "pod-subpath-test-preprovisionedpv-qcsf": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.102206118s
STEP: Saw pod success
Jun  5 07:12:55.930: INFO: Pod "pod-subpath-test-preprovisionedpv-qcsf" satisfied condition "Succeeded or Failed"
Jun  5 07:12:55.966: INFO: Trying to get logs from node ip-172-20-55-143.ca-central-1.compute.internal pod pod-subpath-test-preprovisionedpv-qcsf container test-container-volume-preprovisionedpv-qcsf: <nil>
STEP: delete the pod
Jun  5 07:12:56.040: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-qcsf to disappear
Jun  5 07:12:56.070: INFO: Pod pod-subpath-test-preprovisionedpv-qcsf no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-qcsf
Jun  5 07:12:56.070: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-qcsf" in namespace "provisioning-89"
... skipping 19 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support non-existent path
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:194
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir-link] [Testpattern: Pre-provisioned PV (default fs)] subPath should support non-existent path","total":-1,"completed":2,"skipped":7,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:12:56.643: INFO: Only supported for providers [gce gke] (not aws)
... skipping 43 lines ...
Jun  5 07:12:51.059: INFO: PersistentVolumeClaim pvc-pqh5w found but phase is Pending instead of Bound.
Jun  5 07:12:53.092: INFO: PersistentVolumeClaim pvc-pqh5w found and phase=Bound (12.272225196s)
Jun  5 07:12:53.092: INFO: Waiting up to 3m0s for PersistentVolume local-fr2c7 to have phase Bound
Jun  5 07:12:53.131: INFO: PersistentVolume local-fr2c7 found and phase=Bound (39.424016ms)
STEP: Creating pod exec-volume-test-preprovisionedpv-85sg
STEP: Creating a pod to test exec-volume-test
Jun  5 07:12:53.228: INFO: Waiting up to 5m0s for pod "exec-volume-test-preprovisionedpv-85sg" in namespace "volume-124" to be "Succeeded or Failed"
Jun  5 07:12:53.260: INFO: Pod "exec-volume-test-preprovisionedpv-85sg": Phase="Pending", Reason="", readiness=false. Elapsed: 32.001067ms
Jun  5 07:12:55.292: INFO: Pod "exec-volume-test-preprovisionedpv-85sg": Phase="Pending", Reason="", readiness=false. Elapsed: 2.063796747s
Jun  5 07:12:57.327: INFO: Pod "exec-volume-test-preprovisionedpv-85sg": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.099514726s
STEP: Saw pod success
Jun  5 07:12:57.327: INFO: Pod "exec-volume-test-preprovisionedpv-85sg" satisfied condition "Succeeded or Failed"
Jun  5 07:12:57.359: INFO: Trying to get logs from node ip-172-20-62-33.ca-central-1.compute.internal pod exec-volume-test-preprovisionedpv-85sg container exec-container-preprovisionedpv-85sg: <nil>
STEP: delete the pod
Jun  5 07:12:57.480: INFO: Waiting for pod exec-volume-test-preprovisionedpv-85sg to disappear
Jun  5 07:12:57.511: INFO: Pod exec-volume-test-preprovisionedpv-85sg no longer exists
STEP: Deleting pod exec-volume-test-preprovisionedpv-85sg
Jun  5 07:12:57.511: INFO: Deleting pod "exec-volume-test-preprovisionedpv-85sg" in namespace "volume-124"
... skipping 40 lines ...
• [SLOW TEST:20.477 seconds]
[sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  works for multiple CRDs of same group and version but different kinds [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for multiple CRDs of same group and version but different kinds [Conformance]","total":-1,"completed":4,"skipped":11,"failed":0}

SS
------------------------------
[BeforeEach] [sig-storage] ConfigMap
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 12 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Jun  5 07:13:00.848: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "configmap-6671" for this suite.

•
------------------------------
{"msg":"PASSED [sig-storage] ConfigMap updates should be reflected in volume [NodeConformance] [Conformance]","total":-1,"completed":1,"skipped":19,"failed":0}

SSSSSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:13:00.945: INFO: Driver supports dynamic provisioning, skipping InlineVolume pattern
... skipping 54 lines ...
Jun  5 07:12:46.945: INFO: The status of Pod server-envvars-98363187-ad87-4834-b200-3f568c228645 is Pending, waiting for it to be Running (with Ready = true)
Jun  5 07:12:48.945: INFO: The status of Pod server-envvars-98363187-ad87-4834-b200-3f568c228645 is Pending, waiting for it to be Running (with Ready = true)
Jun  5 07:12:50.944: INFO: The status of Pod server-envvars-98363187-ad87-4834-b200-3f568c228645 is Pending, waiting for it to be Running (with Ready = true)
Jun  5 07:12:52.944: INFO: The status of Pod server-envvars-98363187-ad87-4834-b200-3f568c228645 is Pending, waiting for it to be Running (with Ready = true)
Jun  5 07:12:54.945: INFO: The status of Pod server-envvars-98363187-ad87-4834-b200-3f568c228645 is Pending, waiting for it to be Running (with Ready = true)
Jun  5 07:12:56.947: INFO: The status of Pod server-envvars-98363187-ad87-4834-b200-3f568c228645 is Running (Ready = true)
Jun  5 07:12:57.070: INFO: Waiting up to 5m0s for pod "client-envvars-0652cc80-8ae5-450f-bbbc-bb8a8a5c6eba" in namespace "pods-5428" to be "Succeeded or Failed"
Jun  5 07:12:57.102: INFO: Pod "client-envvars-0652cc80-8ae5-450f-bbbc-bb8a8a5c6eba": Phase="Pending", Reason="", readiness=false. Elapsed: 31.686305ms
Jun  5 07:12:59.134: INFO: Pod "client-envvars-0652cc80-8ae5-450f-bbbc-bb8a8a5c6eba": Phase="Pending", Reason="", readiness=false. Elapsed: 2.063825833s
Jun  5 07:13:01.167: INFO: Pod "client-envvars-0652cc80-8ae5-450f-bbbc-bb8a8a5c6eba": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.096960958s
STEP: Saw pod success
Jun  5 07:13:01.167: INFO: Pod "client-envvars-0652cc80-8ae5-450f-bbbc-bb8a8a5c6eba" satisfied condition "Succeeded or Failed"
Jun  5 07:13:01.198: INFO: Trying to get logs from node ip-172-20-55-143.ca-central-1.compute.internal pod client-envvars-0652cc80-8ae5-450f-bbbc-bb8a8a5c6eba container env3cont: <nil>
STEP: delete the pod
Jun  5 07:13:01.268: INFO: Waiting for pod client-envvars-0652cc80-8ae5-450f-bbbc-bb8a8a5c6eba to disappear
Jun  5 07:13:01.299: INFO: Pod client-envvars-0652cc80-8ae5-450f-bbbc-bb8a8a5c6eba no longer exists
[AfterEach] [sig-node] Pods
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:16.689 seconds]
[sig-node] Pods
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  should contain environment variables for services [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] Pods should contain environment variables for services [NodeConformance] [Conformance]","total":-1,"completed":3,"skipped":7,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (default fs)] capacity
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:13:01.374: INFO: Only supported for node OS distro [gci ubuntu custom] (not debian)
[AfterEach] [Testpattern: Dynamic PV (default fs)] capacity
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 23 lines ...
[sig-storage] In-tree Volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  [Driver: hostPath]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (immediate binding)] topology
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

      Driver hostPath doesn't support DynamicPV -- skipping

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:116
------------------------------
... skipping 91 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Jun  5 07:13:02.536: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "proxy-1410" for this suite.

•
------------------------------
{"msg":"PASSED [sig-network] Proxy version v1 should proxy logs on node with explicit kubelet port using proxy subresource ","total":-1,"completed":4,"skipped":11,"failed":0}

SSS
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir-bindmounted] [Testpattern: Pre-provisioned PV (default fs)] volumes should allow exec of files on the volume","total":-1,"completed":3,"skipped":15,"failed":0}
[BeforeEach] [sig-storage] EmptyDir volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Jun  5 07:12:58.035: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename emptydir
STEP: Waiting for a default service account to be provisioned in namespace
[It] should support (root,0644,default) [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test emptydir 0644 on node default medium
Jun  5 07:12:58.241: INFO: Waiting up to 5m0s for pod "pod-830ae1ce-e0c5-450e-8cc3-c67246b79e14" in namespace "emptydir-3681" to be "Succeeded or Failed"
Jun  5 07:12:58.276: INFO: Pod "pod-830ae1ce-e0c5-450e-8cc3-c67246b79e14": Phase="Pending", Reason="", readiness=false. Elapsed: 34.090551ms
Jun  5 07:13:00.307: INFO: Pod "pod-830ae1ce-e0c5-450e-8cc3-c67246b79e14": Phase="Pending", Reason="", readiness=false. Elapsed: 2.065235018s
Jun  5 07:13:02.339: INFO: Pod "pod-830ae1ce-e0c5-450e-8cc3-c67246b79e14": Phase="Pending", Reason="", readiness=false. Elapsed: 4.09719941s
Jun  5 07:13:04.370: INFO: Pod "pod-830ae1ce-e0c5-450e-8cc3-c67246b79e14": Phase="Pending", Reason="", readiness=false. Elapsed: 6.128938128s
Jun  5 07:13:06.408: INFO: Pod "pod-830ae1ce-e0c5-450e-8cc3-c67246b79e14": Phase="Succeeded", Reason="", readiness=false. Elapsed: 8.166100904s
STEP: Saw pod success
Jun  5 07:13:06.408: INFO: Pod "pod-830ae1ce-e0c5-450e-8cc3-c67246b79e14" satisfied condition "Succeeded or Failed"
Jun  5 07:13:06.439: INFO: Trying to get logs from node ip-172-20-62-33.ca-central-1.compute.internal pod pod-830ae1ce-e0c5-450e-8cc3-c67246b79e14 container test-container: <nil>
STEP: delete the pod
Jun  5 07:13:06.514: INFO: Waiting for pod pod-830ae1ce-e0c5-450e-8cc3-c67246b79e14 to disappear
Jun  5 07:13:06.544: INFO: Pod pod-830ae1ce-e0c5-450e-8cc3-c67246b79e14 no longer exists
[AfterEach] [sig-storage] EmptyDir volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:8.576 seconds]
[sig-storage] EmptyDir volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should support (root,0644,default) [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] EmptyDir volumes should support (root,0644,default) [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":4,"skipped":15,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:13:06.622: INFO: Driver local doesn't support DynamicPV -- skipping
[AfterEach] [Testpattern: Dynamic PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 99 lines ...
Jun  5 07:12:09.875: INFO: PersistentVolumeClaim csi-hostpathrt9kc found but phase is Pending instead of Bound.
Jun  5 07:12:11.907: INFO: PersistentVolumeClaim csi-hostpathrt9kc found but phase is Pending instead of Bound.
Jun  5 07:12:13.938: INFO: PersistentVolumeClaim csi-hostpathrt9kc found but phase is Pending instead of Bound.
Jun  5 07:12:15.970: INFO: PersistentVolumeClaim csi-hostpathrt9kc found and phase=Bound (18.315532396s)
STEP: Creating pod pod-subpath-test-dynamicpv-trwk
STEP: Creating a pod to test atomic-volume-subpath
Jun  5 07:12:16.066: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-trwk" in namespace "provisioning-7705" to be "Succeeded or Failed"
Jun  5 07:12:16.096: INFO: Pod "pod-subpath-test-dynamicpv-trwk": Phase="Pending", Reason="", readiness=false. Elapsed: 30.584804ms
Jun  5 07:12:18.128: INFO: Pod "pod-subpath-test-dynamicpv-trwk": Phase="Pending", Reason="", readiness=false. Elapsed: 2.061985661s
Jun  5 07:12:20.163: INFO: Pod "pod-subpath-test-dynamicpv-trwk": Phase="Pending", Reason="", readiness=false. Elapsed: 4.097504891s
Jun  5 07:12:22.194: INFO: Pod "pod-subpath-test-dynamicpv-trwk": Phase="Pending", Reason="", readiness=false. Elapsed: 6.128519827s
Jun  5 07:12:24.225: INFO: Pod "pod-subpath-test-dynamicpv-trwk": Phase="Pending", Reason="", readiness=false. Elapsed: 8.159855967s
Jun  5 07:12:26.260: INFO: Pod "pod-subpath-test-dynamicpv-trwk": Phase="Pending", Reason="", readiness=false. Elapsed: 10.19430685s
... skipping 7 lines ...
Jun  5 07:12:42.513: INFO: Pod "pod-subpath-test-dynamicpv-trwk": Phase="Running", Reason="", readiness=true. Elapsed: 26.447640324s
Jun  5 07:12:44.545: INFO: Pod "pod-subpath-test-dynamicpv-trwk": Phase="Running", Reason="", readiness=true. Elapsed: 28.479321497s
Jun  5 07:12:46.576: INFO: Pod "pod-subpath-test-dynamicpv-trwk": Phase="Running", Reason="", readiness=true. Elapsed: 30.510341775s
Jun  5 07:12:48.612: INFO: Pod "pod-subpath-test-dynamicpv-trwk": Phase="Running", Reason="", readiness=true. Elapsed: 32.5467588s
Jun  5 07:12:50.646: INFO: Pod "pod-subpath-test-dynamicpv-trwk": Phase="Succeeded", Reason="", readiness=false. Elapsed: 34.58077409s
STEP: Saw pod success
Jun  5 07:12:50.646: INFO: Pod "pod-subpath-test-dynamicpv-trwk" satisfied condition "Succeeded or Failed"
Jun  5 07:12:50.677: INFO: Trying to get logs from node ip-172-20-42-252.ca-central-1.compute.internal pod pod-subpath-test-dynamicpv-trwk container test-container-subpath-dynamicpv-trwk: <nil>
STEP: delete the pod
Jun  5 07:12:50.745: INFO: Waiting for pod pod-subpath-test-dynamicpv-trwk to disappear
Jun  5 07:12:50.776: INFO: Pod pod-subpath-test-dynamicpv-trwk no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-trwk
Jun  5 07:12:50.776: INFO: Deleting pod "pod-subpath-test-dynamicpv-trwk" in namespace "provisioning-7705"
... skipping 53 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_volumes.go:40
    [Testpattern: Dynamic PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support file as subpath [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:230
------------------------------
{"msg":"PASSED [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] subPath should support file as subpath [LinuxOnly]","total":-1,"completed":1,"skipped":1,"failed":0}

S
------------------------------
[BeforeEach] [sig-api-machinery] Aggregator
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 37 lines ...
• [SLOW TEST:33.581 seconds]
[sig-api-machinery] Aggregator
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  Should be able to support the 1.17 Sample API Server using the current Aggregator [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] Aggregator Should be able to support the 1.17 Sample API Server using the current Aggregator [Conformance]","total":-1,"completed":5,"skipped":31,"failed":0}

S
------------------------------
[BeforeEach] [sig-api-machinery] API priority and fairness
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 50 lines ...
STEP: Building a namespace api object, basename configmap
STEP: Waiting for a default service account to be provisioned in namespace
[It] should be consumable from pods in volume with mappings as non-root with FSGroup [LinuxOnly] [NodeFeature:FSGroup]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/configmap_volume.go:110
STEP: Creating configMap with name configmap-test-volume-map-7c350581-dae1-490a-a877-fd9a0954f37a
STEP: Creating a pod to test consume configMaps
Jun  5 07:13:10.649: INFO: Waiting up to 5m0s for pod "pod-configmaps-0686e346-069b-4491-ac42-76bbd6521711" in namespace "configmap-6677" to be "Succeeded or Failed"
Jun  5 07:13:10.680: INFO: Pod "pod-configmaps-0686e346-069b-4491-ac42-76bbd6521711": Phase="Pending", Reason="", readiness=false. Elapsed: 30.394389ms
Jun  5 07:13:12.711: INFO: Pod "pod-configmaps-0686e346-069b-4491-ac42-76bbd6521711": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2.061922152s
STEP: Saw pod success
Jun  5 07:13:12.711: INFO: Pod "pod-configmaps-0686e346-069b-4491-ac42-76bbd6521711" satisfied condition "Succeeded or Failed"
Jun  5 07:13:12.742: INFO: Trying to get logs from node ip-172-20-55-143.ca-central-1.compute.internal pod pod-configmaps-0686e346-069b-4491-ac42-76bbd6521711 container agnhost-container: <nil>
STEP: delete the pod
Jun  5 07:13:12.814: INFO: Waiting for pod pod-configmaps-0686e346-069b-4491-ac42-76bbd6521711 to disappear
Jun  5 07:13:12.846: INFO: Pod pod-configmaps-0686e346-069b-4491-ac42-76bbd6521711 no longer exists
[AfterEach] [sig-storage] ConfigMap
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Jun  5 07:13:12.846: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "configmap-6677" for this suite.

•
------------------------------
{"msg":"PASSED [sig-storage] ConfigMap should be consumable from pods in volume with mappings as non-root with FSGroup [LinuxOnly] [NodeFeature:FSGroup]","total":-1,"completed":2,"skipped":2,"failed":0}
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:13:12.920: INFO: Only supported for providers [vsphere] (not aws)
[AfterEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 103 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Inline-volume (default fs)] volumes
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should store data
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Inline-volume (default fs)] volumes should store data","total":-1,"completed":2,"skipped":5,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:13:13.008: INFO: Only supported for providers [openstack] (not aws)
... skipping 48 lines ...
[AfterEach] [sig-api-machinery] client-go should negotiate
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Jun  5 07:13:13.117: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready

•
------------------------------
{"msg":"PASSED [sig-api-machinery] client-go should negotiate watch and report errors with accept \"application/json,application/vnd.kubernetes.protobuf\"","total":-1,"completed":3,"skipped":15,"failed":0}

SSSSSSSSSS
------------------------------
[BeforeEach] [sig-api-machinery] ResourceQuota
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 22 lines ...
• [SLOW TEST:13.687 seconds]
[sig-api-machinery] ResourceQuota
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  should create a ResourceQuota and capture the life of a pod. [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a pod. [Conformance]","total":-1,"completed":5,"skipped":14,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:13:16.339: INFO: Driver csi-hostpath doesn't support PreprovisionedPV -- skipping
... skipping 101 lines ...
Jun  5 07:13:05.474: INFO: PersistentVolumeClaim pvc-k9qnq found but phase is Pending instead of Bound.
Jun  5 07:13:07.505: INFO: PersistentVolumeClaim pvc-k9qnq found and phase=Bound (2.061213951s)
Jun  5 07:13:07.505: INFO: Waiting up to 3m0s for PersistentVolume local-bnlmz to have phase Bound
Jun  5 07:13:07.535: INFO: PersistentVolume local-bnlmz found and phase=Bound (30.621432ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-vw62
STEP: Creating a pod to test subpath
Jun  5 07:13:07.629: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-vw62" in namespace "provisioning-9537" to be "Succeeded or Failed"
Jun  5 07:13:07.659: INFO: Pod "pod-subpath-test-preprovisionedpv-vw62": Phase="Pending", Reason="", readiness=false. Elapsed: 30.524227ms
Jun  5 07:13:09.691: INFO: Pod "pod-subpath-test-preprovisionedpv-vw62": Phase="Pending", Reason="", readiness=false. Elapsed: 2.062448606s
Jun  5 07:13:11.737: INFO: Pod "pod-subpath-test-preprovisionedpv-vw62": Phase="Pending", Reason="", readiness=false. Elapsed: 4.108373538s
Jun  5 07:13:13.769: INFO: Pod "pod-subpath-test-preprovisionedpv-vw62": Phase="Pending", Reason="", readiness=false. Elapsed: 6.139637165s
Jun  5 07:13:15.800: INFO: Pod "pod-subpath-test-preprovisionedpv-vw62": Phase="Succeeded", Reason="", readiness=false. Elapsed: 8.171447374s
STEP: Saw pod success
Jun  5 07:13:15.800: INFO: Pod "pod-subpath-test-preprovisionedpv-vw62" satisfied condition "Succeeded or Failed"
Jun  5 07:13:15.831: INFO: Trying to get logs from node ip-172-20-48-31.ca-central-1.compute.internal pod pod-subpath-test-preprovisionedpv-vw62 container test-container-subpath-preprovisionedpv-vw62: <nil>
STEP: delete the pod
Jun  5 07:13:15.902: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-vw62 to disappear
Jun  5 07:13:15.933: INFO: Pod pod-subpath-test-preprovisionedpv-vw62 no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-vw62
Jun  5 07:13:15.933: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-vw62" in namespace "provisioning-9537"
... skipping 19 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support readOnly file specified in the volumeMount [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:379
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir-bindmounted] [Testpattern: Pre-provisioned PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]","total":-1,"completed":3,"skipped":11,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:13:16.477: INFO: Driver local doesn't support DynamicPV -- skipping
[AfterEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 60 lines ...
Jun  5 07:12:49.417: INFO: PersistentVolumeClaim pvc-hhlx4 found but phase is Pending instead of Bound.
Jun  5 07:12:51.449: INFO: PersistentVolumeClaim pvc-hhlx4 found and phase=Bound (6.164958348s)
Jun  5 07:12:51.449: INFO: Waiting up to 3m0s for PersistentVolume local-bwrhw to have phase Bound
Jun  5 07:12:51.480: INFO: PersistentVolume local-bwrhw found and phase=Bound (30.594422ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-nhmg
STEP: Creating a pod to test subpath
Jun  5 07:12:51.573: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-nhmg" in namespace "provisioning-2913" to be "Succeeded or Failed"
Jun  5 07:12:51.607: INFO: Pod "pod-subpath-test-preprovisionedpv-nhmg": Phase="Pending", Reason="", readiness=false. Elapsed: 34.777233ms
Jun  5 07:12:53.689: INFO: Pod "pod-subpath-test-preprovisionedpv-nhmg": Phase="Pending", Reason="", readiness=false. Elapsed: 2.116600825s
Jun  5 07:12:55.721: INFO: Pod "pod-subpath-test-preprovisionedpv-nhmg": Phase="Pending", Reason="", readiness=false. Elapsed: 4.148696467s
Jun  5 07:12:57.753: INFO: Pod "pod-subpath-test-preprovisionedpv-nhmg": Phase="Pending", Reason="", readiness=false. Elapsed: 6.180014767s
Jun  5 07:12:59.785: INFO: Pod "pod-subpath-test-preprovisionedpv-nhmg": Phase="Succeeded", Reason="", readiness=false. Elapsed: 8.212232165s
STEP: Saw pod success
Jun  5 07:12:59.785: INFO: Pod "pod-subpath-test-preprovisionedpv-nhmg" satisfied condition "Succeeded or Failed"
Jun  5 07:12:59.816: INFO: Trying to get logs from node ip-172-20-62-33.ca-central-1.compute.internal pod pod-subpath-test-preprovisionedpv-nhmg container test-container-subpath-preprovisionedpv-nhmg: <nil>
STEP: delete the pod
Jun  5 07:12:59.889: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-nhmg to disappear
Jun  5 07:12:59.920: INFO: Pod pod-subpath-test-preprovisionedpv-nhmg no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-nhmg
Jun  5 07:12:59.920: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-nhmg" in namespace "provisioning-2913"
STEP: Creating pod pod-subpath-test-preprovisionedpv-nhmg
STEP: Creating a pod to test subpath
Jun  5 07:12:59.982: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-nhmg" in namespace "provisioning-2913" to be "Succeeded or Failed"
Jun  5 07:13:00.013: INFO: Pod "pod-subpath-test-preprovisionedpv-nhmg": Phase="Pending", Reason="", readiness=false. Elapsed: 30.68142ms
Jun  5 07:13:02.059: INFO: Pod "pod-subpath-test-preprovisionedpv-nhmg": Phase="Pending", Reason="", readiness=false. Elapsed: 2.07707687s
Jun  5 07:13:04.092: INFO: Pod "pod-subpath-test-preprovisionedpv-nhmg": Phase="Pending", Reason="", readiness=false. Elapsed: 4.109388136s
Jun  5 07:13:06.124: INFO: Pod "pod-subpath-test-preprovisionedpv-nhmg": Phase="Pending", Reason="", readiness=false. Elapsed: 6.141629019s
Jun  5 07:13:08.155: INFO: Pod "pod-subpath-test-preprovisionedpv-nhmg": Phase="Pending", Reason="", readiness=false. Elapsed: 8.17311736s
Jun  5 07:13:10.192: INFO: Pod "pod-subpath-test-preprovisionedpv-nhmg": Phase="Pending", Reason="", readiness=false. Elapsed: 10.209403537s
Jun  5 07:13:12.225: INFO: Pod "pod-subpath-test-preprovisionedpv-nhmg": Phase="Pending", Reason="", readiness=false. Elapsed: 12.242680862s
Jun  5 07:13:14.275: INFO: Pod "pod-subpath-test-preprovisionedpv-nhmg": Phase="Pending", Reason="", readiness=false. Elapsed: 14.292981593s
Jun  5 07:13:16.312: INFO: Pod "pod-subpath-test-preprovisionedpv-nhmg": Phase="Succeeded", Reason="", readiness=false. Elapsed: 16.329146782s
STEP: Saw pod success
Jun  5 07:13:16.312: INFO: Pod "pod-subpath-test-preprovisionedpv-nhmg" satisfied condition "Succeeded or Failed"
Jun  5 07:13:16.342: INFO: Trying to get logs from node ip-172-20-62-33.ca-central-1.compute.internal pod pod-subpath-test-preprovisionedpv-nhmg container test-container-subpath-preprovisionedpv-nhmg: <nil>
STEP: delete the pod
Jun  5 07:13:16.415: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-nhmg to disappear
Jun  5 07:13:16.447: INFO: Pod pod-subpath-test-preprovisionedpv-nhmg no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-nhmg
Jun  5 07:13:16.447: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-nhmg" in namespace "provisioning-2913"
... skipping 19 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support existing directories when readOnly specified in the volumeSource
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:394
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir-link] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource","total":-1,"completed":3,"skipped":7,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (ext3)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:13:16.974: INFO: Driver emptydir doesn't support PreprovisionedPV -- skipping
... skipping 44 lines ...
Jun  5 07:13:04.776: INFO: PersistentVolumeClaim pvc-rgf54 found but phase is Pending instead of Bound.
Jun  5 07:13:06.807: INFO: PersistentVolumeClaim pvc-rgf54 found and phase=Bound (8.157439983s)
Jun  5 07:13:06.807: INFO: Waiting up to 3m0s for PersistentVolume local-g5gg9 to have phase Bound
Jun  5 07:13:06.842: INFO: PersistentVolume local-g5gg9 found and phase=Bound (34.050204ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-tbmb
STEP: Creating a pod to test subpath
Jun  5 07:13:06.935: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-tbmb" in namespace "provisioning-5763" to be "Succeeded or Failed"
Jun  5 07:13:06.966: INFO: Pod "pod-subpath-test-preprovisionedpv-tbmb": Phase="Pending", Reason="", readiness=false. Elapsed: 30.67298ms
Jun  5 07:13:08.998: INFO: Pod "pod-subpath-test-preprovisionedpv-tbmb": Phase="Pending", Reason="", readiness=false. Elapsed: 2.062739245s
Jun  5 07:13:11.029: INFO: Pod "pod-subpath-test-preprovisionedpv-tbmb": Phase="Pending", Reason="", readiness=false. Elapsed: 4.094484032s
Jun  5 07:13:13.064: INFO: Pod "pod-subpath-test-preprovisionedpv-tbmb": Phase="Pending", Reason="", readiness=false. Elapsed: 6.129483531s
Jun  5 07:13:15.097: INFO: Pod "pod-subpath-test-preprovisionedpv-tbmb": Phase="Pending", Reason="", readiness=false. Elapsed: 8.161621647s
Jun  5 07:13:17.128: INFO: Pod "pod-subpath-test-preprovisionedpv-tbmb": Phase="Succeeded", Reason="", readiness=false. Elapsed: 10.193534864s
STEP: Saw pod success
Jun  5 07:13:17.129: INFO: Pod "pod-subpath-test-preprovisionedpv-tbmb" satisfied condition "Succeeded or Failed"
Jun  5 07:13:17.159: INFO: Trying to get logs from node ip-172-20-42-252.ca-central-1.compute.internal pod pod-subpath-test-preprovisionedpv-tbmb container test-container-subpath-preprovisionedpv-tbmb: <nil>
STEP: delete the pod
Jun  5 07:13:17.237: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-tbmb to disappear
Jun  5 07:13:17.277: INFO: Pod pod-subpath-test-preprovisionedpv-tbmb no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-tbmb
Jun  5 07:13:17.277: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-tbmb" in namespace "provisioning-5763"
... skipping 26 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support readOnly directory specified in the volumeMount
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:364
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: blockfs] [Testpattern: Pre-provisioned PV (default fs)] subPath should support readOnly directory specified in the volumeMount","total":-1,"completed":4,"skipped":23,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (default fs)] capacity
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:13:19.058: INFO: Driver aws doesn't publish storage capacity -- skipping
[AfterEach] [Testpattern: Dynamic PV (default fs)] capacity
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 25 lines ...
[sig-storage] In-tree Volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  [Driver: vsphere]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (immediate binding)] topology
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

      Only supported for providers [vsphere] (not aws)

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/drivers/in_tree.go:1437
------------------------------
... skipping 65 lines ...
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:246

      Driver local doesn't support DynamicPV -- skipping

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:116
------------------------------
{"msg":"PASSED [sig-apps] DisruptionController should update/patch PodDisruptionBudget status [Conformance]","total":-1,"completed":4,"skipped":16,"failed":0}

S
------------------------------
[BeforeEach] [sig-cli] Kubectl client
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 210 lines ...
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159

      Driver emptydir doesn't support ext3 -- skipping

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:121
------------------------------
{"msg":"PASSED [sig-cli] Kubectl client Update Demo should scale a replication controller  [Conformance]","total":-1,"completed":2,"skipped":12,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:13:19.162: INFO: Driver csi-hostpath doesn't support PreprovisionedPV -- skipping
... skipping 81 lines ...
• [SLOW TEST:6.081 seconds]
[sig-api-machinery] ServerSideApply
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  should work for CRDs
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/apply.go:569
------------------------------
{"msg":"PASSED [sig-api-machinery] ServerSideApply should work for CRDs","total":-1,"completed":4,"skipped":25,"failed":0}

S
------------------------------
[BeforeEach] [sig-api-machinery] client-go should negotiate
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 18 lines ...
[sig-storage] In-tree Volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  [Driver: gluster]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (delayed binding)] topology
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

      Only supported for node OS distro [gci ubuntu custom] (not debian)

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/drivers/in_tree.go:263
------------------------------
{"msg":"PASSED [sig-api-machinery] client-go should negotiate watch and report errors with accept \"application/json\"","total":-1,"completed":3,"skipped":19,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:13:19.302: INFO: Driver supports dynamic provisioning, skipping PreprovisionedPV pattern
... skipping 99 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Jun  5 07:13:19.794: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "kubectl-3470" for this suite.

•
------------------------------
{"msg":"PASSED [sig-cli] Kubectl client Proxy server should support proxy with --port 0  [Conformance]","total":-1,"completed":5,"skipped":30,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:13:19.892: INFO: Only supported for providers [gce gke] (not aws)
... skipping 102 lines ...
Jun  5 07:12:10.920: INFO: PersistentVolumeClaim csi-hostpathk84nd found but phase is Pending instead of Bound.
Jun  5 07:12:12.952: INFO: PersistentVolumeClaim csi-hostpathk84nd found but phase is Pending instead of Bound.
Jun  5 07:12:14.983: INFO: PersistentVolumeClaim csi-hostpathk84nd found but phase is Pending instead of Bound.
Jun  5 07:12:17.015: INFO: PersistentVolumeClaim csi-hostpathk84nd found and phase=Bound (18.352264672s)
STEP: Creating pod pod-subpath-test-dynamicpv-xwxj
STEP: Creating a pod to test subpath
Jun  5 07:12:17.112: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-xwxj" in namespace "provisioning-8526" to be "Succeeded or Failed"
Jun  5 07:12:17.154: INFO: Pod "pod-subpath-test-dynamicpv-xwxj": Phase="Pending", Reason="", readiness=false. Elapsed: 41.854175ms
Jun  5 07:12:19.186: INFO: Pod "pod-subpath-test-dynamicpv-xwxj": Phase="Pending", Reason="", readiness=false. Elapsed: 2.073875614s
Jun  5 07:12:21.217: INFO: Pod "pod-subpath-test-dynamicpv-xwxj": Phase="Pending", Reason="", readiness=false. Elapsed: 4.104889616s
Jun  5 07:12:23.249: INFO: Pod "pod-subpath-test-dynamicpv-xwxj": Phase="Pending", Reason="", readiness=false. Elapsed: 6.136541976s
Jun  5 07:12:25.280: INFO: Pod "pod-subpath-test-dynamicpv-xwxj": Phase="Pending", Reason="", readiness=false. Elapsed: 8.167518021s
Jun  5 07:12:27.314: INFO: Pod "pod-subpath-test-dynamicpv-xwxj": Phase="Pending", Reason="", readiness=false. Elapsed: 10.201619013s
Jun  5 07:12:29.345: INFO: Pod "pod-subpath-test-dynamicpv-xwxj": Phase="Pending", Reason="", readiness=false. Elapsed: 12.232093545s
Jun  5 07:12:31.376: INFO: Pod "pod-subpath-test-dynamicpv-xwxj": Phase="Pending", Reason="", readiness=false. Elapsed: 14.263095206s
Jun  5 07:12:33.408: INFO: Pod "pod-subpath-test-dynamicpv-xwxj": Phase="Pending", Reason="", readiness=false. Elapsed: 16.295047832s
Jun  5 07:12:35.444: INFO: Pod "pod-subpath-test-dynamicpv-xwxj": Phase="Pending", Reason="", readiness=false. Elapsed: 18.330958681s
Jun  5 07:12:37.475: INFO: Pod "pod-subpath-test-dynamicpv-xwxj": Phase="Pending", Reason="", readiness=false. Elapsed: 20.362653734s
Jun  5 07:12:39.510: INFO: Pod "pod-subpath-test-dynamicpv-xwxj": Phase="Succeeded", Reason="", readiness=false. Elapsed: 22.397509845s
STEP: Saw pod success
Jun  5 07:12:39.510: INFO: Pod "pod-subpath-test-dynamicpv-xwxj" satisfied condition "Succeeded or Failed"
Jun  5 07:12:39.543: INFO: Trying to get logs from node ip-172-20-42-252.ca-central-1.compute.internal pod pod-subpath-test-dynamicpv-xwxj container test-container-subpath-dynamicpv-xwxj: <nil>
STEP: delete the pod
Jun  5 07:12:39.610: INFO: Waiting for pod pod-subpath-test-dynamicpv-xwxj to disappear
Jun  5 07:12:39.652: INFO: Pod pod-subpath-test-dynamicpv-xwxj no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-xwxj
Jun  5 07:12:39.652: INFO: Deleting pod "pod-subpath-test-dynamicpv-xwxj" in namespace "provisioning-8526"
... skipping 54 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_volumes.go:40
    [Testpattern: Dynamic PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support readOnly directory specified in the volumeMount
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:364
------------------------------
{"msg":"PASSED [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly directory specified in the volumeMount","total":-1,"completed":2,"skipped":15,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:13:20.198: INFO: Driver local doesn't support InlineVolume -- skipping
... skipping 12 lines ...
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:364

      Driver local doesn't support InlineVolume -- skipping

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:116
------------------------------
{"msg":"PASSED [sig-storage] PV Protection Verify that PV bound to a PVC is not removed immediately","total":-1,"completed":3,"skipped":17,"failed":0}
[BeforeEach] [sig-storage] PersistentVolumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Jun  5 07:12:39.297: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename pv
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 19 lines ...
Jun  5 07:13:08.034: INFO: PersistentVolumeClaim pvc-w9zfn found and phase=Bound (6.124320956s)
Jun  5 07:13:08.035: INFO: Waiting up to 3m0s for PersistentVolume nfs-4gq9n to have phase Bound
Jun  5 07:13:08.065: INFO: PersistentVolume nfs-4gq9n found and phase=Bound (30.152673ms)
STEP: Checking pod has write access to PersistentVolume
Jun  5 07:13:08.125: INFO: Creating nfs test pod
Jun  5 07:13:08.156: INFO: Pod should terminate with exitcode 0 (success)
Jun  5 07:13:08.156: INFO: Waiting up to 5m0s for pod "pvc-tester-9q24w" in namespace "pv-5393" to be "Succeeded or Failed"
Jun  5 07:13:08.186: INFO: Pod "pvc-tester-9q24w": Phase="Pending", Reason="", readiness=false. Elapsed: 30.298416ms
Jun  5 07:13:10.221: INFO: Pod "pvc-tester-9q24w": Phase="Pending", Reason="", readiness=false. Elapsed: 2.065173278s
Jun  5 07:13:12.258: INFO: Pod "pvc-tester-9q24w": Phase="Pending", Reason="", readiness=false. Elapsed: 4.101859382s
Jun  5 07:13:14.290: INFO: Pod "pvc-tester-9q24w": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.134020442s
STEP: Saw pod success
Jun  5 07:13:14.290: INFO: Pod "pvc-tester-9q24w" satisfied condition "Succeeded or Failed"
Jun  5 07:13:14.290: INFO: Pod pvc-tester-9q24w succeeded 
Jun  5 07:13:14.290: INFO: Deleting pod "pvc-tester-9q24w" in namespace "pv-5393"
Jun  5 07:13:14.325: INFO: Wait up to 5m0s for pod "pvc-tester-9q24w" to be fully deleted
STEP: Deleting the PVC to invoke the reclaim policy.
Jun  5 07:13:14.358: INFO: Deleting PVC pvc-w9zfn to trigger reclamation of PV nfs-4gq9n
Jun  5 07:13:14.358: INFO: Deleting PersistentVolumeClaim "pvc-w9zfn"
... skipping 23 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes.go:122
    with Single PV - PVC pairs
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes.go:155
      create a PV and a pre-bound PVC: test write access
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes.go:196
------------------------------
{"msg":"PASSED [sig-storage] PersistentVolumes NFS with Single PV - PVC pairs create a PV and a pre-bound PVC: test write access","total":-1,"completed":4,"skipped":17,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:13:20.796: INFO: Driver hostPathSymlink doesn't support DynamicPV -- skipping
[AfterEach] [Testpattern: Dynamic PV (block volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 105 lines ...
• [SLOW TEST:54.450 seconds]
[sig-apps] Job
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23
  should delete a job [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-apps] Job should delete a job [Conformance]","total":-1,"completed":4,"skipped":35,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:13:21.590: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 31 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Jun  5 07:13:23.387: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "security-context-test-6670" for this suite.

•
------------------------------
{"msg":"PASSED [sig-node] Security Context When creating a container with runAsNonRoot should not run with an explicit root user ID [LinuxOnly]","total":-1,"completed":5,"skipped":43,"failed":0}

SSSSSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:13:23.486: INFO: Driver local doesn't support InlineVolume -- skipping
... skipping 91 lines ...
STEP: Building a namespace api object, basename secrets
STEP: Waiting for a default service account to be provisioned in namespace
[It] should be consumable from pods in volume with mappings [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating secret with name secret-test-map-e84a4cfc-089f-4fbe-b39c-7225c24fa22c
STEP: Creating a pod to test consume secrets
Jun  5 07:13:19.460: INFO: Waiting up to 5m0s for pod "pod-secrets-17dfa83c-4e3c-4d82-8dd7-d4d4f838234f" in namespace "secrets-3120" to be "Succeeded or Failed"
Jun  5 07:13:19.578: INFO: Pod "pod-secrets-17dfa83c-4e3c-4d82-8dd7-d4d4f838234f": Phase="Pending", Reason="", readiness=false. Elapsed: 117.875981ms
Jun  5 07:13:21.649: INFO: Pod "pod-secrets-17dfa83c-4e3c-4d82-8dd7-d4d4f838234f": Phase="Pending", Reason="", readiness=false. Elapsed: 2.188492836s
Jun  5 07:13:23.680: INFO: Pod "pod-secrets-17dfa83c-4e3c-4d82-8dd7-d4d4f838234f": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.219335s
STEP: Saw pod success
Jun  5 07:13:23.680: INFO: Pod "pod-secrets-17dfa83c-4e3c-4d82-8dd7-d4d4f838234f" satisfied condition "Succeeded or Failed"
Jun  5 07:13:23.710: INFO: Trying to get logs from node ip-172-20-42-252.ca-central-1.compute.internal pod pod-secrets-17dfa83c-4e3c-4d82-8dd7-d4d4f838234f container secret-volume-test: <nil>
STEP: delete the pod
Jun  5 07:13:23.778: INFO: Waiting for pod pod-secrets-17dfa83c-4e3c-4d82-8dd7-d4d4f838234f to disappear
Jun  5 07:13:23.808: INFO: Pod pod-secrets-17dfa83c-4e3c-4d82-8dd7-d4d4f838234f no longer exists
[AfterEach] [sig-storage] Secrets
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Jun  5 07:13:23.808: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "secrets-3120" for this suite.

•
------------------------------
{"msg":"PASSED [sig-storage] Secrets should be consumable from pods in volume with mappings [NodeConformance] [Conformance]","total":-1,"completed":5,"skipped":20,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Pre-provisioned PV (ext4)] volumes
... skipping 90 lines ...
Jun  5 07:13:14.516: INFO: Waiting for pod aws-client to disappear
Jun  5 07:13:14.582: INFO: Pod aws-client no longer exists
STEP: cleaning the environment after aws
STEP: Deleting pv and pvc
Jun  5 07:13:14.582: INFO: Deleting PersistentVolumeClaim "pvc-cvhwq"
Jun  5 07:13:14.660: INFO: Deleting PersistentVolume "aws-k5m6k"
Jun  5 07:13:14.965: INFO: Couldn't delete PD "aws://ca-central-1a/vol-0ec11bcd47fa1f359", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0ec11bcd47fa1f359 is currently attached to i-070c9797a5ee75576
	status code: 400, request id: aa0d67a7-6aec-4b72-ae14-cc3d6251a3f1
Jun  5 07:13:20.264: INFO: Couldn't delete PD "aws://ca-central-1a/vol-0ec11bcd47fa1f359", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0ec11bcd47fa1f359 is currently attached to i-070c9797a5ee75576
	status code: 400, request id: c615fc5a-3f95-4770-9ece-de71660ebe52
Jun  5 07:13:25.570: INFO: Successfully deleted PD "aws://ca-central-1a/vol-0ec11bcd47fa1f359".
[AfterEach] [Testpattern: Pre-provisioned PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Jun  5 07:13:25.570: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volume-5992" for this suite.
... skipping 6 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (ext4)] volumes
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should store data
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (ext4)] volumes should store data","total":-1,"completed":1,"skipped":6,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:13:25.747: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 191 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (block volmode)] volumes
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should store data
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (block volmode)] volumes should store data","total":-1,"completed":1,"skipped":5,"failed":0}

SSS
------------------------------
[BeforeEach] [sig-node] Security Context
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Jun  5 07:13:19.949: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename security-context-test
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] [sig-node] Security Context
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/security_context.go:46
[It] should run with an explicit non-root user ID [LinuxOnly]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/security_context.go:129
Jun  5 07:13:20.136: INFO: Waiting up to 5m0s for pod "explicit-nonroot-uid" in namespace "security-context-test-8094" to be "Succeeded or Failed"
Jun  5 07:13:20.167: INFO: Pod "explicit-nonroot-uid": Phase="Pending", Reason="", readiness=false. Elapsed: 30.580169ms
Jun  5 07:13:22.200: INFO: Pod "explicit-nonroot-uid": Phase="Pending", Reason="", readiness=false. Elapsed: 2.064149057s
Jun  5 07:13:24.234: INFO: Pod "explicit-nonroot-uid": Phase="Pending", Reason="", readiness=false. Elapsed: 4.098071471s
Jun  5 07:13:26.306: INFO: Pod "explicit-nonroot-uid": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.170182963s
Jun  5 07:13:26.306: INFO: Pod "explicit-nonroot-uid" satisfied condition "Succeeded or Failed"
[AfterEach] [sig-node] Security Context
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Jun  5 07:13:26.416: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "security-context-test-8094" for this suite.


... skipping 2 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  When creating a container with runAsNonRoot
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/security_context.go:104
    should run with an explicit non-root user ID [LinuxOnly]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/security_context.go:129
------------------------------
{"msg":"PASSED [sig-node] Security Context When creating a container with runAsNonRoot should run with an explicit non-root user ID [LinuxOnly]","total":-1,"completed":6,"skipped":45,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:13:26.516: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 28 lines ...
[It] should allow exec of files on the volume
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:196
Jun  5 07:13:20.370: INFO: In-tree plugin kubernetes.io/empty-dir is not migrated, not validating any metrics
Jun  5 07:13:20.370: INFO: Creating resource for inline volume
STEP: Creating pod exec-volume-test-inlinevolume-btsn
STEP: Creating a pod to test exec-volume-test
Jun  5 07:13:20.403: INFO: Waiting up to 5m0s for pod "exec-volume-test-inlinevolume-btsn" in namespace "volume-5867" to be "Succeeded or Failed"
Jun  5 07:13:20.434: INFO: Pod "exec-volume-test-inlinevolume-btsn": Phase="Pending", Reason="", readiness=false. Elapsed: 30.664028ms
Jun  5 07:13:22.472: INFO: Pod "exec-volume-test-inlinevolume-btsn": Phase="Pending", Reason="", readiness=false. Elapsed: 2.068998692s
Jun  5 07:13:24.509: INFO: Pod "exec-volume-test-inlinevolume-btsn": Phase="Pending", Reason="", readiness=false. Elapsed: 4.105624098s
Jun  5 07:13:26.540: INFO: Pod "exec-volume-test-inlinevolume-btsn": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.137224788s
STEP: Saw pod success
Jun  5 07:13:26.540: INFO: Pod "exec-volume-test-inlinevolume-btsn" satisfied condition "Succeeded or Failed"
Jun  5 07:13:26.571: INFO: Trying to get logs from node ip-172-20-42-252.ca-central-1.compute.internal pod exec-volume-test-inlinevolume-btsn container exec-container-inlinevolume-btsn: <nil>
STEP: delete the pod
Jun  5 07:13:26.640: INFO: Waiting for pod exec-volume-test-inlinevolume-btsn to disappear
Jun  5 07:13:26.674: INFO: Pod exec-volume-test-inlinevolume-btsn no longer exists
STEP: Deleting pod exec-volume-test-inlinevolume-btsn
Jun  5 07:13:26.674: INFO: Deleting pod "exec-volume-test-inlinevolume-btsn" in namespace "volume-5867"
... skipping 10 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Inline-volume (default fs)] volumes
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should allow exec of files on the volume
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:196
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Inline-volume (default fs)] volumes should allow exec of files on the volume","total":-1,"completed":3,"skipped":17,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode
... skipping 44 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (filesystem volmode)] volumeMode
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should not mount / map unused volumes in a pod [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:351
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]","total":-1,"completed":4,"skipped":23,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (immediate binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:13:28.094: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 5 lines ...
[sig-storage] In-tree Volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  [Driver: local][LocalVolumeType: dir-bindmounted]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (immediate binding)] topology
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

      Driver local doesn't support DynamicPV -- skipping

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:116
------------------------------
... skipping 33 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Jun  5 07:13:28.368: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "configmap-6286" for this suite.

•
------------------------------
{"msg":"PASSED [sig-node] ConfigMap should update ConfigMap successfully","total":-1,"completed":5,"skipped":26,"failed":0}

SSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:13:28.478: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 28 lines ...
[sig-storage] In-tree Volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  [Driver: hostPath]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (delayed binding)] topology
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

      Driver hostPath doesn't support DynamicPV -- skipping

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:116
------------------------------
... skipping 18 lines ...
Jun  5 07:13:03.616: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
Jun  5 07:13:03.648: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [nfscr4vb] to have phase Bound
Jun  5 07:13:03.679: INFO: PersistentVolumeClaim nfscr4vb found but phase is Pending instead of Bound.
Jun  5 07:13:05.714: INFO: PersistentVolumeClaim nfscr4vb found and phase=Bound (2.06566098s)
STEP: Creating pod exec-volume-test-dynamicpv-qs7z
STEP: Creating a pod to test exec-volume-test
Jun  5 07:13:05.811: INFO: Waiting up to 5m0s for pod "exec-volume-test-dynamicpv-qs7z" in namespace "volume-4075" to be "Succeeded or Failed"
Jun  5 07:13:05.842: INFO: Pod "exec-volume-test-dynamicpv-qs7z": Phase="Pending", Reason="", readiness=false. Elapsed: 30.962118ms
Jun  5 07:13:07.873: INFO: Pod "exec-volume-test-dynamicpv-qs7z": Phase="Pending", Reason="", readiness=false. Elapsed: 2.062160264s
Jun  5 07:13:09.905: INFO: Pod "exec-volume-test-dynamicpv-qs7z": Phase="Pending", Reason="", readiness=false. Elapsed: 4.094281076s
Jun  5 07:13:11.943: INFO: Pod "exec-volume-test-dynamicpv-qs7z": Phase="Pending", Reason="", readiness=false. Elapsed: 6.132328044s
Jun  5 07:13:13.975: INFO: Pod "exec-volume-test-dynamicpv-qs7z": Phase="Pending", Reason="", readiness=false. Elapsed: 8.164711502s
Jun  5 07:13:16.008: INFO: Pod "exec-volume-test-dynamicpv-qs7z": Phase="Succeeded", Reason="", readiness=false. Elapsed: 10.197012491s
STEP: Saw pod success
Jun  5 07:13:16.008: INFO: Pod "exec-volume-test-dynamicpv-qs7z" satisfied condition "Succeeded or Failed"
Jun  5 07:13:16.044: INFO: Trying to get logs from node ip-172-20-42-252.ca-central-1.compute.internal pod exec-volume-test-dynamicpv-qs7z container exec-container-dynamicpv-qs7z: <nil>
STEP: delete the pod
Jun  5 07:13:16.112: INFO: Waiting for pod exec-volume-test-dynamicpv-qs7z to disappear
Jun  5 07:13:16.145: INFO: Pod exec-volume-test-dynamicpv-qs7z no longer exists
STEP: Deleting pod exec-volume-test-dynamicpv-qs7z
Jun  5 07:13:16.145: INFO: Deleting pod "exec-volume-test-dynamicpv-qs7z" in namespace "volume-4075"
... skipping 17 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (default fs)] volumes
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should allow exec of files on the volume
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:196
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: nfs] [Testpattern: Dynamic PV (default fs)] volumes should allow exec of files on the volume","total":-1,"completed":2,"skipped":38,"failed":0}
[BeforeEach] [Testpattern: Inline-volume (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:13:28.540: INFO: Driver local doesn't support InlineVolume -- skipping
[AfterEach] [Testpattern: Inline-volume (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 121 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should not mount / map unused volumes in a pod [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:351
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: tmpfs] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]","total":-1,"completed":6,"skipped":22,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:13:33.499: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 630 lines ...
• [SLOW TEST:102.216 seconds]
[sig-network] Conntrack
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/common/framework.go:23
  should drop INVALID conntrack entries
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/conntrack.go:282
------------------------------
{"msg":"PASSED [sig-network] Conntrack should drop INVALID conntrack entries","total":-1,"completed":1,"skipped":8,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (delayed binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:13:35.686: INFO: Driver "csi-hostpath" does not support topology - skipping
... skipping 204 lines ...
• [SLOW TEST:104.449 seconds]
[sig-storage] Projected configMap
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  optional updates should be reflected in volume [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] Projected configMap optional updates should be reflected in volume [NodeConformance] [Conformance]","total":-1,"completed":1,"skipped":18,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:13:37.965: INFO: Driver local doesn't support ext4 -- skipping
... skipping 22 lines ...
STEP: Creating a kubernetes client
Jun  5 07:12:59.602: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename init-container
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] [sig-node] InitContainer [NodeConformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/init_container.go:162
[It] should not start app containers if init containers fail on a RestartAlways pod [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: creating the pod
Jun  5 07:12:59.760: INFO: PodSpec: initContainers in spec.initContainers
Jun  5 07:13:39.190: INFO: init container has failed twice: &v1.Pod{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pod-init-07988b05-3ca7-4764-9b14-501a992ba76c", GenerateName:"", Namespace:"init-container-5077", SelfLink:"", UID:"d3c135ac-20be-4e6d-ac5c-89f35d3e701e", ResourceVersion:"6463", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63758473979, loc:(*time.Location)(0x9dc0820)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"name":"foo", "time":"760287648"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"e2e.test", Operation:"Update", APIVersion:"v1", Time:(*v1.Time)(0xc00356cc18), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc00356cc30)}, v1.ManagedFieldsEntry{Manager:"kubelet", Operation:"Update", APIVersion:"v1", Time:(*v1.Time)(0xc00356cc48), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc00356cc60)}}}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"kube-api-access-pzm2j", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(0xc005b980c0), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container{v1.Container{Name:"init1", Image:"k8s.gcr.io/e2e-test-images/busybox:1.29-1", Command:[]string{"/bin/false"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar(nil), Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-api-access-pzm2j", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}, v1.Container{Name:"init2", Image:"k8s.gcr.io/e2e-test-images/busybox:1.29-1", Command:[]string{"/bin/true"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar(nil), Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-api-access-pzm2j", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}}, Containers:[]v1.Container{v1.Container{Name:"run1", Image:"k8s.gcr.io/pause:3.4.1", Command:[]string(nil), Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar(nil), Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:100, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100m", Format:"DecimalSI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:100, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100m", Format:"DecimalSI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-api-access-pzm2j", ReadOnly:true, MountPath:"/var/run/secrets/kubernetes.io/serviceaccount", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0xc004b431f0), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string(nil), ServiceAccountName:"default", DeprecatedServiceAccount:"default", AutomountServiceAccountToken:(*bool)(nil), NodeName:"ip-172-20-62-33.ca-central-1.compute.internal", HostNetwork:false, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0xc00203e620), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"node.kubernetes.io/not-ready", Operator:"Exists", Value:"", Effect:"NoExecute", TolerationSeconds:(*int64)(0xc004b432f0)}, v1.Toleration{Key:"node.kubernetes.io/unreachable", Operator:"Exists", Value:"", Effect:"NoExecute", TolerationSeconds:(*int64)(0xc004b43310)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"", Priority:(*int32)(0xc004b43318), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(0xc004b4331c), PreemptionPolicy:(*v1.PreemptionPolicy)(0xc0039d8bb0), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}, Status:v1.PodStatus{Phase:"Pending", Conditions:[]v1.PodCondition{v1.PodCondition{Type:"Initialized", Status:"False", LastProbeTime:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63758473979, loc:(*time.Location)(0x9dc0820)}}, Reason:"ContainersNotInitialized", Message:"containers with incomplete status: [init1 init2]"}, v1.PodCondition{Type:"Ready", Status:"False", LastProbeTime:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63758473979, loc:(*time.Location)(0x9dc0820)}}, Reason:"ContainersNotReady", Message:"containers with unready status: [run1]"}, v1.PodCondition{Type:"ContainersReady", Status:"False", LastProbeTime:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63758473979, loc:(*time.Location)(0x9dc0820)}}, Reason:"ContainersNotReady", Message:"containers with unready status: [run1]"}, v1.PodCondition{Type:"PodScheduled", Status:"True", LastProbeTime:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63758473979, loc:(*time.Location)(0x9dc0820)}}, Reason:"", Message:""}}, Message:"", Reason:"", NominatedNodeName:"", HostIP:"172.20.62.33", PodIP:"100.96.4.3", PodIPs:[]v1.PodIP{v1.PodIP{IP:"100.96.4.3"}}, StartTime:(*v1.Time)(0xc00356cc90), InitContainerStatuses:[]v1.ContainerStatus{v1.ContainerStatus{Name:"init1", State:v1.ContainerState{Waiting:(*v1.ContainerStateWaiting)(nil), Running:(*v1.ContainerStateRunning)(nil), Terminated:(*v1.ContainerStateTerminated)(0xc00203e700)}, LastTerminationState:v1.ContainerState{Waiting:(*v1.ContainerStateWaiting)(nil), Running:(*v1.ContainerStateRunning)(nil), Terminated:(*v1.ContainerStateTerminated)(0xc00203e7e0)}, Ready:false, RestartCount:3, Image:"k8s.gcr.io/e2e-test-images/busybox:1.29-1", ImageID:"k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592", ContainerID:"containerd://4594caed0821fa550b8b335b9490a54ead8fa514fd02620c8670deb17a1c38d0", Started:(*bool)(nil)}, v1.ContainerStatus{Name:"init2", State:v1.ContainerState{Waiting:(*v1.ContainerStateWaiting)(0xc005b98140), Running:(*v1.ContainerStateRunning)(nil), Terminated:(*v1.ContainerStateTerminated)(nil)}, LastTerminationState:v1.ContainerState{Waiting:(*v1.ContainerStateWaiting)(nil), Running:(*v1.ContainerStateRunning)(nil), Terminated:(*v1.ContainerStateTerminated)(nil)}, Ready:false, RestartCount:0, Image:"k8s.gcr.io/e2e-test-images/busybox:1.29-1", ImageID:"", ContainerID:"", Started:(*bool)(nil)}}, ContainerStatuses:[]v1.ContainerStatus{v1.ContainerStatus{Name:"run1", State:v1.ContainerState{Waiting:(*v1.ContainerStateWaiting)(0xc005b98120), Running:(*v1.ContainerStateRunning)(nil), Terminated:(*v1.ContainerStateTerminated)(nil)}, LastTerminationState:v1.ContainerState{Waiting:(*v1.ContainerStateWaiting)(nil), Running:(*v1.ContainerStateRunning)(nil), Terminated:(*v1.ContainerStateTerminated)(nil)}, Ready:false, RestartCount:0, Image:"k8s.gcr.io/pause:3.4.1", ImageID:"", ContainerID:"", Started:(*bool)(0xc004b433bf)}}, QOSClass:"Burstable", EphemeralContainerStatuses:[]v1.ContainerStatus(nil)}}
[AfterEach] [sig-node] InitContainer [NodeConformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Jun  5 07:13:39.191: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "init-container-5077" for this suite.


• [SLOW TEST:39.652 seconds]
[sig-node] InitContainer [NodeConformance]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  should not start app containers if init containers fail on a RestartAlways pod [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] InitContainer [NodeConformance] should not start app containers if init containers fail on a RestartAlways pod [Conformance]","total":-1,"completed":5,"skipped":13,"failed":0}

SS
------------------------------
[BeforeEach] [sig-node] AppArmor
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 80 lines ...
[It] should support existing directory
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:205
Jun  5 07:13:33.761: INFO: In-tree plugin kubernetes.io/host-path is not migrated, not validating any metrics
Jun  5 07:13:33.817: INFO: Creating resource for inline volume
STEP: Creating pod pod-subpath-test-inlinevolume-zm6k
STEP: Creating a pod to test subpath
Jun  5 07:13:33.860: INFO: Waiting up to 5m0s for pod "pod-subpath-test-inlinevolume-zm6k" in namespace "provisioning-4277" to be "Succeeded or Failed"
Jun  5 07:13:33.895: INFO: Pod "pod-subpath-test-inlinevolume-zm6k": Phase="Pending", Reason="", readiness=false. Elapsed: 34.050533ms
Jun  5 07:13:35.926: INFO: Pod "pod-subpath-test-inlinevolume-zm6k": Phase="Pending", Reason="", readiness=false. Elapsed: 2.065705172s
Jun  5 07:13:37.961: INFO: Pod "pod-subpath-test-inlinevolume-zm6k": Phase="Pending", Reason="", readiness=false. Elapsed: 4.100324401s
Jun  5 07:13:39.993: INFO: Pod "pod-subpath-test-inlinevolume-zm6k": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.132715357s
STEP: Saw pod success
Jun  5 07:13:39.993: INFO: Pod "pod-subpath-test-inlinevolume-zm6k" satisfied condition "Succeeded or Failed"
Jun  5 07:13:40.024: INFO: Trying to get logs from node ip-172-20-48-31.ca-central-1.compute.internal pod pod-subpath-test-inlinevolume-zm6k container test-container-volume-inlinevolume-zm6k: <nil>
STEP: delete the pod
Jun  5 07:13:40.108: INFO: Waiting for pod pod-subpath-test-inlinevolume-zm6k to disappear
Jun  5 07:13:40.139: INFO: Pod pod-subpath-test-inlinevolume-zm6k no longer exists
STEP: Deleting pod pod-subpath-test-inlinevolume-zm6k
Jun  5 07:13:40.139: INFO: Deleting pod "pod-subpath-test-inlinevolume-zm6k" in namespace "provisioning-4277"
... skipping 12 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Inline-volume (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support existing directory
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:205
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Inline-volume (default fs)] subPath should support existing directory","total":-1,"completed":7,"skipped":42,"failed":0}
[BeforeEach] [Testpattern: Pre-provisioned PV (ext3)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:13:40.275: INFO: Driver nfs doesn't support ext3 -- skipping
[AfterEach] [Testpattern: Pre-provisioned PV (ext3)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 57 lines ...
• [SLOW TEST:20.255 seconds]
[sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  works for multiple CRDs of different groups [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for multiple CRDs of different groups [Conformance]","total":-1,"completed":5,"skipped":31,"failed":0}
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:13:41.133: INFO: Only supported for providers [azure] (not aws)
[AfterEach] [Testpattern: Pre-provisioned PV (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 19 lines ...
STEP: Building a namespace api object, basename configmap
STEP: Waiting for a default service account to be provisioned in namespace
[It] should be consumable from pods in volume with defaultMode set [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating configMap with name configmap-test-volume-ff3a7e01-6e70-4284-a8d4-a6e363828bed
STEP: Creating a pod to test consume configMaps
Jun  5 07:13:35.973: INFO: Waiting up to 5m0s for pod "pod-configmaps-66eed3f3-efcf-4983-a758-07c7bb0a3a54" in namespace "configmap-3464" to be "Succeeded or Failed"
Jun  5 07:13:36.004: INFO: Pod "pod-configmaps-66eed3f3-efcf-4983-a758-07c7bb0a3a54": Phase="Pending", Reason="", readiness=false. Elapsed: 30.470554ms
Jun  5 07:13:38.036: INFO: Pod "pod-configmaps-66eed3f3-efcf-4983-a758-07c7bb0a3a54": Phase="Pending", Reason="", readiness=false. Elapsed: 2.062364468s
Jun  5 07:13:40.068: INFO: Pod "pod-configmaps-66eed3f3-efcf-4983-a758-07c7bb0a3a54": Phase="Pending", Reason="", readiness=false. Elapsed: 4.094320667s
Jun  5 07:13:42.099: INFO: Pod "pod-configmaps-66eed3f3-efcf-4983-a758-07c7bb0a3a54": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.125521132s
STEP: Saw pod success
Jun  5 07:13:42.099: INFO: Pod "pod-configmaps-66eed3f3-efcf-4983-a758-07c7bb0a3a54" satisfied condition "Succeeded or Failed"
Jun  5 07:13:42.129: INFO: Trying to get logs from node ip-172-20-42-252.ca-central-1.compute.internal pod pod-configmaps-66eed3f3-efcf-4983-a758-07c7bb0a3a54 container agnhost-container: <nil>
STEP: delete the pod
Jun  5 07:13:42.204: INFO: Waiting for pod pod-configmaps-66eed3f3-efcf-4983-a758-07c7bb0a3a54 to disappear
Jun  5 07:13:42.234: INFO: Pod pod-configmaps-66eed3f3-efcf-4983-a758-07c7bb0a3a54 no longer exists
[AfterEach] [sig-storage] ConfigMap
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:6.544 seconds]
[sig-storage] ConfigMap
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should be consumable from pods in volume with defaultMode set [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] ConfigMap should be consumable from pods in volume with defaultMode set [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":2,"skipped":21,"failed":0}

S
------------------------------
[BeforeEach] [sig-api-machinery] ResourceQuota
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 18 lines ...
• [SLOW TEST:11.456 seconds]
[sig-api-machinery] ResourceQuota
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  should create a ResourceQuota and capture the life of a persistent volume claim with a storage class
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/resource_quota.go:531
------------------------------
{"msg":"PASSED [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a persistent volume claim with a storage class","total":-1,"completed":2,"skipped":19,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:13:47.603: INFO: Only supported for providers [vsphere] (not aws)
[AfterEach] [Testpattern: Dynamic PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 128 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] volumes
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should store data
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir-link-bindmounted] [Testpattern: Pre-provisioned PV (default fs)] volumes should store data","total":-1,"completed":5,"skipped":17,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (delayed binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (delayed binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Jun  5 07:13:49.230: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename topology
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail to schedule a pod which has topologies that conflict with AllowedTopologies
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192
Jun  5 07:13:49.418: INFO: found topology map[topology.kubernetes.io/zone:ca-central-1a]
Jun  5 07:13:49.418: INFO: In-tree plugin kubernetes.io/aws-ebs is not migrated, not validating any metrics
Jun  5 07:13:49.418: INFO: Not enough topologies in cluster -- skipping
STEP: Deleting pvc
STEP: Deleting sc
... skipping 7 lines ...
[sig-storage] In-tree Volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  [Driver: aws]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (delayed binding)] topology
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [It]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

      Not enough topologies in cluster -- skipping

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:199
------------------------------
... skipping 146 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] volumes
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should store data
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir-link] [Testpattern: Pre-provisioned PV (default fs)] volumes should store data","total":-1,"completed":4,"skipped":7,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] provisioning
... skipping 161 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_volumes.go:40
    [Testpattern: Dynamic PV (block volmode)] provisioning
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should provision storage with pvc data source
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/provisioning.go:238
------------------------------
{"msg":"PASSED [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (block volmode)] provisioning should provision storage with pvc data source","total":-1,"completed":1,"skipped":1,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volumes
... skipping 168 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_volumes.go:40
    [Testpattern: Dynamic PV (block volmode)] volumes
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should store data
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159
------------------------------
{"msg":"PASSED [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (block volmode)] volumes should store data","total":-1,"completed":1,"skipped":4,"failed":0}

S
------------------------------
[BeforeEach] [sig-storage] PersistentVolumes-local 
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 66 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:192
    Two pods mounting a local volume one after the other
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:254
      should be able to write from pod1 and read from pod2
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:255
------------------------------
{"msg":"PASSED [sig-storage] PersistentVolumes-local  [Volume type: block] Two pods mounting a local volume one after the other should be able to write from pod1 and read from pod2","total":-1,"completed":7,"skipped":53,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:13:52.268: INFO: Driver emptydir doesn't support DynamicPV -- skipping
[AfterEach] [Testpattern: Dynamic PV (block volmode)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 29 lines ...
Jun  5 07:13:23.719: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-898kgpfd
STEP: creating a claim
Jun  5 07:13:23.750: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-mrq6
STEP: Creating a pod to test subpath
Jun  5 07:13:23.845: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-mrq6" in namespace "provisioning-898" to be "Succeeded or Failed"
Jun  5 07:13:23.875: INFO: Pod "pod-subpath-test-dynamicpv-mrq6": Phase="Pending", Reason="", readiness=false. Elapsed: 30.605285ms
Jun  5 07:13:25.907: INFO: Pod "pod-subpath-test-dynamicpv-mrq6": Phase="Pending", Reason="", readiness=false. Elapsed: 2.061992636s
Jun  5 07:13:27.960: INFO: Pod "pod-subpath-test-dynamicpv-mrq6": Phase="Pending", Reason="", readiness=false. Elapsed: 4.115254042s
Jun  5 07:13:29.994: INFO: Pod "pod-subpath-test-dynamicpv-mrq6": Phase="Pending", Reason="", readiness=false. Elapsed: 6.149492792s
Jun  5 07:13:32.026: INFO: Pod "pod-subpath-test-dynamicpv-mrq6": Phase="Pending", Reason="", readiness=false. Elapsed: 8.181213108s
Jun  5 07:13:34.069: INFO: Pod "pod-subpath-test-dynamicpv-mrq6": Phase="Pending", Reason="", readiness=false. Elapsed: 10.22404455s
Jun  5 07:13:36.100: INFO: Pod "pod-subpath-test-dynamicpv-mrq6": Phase="Pending", Reason="", readiness=false. Elapsed: 12.255025026s
Jun  5 07:13:38.153: INFO: Pod "pod-subpath-test-dynamicpv-mrq6": Phase="Pending", Reason="", readiness=false. Elapsed: 14.308402557s
Jun  5 07:13:40.185: INFO: Pod "pod-subpath-test-dynamicpv-mrq6": Phase="Pending", Reason="", readiness=false. Elapsed: 16.340520153s
Jun  5 07:13:42.218: INFO: Pod "pod-subpath-test-dynamicpv-mrq6": Phase="Succeeded", Reason="", readiness=false. Elapsed: 18.372843325s
STEP: Saw pod success
Jun  5 07:13:42.218: INFO: Pod "pod-subpath-test-dynamicpv-mrq6" satisfied condition "Succeeded or Failed"
Jun  5 07:13:42.248: INFO: Trying to get logs from node ip-172-20-42-252.ca-central-1.compute.internal pod pod-subpath-test-dynamicpv-mrq6 container test-container-subpath-dynamicpv-mrq6: <nil>
STEP: delete the pod
Jun  5 07:13:42.316: INFO: Waiting for pod pod-subpath-test-dynamicpv-mrq6 to disappear
Jun  5 07:13:42.352: INFO: Pod pod-subpath-test-dynamicpv-mrq6 no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-mrq6
Jun  5 07:13:42.352: INFO: Deleting pod "pod-subpath-test-dynamicpv-mrq6" in namespace "provisioning-898"
... skipping 19 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support existing single file [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:219
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] subPath should support existing single file [LinuxOnly]","total":-1,"completed":6,"skipped":64,"failed":0}

S
------------------------------
[BeforeEach] [sig-storage] PersistentVolumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 18 lines ...
Jun  5 07:13:21.582: INFO: PersistentVolumeClaim pvc-v9crn found and phase=Bound (35.698678ms)
Jun  5 07:13:21.582: INFO: Waiting up to 3m0s for PersistentVolume nfs-v6xf7 to have phase Bound
Jun  5 07:13:21.649: INFO: PersistentVolume nfs-v6xf7 found and phase=Bound (66.807443ms)
[It] should test that a PV becomes Available and is clean after the PVC is deleted.
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes.go:283
STEP: Writing to the volume.
Jun  5 07:13:21.774: INFO: Waiting up to 5m0s for pod "pvc-tester-9wvpz" in namespace "pv-195" to be "Succeeded or Failed"
Jun  5 07:13:21.805: INFO: Pod "pvc-tester-9wvpz": Phase="Pending", Reason="", readiness=false. Elapsed: 30.889251ms
Jun  5 07:13:23.836: INFO: Pod "pvc-tester-9wvpz": Phase="Pending", Reason="", readiness=false. Elapsed: 2.061805741s
Jun  5 07:13:25.875: INFO: Pod "pvc-tester-9wvpz": Phase="Running", Reason="", readiness=true. Elapsed: 4.100955099s
Jun  5 07:13:27.926: INFO: Pod "pvc-tester-9wvpz": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.151953924s
STEP: Saw pod success
Jun  5 07:13:27.927: INFO: Pod "pvc-tester-9wvpz" satisfied condition "Succeeded or Failed"
STEP: Deleting the claim
Jun  5 07:13:27.927: INFO: Deleting pod "pvc-tester-9wvpz" in namespace "pv-195"
Jun  5 07:13:27.980: INFO: Wait up to 5m0s for pod "pvc-tester-9wvpz" to be fully deleted
Jun  5 07:13:28.010: INFO: Deleting PVC pvc-v9crn to trigger reclamation of PV 
Jun  5 07:13:28.010: INFO: Deleting PersistentVolumeClaim "pvc-v9crn"
Jun  5 07:13:28.042: INFO: Waiting for reclaim process to complete.
... skipping 3 lines ...
Jun  5 07:13:32.143: INFO: PersistentVolume nfs-v6xf7 found and phase=Available (4.101130231s)
Jun  5 07:13:32.174: INFO: PV nfs-v6xf7 now in "Available" phase
STEP: Re-mounting the volume.
Jun  5 07:13:32.206: INFO: Waiting up to timeout=1m0s for PersistentVolumeClaims [pvc-br2mm] to have phase Bound
Jun  5 07:13:32.236: INFO: PersistentVolumeClaim pvc-br2mm found and phase=Bound (30.249751ms)
STEP: Verifying the mount has been cleaned.
Jun  5 07:13:32.269: INFO: Waiting up to 5m0s for pod "pvc-tester-7khlk" in namespace "pv-195" to be "Succeeded or Failed"
Jun  5 07:13:32.299: INFO: Pod "pvc-tester-7khlk": Phase="Pending", Reason="", readiness=false. Elapsed: 30.307817ms
Jun  5 07:13:34.337: INFO: Pod "pvc-tester-7khlk": Phase="Pending", Reason="", readiness=false. Elapsed: 2.068517808s
Jun  5 07:13:36.375: INFO: Pod "pvc-tester-7khlk": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.106156162s
STEP: Saw pod success
Jun  5 07:13:36.375: INFO: Pod "pvc-tester-7khlk" satisfied condition "Succeeded or Failed"
Jun  5 07:13:36.375: INFO: Deleting pod "pvc-tester-7khlk" in namespace "pv-195"
Jun  5 07:13:36.408: INFO: Wait up to 5m0s for pod "pvc-tester-7khlk" to be fully deleted
Jun  5 07:13:36.439: INFO: Pod exited without failure; the volume has been recycled.
Jun  5 07:13:36.439: INFO: Removing second PVC, waiting for the recycler to finish before cleanup.
Jun  5 07:13:36.439: INFO: Deleting PVC pvc-br2mm to trigger reclamation of PV 
Jun  5 07:13:36.439: INFO: Deleting PersistentVolumeClaim "pvc-br2mm"
... skipping 27 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes.go:122
    when invoking the Recycle reclaim policy
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes.go:265
      should test that a PV becomes Available and is clean after the PVC is deleted.
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes.go:283
------------------------------
{"msg":"PASSED [sig-storage] PersistentVolumes NFS when invoking the Recycle reclaim policy should test that a PV becomes Available and is clean after the PVC is deleted.","total":-1,"completed":3,"skipped":5,"failed":0}

SSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
... skipping 59 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should be able to unmount after the subpath directory is deleted [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:444
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: blockfs] [Testpattern: Pre-provisioned PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]","total":-1,"completed":6,"skipped":41,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:13:52.891: INFO: Driver local doesn't support DynamicPV -- skipping
[AfterEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 28 lines ...
Jun  5 07:13:33.042: INFO: The status of Pod kube-proxy-mode-detector is Pending, waiting for it to be Running (with Ready = true)
Jun  5 07:13:35.042: INFO: The status of Pod kube-proxy-mode-detector is Running (Ready = true)
Jun  5 07:13:35.079: INFO: Running '/tmp/kubectl3037677957/kubectl --server=https://api.e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=services-7410 exec kube-proxy-mode-detector -- /bin/sh -x -c curl -q -s --connect-timeout 1 http://localhost:10249/proxyMode'
Jun  5 07:13:35.545: INFO: rc: 7
Jun  5 07:13:35.580: INFO: Waiting for pod kube-proxy-mode-detector to disappear
Jun  5 07:13:35.611: INFO: Pod kube-proxy-mode-detector no longer exists
Jun  5 07:13:35.611: INFO: Couldn't detect KubeProxy mode - test failure may be expected: error running /tmp/kubectl3037677957/kubectl --server=https://api.e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=services-7410 exec kube-proxy-mode-detector -- /bin/sh -x -c curl -q -s --connect-timeout 1 http://localhost:10249/proxyMode:
Command stdout:

stderr:
+ curl -q -s --connect-timeout 1 http://localhost:10249/proxyMode
command terminated with exit code 7

error:
exit status 7
STEP: creating a TCP service sourceip-test with type=ClusterIP in namespace services-7410
Jun  5 07:13:35.649: INFO: sourceip-test cluster ip: 100.67.157.69
STEP: Picking 2 Nodes to test whether source IP is preserved or not
STEP: Creating a webserver pod to be part of the TCP service which echoes back source ip
Jun  5 07:13:35.744: INFO: The status of Pod echo-sourceip is Pending, waiting for it to be Running (with Ready = true)
... skipping 32 lines ...
• [SLOW TEST:26.424 seconds]
[sig-network] Services
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/common/framework.go:23
  should preserve source pod IP for traffic thru service cluster IP [LinuxOnly]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:903
------------------------------
{"msg":"PASSED [sig-network] Services should preserve source pod IP for traffic thru service cluster IP [LinuxOnly]","total":-1,"completed":4,"skipped":18,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:13:53.233: INFO: Only supported for providers [gce gke] (not aws)
... skipping 219 lines ...
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] [sig-storage] Projected downwardAPI
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/projected_downwardapi.go:41
[It] should set DefaultMode on files [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test downward API volume plugin
Jun  5 07:13:52.004: INFO: Waiting up to 5m0s for pod "downwardapi-volume-7097ed7e-6822-4d05-8ab9-6c36a7484b63" in namespace "projected-4247" to be "Succeeded or Failed"
Jun  5 07:13:52.035: INFO: Pod "downwardapi-volume-7097ed7e-6822-4d05-8ab9-6c36a7484b63": Phase="Pending", Reason="", readiness=false. Elapsed: 30.919312ms
Jun  5 07:13:54.069: INFO: Pod "downwardapi-volume-7097ed7e-6822-4d05-8ab9-6c36a7484b63": Phase="Pending", Reason="", readiness=false. Elapsed: 2.064940489s
Jun  5 07:13:56.100: INFO: Pod "downwardapi-volume-7097ed7e-6822-4d05-8ab9-6c36a7484b63": Phase="Pending", Reason="", readiness=false. Elapsed: 4.096458782s
Jun  5 07:13:58.132: INFO: Pod "downwardapi-volume-7097ed7e-6822-4d05-8ab9-6c36a7484b63": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.127975438s
STEP: Saw pod success
Jun  5 07:13:58.132: INFO: Pod "downwardapi-volume-7097ed7e-6822-4d05-8ab9-6c36a7484b63" satisfied condition "Succeeded or Failed"
Jun  5 07:13:58.163: INFO: Trying to get logs from node ip-172-20-62-33.ca-central-1.compute.internal pod downwardapi-volume-7097ed7e-6822-4d05-8ab9-6c36a7484b63 container client-container: <nil>
STEP: delete the pod
Jun  5 07:13:58.240: INFO: Waiting for pod downwardapi-volume-7097ed7e-6822-4d05-8ab9-6c36a7484b63 to disappear
Jun  5 07:13:58.271: INFO: Pod downwardapi-volume-7097ed7e-6822-4d05-8ab9-6c36a7484b63 no longer exists
[AfterEach] [sig-storage] Projected downwardAPI
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:6.525 seconds]
[sig-storage] Projected downwardAPI
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should set DefaultMode on files [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] Projected downwardAPI should set DefaultMode on files [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":2,"skipped":2,"failed":0}

SSSSSS
------------------------------
[BeforeEach] [sig-node] SSH
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 13 lines ...
Jun  5 07:13:54.455: INFO: Got stdout from 99.79.190.149:22: Hello from admin@ip-172-20-62-33
STEP: SSH'ing to 1 nodes and running echo "foo" | grep "bar"
STEP: SSH'ing to 1 nodes and running echo "stdout" && echo "stderr" >&2 && exit 7
Jun  5 07:13:55.256: INFO: Got stdout from 35.183.4.85:22: stdout
Jun  5 07:13:55.256: INFO: Got stderr from 35.183.4.85:22: stderr
STEP: SSH'ing to a nonexistent host
error dialing admin@i.do.not.exist: 'dial tcp: address i.do.not.exist: missing port in address', retrying
[AfterEach] [sig-node] SSH
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Jun  5 07:14:00.258: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "ssh-4667" for this suite.


• [SLOW TEST:8.736 seconds]
[sig-node] SSH
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/framework.go:23
  should SSH to all nodes and run commands
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/ssh.go:45
------------------------------
{"msg":"PASSED [sig-node] SSH should SSH to all nodes and run commands","total":-1,"completed":5,"skipped":8,"failed":0}

SSS
------------------------------
[BeforeEach] [sig-storage] PersistentVolumes-local 
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 66 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:192
    Two pods mounting a local volume one after the other
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:254
      should be able to write from pod1 and read from pod2
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:255
------------------------------
{"msg":"PASSED [sig-storage] PersistentVolumes-local  [Volume type: blockfswithoutformat] Two pods mounting a local volume one after the other should be able to write from pod1 and read from pod2","total":-1,"completed":6,"skipped":32,"failed":0}

SSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
... skipping 59 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should be able to unmount after the subpath directory is deleted [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:444
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: block] [Testpattern: Pre-provisioned PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]","total":-1,"completed":4,"skipped":27,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:14:00.833: INFO: Only supported for node OS distro [gci ubuntu custom] (not debian)
[AfterEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 141 lines ...
• [SLOW TEST:8.469 seconds]
[sig-node] Pods
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  should support retrieving logs from the container over websockets [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] Pods should support retrieving logs from the container over websockets [NodeConformance] [Conformance]","total":-1,"completed":7,"skipped":42,"failed":0}

SSSS
------------------------------
[BeforeEach] [sig-storage] CSI mock volume
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 102 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  CSI attach test using mock driver
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:316
    should require VolumeAttach for drivers with attachment
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:338
------------------------------
{"msg":"PASSED [sig-storage] CSI mock volume CSI attach test using mock driver should require VolumeAttach for drivers with attachment","total":-1,"completed":4,"skipped":9,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:14:02.105: INFO: Driver local doesn't support InlineVolume -- skipping
... skipping 14 lines ...
      Driver local doesn't support InlineVolume -- skipping

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:116
------------------------------
SSSSSSSS
------------------------------
{"msg":"PASSED [sig-apps] ReplicaSet should serve a basic image on each replica with a public image  [Conformance]","total":-1,"completed":8,"skipped":50,"failed":0}
[BeforeEach] [sig-apps] Deployment
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Jun  5 07:13:57.779: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename deployment
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 24 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Jun  5 07:14:02.423: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "deployment-3973" for this suite.

•
------------------------------
{"msg":"PASSED [sig-apps] Deployment RecreateDeployment should delete old pods and create new ones [Conformance]","total":-1,"completed":9,"skipped":50,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:14:02.514: INFO: Driver csi-hostpath doesn't support InlineVolume -- skipping
... skipping 104 lines ...
Jun  5 07:13:01.856: INFO: PersistentVolumeClaim csi-hostpathpd7c5 found but phase is Pending instead of Bound.
Jun  5 07:13:03.888: INFO: PersistentVolumeClaim csi-hostpathpd7c5 found but phase is Pending instead of Bound.
Jun  5 07:13:05.919: INFO: PersistentVolumeClaim csi-hostpathpd7c5 found but phase is Pending instead of Bound.
Jun  5 07:13:07.951: INFO: PersistentVolumeClaim csi-hostpathpd7c5 found and phase=Bound (22.41170122s)
STEP: Expanding non-expandable pvc
Jun  5 07:13:08.013: INFO: currentPvcSize {{1073741824 0} {<nil>} 1Gi BinarySI}, newSize {{2147483648 0} {<nil>}  BinarySI}
Jun  5 07:13:08.076: INFO: Error updating pvc csi-hostpathpd7c5: persistentvolumeclaims "csi-hostpathpd7c5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Jun  5 07:13:10.145: INFO: Error updating pvc csi-hostpathpd7c5: persistentvolumeclaims "csi-hostpathpd7c5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Jun  5 07:13:12.166: INFO: Error updating pvc csi-hostpathpd7c5: persistentvolumeclaims "csi-hostpathpd7c5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Jun  5 07:13:14.148: INFO: Error updating pvc csi-hostpathpd7c5: persistentvolumeclaims "csi-hostpathpd7c5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Jun  5 07:13:16.145: INFO: Error updating pvc csi-hostpathpd7c5: persistentvolumeclaims "csi-hostpathpd7c5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Jun  5 07:13:18.151: INFO: Error updating pvc csi-hostpathpd7c5: persistentvolumeclaims "csi-hostpathpd7c5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Jun  5 07:13:20.151: INFO: Error updating pvc csi-hostpathpd7c5: persistentvolumeclaims "csi-hostpathpd7c5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Jun  5 07:13:22.150: INFO: Error updating pvc csi-hostpathpd7c5: persistentvolumeclaims "csi-hostpathpd7c5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Jun  5 07:13:24.140: INFO: Error updating pvc csi-hostpathpd7c5: persistentvolumeclaims "csi-hostpathpd7c5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Jun  5 07:13:26.150: INFO: Error updating pvc csi-hostpathpd7c5: persistentvolumeclaims "csi-hostpathpd7c5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Jun  5 07:13:28.141: INFO: Error updating pvc csi-hostpathpd7c5: persistentvolumeclaims "csi-hostpathpd7c5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Jun  5 07:13:30.139: INFO: Error updating pvc csi-hostpathpd7c5: persistentvolumeclaims "csi-hostpathpd7c5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Jun  5 07:13:32.140: INFO: Error updating pvc csi-hostpathpd7c5: persistentvolumeclaims "csi-hostpathpd7c5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Jun  5 07:13:34.145: INFO: Error updating pvc csi-hostpathpd7c5: persistentvolumeclaims "csi-hostpathpd7c5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Jun  5 07:13:36.140: INFO: Error updating pvc csi-hostpathpd7c5: persistentvolumeclaims "csi-hostpathpd7c5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Jun  5 07:13:38.167: INFO: Error updating pvc csi-hostpathpd7c5: persistentvolumeclaims "csi-hostpathpd7c5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Jun  5 07:13:38.276: INFO: Error updating pvc csi-hostpathpd7c5: persistentvolumeclaims "csi-hostpathpd7c5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
STEP: Deleting pvc
Jun  5 07:13:38.276: INFO: Deleting PersistentVolumeClaim "csi-hostpathpd7c5"
Jun  5 07:13:38.363: INFO: Waiting up to 5m0s for PersistentVolume pvc-004a8c6e-319e-455c-9274-f630adfd2e44 to get deleted
Jun  5 07:13:38.400: INFO: PersistentVolume pvc-004a8c6e-319e-455c-9274-f630adfd2e44 found and phase=Bound (37.000319ms)
Jun  5 07:13:43.432: INFO: PersistentVolume pvc-004a8c6e-319e-455c-9274-f630adfd2e44 was removed
STEP: Deleting sc
... skipping 46 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_volumes.go:40
    [Testpattern: Dynamic PV (default fs)] volume-expand
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should not allow expansion of pvcs without AllowVolumeExpansion property
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:157
------------------------------
{"msg":"PASSED [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property","total":-1,"completed":3,"skipped":38,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:14:02.775: INFO: Only supported for node OS distro [gci ubuntu custom] (not debian)
[AfterEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 154 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Jun  5 07:14:05.126: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "security-context-test-7904" for this suite.

•
------------------------------
{"msg":"PASSED [sig-node] Security Context When creating a container with runAsNonRoot should not run without a specified user ID","total":-1,"completed":5,"skipped":38,"failed":0}
[BeforeEach] [Testpattern: Pre-provisioned PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:14:05.200: INFO: Driver local doesn't support ext4 -- skipping
[AfterEach] [Testpattern: Pre-provisioned PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 9 lines ...
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:196

      Driver local doesn't support ext4 -- skipping

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:121
------------------------------
{"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] listing validating webhooks should work [Conformance]","total":-1,"completed":3,"skipped":8,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:14:05.200: INFO: Only supported for node OS distro [gci ubuntu custom] (not debian)
[AfterEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 22 lines ...
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] [sig-storage] Projected downwardAPI
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/projected_downwardapi.go:41
[It] should provide podname as non-root with fsgroup [LinuxOnly] [NodeFeature:FSGroup]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/projected_downwardapi.go:91
STEP: Creating a pod to test downward API volume plugin
Jun  5 07:14:01.109: INFO: Waiting up to 5m0s for pod "metadata-volume-853d8b87-6b2f-4f70-9a07-738fc54fe7c1" in namespace "projected-250" to be "Succeeded or Failed"
Jun  5 07:14:01.140: INFO: Pod "metadata-volume-853d8b87-6b2f-4f70-9a07-738fc54fe7c1": Phase="Pending", Reason="", readiness=false. Elapsed: 30.631688ms
Jun  5 07:14:03.174: INFO: Pod "metadata-volume-853d8b87-6b2f-4f70-9a07-738fc54fe7c1": Phase="Pending", Reason="", readiness=false. Elapsed: 2.06473897s
Jun  5 07:14:05.205: INFO: Pod "metadata-volume-853d8b87-6b2f-4f70-9a07-738fc54fe7c1": Phase="Pending", Reason="", readiness=false. Elapsed: 4.096111373s
Jun  5 07:14:07.237: INFO: Pod "metadata-volume-853d8b87-6b2f-4f70-9a07-738fc54fe7c1": Phase="Pending", Reason="", readiness=false. Elapsed: 6.127404662s
Jun  5 07:14:09.268: INFO: Pod "metadata-volume-853d8b87-6b2f-4f70-9a07-738fc54fe7c1": Phase="Succeeded", Reason="", readiness=false. Elapsed: 8.158685285s
STEP: Saw pod success
Jun  5 07:14:09.268: INFO: Pod "metadata-volume-853d8b87-6b2f-4f70-9a07-738fc54fe7c1" satisfied condition "Succeeded or Failed"
Jun  5 07:14:09.299: INFO: Trying to get logs from node ip-172-20-55-143.ca-central-1.compute.internal pod metadata-volume-853d8b87-6b2f-4f70-9a07-738fc54fe7c1 container client-container: <nil>
STEP: delete the pod
Jun  5 07:14:09.365: INFO: Waiting for pod metadata-volume-853d8b87-6b2f-4f70-9a07-738fc54fe7c1 to disappear
Jun  5 07:14:09.396: INFO: Pod metadata-volume-853d8b87-6b2f-4f70-9a07-738fc54fe7c1 no longer exists
[AfterEach] [sig-storage] Projected downwardAPI
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:8.541 seconds]
[sig-storage] Projected downwardAPI
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should provide podname as non-root with fsgroup [LinuxOnly] [NodeFeature:FSGroup]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/projected_downwardapi.go:91
------------------------------
{"msg":"PASSED [sig-storage] Projected downwardAPI should provide podname as non-root with fsgroup [LinuxOnly] [NodeFeature:FSGroup]","total":-1,"completed":7,"skipped":43,"failed":0}

SSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:14:09.511: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 24 lines ...
STEP: Building a namespace api object, basename projected
STEP: Waiting for a default service account to be provisioned in namespace
[It] should be consumable from pods in volume with defaultMode set [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating configMap with name projected-configmap-test-volume-c112c789-34dc-414f-a91a-ca324117b9bc
STEP: Creating a pod to test consume configMaps
Jun  5 07:14:05.452: INFO: Waiting up to 5m0s for pod "pod-projected-configmaps-fccc4324-26cf-4af2-bbe4-c0da03050aea" in namespace "projected-5968" to be "Succeeded or Failed"
Jun  5 07:14:05.486: INFO: Pod "pod-projected-configmaps-fccc4324-26cf-4af2-bbe4-c0da03050aea": Phase="Pending", Reason="", readiness=false. Elapsed: 33.957369ms
Jun  5 07:14:07.519: INFO: Pod "pod-projected-configmaps-fccc4324-26cf-4af2-bbe4-c0da03050aea": Phase="Pending", Reason="", readiness=false. Elapsed: 2.067796152s
Jun  5 07:14:09.551: INFO: Pod "pod-projected-configmaps-fccc4324-26cf-4af2-bbe4-c0da03050aea": Phase="Pending", Reason="", readiness=false. Elapsed: 4.099129397s
Jun  5 07:14:11.592: INFO: Pod "pod-projected-configmaps-fccc4324-26cf-4af2-bbe4-c0da03050aea": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.14034652s
STEP: Saw pod success
Jun  5 07:14:11.592: INFO: Pod "pod-projected-configmaps-fccc4324-26cf-4af2-bbe4-c0da03050aea" satisfied condition "Succeeded or Failed"
Jun  5 07:14:11.624: INFO: Trying to get logs from node ip-172-20-42-252.ca-central-1.compute.internal pod pod-projected-configmaps-fccc4324-26cf-4af2-bbe4-c0da03050aea container agnhost-container: <nil>
STEP: delete the pod
Jun  5 07:14:11.698: INFO: Waiting for pod pod-projected-configmaps-fccc4324-26cf-4af2-bbe4-c0da03050aea to disappear
Jun  5 07:14:11.729: INFO: Pod pod-projected-configmaps-fccc4324-26cf-4af2-bbe4-c0da03050aea no longer exists
[AfterEach] [sig-storage] Projected configMap
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 123 lines ...
STEP: Building a namespace api object, basename projected
STEP: Waiting for a default service account to be provisioned in namespace
[It] should be consumable from pods in volume with mappings [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating configMap with name projected-configmap-test-volume-map-e547eb7e-de83-4846-9284-b59b18837f83
STEP: Creating a pod to test consume configMaps
Jun  5 07:14:02.762: INFO: Waiting up to 5m0s for pod "pod-projected-configmaps-de870ce4-4bdc-4372-8271-843bb3610ba1" in namespace "projected-7120" to be "Succeeded or Failed"
Jun  5 07:14:02.797: INFO: Pod "pod-projected-configmaps-de870ce4-4bdc-4372-8271-843bb3610ba1": Phase="Pending", Reason="", readiness=false. Elapsed: 34.522989ms
Jun  5 07:14:04.829: INFO: Pod "pod-projected-configmaps-de870ce4-4bdc-4372-8271-843bb3610ba1": Phase="Pending", Reason="", readiness=false. Elapsed: 2.066611439s
Jun  5 07:14:06.862: INFO: Pod "pod-projected-configmaps-de870ce4-4bdc-4372-8271-843bb3610ba1": Phase="Pending", Reason="", readiness=false. Elapsed: 4.099202369s
Jun  5 07:14:08.894: INFO: Pod "pod-projected-configmaps-de870ce4-4bdc-4372-8271-843bb3610ba1": Phase="Pending", Reason="", readiness=false. Elapsed: 6.131356923s
Jun  5 07:14:10.925: INFO: Pod "pod-projected-configmaps-de870ce4-4bdc-4372-8271-843bb3610ba1": Phase="Pending", Reason="", readiness=false. Elapsed: 8.163008176s
Jun  5 07:14:12.958: INFO: Pod "pod-projected-configmaps-de870ce4-4bdc-4372-8271-843bb3610ba1": Phase="Succeeded", Reason="", readiness=false. Elapsed: 10.195497647s
STEP: Saw pod success
Jun  5 07:14:12.958: INFO: Pod "pod-projected-configmaps-de870ce4-4bdc-4372-8271-843bb3610ba1" satisfied condition "Succeeded or Failed"
Jun  5 07:14:12.989: INFO: Trying to get logs from node ip-172-20-55-143.ca-central-1.compute.internal pod pod-projected-configmaps-de870ce4-4bdc-4372-8271-843bb3610ba1 container agnhost-container: <nil>
STEP: delete the pod
Jun  5 07:14:13.066: INFO: Waiting for pod pod-projected-configmaps-de870ce4-4bdc-4372-8271-843bb3610ba1 to disappear
Jun  5 07:14:13.097: INFO: Pod pod-projected-configmaps-de870ce4-4bdc-4372-8271-843bb3610ba1 no longer exists
[AfterEach] [sig-storage] Projected configMap
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:10.626 seconds]
[sig-storage] Projected configMap
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should be consumable from pods in volume with mappings [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] Projected configMap should be consumable from pods in volume with mappings [NodeConformance] [Conformance]","total":-1,"completed":10,"skipped":56,"failed":0}

SS
------------------------------
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 36 lines ...
• [SLOW TEST:12.867 seconds]
[sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  should be able to deny custom resource creation, update and deletion [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should be able to deny custom resource creation, update and deletion [Conformance]","total":-1,"completed":8,"skipped":46,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:14:14.286: INFO: Only supported for node OS distro [gci ubuntu custom] (not debian)
... skipping 14 lines ...
      Only supported for node OS distro [gci ubuntu custom] (not debian)

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/drivers/in_tree.go:263
------------------------------
SS
------------------------------
{"msg":"PASSED [sig-storage] Projected configMap should be consumable from pods in volume with defaultMode set [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":4,"skipped":10,"failed":0}
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Jun  5 07:14:11.804: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename webhook
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 5 lines ...
STEP: Wait for the deployment to be ready
Jun  5 07:14:12.947: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63758474052, loc:(*time.Location)(0x9dc0820)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63758474052, loc:(*time.Location)(0x9dc0820)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63758474052, loc:(*time.Location)(0x9dc0820)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63758474052, loc:(*time.Location)(0x9dc0820)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-78988fc6cd\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jun  5 07:14:15.024: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63758474052, loc:(*time.Location)(0x9dc0820)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63758474052, loc:(*time.Location)(0x9dc0820)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63758474052, loc:(*time.Location)(0x9dc0820)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63758474052, loc:(*time.Location)(0x9dc0820)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-78988fc6cd\" is progressing."}}, CollisionCount:(*int32)(nil)}
STEP: Deploying the webhook service
STEP: Verifying the service has paired with the endpoint
Jun  5 07:14:18.015: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
[It] should unconditionally reject operations on fail closed webhook [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Registering a webhook that server cannot talk to, with fail closed policy, via the AdmissionRegistration API
STEP: create a namespace for the webhook
STEP: create a configmap should be unconditionally rejected by the webhook
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Jun  5 07:14:18.250: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "webhook-7990" for this suite.
... skipping 2 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:102


• [SLOW TEST:6.694 seconds]
[sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  should unconditionally reject operations on fail closed webhook [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should unconditionally reject operations on fail closed webhook [Conformance]","total":-1,"completed":5,"skipped":10,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:14:18.515: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 62 lines ...
• [SLOW TEST:39.210 seconds]
[sig-network] Conntrack
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/common/framework.go:23
  should be able to preserve UDP traffic when server pod cycles for a NodePort service
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/conntrack.go:130
------------------------------
{"msg":"PASSED [sig-network] Conntrack should be able to preserve UDP traffic when server pod cycles for a NodePort service","total":-1,"completed":6,"skipped":28,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
... skipping 15 lines ...
Jun  5 07:14:05.765: INFO: PersistentVolumeClaim pvc-xkpmp found but phase is Pending instead of Bound.
Jun  5 07:14:07.796: INFO: PersistentVolumeClaim pvc-xkpmp found and phase=Bound (2.062088147s)
Jun  5 07:14:07.796: INFO: Waiting up to 3m0s for PersistentVolume local-fprgw to have phase Bound
Jun  5 07:14:07.829: INFO: PersistentVolume local-fprgw found and phase=Bound (32.562662ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-7vs4
STEP: Creating a pod to test subpath
Jun  5 07:14:07.921: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-7vs4" in namespace "provisioning-4340" to be "Succeeded or Failed"
Jun  5 07:14:07.952: INFO: Pod "pod-subpath-test-preprovisionedpv-7vs4": Phase="Pending", Reason="", readiness=false. Elapsed: 30.392719ms
Jun  5 07:14:09.983: INFO: Pod "pod-subpath-test-preprovisionedpv-7vs4": Phase="Pending", Reason="", readiness=false. Elapsed: 2.062073631s
Jun  5 07:14:12.014: INFO: Pod "pod-subpath-test-preprovisionedpv-7vs4": Phase="Pending", Reason="", readiness=false. Elapsed: 4.093262954s
Jun  5 07:14:14.047: INFO: Pod "pod-subpath-test-preprovisionedpv-7vs4": Phase="Pending", Reason="", readiness=false. Elapsed: 6.125555413s
Jun  5 07:14:16.078: INFO: Pod "pod-subpath-test-preprovisionedpv-7vs4": Phase="Pending", Reason="", readiness=false. Elapsed: 8.157241123s
Jun  5 07:14:18.109: INFO: Pod "pod-subpath-test-preprovisionedpv-7vs4": Phase="Succeeded", Reason="", readiness=false. Elapsed: 10.188237626s
STEP: Saw pod success
Jun  5 07:14:18.109: INFO: Pod "pod-subpath-test-preprovisionedpv-7vs4" satisfied condition "Succeeded or Failed"
Jun  5 07:14:18.140: INFO: Trying to get logs from node ip-172-20-55-143.ca-central-1.compute.internal pod pod-subpath-test-preprovisionedpv-7vs4 container test-container-subpath-preprovisionedpv-7vs4: <nil>
STEP: delete the pod
Jun  5 07:14:18.215: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-7vs4 to disappear
Jun  5 07:14:18.249: INFO: Pod pod-subpath-test-preprovisionedpv-7vs4 no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-7vs4
Jun  5 07:14:18.249: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-7vs4" in namespace "provisioning-4340"
... skipping 19 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support readOnly file specified in the volumeMount [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:379
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir-link-bindmounted] [Testpattern: Pre-provisioned PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]","total":-1,"completed":6,"skipped":34,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (immediate binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:14:18.818: INFO: Only supported for providers [gce gke] (not aws)
[AfterEach] [Testpattern: Dynamic PV (immediate binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 2 lines ...
[sig-storage] In-tree Volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  [Driver: gcepd]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (immediate binding)] topology
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

      Only supported for providers [gce gke] (not aws)

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/drivers/in_tree.go:1301
------------------------------
... skipping 13 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Jun  5 07:14:18.969: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "watch-6533" for this suite.

•
------------------------------
{"msg":"PASSED [sig-api-machinery] Watchers should receive events on concurrent watches in same order [Conformance]","total":-1,"completed":9,"skipped":51,"failed":0}

SSS
------------------------------
[BeforeEach] [sig-node] ConfigMap
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 12 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Jun  5 07:14:19.196: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "configmap-7675" for this suite.

•
------------------------------
{"msg":"PASSED [sig-node] ConfigMap should run through a ConfigMap lifecycle [Conformance]","total":-1,"completed":7,"skipped":36,"failed":0}

SSSSSSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:14:19.305: INFO: Driver local doesn't support InlineVolume -- skipping
... skipping 57 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Jun  5 07:14:20.113: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "svcaccounts-3442" for this suite.

•
------------------------------
{"msg":"PASSED [sig-auth] ServiceAccounts should guarantee kube-root-ca.crt exist in any namespace [Conformance]","total":-1,"completed":7,"skipped":29,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:14:20.193: INFO: Driver emptydir doesn't support DynamicPV -- skipping
... skipping 167 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  CSIStorageCapacity
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:1134
    CSIStorageCapacity used, no capacity
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:1177
------------------------------
{"msg":"PASSED [sig-storage] CSI mock volume CSIStorageCapacity CSIStorageCapacity used, no capacity","total":-1,"completed":3,"skipped":46,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
... skipping 14 lines ...
STEP: creating a claim
Jun  5 07:13:56.607: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
Jun  5 07:13:56.639: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [nfs4kg7g] to have phase Bound
Jun  5 07:13:56.671: INFO: PersistentVolumeClaim nfs4kg7g found and phase=Bound (32.242529ms)
STEP: Creating pod pod-subpath-test-dynamicpv-276b
STEP: Creating a pod to test subpath
Jun  5 07:13:56.765: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-276b" in namespace "provisioning-1309" to be "Succeeded or Failed"
Jun  5 07:13:56.796: INFO: Pod "pod-subpath-test-dynamicpv-276b": Phase="Pending", Reason="", readiness=false. Elapsed: 30.806327ms
Jun  5 07:13:58.828: INFO: Pod "pod-subpath-test-dynamicpv-276b": Phase="Pending", Reason="", readiness=false. Elapsed: 2.06237281s
Jun  5 07:14:00.860: INFO: Pod "pod-subpath-test-dynamicpv-276b": Phase="Pending", Reason="", readiness=false. Elapsed: 4.095139901s
Jun  5 07:14:02.892: INFO: Pod "pod-subpath-test-dynamicpv-276b": Phase="Pending", Reason="", readiness=false. Elapsed: 6.127233869s
Jun  5 07:14:04.924: INFO: Pod "pod-subpath-test-dynamicpv-276b": Phase="Pending", Reason="", readiness=false. Elapsed: 8.159245419s
Jun  5 07:14:06.957: INFO: Pod "pod-subpath-test-dynamicpv-276b": Phase="Succeeded", Reason="", readiness=false. Elapsed: 10.191609948s
STEP: Saw pod success
Jun  5 07:14:06.957: INFO: Pod "pod-subpath-test-dynamicpv-276b" satisfied condition "Succeeded or Failed"
Jun  5 07:14:06.987: INFO: Trying to get logs from node ip-172-20-42-252.ca-central-1.compute.internal pod pod-subpath-test-dynamicpv-276b container test-container-subpath-dynamicpv-276b: <nil>
STEP: delete the pod
Jun  5 07:14:07.055: INFO: Waiting for pod pod-subpath-test-dynamicpv-276b to disappear
Jun  5 07:14:07.086: INFO: Pod pod-subpath-test-dynamicpv-276b no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-276b
Jun  5 07:14:07.086: INFO: Deleting pod "pod-subpath-test-dynamicpv-276b" in namespace "provisioning-1309"
STEP: Creating pod pod-subpath-test-dynamicpv-276b
STEP: Creating a pod to test subpath
Jun  5 07:14:07.149: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-276b" in namespace "provisioning-1309" to be "Succeeded or Failed"
Jun  5 07:14:07.180: INFO: Pod "pod-subpath-test-dynamicpv-276b": Phase="Pending", Reason="", readiness=false. Elapsed: 30.834161ms
Jun  5 07:14:09.211: INFO: Pod "pod-subpath-test-dynamicpv-276b": Phase="Pending", Reason="", readiness=false. Elapsed: 2.062000168s
Jun  5 07:14:11.243: INFO: Pod "pod-subpath-test-dynamicpv-276b": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.093599968s
STEP: Saw pod success
Jun  5 07:14:11.243: INFO: Pod "pod-subpath-test-dynamicpv-276b" satisfied condition "Succeeded or Failed"
Jun  5 07:14:11.274: INFO: Trying to get logs from node ip-172-20-42-252.ca-central-1.compute.internal pod pod-subpath-test-dynamicpv-276b container test-container-subpath-dynamicpv-276b: <nil>
STEP: delete the pod
Jun  5 07:14:11.340: INFO: Waiting for pod pod-subpath-test-dynamicpv-276b to disappear
Jun  5 07:14:11.371: INFO: Pod pod-subpath-test-dynamicpv-276b no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-276b
Jun  5 07:14:11.371: INFO: Deleting pod "pod-subpath-test-dynamicpv-276b" in namespace "provisioning-1309"
... skipping 20 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support existing directories when readOnly specified in the volumeSource
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:394
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: nfs] [Testpattern: Dynamic PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource","total":-1,"completed":2,"skipped":24,"failed":0}

SS
------------------------------
[BeforeEach] [sig-api-machinery] Garbage collector
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 16 lines ...
• [SLOW TEST:57.902 seconds]
[sig-api-machinery] Garbage collector
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  should support orphan deletion of custom resources
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/garbage_collector.go:1055
------------------------------
{"msg":"PASSED [sig-api-machinery] Garbage collector should support orphan deletion of custom resources","total":-1,"completed":2,"skipped":8,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:14:23.868: INFO: Only supported for providers [openstack] (not aws)
[AfterEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 43 lines ...
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] [sig-storage] Downward API volume
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/downwardapi_volume.go:41
[It] should provide container's cpu limit [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test downward API volume plugin
Jun  5 07:14:20.570: INFO: Waiting up to 5m0s for pod "downwardapi-volume-a6db1f6c-73a7-40cd-956e-b202c9fc30b0" in namespace "downward-api-3179" to be "Succeeded or Failed"
Jun  5 07:14:20.602: INFO: Pod "downwardapi-volume-a6db1f6c-73a7-40cd-956e-b202c9fc30b0": Phase="Pending", Reason="", readiness=false. Elapsed: 31.292469ms
Jun  5 07:14:22.640: INFO: Pod "downwardapi-volume-a6db1f6c-73a7-40cd-956e-b202c9fc30b0": Phase="Pending", Reason="", readiness=false. Elapsed: 2.069067293s
Jun  5 07:14:24.672: INFO: Pod "downwardapi-volume-a6db1f6c-73a7-40cd-956e-b202c9fc30b0": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.101262344s
STEP: Saw pod success
Jun  5 07:14:24.672: INFO: Pod "downwardapi-volume-a6db1f6c-73a7-40cd-956e-b202c9fc30b0" satisfied condition "Succeeded or Failed"
Jun  5 07:14:24.707: INFO: Trying to get logs from node ip-172-20-55-143.ca-central-1.compute.internal pod downwardapi-volume-a6db1f6c-73a7-40cd-956e-b202c9fc30b0 container client-container: <nil>
STEP: delete the pod
Jun  5 07:14:24.796: INFO: Waiting for pod downwardapi-volume-a6db1f6c-73a7-40cd-956e-b202c9fc30b0 to disappear
Jun  5 07:14:24.828: INFO: Pod downwardapi-volume-a6db1f6c-73a7-40cd-956e-b202c9fc30b0 no longer exists
[AfterEach] [sig-storage] Downward API volume
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Jun  5 07:14:24.828: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "downward-api-3179" for this suite.

•
------------------------------
{"msg":"PASSED [sig-storage] Downward API volume should provide container's cpu limit [NodeConformance] [Conformance]","total":-1,"completed":4,"skipped":47,"failed":0}

SSS
------------------------------
[BeforeEach] [sig-apps] Job
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 18 lines ...
• [SLOW TEST:45.234 seconds]
[sig-apps] Job
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23
  should remove pods when job is deleted
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/job.go:189
------------------------------
{"msg":"PASSED [sig-apps] Job should remove pods when job is deleted","total":-1,"completed":3,"skipped":35,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Jun  5 07:14:32.921: INFO: Driver local doesn't support DynamicPV -- skipping
[AfterEach] [Testpattern: Dynamic PV (block volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 95 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:241
[It] should check if cluster-info dump succeeds
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:1078
STEP: running cluster-info dump
Jun  5 07:14:33.384: INFO: Running '/tmp/kubectl3037677957/kubectl --server=https://api.e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-1203 cluster-info dump'
Jun  5 07:14:35.119: INFO: stderr: ""
Jun  5 07:14:35.123: INFO: stdout: "{\n    \"kind\": \"NodeList\",\n    \"apiVersion\": \"v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"9562\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"uid\": \"d04e1632-a1ba-422d-99b5-e68359212bb9\",\n                \"resourceVersion\": \"5148\",\n                \"creationTimestamp\": \"2021-06-05T07:07:33Z\",\n                \"labels\": {\n                    \"beta.kubernetes.io/arch\": \"amd64\",\n                    \"beta.kubernetes.io/instance-type\": \"c5.large\",\n                    \"beta.kubernetes.io/os\": \"linux\",\n                    \"failure-domain.beta.kubernetes.io/region\": \"ca-central-1\",\n                    \"failure-domain.beta.kubernetes.io/zone\": \"ca-central-1a\",\n                    \"kops.k8s.io/instancegroup\": \"master-ca-central-1a\",\n                    \"kops.k8s.io/kops-controller-pki\": \"\",\n                    \"kubernetes.io/arch\": \"amd64\",\n                    \"kubernetes.io/hostname\": \"ip-172-20-37-235.ca-central-1.compute.internal\",\n                    \"kubernetes.io/os\": \"linux\",\n                    \"kubernetes.io/role\": \"master\",\n                    \"node-role.kubernetes.io/control-plane\": \"\",\n                    \"node-role.kubernetes.io/master\": \"\",\n                    \"node.kubernetes.io/exclude-from-external-load-balancers\": \"\",\n                    \"node.kubernetes.io/instance-type\": \"c5.large\",\n                    \"topology.kubernetes.io/region\": \"ca-central-1\",\n                    \"topology.kubernetes.io/zone\": \"ca-central-1a\"\n                },\n                \"annotations\": {\n                    \"io.cilium.network.ipv4-cilium-host\": \"100.96.0.231\",\n                    \"io.cilium.network.ipv4-health-ip\": \"100.96.0.210\",\n                    \"io.cilium.network.ipv4-pod-cidr\": \"100.96.0.0/24\",\n                    \"node.alpha.kubernetes.io/ttl\": \"0\",\n                    \"volumes.kubernetes.io/controller-managed-attach-detach\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"podCIDR\": \"100.96.0.0/24\",\n                \"podCIDRs\": [\n                    \"100.96.0.0/24\"\n                ],\n                \"providerID\": \"aws:///ca-central-1a/i-0fb00afeb8de82413\",\n                \"taints\": [\n                    {\n                        \"key\": \"node-role.kubernetes.io/master\",\n                        \"effect\": \"NoSchedule\"\n                    }\n                ]\n            },\n            \"status\": {\n                \"capacity\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"49347208Ki\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3827036Ki\",\n                    \"pods\": \"110\"\n                },\n                \"allocatable\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"45478386818\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3724636Ki\",\n                    \"pods\": \"110\"\n                },\n                \"conditions\": [\n                    {\n                        \"type\": \"NetworkUnavailable\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-06-05T07:09:19Z\",\n                        \"lastTransitionTime\": \"2021-06-05T07:09:19Z\",\n                        \"reason\": \"CiliumIsUp\",\n                        \"message\": \"Cilium is running on this node\"\n                    },\n                    {\n                        \"type\": \"MemoryPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-06-05T07:13:15Z\",\n                        \"lastTransitionTime\": \"2021-06-05T07:07:30Z\",\n                        \"reason\": \"KubeletHasSufficientMemory\",\n                        \"message\": \"kubelet has sufficient memory available\"\n                    },\n                    {\n                        \"type\": \"DiskPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-06-05T07:13:15Z\",\n                        \"lastTransitionTime\": \"2021-06-05T07:07:30Z\",\n                        \"reason\": \"KubeletHasNoDiskPressure\",\n                        \"message\": \"kubelet has no disk pressure\"\n                    },\n                    {\n                        \"type\": \"PIDPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-06-05T07:13:15Z\",\n                        \"lastTransitionTime\": \"2021-06-05T07:07:30Z\",\n                        \"reason\": \"KubeletHasSufficientPID\",\n                        \"message\": \"kubelet has sufficient PID available\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastHeartbeatTime\": \"2021-06-05T07:13:15Z\",\n                        \"lastTransitionTime\": \"2021-06-05T07:08:03Z\",\n                        \"reason\": \"KubeletReady\",\n                        \"message\": \"kubelet is posting ready status. AppArmor enabled\"\n                    }\n                ],\n                \"addresses\": [\n                    {\n                        \"type\": \"InternalIP\",\n                        \"address\": \"172.20.37.235\"\n                    },\n                    {\n                        \"type\": \"ExternalIP\",\n                        \"address\": \"35.183.4.85\"\n                    },\n                    {\n                        \"type\": \"Hostname\",\n                        \"address\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n                    },\n                    {\n                        \"type\": \"InternalDNS\",\n                        \"address\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n                    },\n                    {\n                        \"type\": \"ExternalDNS\",\n                        \"address\": \"ec2-35-183-4-85.ca-central-1.compute.amazonaws.com\"\n                    }\n                ],\n                \"daemonEndpoints\": {\n                    \"kubeletEndpoint\": {\n                        \"Port\": 10250\n                    }\n                },\n                \"nodeInfo\": {\n                    \"machineID\": \"ec21949f05a2cb72eaf07300cbb6b119\",\n                    \"systemUUID\": \"ec21949f-05a2-cb72-eaf0-7300cbb6b119\",\n                    \"bootID\": \"8489f252-ce6c-4bab-b0a2-310f48fafa88\",\n                    \"kernelVersion\": \"4.19.0-16-cloud-amd64\",\n                    \"osImage\": \"Debian GNU/Linux 10 (buster)\",\n                    \"containerRuntimeVersion\": \"containerd://1.4.6\",\n                    \"kubeletVersion\": \"v1.21.1\",\n                    \"kubeProxyVersion\": \"v1.21.1\",\n                    \"operatingSystem\": \"linux\",\n                    \"architecture\": \"amd64\"\n                },\n                \"images\": [\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/etcdadm/etcd-manager@sha256:ebb73d3d4a99da609f9e01c556cd9f9aa7a0aecba8f5bc5588d7c45eb38e3a7e\",\n                            \"k8s.gcr.io/etcdadm/etcd-manager:3.0.20210430\"\n                        ],\n                        \"sizeBytes\": 171082409\n                    },\n                    {\n                        \"names\": [\n                            \"docker.io/cilium/cilium@sha256:587627d909ffe0418c0bd907516496844867a21812946af82096d367760e4c1e\",\n                            \"docker.io/cilium/cilium:v1.10.0\"\n                        ],\n                        \"sizeBytes\": 146585957\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-proxy-amd64:v1.21.1\"\n                        ],\n                        \"sizeBytes\": 132727503\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-apiserver-amd64:v1.21.1\"\n                        ],\n                        \"sizeBytes\": 126863827\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-controller-manager-amd64:v1.21.1\"\n                        ],\n                        \"sizeBytes\": 121076537\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kops/dns-controller:1.22.0-alpha.1\"\n                        ],\n                        \"sizeBytes\": 113860108\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kops/kops-controller:1.22.0-alpha.1\"\n                        ],\n                        \"sizeBytes\": 112078349\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-scheduler-amd64:v1.21.1\"\n                        ],\n                        \"sizeBytes\": 51886392\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kops/kube-apiserver-healthcheck:1.22.0-alpha.1\"\n                        ],\n                        \"sizeBytes\": 25632279\n                    },\n                    {\n                        \"names\": [\n                            \"docker.io/cilium/operator@sha256:d0ec430f14a39e0993abef058176c8e41387b58b4354e4bf658af47411867be7\",\n                            \"docker.io/cilium/operator:v1.10.0\"\n                        ],\n                        \"sizeBytes\": 22491363\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f\",\n                            \"k8s.gcr.io/pause:3.2\"\n                        ],\n                        \"sizeBytes\": 299513\n                    }\n                ]\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"ip-172-20-42-252.ca-central-1.compute.internal\",\n                \"uid\": \"36818d16-c00d-4f1e-ad6b-85e194d01a2d\",\n                \"resourceVersion\": \"8861\",\n                \"creationTimestamp\": \"2021-06-05T07:09:03Z\",\n                \"labels\": {\n                    \"beta.kubernetes.io/arch\": \"amd64\",\n                    \"beta.kubernetes.io/instance-type\": \"t3.medium\",\n                    \"beta.kubernetes.io/os\": \"linux\",\n                    \"failure-domain.beta.kubernetes.io/region\": \"ca-central-1\",\n                    \"failure-domain.beta.kubernetes.io/zone\": \"ca-central-1a\",\n                    \"kops.k8s.io/instancegroup\": \"nodes-ca-central-1a\",\n                    \"kubernetes.io/arch\": \"amd64\",\n                    \"kubernetes.io/hostname\": \"ip-172-20-42-252.ca-central-1.compute.internal\",\n                    \"kubernetes.io/os\": \"linux\",\n                    \"kubernetes.io/role\": \"node\",\n                    \"node-role.kubernetes.io/node\": \"\",\n                    \"node.kubernetes.io/instance-type\": \"t3.medium\",\n                    \"topology.hostpath.csi/node\": \"ip-172-20-42-252.ca-central-1.compute.internal\",\n                    \"topology.kubernetes.io/region\": \"ca-central-1\",\n                    \"topology.kubernetes.io/zone\": \"ca-central-1a\"\n                },\n                \"annotations\": {\n                    \"csi.volume.kubernetes.io/nodeid\": \"{\\\"csi-hostpath-provisioning-7705\\\":\\\"ip-172-20-42-252.ca-central-1.compute.internal\\\",\\\"csi-hostpath-provisioning-8526\\\":\\\"ip-172-20-42-252.ca-central-1.compute.internal\\\",\\\"csi-mock-csi-mock-volumes-1359\\\":\\\"csi-mock-csi-mock-volumes-1359\\\",\\\"csi-mock-csi-mock-volumes-3929\\\":\\\"csi-mock-csi-mock-volumes-3929\\\"}\",\n                    \"io.cilium.network.ipv4-cilium-host\": \"100.96.3.151\",\n                    \"io.cilium.network.ipv4-health-ip\": \"100.96.3.132\",\n                    \"io.cilium.network.ipv4-pod-cidr\": \"100.96.3.0/24\",\n                    \"node.alpha.kubernetes.io/ttl\": \"0\",\n                    \"volumes.kubernetes.io/controller-managed-attach-detach\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"podCIDR\": \"100.96.3.0/24\",\n                \"podCIDRs\": [\n                    \"100.96.3.0/24\"\n                ],\n                \"providerID\": \"aws:///ca-central-1a/i-02951e6eafde29ae0\"\n            },\n            \"status\": {\n                \"capacity\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"49347208Ki\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3982680Ki\",\n                    \"pods\": \"110\"\n                },\n                \"allocatable\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"45478386818\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3880280Ki\",\n                    \"pods\": \"110\"\n                },\n                \"conditions\": [\n                    {\n                        \"type\": \"NetworkUnavailable\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-06-05T07:09:24Z\",\n                        \"lastTransitionTime\": \"2021-06-05T07:09:24Z\",\n                        \"reason\": \"CiliumIsUp\",\n                        \"message\": \"Cilium is running on this node\"\n                    },\n                    {\n                        \"type\": \"MemoryPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-06-05T07:13:43Z\",\n                        \"lastTransitionTime\": \"2021-06-05T07:09:03Z\",\n                        \"reason\": \"KubeletHasSufficientMemory\",\n                        \"message\": \"kubelet has sufficient memory available\"\n                    },\n                    {\n                        \"type\": \"DiskPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-06-05T07:13:43Z\",\n                        \"lastTransitionTime\": \"2021-06-05T07:09:03Z\",\n                        \"reason\": \"KubeletHasNoDiskPressure\",\n                        \"message\": \"kubelet has no disk pressure\"\n                    },\n                    {\n                        \"type\": \"PIDPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-06-05T07:13:43Z\",\n                        \"lastTransitionTime\": \"2021-06-05T07:09:03Z\",\n                        \"reason\": \"KubeletHasSufficientPID\",\n                        \"message\": \"kubelet has sufficient PID available\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastHeartbeatTime\": \"2021-06-05T07:13:43Z\",\n                        \"lastTransitionTime\": \"2021-06-05T07:09:23Z\",\n                        \"reason\": \"KubeletReady\",\n                        \"message\": \"kubelet is posting ready status. AppArmor enabled\"\n                    }\n                ],\n                \"addresses\": [\n                    {\n                        \"type\": \"InternalIP\",\n                        \"address\": \"172.20.42.252\"\n                    },\n                    {\n                        \"type\": \"ExternalIP\",\n                        \"address\": \"35.183.68.105\"\n                    },\n                    {\n                        \"type\": \"Hostname\",\n                        \"address\": \"ip-172-20-42-252.ca-central-1.compute.internal\"\n                    },\n                    {\n                        \"type\": \"InternalDNS\",\n                        \"address\": \"ip-172-20-42-252.ca-central-1.compute.internal\"\n                    },\n                    {\n                        \"type\": \"ExternalDNS\",\n                        \"address\": \"ec2-35-183-68-105.ca-central-1.compute.amazonaws.com\"\n                    }\n                ],\n                \"daemonEndpoints\": {\n                    \"kubeletEndpoint\": {\n                        \"Port\": 10250\n                    }\n                },\n                \"nodeInfo\": {\n                    \"machineID\": \"ec2eb2513e1392e8095aaf8589a08810\",\n                    \"systemUUID\": \"ec2eb251-3e13-92e8-095a-af8589a08810\",\n                    \"bootID\": \"414e4bf7-b0d8-460b-bf55-66e6639c25a2\",\n                    \"kernelVersion\": \"4.19.0-16-cloud-amd64\",\n                    \"osImage\": \"Debian GNU/Linux 10 (buster)\",\n                    \"containerRuntimeVersion\": \"containerd://1.4.6\",\n                    \"kubeletVersion\": \"v1.21.1\",\n                    \"kubeProxyVersion\": \"v1.21.1\",\n                    \"operatingSystem\": \"linux\",\n                    \"architecture\": \"amd64\"\n                },\n                \"images\": [\n                    {\n                        \"names\": [\n                            \"docker.io/cilium/cilium@sha256:587627d909ffe0418c0bd907516496844867a21812946af82096d367760e4c1e\",\n                            \"docker.io/cilium/cilium:v1.10.0\"\n                        ],\n                        \"sizeBytes\": 146585957\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-proxy-amd64:v1.21.1\"\n                        ],\n                        \"sizeBytes\": 132727503\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/agnhost@sha256:758db666ac7028534dba72e7e9bb1e57bb81b8196f976f7a5cc351ef8b3529e1\",\n                            \"k8s.gcr.io/e2e-test-images/agnhost:2.32\"\n                        ],\n                        \"sizeBytes\": 50002177\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/nautilus@sha256:1f36a24cfb5e0c3f725d7565a867c2384282fcbeccc77b07b423c9da95763a9a\",\n                            \"k8s.gcr.io/e2e-test-images/nautilus:1.4\"\n                        ],\n                        \"sizeBytes\": 49230179\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50\",\n                            \"k8s.gcr.io/e2e-test-images/httpd:2.4.38-1\"\n                        ],\n                        \"sizeBytes\": 40765006\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2\",\n                            \"k8s.gcr.io/sig-storage/csi-provisioner:v2.1.0\"\n                        ],\n                        \"sizeBytes\": 21205045\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-snapshotter@sha256:26e327b018c21a49523b759d7787e99553181ae9ef90b6bdc13abe362a43ced0\",\n                            \"k8s.gcr.io/sig-storage/csi-snapshotter:v3.0.2\"\n                        ],\n                        \"sizeBytes\": 19498520\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679\",\n                            \"k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0\"\n                        ],\n                        \"sizeBytes\": 19408504\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab\",\n                            \"k8s.gcr.io/sig-storage/csi-attacher:v2.2.0\"\n                        ],\n                        \"sizeBytes\": 18451536\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c\",\n                            \"k8s.gcr.io/sig-storage/csi-resizer:v0.5.0\"\n                        ],\n                        \"sizeBytes\": 18412631\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/nonroot@sha256:4051e85640c22f8e00c34dbd273576fc9e1e2829992656588062be9c0f69b04b\",\n                            \"k8s.gcr.io/e2e-test-images/nonroot:1.1\"\n                        ],\n                        \"sizeBytes\": 17748448\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5\",\n                            \"k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0\"\n                        ],\n                        \"sizeBytes\": 13995876\n                    },\n                    {\n                        \"names\": [\n                            \"docker.io/coredns/coredns@sha256:642ff9910da6ea9a8624b0234eef52af9ca75ecbec474c5507cb096bdfbae4e5\",\n                            \"docker.io/coredns/coredns:1.8.3\"\n                        ],\n                        \"sizeBytes\": 12893350\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f\",\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0\"\n                        ],\n                        \"sizeBytes\": 9068367\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793\",\n                            \"k8s.gcr.io/sig-storage/mock-driver:v4.1.0\"\n                        ],\n                        \"sizeBytes\": 8223849\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309\",\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0\"\n                        ],\n                        \"sizeBytes\": 7717137\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b\",\n                            \"k8s.gcr.io/e2e-test-images/nginx:1.14-1\"\n                        ],\n                        \"sizeBytes\": 6979365\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7\",\n                            \"k8s.gcr.io/sig-storage/livenessprobe:v1.1.0\"\n                        ],\n                        \"sizeBytes\": 6691212\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592\",\n                            \"k8s.gcr.io/e2e-test-images/busybox:1.29-1\"\n                        ],\n                        \"sizeBytes\": 732746\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:6c3835cab3980f11b83277305d0d736051c32b17606f5ec59f1dda67c9ba3810\",\n                            \"k8s.gcr.io/pause:3.4.1\"\n                        ],\n                        \"sizeBytes\": 301268\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f\",\n                            \"k8s.gcr.io/pause:3.2\"\n                        ],\n                        \"sizeBytes\": 299513\n                    }\n                ],\n                \"volumesInUse\": [\n                    \"kubernetes.io/csi/csi-hostpath-provisioning-7705^5adbbba4-c5cd-11eb-84f9-4613a5285b2e\"\n                ],\n                \"volumesAttached\": [\n                    {\n                        \"name\": \"kubernetes.io/csi/csi-hostpath-provisioning-7705^5adbbba4-c5cd-11eb-84f9-4613a5285b2e\",\n                        \"devicePath\": \"\"\n                    }\n                ]\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"ip-172-20-48-31.ca-central-1.compute.internal\",\n                \"uid\": \"a34ddcb0-bd70-4e1c-9ccb-2c83fdf84f91\",\n                \"resourceVersion\": \"9547\",\n                \"creationTimestamp\": \"2021-06-05T07:09:01Z\",\n                \"labels\": {\n                    \"beta.kubernetes.io/arch\": \"amd64\",\n                    \"beta.kubernetes.io/instance-type\": \"t3.medium\",\n                    \"beta.kubernetes.io/os\": \"linux\",\n                    \"failure-domain.beta.kubernetes.io/region\": \"ca-central-1\",\n                    \"failure-domain.beta.kubernetes.io/zone\": \"ca-central-1a\",\n                    \"kops.k8s.io/instancegroup\": \"nodes-ca-central-1a\",\n                    \"kubernetes.io/arch\": \"amd64\",\n                    \"kubernetes.io/hostname\": \"ip-172-20-48-31.ca-central-1.compute.internal\",\n                    \"kubernetes.io/os\": \"linux\",\n                    \"kubernetes.io/role\": \"node\",\n                    \"node-role.kubernetes.io/node\": \"\",\n                    \"node.kubernetes.io/instance-type\": \"t3.medium\",\n                    \"topology.hostpath.csi/node\": \"ip-172-20-48-31.ca-central-1.compute.internal\",\n                    \"topology.kubernetes.io/region\": \"ca-central-1\",\n                    \"topology.kubernetes.io/zone\": \"ca-central-1a\"\n                },\n                \"annotations\": {\n                    \"csi.volume.kubernetes.io/nodeid\": \"{\\\"csi-hostpath-ephemeral-6501\\\":\\\"ip-172-20-48-31.ca-central-1.compute.internal\\\",\\\"csi-hostpath-volume-expand-9649\\\":\\\"ip-172-20-48-31.ca-central-1.compute.internal\\\",\\\"csi-mock-csi-mock-volumes-2507\\\":\\\"csi-mock-csi-mock-volumes-2507\\\",\\\"csi-mock-csi-mock-volumes-2578\\\":\\\"csi-mock-csi-mock-volumes-2578\\\"}\",\n                    \"io.cilium.network.ipv4-cilium-host\": \"100.96.1.189\",\n                    \"io.cilium.network.ipv4-health-ip\": \"100.96.1.147\",\n                    \"io.cilium.network.ipv4-pod-cidr\": \"100.96.1.0/24\",\n                    \"node.alpha.kubernetes.io/ttl\": \"0\",\n                    \"volumes.kubernetes.io/controller-managed-attach-detach\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"podCIDR\": \"100.96.1.0/24\",\n                \"podCIDRs\": [\n                    \"100.96.1.0/24\"\n                ],\n                \"providerID\": \"aws:///ca-central-1a/i-070c9797a5ee75576\"\n            },\n            \"status\": {\n                \"capacity\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"49347208Ki\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3982680Ki\",\n                    \"pods\": \"110\"\n                },\n                \"allocatable\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"45478386818\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3880280Ki\",\n                    \"pods\": \"110\"\n                },\n                \"conditions\": [\n                    {\n                        \"type\": \"NetworkUnavailable\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-06-05T07:09:22Z\",\n                        \"lastTransitionTime\": \"2021-06-05T07:09:22Z\",\n                        \"reason\": \"CiliumIsUp\",\n                        \"message\": \"Cilium is running on this node\"\n                    },\n                    {\n                        \"type\": \"MemoryPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-06-05T07:14:31Z\",\n                        \"lastTransitionTime\": \"2021-06-05T07:09:00Z\",\n                        \"reason\": \"KubeletHasSufficientMemory\",\n                        \"message\": \"kubelet has sufficient memory available\"\n                    },\n                    {\n                        \"type\": \"DiskPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-06-05T07:14:31Z\",\n                        \"lastTransitionTime\": \"2021-06-05T07:09:00Z\",\n                        \"reason\": \"KubeletHasNoDiskPressure\",\n                        \"message\": \"kubelet has no disk pressure\"\n                    },\n                    {\n                        \"type\": \"PIDPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-06-05T07:14:31Z\",\n                        \"lastTransitionTime\": \"2021-06-05T07:09:00Z\",\n                        \"reason\": \"KubeletHasSufficientPID\",\n                        \"message\": \"kubelet has sufficient PID available\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastHeartbeatTime\": \"2021-06-05T07:14:31Z\",\n                        \"lastTransitionTime\": \"2021-06-05T07:09:21Z\",\n                        \"reason\": \"KubeletReady\",\n                        \"message\": \"kubelet is posting ready status. AppArmor enabled\"\n                    }\n                ],\n                \"addresses\": [\n                    {\n                        \"type\": \"InternalIP\",\n                        \"address\": \"172.20.48.31\"\n                    },\n                    {\n                        \"type\": \"ExternalIP\",\n                        \"address\": \"3.96.207.212\"\n                    },\n                    {\n                        \"type\": \"Hostname\",\n                        \"address\": \"ip-172-20-48-31.ca-central-1.compute.internal\"\n                    },\n                    {\n                        \"type\": \"InternalDNS\",\n                        \"address\": \"ip-172-20-48-31.ca-central-1.compute.internal\"\n                    },\n                    {\n                        \"type\": \"ExternalDNS\",\n                        \"address\": \"ec2-3-96-207-212.ca-central-1.compute.amazonaws.com\"\n                    }\n                ],\n                \"daemonEndpoints\": {\n                    \"kubeletEndpoint\": {\n                        \"Port\": 10250\n                    }\n                },\n                \"nodeInfo\": {\n                    \"machineID\": \"ec28cb55d3323054eefa73764d3c4286\",\n                    \"systemUUID\": \"ec28cb55-d332-3054-eefa-73764d3c4286\",\n                    \"bootID\": \"fe61bdbe-d07e-4859-8c14-45e80dbca1bd\",\n                    \"kernelVersion\": \"4.19.0-16-cloud-amd64\",\n                    \"osImage\": \"Debian GNU/Linux 10 (buster)\",\n                    \"containerRuntimeVersion\": \"containerd://1.4.6\",\n                    \"kubeletVersion\": \"v1.21.1\",\n                    \"kubeProxyVersion\": \"v1.21.1\",\n                    \"operatingSystem\": \"linux\",\n                    \"architecture\": \"amd64\"\n                },\n                \"images\": [\n                    {\n                        \"names\": [\n                            \"docker.io/cilium/cilium@sha256:587627d909ffe0418c0bd907516496844867a21812946af82096d367760e4c1e\",\n                            \"docker.io/cilium/cilium:v1.10.0\"\n                        ],\n                        \"sizeBytes\": 146585957\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/nfs-provisioner@sha256:c1bedac8758029948afe060bf8f6ee63ea489b5e08d29745f44fab68ee0d46ca\",\n                            \"k8s.gcr.io/sig-storage/nfs-provisioner:v2.2.2\"\n                        ],\n                        \"sizeBytes\": 138177747\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-proxy-amd64:v1.21.1\"\n                        ],\n                        \"sizeBytes\": 132727503\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/volume/nfs@sha256:124a375b4f930627c65b2f84c0d0f09229a96bc527eec18ad0eeac150b96d1c2\",\n                            \"k8s.gcr.io/e2e-test-images/volume/nfs:1.2\"\n                        ],\n                        \"sizeBytes\": 95843946\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2\",\n                            \"k8s.gcr.io/etcd:3.4.13-0\"\n                        ],\n                        \"sizeBytes\": 86742272\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/agnhost@sha256:758db666ac7028534dba72e7e9bb1e57bb81b8196f976f7a5cc351ef8b3529e1\",\n                            \"k8s.gcr.io/e2e-test-images/agnhost:2.32\"\n                        ],\n                        \"sizeBytes\": 50002177\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/nautilus@sha256:1f36a24cfb5e0c3f725d7565a867c2384282fcbeccc77b07b423c9da95763a9a\",\n                            \"k8s.gcr.io/e2e-test-images/nautilus:1.4\"\n                        ],\n                        \"sizeBytes\": 49230179\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0\",\n                            \"k8s.gcr.io/e2e-test-images/httpd:2.4.39-1\"\n                        ],\n                        \"sizeBytes\": 41902332\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/sample-apiserver@sha256:e7fddbaac4c3451da2365ab90bad149d32f11409738034e41e0f460927f7c276\",\n                            \"k8s.gcr.io/e2e-test-images/sample-apiserver:1.17.4\"\n                        ],\n                        \"sizeBytes\": 24757245\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2\",\n                            \"k8s.gcr.io/sig-storage/csi-provisioner:v2.1.0\"\n                        ],\n                        \"sizeBytes\": 21205045\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-snapshotter@sha256:26e327b018c21a49523b759d7787e99553181ae9ef90b6bdc13abe362a43ced0\",\n                            \"k8s.gcr.io/sig-storage/csi-snapshotter:v3.0.2\"\n                        ],\n                        \"sizeBytes\": 19498520\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679\",\n                            \"k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0\"\n                        ],\n                        \"sizeBytes\": 19408504\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab\",\n                            \"k8s.gcr.io/sig-storage/csi-attacher:v2.2.0\"\n                        ],\n                        \"sizeBytes\": 18451536\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c\",\n                            \"k8s.gcr.io/sig-storage/csi-resizer:v0.5.0\"\n                        ],\n                        \"sizeBytes\": 18412631\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5\",\n                            \"k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0\"\n                        ],\n                        \"sizeBytes\": 13995876\n                    },\n                    {\n                        \"names\": [\n                            \"docker.io/coredns/coredns@sha256:642ff9910da6ea9a8624b0234eef52af9ca75ecbec474c5507cb096bdfbae4e5\",\n                            \"docker.io/coredns/coredns:1.8.3\"\n                        ],\n                        \"sizeBytes\": 12893350\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f\",\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0\"\n                        ],\n                        \"sizeBytes\": 9068367\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793\",\n                            \"k8s.gcr.io/sig-storage/mock-driver:v4.1.0\"\n                        ],\n                        \"sizeBytes\": 8223849\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309\",\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0\"\n                        ],\n                        \"sizeBytes\": 7717137\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7\",\n                            \"k8s.gcr.io/sig-storage/livenessprobe:v1.1.0\"\n                        ],\n                        \"sizeBytes\": 6691212\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592\",\n                            \"k8s.gcr.io/e2e-test-images/busybox:1.29-1\"\n                        ],\n                        \"sizeBytes\": 732746\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:6c3835cab3980f11b83277305d0d736051c32b17606f5ec59f1dda67c9ba3810\",\n                            \"k8s.gcr.io/pause:3.4.1\"\n                        ],\n                        \"sizeBytes\": 301268\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f\",\n                            \"k8s.gcr.io/pause:3.2\"\n                        ],\n                        \"sizeBytes\": 299513\n                    }\n                ],\n                \"volumesInUse\": [\n                    \"kubernetes.io/csi/csi-mock-csi-mock-volumes-2507^4\"\n                ],\n                \"volumesAttached\": [\n                    {\n                        \"name\": \"kubernetes.io/csi/csi-mock-csi-mock-volumes-2507^4\",\n                        \"devicePath\": \"\"\n                    }\n                ]\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"ip-172-20-55-143.ca-central-1.compute.internal\",\n                \"uid\": \"3b474d59-d690-4b91-a89d-5c54f9069989\",\n                \"resourceVersion\": \"9485\",\n                \"creationTimestamp\": \"2021-06-05T07:09:01Z\",\n                \"labels\": {\n                    \"beta.kubernetes.io/arch\": \"amd64\",\n                    \"beta.kubernetes.io/instance-type\": \"t3.medium\",\n                    \"beta.kubernetes.io/os\": \"linux\",\n                    \"failure-domain.beta.kubernetes.io/region\": \"ca-central-1\",\n                    \"failure-domain.beta.kubernetes.io/zone\": \"ca-central-1a\",\n                    \"kops.k8s.io/instancegroup\": \"nodes-ca-central-1a\",\n                    \"kubernetes.io/arch\": \"amd64\",\n                    \"kubernetes.io/hostname\": \"ip-172-20-55-143.ca-central-1.compute.internal\",\n                    \"kubernetes.io/os\": \"linux\",\n                    \"kubernetes.io/role\": \"node\",\n                    \"node-role.kubernetes.io/node\": \"\",\n                    \"node.kubernetes.io/instance-type\": \"t3.medium\",\n                    \"topology.hostpath.csi/node\": \"ip-172-20-55-143.ca-central-1.compute.internal\",\n                    \"topology.kubernetes.io/region\": \"ca-central-1\",\n                    \"topology.kubernetes.io/zone\": \"ca-central-1a\"\n                },\n                \"annotations\": {\n                    \"csi.volume.kubernetes.io/nodeid\": \"{\\\"csi-hostpath-provisioning-3268\\\":\\\"ip-172-20-55-143.ca-central-1.compute.internal\\\",\\\"csi-mock-csi-mock-volumes-8071\\\":\\\"csi-mock-csi-mock-volumes-8071\\\"}\",\n                    \"io.cilium.network.ipv4-cilium-host\": \"100.96.2.76\",\n                    \"io.cilium.network.ipv4-health-ip\": \"100.96.2.77\",\n                    \"io.cilium.network.ipv4-pod-cidr\": \"100.96.2.0/24\",\n                    \"node.alpha.kubernetes.io/ttl\": \"0\",\n                    \"volumes.kubernetes.io/controller-managed-attach-detach\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"podCIDR\": \"100.96.2.0/24\",\n                \"podCIDRs\": [\n                    \"100.96.2.0/24\"\n                ],\n                \"providerID\": \"aws:///ca-central-1a/i-01a6ea86810793f5b\"\n            },\n            \"status\": {\n                \"capacity\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"49347208Ki\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3982680Ki\",\n                    \"pods\": \"110\"\n                },\n                \"allocatable\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"45478386818\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3880280Ki\",\n                    \"pods\": \"110\"\n                },\n                \"conditions\": [\n                    {\n                        \"type\": \"NetworkUnavailable\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-06-05T07:09:22Z\",\n                        \"lastTransitionTime\": \"2021-06-05T07:09:22Z\",\n                        \"reason\": \"CiliumIsUp\",\n                        \"message\": \"Cilium is running on this node\"\n                    },\n                    {\n                        \"type\": \"MemoryPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-06-05T07:14:31Z\",\n                        \"lastTransitionTime\": \"2021-06-05T07:09:01Z\",\n                        \"reason\": \"KubeletHasSufficientMemory\",\n                        \"message\": \"kubelet has sufficient memory available\"\n                    },\n                    {\n                        \"type\": \"DiskPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-06-05T07:14:31Z\",\n                        \"lastTransitionTime\": \"2021-06-05T07:09:01Z\",\n                        \"reason\": \"KubeletHasNoDiskPressure\",\n                        \"message\": \"kubelet has no disk pressure\"\n                    },\n                    {\n                        \"type\": \"PIDPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-06-05T07:14:31Z\",\n                        \"lastTransitionTime\": \"2021-06-05T07:09:01Z\",\n                        \"reason\": \"KubeletHasSufficientPID\",\n                        \"message\": \"kubelet has sufficient PID available\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastHeartbeatTime\": \"2021-06-05T07:14:31Z\",\n                        \"lastTransitionTime\": \"2021-06-05T07:09:21Z\",\n                        \"reason\": \"KubeletReady\",\n                        \"message\": \"kubelet is posting ready status. AppArmor enabled\"\n                    }\n                ],\n                \"addresses\": [\n                    {\n                        \"type\": \"InternalIP\",\n                        \"address\": \"172.20.55.143\"\n                    },\n                    {\n                        \"type\": \"ExternalIP\",\n                        \"address\": \"3.96.199.59\"\n                    },\n                    {\n                        \"type\": \"Hostname\",\n                        \"address\": \"ip-172-20-55-143.ca-central-1.compute.internal\"\n                    },\n                    {\n                        \"type\": \"InternalDNS\",\n                        \"address\": \"ip-172-20-55-143.ca-central-1.compute.internal\"\n                    },\n                    {\n                        \"type\": \"ExternalDNS\",\n                        \"address\": \"ec2-3-96-199-59.ca-central-1.compute.amazonaws.com\"\n                    }\n                ],\n                \"daemonEndpoints\": {\n                    \"kubeletEndpoint\": {\n                        \"Port\": 10250\n                    }\n                },\n                \"nodeInfo\": {\n                    \"machineID\": \"ec2297bb0fba9add71c2b24f81a568e6\",\n                    \"systemUUID\": \"ec2297bb-0fba-9add-71c2-b24f81a568e6\",\n                    \"bootID\": \"1527c5af-dc08-47e6-ac8f-739274d080b1\",\n                    \"kernelVersion\": \"4.19.0-16-cloud-amd64\",\n                    \"osImage\": \"Debian GNU/Linux 10 (buster)\",\n                    \"containerRuntimeVersion\": \"containerd://1.4.6\",\n                    \"kubeletVersion\": \"v1.21.1\",\n                    \"kubeProxyVersion\": \"v1.21.1\",\n                    \"operatingSystem\": \"linux\",\n                    \"architecture\": \"amd64\"\n                },\n                \"images\": [\n                    {\n                        \"names\": [\n                            \"docker.io/cilium/cilium@sha256:587627d909ffe0418c0bd907516496844867a21812946af82096d367760e4c1e\",\n                            \"docker.io/cilium/cilium:v1.10.0\"\n                        ],\n                        \"sizeBytes\": 146585957\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-proxy-amd64:v1.21.1\"\n                        ],\n                        \"sizeBytes\": 132727503\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/volume/nfs@sha256:124a375b4f930627c65b2f84c0d0f09229a96bc527eec18ad0eeac150b96d1c2\",\n                            \"k8s.gcr.io/e2e-test-images/volume/nfs:1.2\"\n                        ],\n                        \"sizeBytes\": 95843946\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/agnhost@sha256:758db666ac7028534dba72e7e9bb1e57bb81b8196f976f7a5cc351ef8b3529e1\",\n                            \"k8s.gcr.io/e2e-test-images/agnhost:2.32\"\n                        ],\n                        \"sizeBytes\": 50002177\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50\",\n                            \"k8s.gcr.io/e2e-test-images/httpd:2.4.38-1\"\n                        ],\n                        \"sizeBytes\": 40765006\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2\",\n                            \"k8s.gcr.io/sig-storage/csi-provisioner:v2.1.0\"\n                        ],\n                        \"sizeBytes\": 21205045\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-snapshotter@sha256:26e327b018c21a49523b759d7787e99553181ae9ef90b6bdc13abe362a43ced0\",\n                            \"k8s.gcr.io/sig-storage/csi-snapshotter:v3.0.2\"\n                        ],\n                        \"sizeBytes\": 19498520\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679\",\n                            \"k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0\"\n                        ],\n                        \"sizeBytes\": 19408504\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab\",\n                            \"k8s.gcr.io/sig-storage/csi-attacher:v2.2.0\"\n                        ],\n                        \"sizeBytes\": 18451536\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c\",\n                            \"k8s.gcr.io/sig-storage/csi-resizer:v0.5.0\"\n                        ],\n                        \"sizeBytes\": 18412631\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/cpa/cluster-proportional-autoscaler@sha256:67640771ad9fc56f109d5b01e020f0c858e7c890bb0eb15ba0ebd325df3285e7\",\n                            \"k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.3\"\n                        ],\n                        \"sizeBytes\": 15191740\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5\",\n                            \"k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0\"\n                        ],\n                        \"sizeBytes\": 13995876\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f\",\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0\"\n                        ],\n                        \"sizeBytes\": 9068367\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793\",\n                            \"k8s.gcr.io/sig-storage/mock-driver:v4.1.0\"\n                        ],\n                        \"sizeBytes\": 8223849\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309\",\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0\"\n                        ],\n                        \"sizeBytes\": 7717137\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b\",\n                            \"k8s.gcr.io/e2e-test-images/nginx:1.14-1\"\n                        ],\n                        \"sizeBytes\": 6979365\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7\",\n                            \"k8s.gcr.io/sig-storage/livenessprobe:v1.1.0\"\n                        ],\n                        \"sizeBytes\": 6691212\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592\",\n                            \"k8s.gcr.io/e2e-test-images/busybox:1.29-1\"\n                        ],\n                        \"sizeBytes\": 732746\n                    },\n                    {\n                        \"names\": [\n                            \"docker.io/library/busybox@sha256:bbc3a03235220b170ba48a157dd097dd1379299370e1ed99ce976df0355d24f0\",\n                            \"docker.io/library/busybox:1.27\"\n                        ],\n                        \"sizeBytes\": 720019\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:6c3835cab3980f11b83277305d0d736051c32b17606f5ec59f1dda67c9ba3810\",\n                            \"k8s.gcr.io/pause:3.4.1\"\n                        ],\n                        \"sizeBytes\": 301268\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f\",\n                            \"k8s.gcr.io/pause:3.2\"\n                        ],\n                        \"sizeBytes\": 299513\n                    }\n                ]\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"ip-172-20-62-33.ca-central-1.compute.internal\",\n                \"uid\": \"af32b94c-626f-4042-865a-8818208b9577\",\n                \"resourceVersion\": \"9388\",\n                \"creationTimestamp\": \"2021-06-05T07:09:06Z\",\n                \"labels\": {\n                    \"beta.kubernetes.io/arch\": \"amd64\",\n                    \"beta.kubernetes.io/instance-type\": \"t3.medium\",\n                    \"beta.kubernetes.io/os\": \"linux\",\n                    \"failure-domain.beta.kubernetes.io/region\": \"ca-central-1\",\n                    \"failure-domain.beta.kubernetes.io/zone\": \"ca-central-1a\",\n                    \"kops.k8s.io/instancegroup\": \"nodes-ca-central-1a\",\n                    \"kubernetes.io/arch\": \"amd64\",\n                    \"kubernetes.io/hostname\": \"ip-172-20-62-33.ca-central-1.compute.internal\",\n                    \"kubernetes.io/os\": \"linux\",\n                    \"kubernetes.io/role\": \"node\",\n                    \"mounted_volume_expand\": \"mounted-volume-expand-4409\",\n                    \"node-role.kubernetes.io/node\": \"\",\n                    \"node.kubernetes.io/instance-type\": \"t3.medium\",\n                    \"topology.hostpath.csi/node\": \"ip-172-20-62-33.ca-central-1.compute.internal\",\n                    \"topology.kubernetes.io/region\": \"ca-central-1\",\n                    \"topology.kubernetes.io/zone\": \"ca-central-1a\"\n                },\n                \"annotations\": {\n                    \"csi.volume.kubernetes.io/nodeid\": \"{\\\"csi-hostpath-ephemeral-511\\\":\\\"ip-172-20-62-33.ca-central-1.compute.internal\\\",\\\"csi-hostpath-ephemeral-8431\\\":\\\"ip-172-20-62-33.ca-central-1.compute.internal\\\",\\\"csi-hostpath-volume-2048\\\":\\\"ip-172-20-62-33.ca-central-1.compute.internal\\\",\\\"csi-mock-csi-mock-volumes-6847\\\":\\\"csi-mock-csi-mock-volumes-6847\\\"}\",\n                    \"io.cilium.network.ipv4-cilium-host\": \"100.96.4.183\",\n                    \"io.cilium.network.ipv4-health-ip\": \"100.96.4.155\",\n                    \"io.cilium.network.ipv4-pod-cidr\": \"100.96.4.0/24\",\n                    \"node.alpha.kubernetes.io/ttl\": \"0\",\n                    \"volumes.kubernetes.io/controller-managed-attach-detach\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"podCIDR\": \"100.96.4.0/24\",\n                \"podCIDRs\": [\n                    \"100.96.4.0/24\"\n                ],\n                \"providerID\": \"aws:///ca-central-1a/i-077b3814383b4e54e\"\n            },\n            \"status\": {\n                \"capacity\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"49347208Ki\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3982680Ki\",\n                    \"pods\": \"110\"\n                },\n                \"allocatable\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"45478386818\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3880280Ki\",\n                    \"pods\": \"110\"\n                },\n                \"conditions\": [\n                    {\n                        \"type\": \"NetworkUnavailable\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-06-05T07:09:27Z\",\n                        \"lastTransitionTime\": \"2021-06-05T07:09:27Z\",\n                        \"reason\": \"CiliumIsUp\",\n                        \"message\": \"Cilium is running on this node\"\n                    },\n                    {\n                        \"type\": \"MemoryPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-06-05T07:14:26Z\",\n                        \"lastTransitionTime\": \"2021-06-05T07:09:06Z\",\n                        \"reason\": \"KubeletHasSufficientMemory\",\n                        \"message\": \"kubelet has sufficient memory available\"\n                    },\n                    {\n                        \"type\": \"DiskPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-06-05T07:14:26Z\",\n                        \"lastTransitionTime\": \"2021-06-05T07:09:06Z\",\n                        \"reason\": \"KubeletHasNoDiskPressure\",\n                        \"message\": \"kubelet has no disk pressure\"\n                    },\n                    {\n                        \"type\": \"PIDPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-06-05T07:14:26Z\",\n                        \"lastTransitionTime\": \"2021-06-05T07:09:06Z\",\n                        \"reason\": \"KubeletHasSufficientPID\",\n                        \"message\": \"kubelet has sufficient PID available\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastHeartbeatTime\": \"2021-06-05T07:14:26Z\",\n                        \"lastTransitionTime\": \"2021-06-05T07:09:26Z\",\n                        \"reason\": \"KubeletReady\",\n                        \"message\": \"kubelet is posting ready status. AppArmor enabled\"\n                    }\n                ],\n                \"addresses\": [\n                    {\n                        \"type\": \"InternalIP\",\n                        \"address\": \"172.20.62.33\"\n                    },\n                    {\n                        \"type\": \"ExternalIP\",\n                        \"address\": \"99.79.190.149\"\n                    },\n                    {\n                        \"type\": \"Hostname\",\n                        \"address\": \"ip-172-20-62-33.ca-central-1.compute.internal\"\n                    },\n                    {\n                        \"type\": \"InternalDNS\",\n                        \"address\": \"ip-172-20-62-33.ca-central-1.compute.internal\"\n                    },\n                    {\n                        \"type\": \"ExternalDNS\",\n                        \"address\": \"ec2-99-79-190-149.ca-central-1.compute.amazonaws.com\"\n                    }\n                ],\n                \"daemonEndpoints\": {\n                    \"kubeletEndpoint\": {\n                        \"Port\": 10250\n                    }\n                },\n                \"nodeInfo\": {\n                    \"machineID\": \"ec2cf6a42c5b3707448b1d24cd2d6ea9\",\n                    \"systemUUID\": \"ec2cf6a4-2c5b-3707-448b-1d24cd2d6ea9\",\n                    \"bootID\": \"8f7a2aba-8772-466a-b26a-a3f4fc5a75ca\",\n                    \"kernelVersion\": \"4.19.0-16-cloud-amd64\",\n                    \"osImage\": \"Debian GNU/Linux 10 (buster)\",\n                    \"containerRuntimeVersion\": \"containerd://1.4.6\",\n                    \"kubeletVersion\": \"v1.21.1\",\n                    \"kubeProxyVersion\": \"v1.21.1\",\n                    \"operatingSystem\": \"linux\",\n                    \"architecture\": \"amd64\"\n                },\n                \"images\": [\n                    {\n                        \"names\": [\n                            \"docker.io/cilium/cilium@sha256:587627d909ffe0418c0bd907516496844867a21812946af82096d367760e4c1e\",\n                            \"docker.io/cilium/cilium:v1.10.0\"\n                        ],\n                        \"sizeBytes\": 146585957\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/nfs-provisioner@sha256:c1bedac8758029948afe060bf8f6ee63ea489b5e08d29745f44fab68ee0d46ca\",\n                            \"k8s.gcr.io/sig-storage/nfs-provisioner:v2.2.2\"\n                        ],\n                        \"sizeBytes\": 138177747\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-proxy-amd64:v1.21.1\"\n                        ],\n                        \"sizeBytes\": 132727503\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/agnhost@sha256:758db666ac7028534dba72e7e9bb1e57bb81b8196f976f7a5cc351ef8b3529e1\",\n                            \"k8s.gcr.io/e2e-test-images/agnhost:2.32\"\n                        ],\n                        \"sizeBytes\": 50002177\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2\",\n                            \"k8s.gcr.io/sig-storage/csi-provisioner:v2.1.0\"\n                        ],\n                        \"sizeBytes\": 21205045\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-snapshotter@sha256:26e327b018c21a49523b759d7787e99553181ae9ef90b6bdc13abe362a43ced0\",\n                            \"k8s.gcr.io/sig-storage/csi-snapshotter:v3.0.2\"\n                        ],\n                        \"sizeBytes\": 19498520\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679\",\n                            \"k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0\"\n                        ],\n                        \"sizeBytes\": 19408504\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf\",\n                            \"k8s.gcr.io/e2e-test-images/regression-issue-74839:1.2\"\n                        ],\n                        \"sizeBytes\": 18651485\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab\",\n                            \"k8s.gcr.io/sig-storage/csi-attacher:v2.2.0\"\n                        ],\n                        \"sizeBytes\": 18451536\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c\",\n                            \"k8s.gcr.io/sig-storage/csi-resizer:v0.5.0\"\n                        ],\n                        \"sizeBytes\": 18412631\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5\",\n                            \"k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0\"\n                        ],\n                        \"sizeBytes\": 13995876\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f\",\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0\"\n                        ],\n                        \"sizeBytes\": 9068367\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793\",\n                            \"k8s.gcr.io/sig-storage/mock-driver:v4.1.0\"\n                        ],\n                        \"sizeBytes\": 8223849\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309\",\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0\"\n                        ],\n                        \"sizeBytes\": 7717137\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b\",\n                            \"k8s.gcr.io/e2e-test-images/nginx:1.14-1\"\n                        ],\n                        \"sizeBytes\": 6979365\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7\",\n                            \"k8s.gcr.io/sig-storage/livenessprobe:v1.1.0\"\n                        ],\n                        \"sizeBytes\": 6691212\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592\",\n                            \"k8s.gcr.io/e2e-test-images/busybox:1.29-1\"\n                        ],\n                        \"sizeBytes\": 732746\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:6c3835cab3980f11b83277305d0d736051c32b17606f5ec59f1dda67c9ba3810\",\n                            \"k8s.gcr.io/pause:3.4.1\"\n                        ],\n                        \"sizeBytes\": 301268\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f\",\n                            \"k8s.gcr.io/pause:3.2\"\n                        ],\n                        \"sizeBytes\": 299513\n                    }\n                ],\n                \"volumesInUse\": [\n                    \"kubernetes.io/csi/csi-hostpath-ephemeral-511^a75f89c5-c5cd-11eb-b734-f262eb8f6962\"\n                ],\n                \"volumesAttached\": [\n                    {\n                        \"name\": \"kubernetes.io/aws-ebs/aws://ca-central-1a/vol-0bae6a4d0230a88ca\",\n                        \"devicePath\": \"/dev/xvdbb\"\n                    },\n                    {\n                        \"name\": \"kubernetes.io/csi/csi-hostpath-ephemeral-511^a75f89c5-c5cd-11eb-b734-f262eb8f6962\",\n                        \"devicePath\": \"\"\n                    }\n                ]\n            }\n        }\n    ]\n}\n{\n    \"kind\": \"EventList\",\n    \"apiVersion\": \"v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"3755\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"cilium-25vms.16859deab9333c6f\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"a516c5c7-e0bb-4d89-a987-1a1888744096\",\n                \"resourceVersion\": \"57\",\n                \"creationTimestamp\": \"2021-06-05T07:07:52Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-25vms\",\n                \"uid\": \"8bafd635-e24b-4bf2-a44d-dc1ae6972cca\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"448\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/cilium-25vms to ip-172-20-37-235.ca-central-1.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:52Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:52Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-25vms.16859dead9865071\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"5fa1f02c-f01a-4528-8faf-ca785628162a\",\n                \"resourceVersion\": \"59\",\n                \"creationTimestamp\": \"2021-06-05T07:07:52Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-25vms\",\n                \"uid\": \"8bafd635-e24b-4bf2-a44d-dc1ae6972cca\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"452\",\n                \"fieldPath\": \"spec.initContainers{clean-cilium-state}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"docker.io/cilium/cilium:v1.10.0\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:52Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:52Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-25vms.16859dec8a42a223\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"4229f0e3-99da-4afa-9276-132a2d73a9db\",\n                \"resourceVersion\": \"66\",\n                \"creationTimestamp\": \"2021-06-05T07:08:00Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-25vms\",\n                \"uid\": \"8bafd635-e24b-4bf2-a44d-dc1ae6972cca\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"452\",\n                \"fieldPath\": \"spec.initContainers{clean-cilium-state}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"docker.io/cilium/cilium:v1.10.0\\\" in 7.260082646s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:59Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:59Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-25vms.16859decd10453cb\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"8dc2f301-fc32-4c33-bd58-72fc387f6226\",\n                \"resourceVersion\": \"67\",\n                \"creationTimestamp\": \"2021-06-05T07:08:01Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-25vms\",\n                \"uid\": \"8bafd635-e24b-4bf2-a44d-dc1ae6972cca\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"452\",\n                \"fieldPath\": \"spec.initContainers{clean-cilium-state}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container clean-cilium-state\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:08:01Z\",\n            \"lastTimestamp\": \"2021-06-05T07:08:01Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-25vms.16859decd7a796c4\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"116216c8-4a58-481e-b42b-e056fd5430fd\",\n                \"resourceVersion\": \"68\",\n                \"creationTimestamp\": \"2021-06-05T07:08:01Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-25vms\",\n                \"uid\": \"8bafd635-e24b-4bf2-a44d-dc1ae6972cca\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"452\",\n                \"fieldPath\": \"spec.initContainers{clean-cilium-state}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container clean-cilium-state\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:08:01Z\",\n            \"lastTimestamp\": \"2021-06-05T07:08:01Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-25vms.16859ded0af9b94b\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"a7e0b494-3c3a-42cc-b0ff-581d8ea5e382\",\n                \"resourceVersion\": \"69\",\n                \"creationTimestamp\": \"2021-06-05T07:08:02Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-25vms\",\n                \"uid\": \"8bafd635-e24b-4bf2-a44d-dc1ae6972cca\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"452\",\n                \"fieldPath\": \"spec.containers{cilium-agent}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"docker.io/cilium/cilium:v1.10.0\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:08:02Z\",\n            \"lastTimestamp\": \"2021-06-05T07:08:02Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-25vms.16859ded12180f1a\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"7807fff1-2a42-4980-a133-4c338a0f1b55\",\n                \"resourceVersion\": \"70\",\n                \"creationTimestamp\": \"2021-06-05T07:08:02Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-25vms\",\n                \"uid\": \"8bafd635-e24b-4bf2-a44d-dc1ae6972cca\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"452\",\n                \"fieldPath\": \"spec.containers{cilium-agent}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container cilium-agent\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:08:02Z\",\n            \"lastTimestamp\": \"2021-06-05T07:08:02Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-25vms.16859ded1bb90d93\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d72b05ec-bf98-4e80-93b7-85fe2a1ee9a8\",\n                \"resourceVersion\": \"71\",\n                \"creationTimestamp\": \"2021-06-05T07:08:02Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-25vms\",\n                \"uid\": \"8bafd635-e24b-4bf2-a44d-dc1ae6972cca\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"452\",\n                \"fieldPath\": \"spec.containers{cilium-agent}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container cilium-agent\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:08:02Z\",\n            \"lastTimestamp\": \"2021-06-05T07:08:02Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-25vms.16859ded83ffd315\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"56fb1952-ec99-48a8-9438-916152abf495\",\n                \"resourceVersion\": \"102\",\n                \"creationTimestamp\": \"2021-06-05T07:08:04Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-25vms\",\n                \"uid\": \"8bafd635-e24b-4bf2-a44d-dc1ae6972cca\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"452\",\n                \"fieldPath\": \"spec.containers{cilium-agent}\"\n            },\n            \"reason\": \"Unhealthy\",\n            \"message\": \"Startup probe failed: Get \\\"http://127.0.0.1:9876/healthz\\\": dial tcp 127.0.0.1:9876: connect: connection refused\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:08:04Z\",\n            \"lastTimestamp\": \"2021-06-05T07:08:38Z\",\n            \"count\": 18,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-d9szd.16859dfac14e59af\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"baa648c3-a62a-4d13-913a-703615c26816\",\n                \"resourceVersion\": \"106\",\n                \"creationTimestamp\": \"2021-06-05T07:09:01Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-d9szd\",\n                \"uid\": \"e788479b-eca9-4458-9645-8de4589a2e0b\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"642\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/cilium-d9szd to ip-172-20-48-31.ca-central-1.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:01Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:01Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-d9szd.16859dfb7624d001\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d92b5a93-2848-47a1-9dfb-a818ae9ec5db\",\n                \"resourceVersion\": \"150\",\n                \"creationTimestamp\": \"2021-06-05T07:09:06Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-d9szd\",\n                \"uid\": \"e788479b-eca9-4458-9645-8de4589a2e0b\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"644\",\n                \"fieldPath\": \"spec.initContainers{clean-cilium-state}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"docker.io/cilium/cilium:v1.10.0\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-48-31.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:04Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:04Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-d9szd.16859dfcafadac1b\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"282f5169-fce6-4b75-a3eb-252ee6cb86d1\",\n                \"resourceVersion\": \"158\",\n                \"creationTimestamp\": \"2021-06-05T07:09:09Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-d9szd\",\n                \"uid\": \"e788479b-eca9-4458-9645-8de4589a2e0b\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"644\",\n                \"fieldPath\": \"spec.initContainers{clean-cilium-state}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"docker.io/cilium/cilium:v1.10.0\\\" in 5.260208188s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-48-31.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:09Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:09Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-d9szd.16859dfd1b8ac13d\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"2c47fd76-4856-4fd0-8fab-b718f516dbdb\",\n                \"resourceVersion\": \"176\",\n                \"creationTimestamp\": \"2021-06-05T07:09:11Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-d9szd\",\n                \"uid\": \"e788479b-eca9-4458-9645-8de4589a2e0b\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"644\",\n                \"fieldPath\": \"spec.initContainers{clean-cilium-state}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container clean-cilium-state\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-48-31.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:11Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:11Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-d9szd.16859dfd20803020\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"718c59bb-4d62-4656-9588-8fe1f8f15e1f\",\n                \"resourceVersion\": \"177\",\n                \"creationTimestamp\": \"2021-06-05T07:09:11Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-d9szd\",\n                \"uid\": \"e788479b-eca9-4458-9645-8de4589a2e0b\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"644\",\n                \"fieldPath\": \"spec.initContainers{clean-cilium-state}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container clean-cilium-state\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-48-31.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:11Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:11Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-d9szd.16859dfd4c4f4549\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"bc765f31-64d8-4f8d-beae-1fef521ce23a\",\n                \"resourceVersion\": \"181\",\n                \"creationTimestamp\": \"2021-06-05T07:09:11Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-d9szd\",\n                \"uid\": \"e788479b-eca9-4458-9645-8de4589a2e0b\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"644\",\n                \"fieldPath\": \"spec.containers{cilium-agent}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"docker.io/cilium/cilium:v1.10.0\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-48-31.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:11Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:11Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-d9szd.16859dfd50ad2acc\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"93ad0c5d-393d-48b0-b4c5-35505f1550c7\",\n                \"resourceVersion\": \"182\",\n                \"creationTimestamp\": \"2021-06-05T07:09:12Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-d9szd\",\n                \"uid\": \"e788479b-eca9-4458-9645-8de4589a2e0b\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"644\",\n                \"fieldPath\": \"spec.containers{cilium-agent}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container cilium-agent\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-48-31.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:12Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:12Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-d9szd.16859dfd566cac8a\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"58479c35-c187-4534-a7fb-68fe5de3cfad\",\n                \"resourceVersion\": \"183\",\n                \"creationTimestamp\": \"2021-06-05T07:09:12Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-d9szd\",\n                \"uid\": \"e788479b-eca9-4458-9645-8de4589a2e0b\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"644\",\n                \"fieldPath\": \"spec.containers{cilium-agent}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container cilium-agent\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-48-31.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:12Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:12Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-d9szd.16859dfdee713f52\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"6ecc311d-00df-434b-867b-5836b61d6bda\",\n                \"resourceVersion\": \"207\",\n                \"creationTimestamp\": \"2021-06-05T07:09:14Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-d9szd\",\n                \"uid\": \"e788479b-eca9-4458-9645-8de4589a2e0b\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"644\",\n                \"fieldPath\": \"spec.containers{cilium-agent}\"\n            },\n            \"reason\": \"Unhealthy\",\n            \"message\": \"Startup probe failed: Get \\\"http://127.0.0.1:9876/healthz\\\": dial tcp 127.0.0.1:9876: connect: connection refused\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-48-31.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:14Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:20Z\",\n            \"count\": 4,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-lnws2.16859dfad83d806c\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"4a3b8bb2-2781-48fe-a619-2bff15a8e38f\",\n                \"resourceVersion\": \"108\",\n                \"creationTimestamp\": \"2021-06-05T07:09:01Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-lnws2\",\n                \"uid\": \"06ecc1cd-9366-457e-85c9-d1a4a336344e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"651\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/cilium-lnws2 to ip-172-20-55-143.ca-central-1.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:01Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:01Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-lnws2.16859dfb82c06c19\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"41b9f9e6-f7cb-4677-b1c3-d095f32cf643\",\n                \"resourceVersion\": \"137\",\n                \"creationTimestamp\": \"2021-06-05T07:09:04Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-lnws2\",\n                \"uid\": \"06ecc1cd-9366-457e-85c9-d1a4a336344e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"654\",\n                \"fieldPath\": \"spec.initContainers{clean-cilium-state}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"docker.io/cilium/cilium:v1.10.0\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-55-143.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:04Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:04Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-lnws2.16859dfcd6614d18\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f11522cf-c543-4181-92ae-025349798c8c\",\n                \"resourceVersion\": \"170\",\n                \"creationTimestamp\": \"2021-06-05T07:09:09Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-lnws2\",\n                \"uid\": \"06ecc1cd-9366-457e-85c9-d1a4a336344e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"654\",\n                \"fieldPath\": \"spec.initContainers{clean-cilium-state}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"docker.io/cilium/cilium:v1.10.0\\\" in 5.697966228s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-55-143.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:09Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:09Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-lnws2.16859dfd41ddd3e6\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"805cb989-0eca-4757-b62d-9bc13eda38bc\",\n                \"resourceVersion\": \"178\",\n                \"creationTimestamp\": \"2021-06-05T07:09:11Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-lnws2\",\n                \"uid\": \"06ecc1cd-9366-457e-85c9-d1a4a336344e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"654\",\n                \"fieldPath\": \"spec.initContainers{clean-cilium-state}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container clean-cilium-state\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-55-143.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:11Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:11Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-lnws2.16859dfd48268474\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"e3d7c897-1282-4c55-a708-7fdbd64e357d\",\n                \"resourceVersion\": \"180\",\n                \"creationTimestamp\": \"2021-06-05T07:09:11Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-lnws2\",\n                \"uid\": \"06ecc1cd-9366-457e-85c9-d1a4a336344e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"654\",\n                \"fieldPath\": \"spec.initContainers{clean-cilium-state}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container clean-cilium-state\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-55-143.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:11Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:11Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-lnws2.16859dfd6b74a9a5\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"cf48072d-58ec-4bdc-a4d5-b9ec349ef4c2\",\n                \"resourceVersion\": \"184\",\n                \"creationTimestamp\": \"2021-06-05T07:09:12Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-lnws2\",\n                \"uid\": \"06ecc1cd-9366-457e-85c9-d1a4a336344e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"654\",\n                \"fieldPath\": \"spec.containers{cilium-agent}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"docker.io/cilium/cilium:v1.10.0\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-55-143.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:12Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:12Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-lnws2.16859dfd70519367\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"384e2087-2492-485e-8aee-302b308da552\",\n                \"resourceVersion\": \"185\",\n                \"creationTimestamp\": \"2021-06-05T07:09:12Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-lnws2\",\n                \"uid\": \"06ecc1cd-9366-457e-85c9-d1a4a336344e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"654\",\n                \"fieldPath\": \"spec.containers{cilium-agent}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container cilium-agent\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-55-143.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:12Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:12Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-lnws2.16859dfd769203d8\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"b4e30113-858e-47ab-bc4c-4b08c5e47f98\",\n                \"resourceVersion\": \"186\",\n                \"creationTimestamp\": \"2021-06-05T07:09:12Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-lnws2\",\n                \"uid\": \"06ecc1cd-9366-457e-85c9-d1a4a336344e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"654\",\n                \"fieldPath\": \"spec.containers{cilium-agent}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container cilium-agent\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-55-143.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:12Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:12Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-lnws2.16859dfe0635d8e6\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"9b86f0d1-cd86-4bec-92f1-5e18407209cb\",\n                \"resourceVersion\": \"209\",\n                \"creationTimestamp\": \"2021-06-05T07:09:15Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-lnws2\",\n                \"uid\": \"06ecc1cd-9366-457e-85c9-d1a4a336344e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"654\",\n                \"fieldPath\": \"spec.containers{cilium-agent}\"\n            },\n            \"reason\": \"Unhealthy\",\n            \"message\": \"Startup probe failed: Get \\\"http://127.0.0.1:9876/healthz\\\": dial tcp 127.0.0.1:9876: connect: connection refused\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-55-143.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:15Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:21Z\",\n            \"count\": 4,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-operator-794454784c-dc7nv.16859deab8484021\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d01b6ad1-72d4-4c05-9a06-75b3e843fb76\",\n                \"resourceVersion\": \"56\",\n                \"creationTimestamp\": \"2021-06-05T07:07:52Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-operator-794454784c-dc7nv\",\n                \"uid\": \"c035a725-54ce-4b02-bfe6-f6cc1a42464a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"427\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/cilium-operator-794454784c-dc7nv to ip-172-20-37-235.ca-central-1.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:52Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:52Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-operator-794454784c-dc7nv.16859deae592a0ce\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3619a317-1067-437a-84b0-c1b82b8ba288\",\n                \"resourceVersion\": \"62\",\n                \"creationTimestamp\": \"2021-06-05T07:07:52Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-operator-794454784c-dc7nv\",\n                \"uid\": \"c035a725-54ce-4b02-bfe6-f6cc1a42464a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"449\",\n                \"fieldPath\": \"spec.containers{cilium-operator}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"docker.io/cilium/operator:v1.10.0\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:52Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:52Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-operator-794454784c-dc7nv.16859ded44f0d11f\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"fc988fe6-cb73-4776-987e-66c6d0380869\",\n                \"resourceVersion\": \"72\",\n                \"creationTimestamp\": \"2021-06-05T07:08:03Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-operator-794454784c-dc7nv\",\n                \"uid\": \"c035a725-54ce-4b02-bfe6-f6cc1a42464a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"449\",\n                \"fieldPath\": \"spec.containers{cilium-operator}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"docker.io/cilium/operator:v1.10.0\\\" in 10.189930311s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:08:03Z\",\n            \"lastTimestamp\": \"2021-06-05T07:08:03Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-operator-794454784c-dc7nv.16859ded50223027\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"e30ebce8-511f-4c6c-978a-c000fd93c313\",\n                \"resourceVersion\": \"157\",\n                \"creationTimestamp\": \"2021-06-05T07:08:03Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-operator-794454784c-dc7nv\",\n                \"uid\": \"c035a725-54ce-4b02-bfe6-f6cc1a42464a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"449\",\n                \"fieldPath\": \"spec.containers{cilium-operator}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container cilium-operator\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:08:03Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:09Z\",\n            \"count\": 2,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-operator-794454784c-dc7nv.16859ded57fa60c9\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"65c07c7f-5cbe-404f-b3ec-2b6e9682d3f0\",\n                \"resourceVersion\": \"159\",\n                \"creationTimestamp\": \"2021-06-05T07:08:03Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-operator-794454784c-dc7nv\",\n                \"uid\": \"c035a725-54ce-4b02-bfe6-f6cc1a42464a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"449\",\n                \"fieldPath\": \"spec.containers{cilium-operator}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container cilium-operator\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:08:03Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:09Z\",\n            \"count\": 2,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-operator-794454784c-dc7nv.16859dfcaa131468\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3e86c8bb-e2c3-4beb-ab51-6a5d88401c25\",\n                \"resourceVersion\": \"156\",\n                \"creationTimestamp\": \"2021-06-05T07:09:09Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-operator-794454784c-dc7nv\",\n                \"uid\": \"c035a725-54ce-4b02-bfe6-f6cc1a42464a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"449\",\n                \"fieldPath\": \"spec.containers{cilium-operator}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"docker.io/cilium/operator:v1.10.0\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:09Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:09Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-operator-794454784c.16859deab311f392\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"483c9461-3476-4835-9146-13f29340eb15\",\n                \"resourceVersion\": \"51\",\n                \"creationTimestamp\": \"2021-06-05T07:07:52Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"ReplicaSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-operator-794454784c\",\n                \"uid\": \"3adf6d33-0dd4-472b-9d08-68faeed2429e\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"404\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: cilium-operator-794454784c-dc7nv\",\n            \"source\": {\n                \"component\": \"replicaset-controller\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:52Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:52Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-operator.16859dea926be26f\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"9d9c227e-c2dc-4df3-ae63-fad0bf784823\",\n                \"resourceVersion\": \"44\",\n                \"creationTimestamp\": \"2021-06-05T07:07:51Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Deployment\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-operator\",\n                \"uid\": \"9235bb2b-6d9c-4050-9457-5fc9f21d00a9\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"288\"\n            },\n            \"reason\": \"ScalingReplicaSet\",\n            \"message\": \"Scaled up replica set cilium-operator-794454784c to 1\",\n            \"source\": {\n                \"component\": \"deployment-controller\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:51Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:51Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-swx97.16859dfbf993fcfe\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"e2f77500-8ebb-4d9b-8e2d-b92a559e2190\",\n                \"resourceVersion\": \"152\",\n                \"creationTimestamp\": \"2021-06-05T07:09:06Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-swx97\",\n                \"uid\": \"0044d02a-34ea-49fd-83b7-3993265daa4e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"688\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/cilium-swx97 to ip-172-20-62-33.ca-central-1.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:06Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:06Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-swx97.16859dfc9eb82e32\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"18c427c3-9365-4e6e-9680-5425de03e8f8\",\n                \"resourceVersion\": \"173\",\n                \"creationTimestamp\": \"2021-06-05T07:09:10Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-swx97\",\n                \"uid\": \"0044d02a-34ea-49fd-83b7-3993265daa4e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"690\",\n                \"fieldPath\": \"spec.initContainers{clean-cilium-state}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"docker.io/cilium/cilium:v1.10.0\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-33.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:09Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:09Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-swx97.16859dfdff0cc861\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"87d29556-dacc-407c-aa5a-23df304330fe\",\n                \"resourceVersion\": \"193\",\n                \"creationTimestamp\": \"2021-06-05T07:09:14Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-swx97\",\n                \"uid\": \"0044d02a-34ea-49fd-83b7-3993265daa4e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"690\",\n                \"fieldPath\": \"spec.initContainers{clean-cilium-state}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"docker.io/cilium/cilium:v1.10.0\\\" in 5.911089117s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-33.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:14Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:14Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-swx97.16859dfe6947df5f\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"8b1ab249-4391-4cc0-b067-27a7dc4aca02\",\n                \"resourceVersion\": \"196\",\n                \"creationTimestamp\": \"2021-06-05T07:09:16Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-swx97\",\n                \"uid\": \"0044d02a-34ea-49fd-83b7-3993265daa4e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"690\",\n                \"fieldPath\": \"spec.initContainers{clean-cilium-state}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container clean-cilium-state\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-33.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:16Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:16Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-swx97.16859dfe6efeb563\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f4229b6a-a250-4245-a8b0-a5c06a9fba9e\",\n                \"resourceVersion\": \"197\",\n                \"creationTimestamp\": \"2021-06-05T07:09:16Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-swx97\",\n                \"uid\": \"0044d02a-34ea-49fd-83b7-3993265daa4e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"690\",\n                \"fieldPath\": \"spec.initContainers{clean-cilium-state}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container clean-cilium-state\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-33.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:16Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:16Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-swx97.16859dfea63f0c96\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"e2e4e97f-4297-4faa-98eb-ae6fd60b1022\",\n                \"resourceVersion\": \"200\",\n                \"creationTimestamp\": \"2021-06-05T07:09:17Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-swx97\",\n                \"uid\": \"0044d02a-34ea-49fd-83b7-3993265daa4e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"690\",\n                \"fieldPath\": \"spec.containers{cilium-agent}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"docker.io/cilium/cilium:v1.10.0\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-33.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:17Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:17Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-swx97.16859dfeaa965d20\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"80584852-b31c-4e8d-bcfe-18112dfce6a7\",\n                \"resourceVersion\": \"201\",\n                \"creationTimestamp\": \"2021-06-05T07:09:17Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-swx97\",\n                \"uid\": \"0044d02a-34ea-49fd-83b7-3993265daa4e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"690\",\n                \"fieldPath\": \"spec.containers{cilium-agent}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container cilium-agent\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-33.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:17Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:17Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-swx97.16859dfeafd3ee2f\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"86ad736e-951e-4070-a0e4-d9cfe36013bb\",\n                \"resourceVersion\": \"202\",\n                \"creationTimestamp\": \"2021-06-05T07:09:17Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-swx97\",\n                \"uid\": \"0044d02a-34ea-49fd-83b7-3993265daa4e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"690\",\n                \"fieldPath\": \"spec.containers{cilium-agent}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container cilium-agent\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-33.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:17Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:17Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-swx97.16859dff25b52bbe\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"cc3b8e27-4d73-4862-99e0-ab6b9a39e198\",\n                \"resourceVersion\": \"218\",\n                \"creationTimestamp\": \"2021-06-05T07:09:19Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-swx97\",\n                \"uid\": \"0044d02a-34ea-49fd-83b7-3993265daa4e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"690\",\n                \"fieldPath\": \"spec.containers{cilium-agent}\"\n            },\n            \"reason\": \"Unhealthy\",\n            \"message\": \"Startup probe failed: Get \\\"http://127.0.0.1:9876/healthz\\\": dial tcp 127.0.0.1:9876: connect: connection refused\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-33.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:19Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:25Z\",\n            \"count\": 4,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-wqwtd.16859dfb50c644a8\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"fb3ad0a6-b245-4925-a42f-139277fcd834\",\n                \"resourceVersion\": \"124\",\n                \"creationTimestamp\": \"2021-06-05T07:09:03Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-wqwtd\",\n                \"uid\": \"3e81529b-0170-44ef-82c1-6261de4c6999\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"670\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/cilium-wqwtd to ip-172-20-42-252.ca-central-1.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:03Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:03Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-wqwtd.16859dfc0366af96\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"240a4ad6-7933-441a-9780-44a7fc432f5f\",\n                \"resourceVersion\": \"153\",\n                \"creationTimestamp\": \"2021-06-05T07:09:06Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-wqwtd\",\n                \"uid\": \"3e81529b-0170-44ef-82c1-6261de4c6999\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"672\",\n                \"fieldPath\": \"spec.initContainers{clean-cilium-state}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"docker.io/cilium/cilium:v1.10.0\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-252.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:06Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:06Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-wqwtd.16859dfd47f3ff95\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"c9cc1f07-ccae-4290-aaaf-934ee2456a48\",\n                \"resourceVersion\": \"179\",\n                \"creationTimestamp\": \"2021-06-05T07:09:11Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-wqwtd\",\n                \"uid\": \"3e81529b-0170-44ef-82c1-6261de4c6999\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"672\",\n                \"fieldPath\": \"spec.initContainers{clean-cilium-state}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"docker.io/cilium/cilium:v1.10.0\\\" in 5.445061909s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-252.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:11Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:11Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-wqwtd.16859dfdb32ce0b8\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d04d2edc-34ac-4577-8472-14bd1fe21935\",\n                \"resourceVersion\": \"187\",\n                \"creationTimestamp\": \"2021-06-05T07:09:13Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-wqwtd\",\n                \"uid\": \"3e81529b-0170-44ef-82c1-6261de4c6999\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"672\",\n                \"fieldPath\": \"spec.initContainers{clean-cilium-state}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container clean-cilium-state\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-252.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:13Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:13Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-wqwtd.16859dfdb89296d3\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"5d4aea8c-4b01-4571-b23d-2176db48b9bc\",\n                \"resourceVersion\": \"188\",\n                \"creationTimestamp\": \"2021-06-05T07:09:13Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-wqwtd\",\n                \"uid\": \"3e81529b-0170-44ef-82c1-6261de4c6999\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"672\",\n                \"fieldPath\": \"spec.initContainers{clean-cilium-state}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container clean-cilium-state\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-252.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:13Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:13Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-wqwtd.16859dfde8747725\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"452be588-a668-4f24-8f61-dabf7837bf23\",\n                \"resourceVersion\": \"189\",\n                \"creationTimestamp\": \"2021-06-05T07:09:14Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-wqwtd\",\n                \"uid\": \"3e81529b-0170-44ef-82c1-6261de4c6999\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"672\",\n                \"fieldPath\": \"spec.containers{cilium-agent}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"docker.io/cilium/cilium:v1.10.0\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-252.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:14Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:14Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-wqwtd.16859dfdec671c9d\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"9339044d-fc5c-481e-85bd-d015d5a8eef0\",\n                \"resourceVersion\": \"190\",\n                \"creationTimestamp\": \"2021-06-05T07:09:14Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-wqwtd\",\n                \"uid\": \"3e81529b-0170-44ef-82c1-6261de4c6999\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"672\",\n                \"fieldPath\": \"spec.containers{cilium-agent}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container cilium-agent\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-252.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:14Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:14Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-wqwtd.16859dfdf1ea2c51\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"e871205f-4c13-456d-aeef-ee8b0b3e1431\",\n                \"resourceVersion\": \"192\",\n                \"creationTimestamp\": \"2021-06-05T07:09:14Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-wqwtd\",\n                \"uid\": \"3e81529b-0170-44ef-82c1-6261de4c6999\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"672\",\n                \"fieldPath\": \"spec.containers{cilium-agent}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container cilium-agent\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-252.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:14Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:14Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-wqwtd.16859dfe7f45ee3d\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"03aa47d1-1095-4be3-bd71-8ba448bec954\",\n                \"resourceVersion\": \"215\",\n                \"creationTimestamp\": \"2021-06-05T07:09:17Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium-wqwtd\",\n                \"uid\": \"3e81529b-0170-44ef-82c1-6261de4c6999\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"672\",\n                \"fieldPath\": \"spec.containers{cilium-agent}\"\n            },\n            \"reason\": \"Unhealthy\",\n            \"message\": \"Startup probe failed: Get \\\"http://127.0.0.1:9876/healthz\\\": dial tcp 127.0.0.1:9876: connect: connection refused\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-252.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:17Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:23Z\",\n            \"count\": 4,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium.16859deab70500a8\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"b51d3ae4-e612-430a-85e2-35170255f2ef\",\n                \"resourceVersion\": \"55\",\n                \"creationTimestamp\": \"2021-06-05T07:07:52Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"DaemonSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium\",\n                \"uid\": \"a43e0fc8-0e8f-4934-b573-82baa5f51c0c\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"287\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: cilium-25vms\",\n            \"source\": {\n                \"component\": \"daemonset-controller\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:52Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:52Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium.16859dfac0e29077\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"4c98866e-9259-4131-b2de-c5848ccdc814\",\n                \"resourceVersion\": \"105\",\n                \"creationTimestamp\": \"2021-06-05T07:09:01Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"DaemonSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium\",\n                \"uid\": \"a43e0fc8-0e8f-4934-b573-82baa5f51c0c\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"451\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: cilium-d9szd\",\n            \"source\": {\n                \"component\": \"daemonset-controller\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:01Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:01Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium.16859dfad79db23c\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"7546ef09-26af-4ed4-8f02-e03a4de7e0be\",\n                \"resourceVersion\": \"107\",\n                \"creationTimestamp\": \"2021-06-05T07:09:01Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"DaemonSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium\",\n                \"uid\": \"a43e0fc8-0e8f-4934-b573-82baa5f51c0c\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"645\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: cilium-lnws2\",\n            \"source\": {\n                \"component\": \"daemonset-controller\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:01Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:01Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium.16859dfb501f1cec\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"9e3032ee-dd99-45e6-824b-0141019654b2\",\n                \"resourceVersion\": \"123\",\n                \"creationTimestamp\": \"2021-06-05T07:09:03Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"DaemonSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium\",\n                \"uid\": \"a43e0fc8-0e8f-4934-b573-82baa5f51c0c\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"653\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: cilium-wqwtd\",\n            \"source\": {\n                \"component\": \"daemonset-controller\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:03Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:03Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium.16859dfbf91a7bcc\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"dc497647-2549-47f0-b123-7e47db45dbdc\",\n                \"resourceVersion\": \"151\",\n                \"creationTimestamp\": \"2021-06-05T07:09:06Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"DaemonSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"cilium\",\n                \"uid\": \"a43e0fc8-0e8f-4934-b573-82baa5f51c0c\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"673\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: cilium-swx97\",\n            \"source\": {\n                \"component\": \"daemonset-controller\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:06Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:06Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-6f594f4c58-8v4pg.16859deab5fb601e\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"b2bbc835-a53f-4052-87c9-94d096176d8b\",\n                \"resourceVersion\": \"86\",\n                \"creationTimestamp\": \"2021-06-05T07:07:52Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-6f594f4c58-8v4pg\",\n                \"uid\": \"0caaa7c9-6536-401a-ad35-aafec12ab709\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"426\"\n            },\n            \"reason\": \"FailedScheduling\",\n            \"message\": \"0/1 nodes are available: 1 node(s) had taint {node-role.kubernetes.io/master: }, that the pod didn't tolerate.\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:52Z\",\n            \"lastTimestamp\": \"2021-06-05T07:08:08Z\",\n            \"count\": 4,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-6f594f4c58-8v4pg.16859dfac0584398\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"a3b2b8ce-f0ec-48b8-80fb-78aa2ef0c152\",\n                \"resourceVersion\": \"104\",\n                \"creationTimestamp\": \"2021-06-05T07:09:01Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-6f594f4c58-8v4pg\",\n                \"uid\": \"0caaa7c9-6536-401a-ad35-aafec12ab709\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"443\"\n            },\n            \"reason\": \"FailedScheduling\",\n            \"message\": \"0/2 nodes are available: 1 node(s) had taint {node-role.kubernetes.io/master: }, that the pod didn't tolerate, 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate.\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:01Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:01Z\",\n            \"count\": 1,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-6f594f4c58-8v4pg.16859dfd197b7fac\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"0ad0efba-a139-4999-ac3c-6cd9295baa4a\",\n                \"resourceVersion\": \"175\",\n                \"creationTimestamp\": \"2021-06-05T07:09:11Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-6f594f4c58-8v4pg\",\n                \"uid\": \"0caaa7c9-6536-401a-ad35-aafec12ab709\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"641\"\n            },\n            \"reason\": \"FailedScheduling\",\n            \"message\": \"0/5 nodes are available: 1 node(s) had taint {node-role.kubernetes.io/master: }, that the pod didn't tolerate, 4 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate.\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:11Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:11Z\",\n            \"count\": 1,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-6f594f4c58-8v4pg.16859dffa86acd64\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"7f936d13-915c-41de-b13b-71ce68687d5a\",\n                \"resourceVersion\": \"214\",\n                \"creationTimestamp\": \"2021-06-05T07:09:22Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-6f594f4c58-8v4pg\",\n                \"uid\": \"0caaa7c9-6536-401a-ad35-aafec12ab709\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"739\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/coredns-autoscaler-6f594f4c58-8v4pg to ip-172-20-55-143.ca-central-1.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:22Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:22Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-6f594f4c58-8v4pg.16859e01b6ab0a1e\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3dbaf506-4d2b-4108-bf5b-f91c49efa5e8\",\n                \"resourceVersion\": \"221\",\n                \"creationTimestamp\": \"2021-06-05T07:09:30Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-6f594f4c58-8v4pg\",\n                \"uid\": \"0caaa7c9-6536-401a-ad35-aafec12ab709\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"808\",\n                \"fieldPath\": \"spec.containers{autoscaler}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.3\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-55-143.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:30Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:30Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-6f594f4c58-8v4pg.16859e02014e35b8\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"825fff2a-394f-4071-aad0-a7e713fa2626\",\n                \"resourceVersion\": \"225\",\n                \"creationTimestamp\": \"2021-06-05T07:09:32Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-6f594f4c58-8v4pg\",\n                \"uid\": \"0caaa7c9-6536-401a-ad35-aafec12ab709\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"808\",\n                \"fieldPath\": \"spec.containers{autoscaler}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.3\\\" in 1.252191983s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-55-143.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:32Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:32Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-6f594f4c58-8v4pg.16859e020cb45680\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"7f97640c-5110-41b9-9e98-783c1cbe32f5\",\n                \"resourceVersion\": \"226\",\n                \"creationTimestamp\": \"2021-06-05T07:09:32Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-6f594f4c58-8v4pg\",\n                \"uid\": \"0caaa7c9-6536-401a-ad35-aafec12ab709\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"808\",\n                \"fieldPath\": \"spec.containers{autoscaler}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container autoscaler\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-55-143.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:32Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:32Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-6f594f4c58-8v4pg.16859e0214ac4bfe\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"601b8f92-d95f-4455-9d52-66df30c2f247\",\n                \"resourceVersion\": \"227\",\n                \"creationTimestamp\": \"2021-06-05T07:09:32Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-6f594f4c58-8v4pg\",\n                \"uid\": \"0caaa7c9-6536-401a-ad35-aafec12ab709\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"808\",\n                \"fieldPath\": \"spec.containers{autoscaler}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container autoscaler\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-55-143.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:32Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:32Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-6f594f4c58.16859deab340896e\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"2153ee74-2cb5-4e57-8984-be63afaa8f84\",\n                \"resourceVersion\": \"52\",\n                \"creationTimestamp\": \"2021-06-05T07:07:52Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"ReplicaSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-6f594f4c58\",\n                \"uid\": \"2a2f93ff-2028-4dbc-aac4-c3e24eeff348\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"401\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: coredns-autoscaler-6f594f4c58-8v4pg\",\n            \"source\": {\n                \"component\": \"replicaset-controller\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:52Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:52Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler.16859dea91fe0a87\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"707d4539-93bc-438a-b99b-32dd56971374\",\n                \"resourceVersion\": \"42\",\n                \"creationTimestamp\": \"2021-06-05T07:07:51Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Deployment\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler\",\n                \"uid\": \"45fcec6f-a566-4e3b-a5fa-a0507cedee8a\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"253\"\n            },\n            \"reason\": \"ScalingReplicaSet\",\n            \"message\": \"Scaled up replica set coredns-autoscaler-6f594f4c58 to 1\",\n            \"source\": {\n                \"component\": \"deployment-controller\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:51Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:51Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-f45c4bf76-f85fb.16859e022577670e\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"fc69162d-87ad-409d-86e4-84b1c324ef18\",\n                \"resourceVersion\": \"230\",\n                \"creationTimestamp\": \"2021-06-05T07:09:32Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-f45c4bf76-f85fb\",\n                \"uid\": \"690d673f-67cd-440e-a3e6-c371cf6b6ecc\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"883\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/coredns-f45c4bf76-f85fb to ip-172-20-42-252.ca-central-1.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:32Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:32Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-f45c4bf76-f85fb.16859e0252db2dd6\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"fc544e7c-6315-4395-b5ed-203fa2701f8e\",\n                \"resourceVersion\": \"231\",\n                \"creationTimestamp\": \"2021-06-05T07:09:33Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-f45c4bf76-f85fb\",\n                \"uid\": \"690d673f-67cd-440e-a3e6-c371cf6b6ecc\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"886\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"coredns/coredns:1.8.3\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-252.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:33Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:33Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-f45c4bf76-f85fb.16859e02980bd0a7\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"b0916887-5c7a-4614-8762-09d5e9a62261\",\n                \"resourceVersion\": \"232\",\n                \"creationTimestamp\": \"2021-06-05T07:09:34Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-f45c4bf76-f85fb\",\n                \"uid\": \"690d673f-67cd-440e-a3e6-c371cf6b6ecc\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"886\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"coredns/coredns:1.8.3\\\" in 1.160797572s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-252.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:34Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:34Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-f45c4bf76-f85fb.16859e02a1fe513e\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"7977b783-91b5-420b-8be0-a2587aca23cc\",\n                \"resourceVersion\": \"233\",\n                \"creationTimestamp\": \"2021-06-05T07:09:34Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-f45c4bf76-f85fb\",\n                \"uid\": \"690d673f-67cd-440e-a3e6-c371cf6b6ecc\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"886\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container coredns\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-252.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:34Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:34Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-f45c4bf76-f85fb.16859e02aa041278\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"74a78165-5908-4c07-bfee-b76fbc96389e\",\n                \"resourceVersion\": \"234\",\n                \"creationTimestamp\": \"2021-06-05T07:09:35Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-f45c4bf76-f85fb\",\n                \"uid\": \"690d673f-67cd-440e-a3e6-c371cf6b6ecc\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"886\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container coredns\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-252.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:35Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:35Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-f45c4bf76-gr4z9.16859deab30df994\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"444eb0c4-3568-493e-a805-a96c3877a8cf\",\n                \"resourceVersion\": \"85\",\n                \"creationTimestamp\": \"2021-06-05T07:07:52Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-f45c4bf76-gr4z9\",\n                \"uid\": \"116a374d-38a2-4e8d-8f33-4e42c49717fa\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"425\"\n            },\n            \"reason\": \"FailedScheduling\",\n            \"message\": \"0/1 nodes are available: 1 node(s) had taint {node-role.kubernetes.io/master: }, that the pod didn't tolerate.\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:52Z\",\n            \"lastTimestamp\": \"2021-06-05T07:08:08Z\",\n            \"count\": 4,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-f45c4bf76-gr4z9.16859dfabef26bd9\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"616aa743-2268-4da7-a335-aa96b9f662a5\",\n                \"resourceVersion\": \"103\",\n                \"creationTimestamp\": \"2021-06-05T07:09:01Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-f45c4bf76-gr4z9\",\n                \"uid\": \"116a374d-38a2-4e8d-8f33-4e42c49717fa\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"441\"\n            },\n            \"reason\": \"FailedScheduling\",\n            \"message\": \"0/2 nodes are available: 1 node(s) had taint {node-role.kubernetes.io/master: }, that the pod didn't tolerate, 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate.\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:01Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:01Z\",\n            \"count\": 1,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-f45c4bf76-gr4z9.16859dfd1790606d\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"5a6ed1a8-4b8e-4845-a41b-3c4588d8e1ce\",\n                \"resourceVersion\": \"174\",\n                \"creationTimestamp\": \"2021-06-05T07:09:11Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-f45c4bf76-gr4z9\",\n                \"uid\": \"116a374d-38a2-4e8d-8f33-4e42c49717fa\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"639\"\n            },\n            \"reason\": \"FailedScheduling\",\n            \"message\": \"0/5 nodes are available: 1 node(s) had taint {node-role.kubernetes.io/master: }, that the pod didn't tolerate, 4 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate.\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:11Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:11Z\",\n            \"count\": 1,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-f45c4bf76-gr4z9.16859dff6c73eaba\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"1b566394-2ffe-4ce9-a7e4-ea1ab5bf901e\",\n                \"resourceVersion\": \"210\",\n                \"creationTimestamp\": \"2021-06-05T07:09:21Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-f45c4bf76-gr4z9\",\n                \"uid\": \"116a374d-38a2-4e8d-8f33-4e42c49717fa\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"738\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/coredns-f45c4bf76-gr4z9 to ip-172-20-48-31.ca-central-1.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:21Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:21Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-f45c4bf76-gr4z9.16859e01989e47f9\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"5e03f721-0701-4ac3-9ed3-71763e2ef494\",\n                \"resourceVersion\": \"220\",\n                \"creationTimestamp\": \"2021-06-05T07:09:30Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-f45c4bf76-gr4z9\",\n                \"uid\": \"116a374d-38a2-4e8d-8f33-4e42c49717fa\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"796\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"coredns/coredns:1.8.3\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-48-31.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:30Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:30Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-f45c4bf76-gr4z9.16859e01ddf77e4b\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"78d27ac0-f91f-44c9-83c5-27d83561b8ba\",\n                \"resourceVersion\": \"222\",\n                \"creationTimestamp\": \"2021-06-05T07:09:31Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-f45c4bf76-gr4z9\",\n                \"uid\": \"116a374d-38a2-4e8d-8f33-4e42c49717fa\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"796\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"coredns/coredns:1.8.3\\\" in 1.16345614s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-48-31.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:31Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:31Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-f45c4bf76-gr4z9.16859e01e7714b08\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"5291bcb6-2141-484c-b53d-dab6c248b022\",\n                \"resourceVersion\": \"223\",\n                \"creationTimestamp\": \"2021-06-05T07:09:31Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-f45c4bf76-gr4z9\",\n                \"uid\": \"116a374d-38a2-4e8d-8f33-4e42c49717fa\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"796\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container coredns\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-48-31.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:31Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:31Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-f45c4bf76-gr4z9.16859e01f0033f70\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"da3722fc-7abb-44f8-b189-2ecd8b858005\",\n                \"resourceVersion\": \"224\",\n                \"creationTimestamp\": \"2021-06-05T07:09:31Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-f45c4bf76-gr4z9\",\n                \"uid\": \"116a374d-38a2-4e8d-8f33-4e42c49717fa\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"796\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container coredns\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-48-31.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:31Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:31Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-f45c4bf76.16859deab2ca89ce\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"5aefda7c-8148-4849-a89a-1a01ddde9e30\",\n                \"resourceVersion\": \"49\",\n                \"creationTimestamp\": \"2021-06-05T07:07:52Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"ReplicaSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-f45c4bf76\",\n                \"uid\": \"f30f550c-0d69-4278-8025-38052833403d\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"402\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: coredns-f45c4bf76-gr4z9\",\n            \"source\": {\n                \"component\": \"replicaset-controller\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:52Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:52Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-f45c4bf76.16859e0224f9895f\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"b277771f-b38e-4c69-9a48-be68cb558a4a\",\n                \"resourceVersion\": \"229\",\n                \"creationTimestamp\": \"2021-06-05T07:09:32Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"ReplicaSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-f45c4bf76\",\n                \"uid\": \"f30f550c-0d69-4278-8025-38052833403d\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"881\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: coredns-f45c4bf76-f85fb\",\n            \"source\": {\n                \"component\": \"replicaset-controller\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:32Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:32Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns.16859dea921f1dad\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"060bcafa-1dd3-4ba1-9a9e-2f3b9c8ce8cc\",\n                \"resourceVersion\": \"43\",\n                \"creationTimestamp\": \"2021-06-05T07:07:51Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Deployment\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns\",\n                \"uid\": \"fe4b9906-7979-43c9-ae09-b031aa40e403\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"244\"\n            },\n            \"reason\": \"ScalingReplicaSet\",\n            \"message\": \"Scaled up replica set coredns-f45c4bf76 to 1\",\n            \"source\": {\n                \"component\": \"deployment-controller\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:51Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:51Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns.16859e0224365478\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"61fa8542-e2ae-440d-ab62-cf33ede27631\",\n                \"resourceVersion\": \"228\",\n                \"creationTimestamp\": \"2021-06-05T07:09:32Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Deployment\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns\",\n                \"uid\": \"fe4b9906-7979-43c9-ae09-b031aa40e403\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"880\"\n            },\n            \"reason\": \"ScalingReplicaSet\",\n            \"message\": \"Scaled up replica set coredns-f45c4bf76 to 2\",\n            \"source\": {\n                \"component\": \"deployment-controller\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:09:32Z\",\n            \"lastTimestamp\": \"2021-06-05T07:09:32Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-5f98b58844-jctdt.16859deab934a9e8\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f948ed32-3a98-4dcf-8f35-788fa27378ae\",\n                \"resourceVersion\": \"58\",\n                \"creationTimestamp\": \"2021-06-05T07:07:52Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"dns-controller-5f98b58844-jctdt\",\n                \"uid\": \"d9b5af02-309d-4f2d-b0ad-0ddaf949bc4a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"432\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/dns-controller-5f98b58844-jctdt to ip-172-20-37-235.ca-central-1.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:52Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:52Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-5f98b58844-jctdt.16859deada2a605b\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"1924bbdc-3b58-4eab-9436-faff389e7410\",\n                \"resourceVersion\": \"60\",\n                \"creationTimestamp\": \"2021-06-05T07:07:52Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"dns-controller-5f98b58844-jctdt\",\n                \"uid\": \"d9b5af02-309d-4f2d-b0ad-0ddaf949bc4a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"450\",\n                \"fieldPath\": \"spec.containers{dns-controller}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kops/dns-controller:1.22.0-alpha.1\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:52Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:52Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-5f98b58844-jctdt.16859deade914613\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"c63bd633-021e-4d9a-925e-205879889a51\",\n                \"resourceVersion\": \"61\",\n                \"creationTimestamp\": \"2021-06-05T07:07:52Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"dns-controller-5f98b58844-jctdt\",\n                \"uid\": \"d9b5af02-309d-4f2d-b0ad-0ddaf949bc4a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"450\",\n                \"fieldPath\": \"spec.containers{dns-controller}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container dns-controller\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:52Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:52Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-5f98b58844-jctdt.16859deae697d48e\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"1fd8827c-66d7-4c7d-85f3-05255cc0a2f1\",\n                \"resourceVersion\": \"63\",\n                \"creationTimestamp\": \"2021-06-05T07:07:52Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"dns-controller-5f98b58844-jctdt\",\n                \"uid\": \"d9b5af02-309d-4f2d-b0ad-0ddaf949bc4a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"450\",\n                \"fieldPath\": \"spec.containers{dns-controller}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container dns-controller\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:52Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:52Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-5f98b58844.16859deab40e28be\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"7305856c-4472-490e-b661-110856f9c7cd\",\n                \"resourceVersion\": \"53\",\n                \"creationTimestamp\": \"2021-06-05T07:07:52Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"ReplicaSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"dns-controller-5f98b58844\",\n                \"uid\": \"cb72c25c-93e6-4611-8219-899d8960d79c\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"403\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: dns-controller-5f98b58844-jctdt\",\n            \"source\": {\n                \"component\": \"replicaset-controller\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:52Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:52Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller.16859dea926f1952\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"bedb23d7-2680-47c5-94ed-603ae2025dea\",\n                \"resourceVersion\": \"45\",\n                \"creationTimestamp\": \"2021-06-05T07:07:51Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Deployment\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"dns-controller\",\n                \"uid\": \"fc408104-db62-47f5-a406-ab703372e22f\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"261\"\n            },\n            \"reason\": \"ScalingReplicaSet\",\n            \"message\": \"Scaled up replica set dns-controller-5f98b58844 to 1\",\n            \"source\": {\n                \"component\": \"deployment-controller\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:51Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:51Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-events-ip-172-20-37-235.ca-central-1.compute.internal.16859dddbe6efac3\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"494a2cd2-d336-4552-b7f8-b64a4f7e5ffd\",\n                \"resourceVersion\": \"23\",\n                \"creationTimestamp\": \"2021-06-05T07:07:39Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-events-ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"uid\": \"df915144f6a8fb9cabcadfbe68a42ad1\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/etcdadm/etcd-manager:3.0.20210430\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:06:56Z\",\n            \"lastTimestamp\": \"2021-06-05T07:06:56Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-events-ip-172-20-37-235.ca-central-1.compute.internal.16859de0d2cde0e7\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"40539fe0-1372-4cce-81ae-816c65385c0d\",\n                \"resourceVersion\": \"34\",\n                \"creationTimestamp\": \"2021-06-05T07:07:41Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-events-ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"uid\": \"df915144f6a8fb9cabcadfbe68a42ad1\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/etcdadm/etcd-manager:3.0.20210430\\\" in 13.226651875s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:09Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:09Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-events-ip-172-20-37-235.ca-central-1.compute.internal.16859de11284735d\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"a386bc99-b7c6-4c27-8ad8-69099f57da8c\",\n                \"resourceVersion\": \"36\",\n                \"creationTimestamp\": \"2021-06-05T07:07:41Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-events-ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"uid\": \"df915144f6a8fb9cabcadfbe68a42ad1\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container etcd-manager\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:10Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:10Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-events-ip-172-20-37-235.ca-central-1.compute.internal.16859de11931cc70\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"76434072-a6c7-4631-bd1c-13f6ee1ff0ed\",\n                \"resourceVersion\": \"37\",\n                \"creationTimestamp\": \"2021-06-05T07:07:42Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-events-ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"uid\": \"df915144f6a8fb9cabcadfbe68a42ad1\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container etcd-manager\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:10Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:10Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-main-ip-172-20-37-235.ca-central-1.compute.internal.16859dddb54282f6\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d2d18391-e095-46dd-9230-a95aee2de925\",\n                \"resourceVersion\": \"22\",\n                \"creationTimestamp\": \"2021-06-05T07:07:39Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-main-ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"uid\": \"058fc19f9bde90a5c86ff3888d747f3c\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/etcdadm/etcd-manager:3.0.20210430\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:06:56Z\",\n            \"lastTimestamp\": \"2021-06-05T07:06:56Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-main-ip-172-20-37-235.ca-central-1.compute.internal.16859de0a9fed75a\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"ea10a1d9-2056-448d-96d3-6f72cfe738eb\",\n                \"resourceVersion\": \"33\",\n                \"creationTimestamp\": \"2021-06-05T07:07:41Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-main-ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"uid\": \"058fc19f9bde90a5c86ff3888d747f3c\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/etcdadm/etcd-manager:3.0.20210430\\\" in 12.695905679s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:08Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:08Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-main-ip-172-20-37-235.ca-central-1.compute.internal.16859de112413c44\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"78119592-24d6-4910-9993-42b48afec3c8\",\n                \"resourceVersion\": \"35\",\n                \"creationTimestamp\": \"2021-06-05T07:07:41Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-main-ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"uid\": \"058fc19f9bde90a5c86ff3888d747f3c\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container etcd-manager\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:10Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:10Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-main-ip-172-20-37-235.ca-central-1.compute.internal.16859de11950762b\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"bb7b45a1-9bba-476f-a057-eafacd3c1c96\",\n                \"resourceVersion\": \"38\",\n                \"creationTimestamp\": \"2021-06-05T07:07:42Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-main-ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"uid\": \"058fc19f9bde90a5c86ff3888d747f3c\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container etcd-manager\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:10Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:10Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller-leader.16859dedcf3c35ff\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"7bcaf49e-9a21-4a29-806d-20460c830b93\",\n                \"resourceVersion\": \"83\",\n                \"creationTimestamp\": \"2021-06-05T07:08:05Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"ConfigMap\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kops-controller-leader\",\n                \"uid\": \"22045cbf-596c-4d34-88db-e106fdf5abf6\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"501\"\n            },\n            \"reason\": \"LeaderElection\",\n            \"message\": \"ip-172-20-37-235_9c33586a-227f-4c03-84ca-c9d61d2955a6 became leader\",\n            \"source\": {\n                \"component\": \"ip-172-20-37-235_9c33586a-227f-4c03-84ca-c9d61d2955a6\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:08:05Z\",\n            \"lastTimestamp\": \"2021-06-05T07:08:05Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller-sh4nx.16859ded6be00c73\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"8c4da87f-e74e-47c5-ac87-4c3fc792a8d7\",\n                \"resourceVersion\": \"78\",\n                \"creationTimestamp\": \"2021-06-05T07:08:03Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kops-controller-sh4nx\",\n                \"uid\": \"260f3752-1748-4c13-b9ce-00056a6d04f1\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"489\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/kops-controller-sh4nx to ip-172-20-37-235.ca-central-1.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:08:03Z\",\n            \"lastTimestamp\": \"2021-06-05T07:08:03Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller-sh4nx.16859ded8658b7b6\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"61d719ad-62e6-4f24-ad0b-0bacfdfb89ca\",\n                \"resourceVersion\": \"80\",\n                \"creationTimestamp\": \"2021-06-05T07:08:04Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kops-controller-sh4nx\",\n                \"uid\": \"260f3752-1748-4c13-b9ce-00056a6d04f1\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"491\",\n                \"fieldPath\": \"spec.containers{kops-controller}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kops/kops-controller:1.22.0-alpha.1\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:08:04Z\",\n            \"lastTimestamp\": \"2021-06-05T07:08:04Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller-sh4nx.16859ded89966fe9\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"54edb18f-2dcc-4fd8-9728-83939d64946a\",\n                \"resourceVersion\": \"81\",\n                \"creationTimestamp\": \"2021-06-05T07:08:04Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kops-controller-sh4nx\",\n                \"uid\": \"260f3752-1748-4c13-b9ce-00056a6d04f1\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"491\",\n                \"fieldPath\": \"spec.containers{kops-controller}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kops-controller\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:08:04Z\",\n            \"lastTimestamp\": \"2021-06-05T07:08:04Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller-sh4nx.16859ded90b55a00\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"1e9862ef-ae25-4698-a027-aae55688dce9\",\n                \"resourceVersion\": \"82\",\n                \"creationTimestamp\": \"2021-06-05T07:08:04Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kops-controller-sh4nx\",\n                \"uid\": \"260f3752-1748-4c13-b9ce-00056a6d04f1\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"491\",\n                \"fieldPath\": \"spec.containers{kops-controller}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kops-controller\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:08:04Z\",\n            \"lastTimestamp\": \"2021-06-05T07:08:04Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller.16859ded6b0454ce\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"eb666451-d7ef-4df5-b756-d3aa66bd0589\",\n                \"resourceVersion\": \"77\",\n                \"creationTimestamp\": \"2021-06-05T07:08:03Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"DaemonSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kops-controller\",\n                \"uid\": \"1381c6f6-e92f-4b7a-b5f0-38756ff58a47\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"447\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: kops-controller-sh4nx\",\n            \"source\": {\n                \"component\": \"daemonset-controller\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:08:03Z\",\n            \"lastTimestamp\": \"2021-06-05T07:08:03Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-ip-172-20-37-235.ca-central-1.compute.internal.16859ddd9483b23c\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"af97e47b-e463-4cd5-b4ca-22f956f4a8e2\",\n                \"resourceVersion\": \"39\",\n                \"creationTimestamp\": \"2021-06-05T07:07:38Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-apiserver-ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"uid\": \"177a790a8a5a474e7fa67573f21ba254\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-apiserver}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kube-apiserver-amd64:v1.21.1\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:06:55Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:24Z\",\n            \"count\": 2,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-ip-172-20-37-235.ca-central-1.compute.internal.16859ddee95d855e\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3804aad1-0d20-442a-b199-cbb4af1c3969\",\n                \"resourceVersion\": \"40\",\n                \"creationTimestamp\": \"2021-06-05T07:07:39Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-apiserver-ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"uid\": \"177a790a8a5a474e7fa67573f21ba254\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-apiserver}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-apiserver\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:01Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:24Z\",\n            \"count\": 2,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-ip-172-20-37-235.ca-central-1.compute.internal.16859ddf248193bf\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"2fc9700e-af8e-4f1d-b43d-13dc2dd825ea\",\n                \"resourceVersion\": \"41\",\n                \"creationTimestamp\": \"2021-06-05T07:07:40Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-apiserver-ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"uid\": \"177a790a8a5a474e7fa67573f21ba254\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-apiserver}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-apiserver\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:02Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:24Z\",\n            \"count\": 2,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-ip-172-20-37-235.ca-central-1.compute.internal.16859ddf2fa4de92\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f64c422d-0cae-4e56-9b55-782862ce7f08\",\n                \"resourceVersion\": \"30\",\n                \"creationTimestamp\": \"2021-06-05T07:07:40Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-apiserver-ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"uid\": \"177a790a8a5a474e7fa67573f21ba254\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{healthcheck}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kops/kube-apiserver-healthcheck:1.22.0-alpha.1\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:02Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:02Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-ip-172-20-37-235.ca-central-1.compute.internal.16859ddf70caef97\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"9b4296ec-620f-4e9d-a317-6f9b6379d2fd\",\n                \"resourceVersion\": \"31\",\n                \"creationTimestamp\": \"2021-06-05T07:07:40Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-apiserver-ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"uid\": \"177a790a8a5a474e7fa67573f21ba254\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{healthcheck}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container healthcheck\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:03Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:03Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-ip-172-20-37-235.ca-central-1.compute.internal.16859ddf8d327181\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"12ec9db2-92c6-4261-839b-9ed6145c2a4b\",\n                \"resourceVersion\": \"32\",\n                \"creationTimestamp\": \"2021-06-05T07:07:41Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-apiserver-ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"uid\": \"177a790a8a5a474e7fa67573f21ba254\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{healthcheck}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container healthcheck\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:04Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:04Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-controller-manager-ip-172-20-37-235.ca-central-1.compute.internal.16859dddb53dc42c\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"fc01864a-5c7f-4409-bdc5-5ee3519d12f7\",\n                \"resourceVersion\": \"21\",\n                \"creationTimestamp\": \"2021-06-05T07:07:38Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-controller-manager-ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"uid\": \"51db6116056772a430a6e21769ef149d\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-controller-manager}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kube-controller-manager-amd64:v1.21.1\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:06:56Z\",\n            \"lastTimestamp\": \"2021-06-05T07:06:56Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-controller-manager-ip-172-20-37-235.ca-central-1.compute.internal.16859ddee95c4b62\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3ee1ccf0-d2bc-451d-8d7e-e7c9208f24de\",\n                \"resourceVersion\": \"24\",\n                \"creationTimestamp\": \"2021-06-05T07:07:39Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-controller-manager-ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"uid\": \"51db6116056772a430a6e21769ef149d\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-controller-manager}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-controller-manager\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:01Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:01Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-controller-manager-ip-172-20-37-235.ca-central-1.compute.internal.16859ddf24832284\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"1b34e00f-aeea-423c-a2d7-0997a9da2bd9\",\n                \"resourceVersion\": \"28\",\n                \"creationTimestamp\": \"2021-06-05T07:07:40Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-controller-manager-ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"uid\": \"51db6116056772a430a6e21769ef149d\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-controller-manager}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-controller-manager\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:02Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:02Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-controller-manager.16859de71a450365\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"6aa15cff-8c20-42a5-b284-cab7138ffe8b\",\n                \"resourceVersion\": \"8\",\n                \"creationTimestamp\": \"2021-06-05T07:07:36Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Lease\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-controller-manager\",\n                \"uid\": \"e054b0ac-afe1-4589-8c3b-84d835f48787\",\n                \"apiVersion\": \"coordination.k8s.io/v1\",\n                \"resourceVersion\": \"216\"\n            },\n            \"reason\": \"LeaderElection\",\n            \"message\": \"ip-172-20-37-235_942a2618-1db3-474d-ac1b-da2c2d7b403d became leader\",\n            \"source\": {\n                \"component\": \"kube-controller-manager\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:36Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:36Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-dns.16859dea88870c68\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"1231a418-9fdf-4c24-a089-8b27a5bc687c\",\n                \"resourceVersion\": \"48\",\n                \"creationTimestamp\": \"2021-06-05T07:07:51Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"PodDisruptionBudget\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-dns\",\n                \"uid\": \"eb7782f1-11a5-4d08-8e19-59c9d84f656f\",\n                \"apiVersion\": \"policy/v1\",\n                \"resourceVersion\": \"247\"\n            },\n            \"reason\": \"NoPods\",\n            \"message\": \"No matching pods found\",\n            \"source\": {\n                \"component\": \"controllermanager\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:51Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:51Z\",\n            \"count\": 2,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-scheduler-ip-172-20-37-235.ca-central-1.compute.internal.16859ddda8216c7d\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"364857a8-88b4-4621-bf41-523acc7c93d0\",\n                \"resourceVersion\": \"20\",\n                \"creationTimestamp\": \"2021-06-05T07:07:38Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-scheduler-ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"uid\": \"606be56347d3792a698c7498153af420\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-scheduler}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kube-scheduler-amd64:v1.21.1\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:06:56Z\",\n            \"lastTimestamp\": \"2021-06-05T07:06:56Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-scheduler-ip-172-20-37-235.ca-central-1.compute.internal.16859ddeebfe640e\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"6f418d2f-bfdc-4973-9f88-9823be1cec7a\",\n                \"resourceVersion\": \"26\",\n                \"creationTimestamp\": \"2021-06-05T07:07:39Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-scheduler-ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"uid\": \"606be56347d3792a698c7498153af420\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-scheduler}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-scheduler\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:01Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:01Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-scheduler-ip-172-20-37-235.ca-central-1.compute.internal.16859ddf2483aa39\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"bb8ccb20-c85a-4725-8340-965e8f6d2d72\",\n                \"resourceVersion\": \"29\",\n                \"creationTimestamp\": \"2021-06-05T07:07:40Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-scheduler-ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"uid\": \"606be56347d3792a698c7498153af420\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-scheduler}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-scheduler\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-235.ca-central-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:02Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:02Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-scheduler.16859de731c69c3b\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"46474ebd-0658-420f-91ae-8461b3eb5e96\",\n                \"resourceVersion\": \"11\",\n                \"creationTimestamp\": \"2021-06-05T07:07:37Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Lease\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-scheduler\",\n                \"uid\": \"73868d97-3819-48c1-8218-a6e1074a42a7\",\n                \"apiVersion\": \"coordination.k8s.io/v1\",\n                \"resourceVersion\": \"218\"\n            },\n            \"reason\": \"LeaderElection\",\n            \"message\": \"ip-172-20-37-235_7c87e371-4590-40f1-8fcf-44ed69de7fbd became leader\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-06-05T07:07:37Z\",\n            \"lastTimestamp\": \"2021-06-05T07:07:37Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        }\n    ]\n}\n{\n    \"kind\": \"ReplicationControllerList\",\n    \"apiVersion\": \"v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"9564\"\n    },\n    \"items\": []\n}\n{\n    \"kind\": \"ServiceList\",\n    \"apiVersion\": \"v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"9564\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"kube-dns\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"9880ed01-576b-49f3-b5ce-129fb96d66af\",\n                \"resourceVersion\": \"246\",\n                \"creationTimestamp\": \"2021-06-05T07:07:40Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"coredns.addons.k8s.io\",\n                    \"addon.kops.k8s.io/version\": \"1.8.3-kops.3\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"k8s-addon\": \"coredns.addons.k8s.io\",\n                    \"k8s-app\": \"kube-dns\",\n                    \"kubernetes.io/cluster-service\": \"true\",\n                    \"kubernetes.io/name\": \"CoreDNS\"\n                },\n                \"annotations\": {\n                    \"kubectl.kubernetes.io/last-applied-configuration\": \"{\\\"apiVersion\\\":\\\"v1\\\",\\\"kind\\\":\\\"Service\\\",\\\"metadata\\\":{\\\"annotations\\\":{\\\"prometheus.io/port\\\":\\\"9153\\\",\\\"prometheus.io/scrape\\\":\\\"true\\\"},\\\"creationTimestamp\\\":null,\\\"labels\\\":{\\\"addon.kops.k8s.io/name\\\":\\\"coredns.addons.k8s.io\\\",\\\"addon.kops.k8s.io/version\\\":\\\"1.8.3-kops.3\\\",\\\"app.kubernetes.io/managed-by\\\":\\\"kops\\\",\\\"k8s-addon\\\":\\\"coredns.addons.k8s.io\\\",\\\"k8s-app\\\":\\\"kube-dns\\\",\\\"kubernetes.io/cluster-service\\\":\\\"true\\\",\\\"kubernetes.io/name\\\":\\\"CoreDNS\\\"},\\\"name\\\":\\\"kube-dns\\\",\\\"namespace\\\":\\\"kube-system\\\",\\\"resourceVersion\\\":\\\"0\\\"},\\\"spec\\\":{\\\"clusterIP\\\":\\\"100.64.0.10\\\",\\\"ports\\\":[{\\\"name\\\":\\\"dns\\\",\\\"port\\\":53,\\\"protocol\\\":\\\"UDP\\\"},{\\\"name\\\":\\\"dns-tcp\\\",\\\"port\\\":53,\\\"protocol\\\":\\\"TCP\\\"},{\\\"name\\\":\\\"metrics\\\",\\\"port\\\":9153,\\\"protocol\\\":\\\"TCP\\\"}],\\\"selector\\\":{\\\"k8s-app\\\":\\\"kube-dns\\\"}}}\\n\",\n                    \"prometheus.io/port\": \"9153\",\n                    \"prometheus.io/scrape\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"ports\": [\n                    {\n                        \"name\": \"dns\",\n                        \"protocol\": \"UDP\",\n                        \"port\": 53,\n                        \"targetPort\": 53\n                    },\n                    {\n                        \"name\": \"dns-tcp\",\n                        \"protocol\": \"TCP\",\n                        \"port\": 53,\n                        \"targetPort\": 53\n                    },\n                    {\n                        \"name\": \"metrics\",\n                        \"protocol\": \"TCP\",\n                        \"port\": 9153,\n                        \"targetPort\": 9153\n                    }\n                ],\n                \"selector\": {\n                    \"k8s-app\": \"kube-dns\"\n                },\n                \"clusterIP\": \"100.64.0.10\",\n                \"clusterIPs\": [\n                    \"100.64.0.10\"\n                ],\n                \"type\": \"ClusterIP\",\n                \"sessionAffinity\": \"None\",\n                \"ipFamilies\": [\n                    \"IPv4\"\n                ],\n                \"ipFamilyPolicy\": \"SingleStack\"\n            },\n            \"status\": {\n                \"loadBalancer\": {}\n            }\n        }\n    ]\n}\n{\n    \"kind\": \"DaemonSetList\",\n    \"apiVersion\": \"apps/v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"9565\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"cilium\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"a43e0fc8-0e8f-4934-b573-82baa5f51c0c\",\n                \"resourceVersion\": \"846\",\n                \"generation\": 1,\n                \"creationTimestamp\": \"2021-06-05T07:07:43Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"networking.cilium.io\",\n                    \"addon.kops.k8s.io/version\": \"1.10.0-kops.1\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"k8s-app\": \"cilium\",\n                    \"kubernetes.io/cluster-service\": \"true\",\n                    \"role.kubernetes.io/networking\": \"1\"\n                },\n                \"annotations\": {\n                    \"deprecated.daemonset.template.generation\": \"1\",\n                    \"kubectl.kubernetes.io/last-applied-configuration\": \"{\\\"apiVersion\\\":\\\"apps/v1\\\",\\\"kind\\\":\\\"DaemonSet\\\",\\\"metadata\\\":{\\\"annotations\\\":{},\\\"creationTimestamp\\\":null,\\\"labels\\\":{\\\"addon.kops.k8s.io/name\\\":\\\"networking.cilium.io\\\",\\\"addon.kops.k8s.io/version\\\":\\\"1.10.0-kops.1\\\",\\\"app.kubernetes.io/managed-by\\\":\\\"kops\\\",\\\"k8s-app\\\":\\\"cilium\\\",\\\"kubernetes.io/cluster-service\\\":\\\"true\\\",\\\"role.kubernetes.io/networking\\\":\\\"1\\\"},\\\"name\\\":\\\"cilium\\\",\\\"namespace\\\":\\\"kube-system\\\"},\\\"spec\\\":{\\\"selector\\\":{\\\"matchLabels\\\":{\\\"k8s-app\\\":\\\"cilium\\\",\\\"kubernetes.io/cluster-service\\\":\\\"true\\\"}},\\\"template\\\":{\\\"metadata\\\":{\\\"annotations\\\":{\\\"scheduler.alpha.kubernetes.io/critical-pod\\\":\\\"\\\"},\\\"labels\\\":{\\\"k8s-app\\\":\\\"cilium\\\",\\\"kubernetes.io/cluster-service\\\":\\\"true\\\"}},\\\"spec\\\":{\\\"affinity\\\":{\\\"nodeAffinity\\\":{\\\"requiredDuringSchedulingIgnoredDuringExecution\\\":{\\\"nodeSelectorTerms\\\":[{\\\"matchExpressions\\\":[{\\\"key\\\":\\\"kubernetes.io/os\\\",\\\"operator\\\":\\\"In\\\",\\\"values\\\":[\\\"linux\\\"]}]}]}},\\\"podAntiAffinity\\\":{\\\"requiredDuringSchedulingIgnoredDuringExecution\\\":[{\\\"labelSelector\\\":{\\\"matchExpressions\\\":[{\\\"key\\\":\\\"k8s-app\\\",\\\"operator\\\":\\\"In\\\",\\\"values\\\":[\\\"cilium\\\"]}]},\\\"topologyKey\\\":\\\"kubernetes.io/hostname\\\"}]}},\\\"containers\\\":[{\\\"args\\\":[\\\"--config-dir=/tmp/cilium/config-map\\\"],\\\"command\\\":[\\\"cilium-agent\\\"],\\\"env\\\":[{\\\"name\\\":\\\"K8S_NODE_NAME\\\",\\\"valueFrom\\\":{\\\"fieldRef\\\":{\\\"apiVersion\\\":\\\"v1\\\",\\\"fieldPath\\\":\\\"spec.nodeName\\\"}}},{\\\"name\\\":\\\"CILIUM_K8S_NAMESPACE\\\",\\\"valueFrom\\\":{\\\"fieldRef\\\":{\\\"apiVersion\\\":\\\"v1\\\",\\\"fieldPath\\\":\\\"metadata.namespace\\\"}}},{\\\"name\\\":\\\"CILIUM_CLUSTERMESH_CONFIG\\\",\\\"value\\\":\\\"/var/lib/cilium/clustermesh/\\\"},{\\\"name\\\":\\\"CILIUM_CNI_CHAINING_MODE\\\",\\\"valueFrom\\\":{\\\"configMapKeyRef\\\":{\\\"key\\\":\\\"cni-chaining-mode\\\",\\\"name\\\":\\\"cilium-config\\\",\\\"optional\\\":true}}},{\\\"name\\\":\\\"CILIUM_CUSTOM_CNI_CONF\\\",\\\"valueFrom\\\":{\\\"configMapKeyRef\\\":{\\\"key\\\":\\\"custom-cni-conf\\\",\\\"name\\\":\\\"cilium-config\\\",\\\"optional\\\":true}}},{\\\"name\\\":\\\"KUBERNETES_SERVICE_HOST\\\",\\\"value\\\":\\\"api.internal.e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io\\\"},{\\\"name\\\":\\\"KUBERNETES_SERVICE_PORT\\\",\\\"value\\\":\\\"443\\\"}],\\\"image\\\":\\\"docker.io/cilium/cilium:v1.10.0\\\",\\\"imagePullPolicy\\\":\\\"IfNotPresent\\\",\\\"lifecycle\\\":{\\\"postStart\\\":{\\\"exec\\\":{\\\"command\\\":[\\\"/cni-install.sh\\\",\\\"--cni-exclusive=true\\\"]}},\\\"preStop\\\":{\\\"exec\\\":{\\\"command\\\":[\\\"/cni-uninstall.sh\\\"]}}},\\\"livenessProbe\\\":{\\\"failureThreshold\\\":10,\\\"httpGet\\\":{\\\"host\\\":\\\"127.0.0.1\\\",\\\"httpHeaders\\\":[{\\\"name\\\":\\\"brief\\\",\\\"value\\\":\\\"true\\\"}],\\\"path\\\":\\\"/healthz\\\",\\\"port\\\":9876,\\\"scheme\\\":\\\"HTTP\\\"},\\\"periodSeconds\\\":30,\\\"successThreshold\\\":1,\\\"timeoutSeconds\\\":5},\\\"name\\\":\\\"cilium-agent\\\",\\\"readinessProbe\\\":{\\\"failureThreshold\\\":3,\\\"httpGet\\\":{\\\"host\\\":\\\"127.0.0.1\\\",\\\"httpHeaders\\\":[{\\\"name\\\":\\\"brief\\\",\\\"value\\\":\\\"true\\\"}],\\\"path\\\":\\\"/healthz\\\",\\\"port\\\":9876,\\\"scheme\\\":\\\"HTTP\\\"},\\\"initialDelaySeconds\\\":5,\\\"periodSeconds\\\":30,\\\"successThreshold\\\":1,\\\"timeoutSeconds\\\":5},\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"25m\\\",\\\"memory\\\":\\\"128Mi\\\"}},\\\"securityContext\\\":{\\\"capabilities\\\":{\\\"add\\\":[\\\"NET_ADMIN\\\",\\\"SYS_MODULE\\\"]},\\\"privileged\\\":true},\\\"startupProbe\\\":{\\\"failureThreshold\\\":24,\\\"httpGet\\\":{\\\"host\\\":\\\"127.0.0.1\\\",\\\"httpHeaders\\\":[{\\\"name\\\":\\\"brief\\\",\\\"value\\\":\\\"true\\\"}],\\\"path\\\":\\\"/healthz\\\",\\\"port\\\":9876,\\\"scheme\\\":\\\"HTTP\\\"},\\\"periodSeconds\\\":2,\\\"successThreshold\\\":null},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/sys/fs/bpf\\\",\\\"name\\\":\\\"bpf-maps\\\"},{\\\"mountPath\\\":\\\"/var/run/cilium\\\",\\\"name\\\":\\\"cilium-run\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cni-path\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"etc-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cilium/clustermesh\\\",\\\"name\\\":\\\"clustermesh-secrets\\\",\\\"readOnly\\\":true},{\\\"mountPath\\\":\\\"/tmp/cilium/config-map\\\",\\\"name\\\":\\\"cilium-config-path\\\",\\\"readOnly\\\":true},{\\\"mountPath\\\":\\\"/lib/modules\\\",\\\"name\\\":\\\"lib-modules\\\",\\\"readOnly\\\":true},{\\\"mountPath\\\":\\\"/run/xtables.lock\\\",\\\"name\\\":\\\"xtables-lock\\\"}]}],\\\"hostNetwork\\\":true,\\\"initContainers\\\":[{\\\"command\\\":[\\\"/init-container.sh\\\"],\\\"env\\\":[{\\\"name\\\":\\\"CILIUM_ALL_STATE\\\",\\\"valueFrom\\\":{\\\"configMapKeyRef\\\":{\\\"key\\\":\\\"clean-cilium-state\\\",\\\"name\\\":\\\"cilium-config\\\",\\\"optional\\\":true}}},{\\\"name\\\":\\\"CILIUM_BPF_STATE\\\",\\\"valueFrom\\\":{\\\"configMapKeyRef\\\":{\\\"key\\\":\\\"clean-cilium-bpf-state\\\",\\\"name\\\":\\\"cilium-config\\\",\\\"optional\\\":true}}},{\\\"name\\\":\\\"CILIUM_WAIT_BPF_MOUNT\\\",\\\"valueFrom\\\":{\\\"configMapKeyRef\\\":{\\\"key\\\":\\\"wait-bpf-mount\\\",\\\"name\\\":\\\"cilium-config\\\",\\\"optional\\\":true}}}],\\\"image\\\":\\\"docker.io/cilium/cilium:v1.10.0\\\",\\\"imagePullPolicy\\\":\\\"IfNotPresent\\\",\\\"name\\\":\\\"clean-cilium-state\\\",\\\"resources\\\":{\\\"limits\\\":{\\\"memory\\\":\\\"100Mi\\\"},\\\"requests\\\":{\\\"cpu\\\":\\\"100m\\\",\\\"memory\\\":\\\"100Mi\\\"}},\\\"securityContext\\\":{\\\"capabilities\\\":{\\\"add\\\":[\\\"NET_ADMIN\\\"]},\\\"privileged\\\":true},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/sys/fs/bpf\\\",\\\"mountPropagation\\\":\\\"HostToContainer\\\",\\\"name\\\":\\\"bpf-maps\\\"},{\\\"mountPath\\\":\\\"/var/run/cilium\\\",\\\"name\\\":\\\"cilium-run\\\"}]}],\\\"priorityClassName\\\":\\\"system-node-critical\\\",\\\"restartPolicy\\\":\\\"Always\\\",\\\"serviceAccount\\\":\\\"cilium\\\",\\\"serviceAccountName\\\":\\\"cilium\\\",\\\"terminationGracePeriodSeconds\\\":1,\\\"tolerations\\\":[{\\\"operator\\\":\\\"Exists\\\"}],\\\"volumes\\\":[{\\\"hostPath\\\":{\\\"path\\\":\\\"/var/run/cilium\\\",\\\"type\\\":\\\"DirectoryOrCreate\\\"},\\\"name\\\":\\\"cilium-run\\\"},{\\\"hostPath\\\":{\\\"path\\\":\\\"/sys/fs/bpf\\\",\\\"type\\\":\\\"DirectoryOrCreate\\\"},\\\"name\\\":\\\"bpf-maps\\\"},{\\\"hostPath\\\":{\\\"path\\\":\\\"/opt/cni/bin\\\",\\\"type\\\":\\\"DirectoryOrCreate\\\"},\\\"name\\\":\\\"cni-path\\\"},{\\\"hostPath\\\":{\\\"path\\\":\\\"/etc/cni/net.d\\\",\\\"type\\\":\\\"DirectoryOrCreate\\\"},\\\"name\\\":\\\"etc-cni-netd\\\"},{\\\"hostPath\\\":{\\\"path\\\":\\\"/lib/modules\\\"},\\\"name\\\":\\\"lib-modules\\\"},{\\\"hostPath\\\":{\\\"path\\\":\\\"/run/xtables.lock\\\",\\\"type\\\":\\\"FileOrCreate\\\"},\\\"name\\\":\\\"xtables-lock\\\"},{\\\"name\\\":\\\"clustermesh-secrets\\\",\\\"secret\\\":{\\\"defaultMode\\\":420,\\\"optional\\\":true,\\\"secretName\\\":\\\"cilium-clustermesh\\\"}},{\\\"configMap\\\":{\\\"name\\\":\\\"cilium-config\\\"},\\\"name\\\":\\\"cilium-config-path\\\"}]}},\\\"updateStrategy\\\":{\\\"type\\\":\\\"OnDelete\\\"}}}\\n\"\n                }\n            },\n            \"spec\": {\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"cilium\",\n                        \"kubernetes.io/cluster-service\": \"true\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-app\": \"cilium\",\n                            \"kubernetes.io/cluster-service\": \"true\"\n                        },\n                        \"annotations\": {\n                            \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                        }\n                    },\n                    \"spec\": {\n                        \"volumes\": [\n                            {\n                                \"name\": \"cilium-run\",\n                                \"hostPath\": {\n                                    \"path\": \"/var/run/cilium\",\n                                    \"type\": \"DirectoryOrCreate\"\n                                }\n                            },\n                            {\n                                \"name\": \"bpf-maps\",\n                                \"hostPath\": {\n                                    \"path\": \"/sys/fs/bpf\",\n                                    \"type\": \"DirectoryOrCreate\"\n                                }\n                            },\n                            {\n                                \"name\": \"cni-path\",\n                                \"hostPath\": {\n                                    \"path\": \"/opt/cni/bin\",\n                                    \"type\": \"DirectoryOrCreate\"\n                                }\n                            },\n                            {\n                                \"name\": \"etc-cni-netd\",\n                                \"hostPath\": {\n                                    \"path\": \"/etc/cni/net.d\",\n                                    \"type\": \"DirectoryOrCreate\"\n                                }\n                            },\n                            {\n                                \"name\": \"lib-modules\",\n                                \"hostPath\": {\n                                    \"path\": \"/lib/modules\",\n                                    \"type\": \"\"\n                                }\n                            },\n                            {\n                                \"name\": \"xtables-lock\",\n                                \"hostPath\": {\n                                    \"path\": \"/run/xtables.lock\",\n                                    \"type\": \"FileOrCreate\"\n                                }\n                            },\n                            {\n                                \"name\": \"clustermesh-secrets\",\n                                \"secret\": {\n                                    \"secretName\": \"cilium-clustermesh\",\n                                    \"defaultMode\": 420,\n                                    \"optional\": true\n                                }\n                            },\n                            {\n                                \"name\": \"cilium-config-path\",\n                                \"configMap\": {\n                                    \"name\": \"cilium-config\",\n                                    \"defaultMode\": 420\n                                }\n                            }\n                        ],\n                        \"initContainers\": [\n                            {\n                                \"name\": \"clean-cilium-state\",\n                                \"image\": \"docker.io/cilium/cilium:v1.10.0\",\n                                \"command\": [\n                                    \"/init-container.sh\"\n                                ],\n                                \"env\": [\n                                    {\n                                        \"name\": \"CILIUM_ALL_STATE\",\n                                        \"valueFrom\": {\n                                            \"configMapKeyRef\": {\n                                                \"name\": \"cilium-config\",\n                                                \"key\": \"clean-cilium-state\",\n                                                \"optional\": true\n                                            }\n                                        }\n                                    },\n                                    {\n                                        \"name\": \"CILIUM_BPF_STATE\",\n                                        \"valueFrom\": {\n                                            \"configMapKeyRef\": {\n                                                \"name\": \"cilium-config\",\n                                                \"key\": \"clean-cilium-bpf-state\",\n                                                \"optional\": true\n                                            }\n                                        }\n                                    },\n                                    {\n                                        \"name\": \"CILIUM_WAIT_BPF_MOUNT\",\n                                        \"valueFrom\": {\n                                            \"configMapKeyRef\": {\n                                                \"name\": \"cilium-config\",\n                                                \"key\": \"wait-bpf-mount\",\n                                                \"optional\": true\n                                            }\n                                        }\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"limits\": {\n                                        \"memory\": \"100Mi\"\n                                    },\n                                    \"requests\": {\n                                        \"cpu\": \"100m\",\n                                        \"memory\": \"100Mi\"\n                                    }\n                                },\n                                \"volumeMounts\": [\n                                    {\n                                        \"name\": \"bpf-maps\",\n                                        \"mountPath\": \"/sys/fs/bpf\",\n                                        \"mountPropagation\": \"HostToContainer\"\n                                    },\n                                    {\n                                        \"name\": \"cilium-run\",\n                                        \"mountPath\": \"/var/run/cilium\"\n                                    }\n                                ],\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\",\n                                \"securityContext\": {\n                                    \"capabilities\": {\n                                        \"add\": [\n                                            \"NET_ADMIN\"\n                                        ]\n                                    },\n                                    \"privileged\": true\n                                }\n                            }\n                        ],\n                        \"containers\": [\n                            {\n                                \"name\": \"cilium-agent\",\n                                \"image\": \"docker.io/cilium/cilium:v1.10.0\",\n                                \"command\": [\n                                    \"cilium-agent\"\n                                ],\n                                \"args\": [\n                                    \"--config-dir=/tmp/cilium/config-map\"\n                                ],\n                                \"env\": [\n                                    {\n                                        \"name\": \"K8S_NODE_NAME\",\n                                        \"valueFrom\": {\n                                            \"fieldRef\": {\n                                                \"apiVersion\": \"v1\",\n                                                \"fieldPath\": \"spec.nodeName\"\n                                            }\n                                        }\n                                    },\n                                    {\n                                        \"name\": \"CILIUM_K8S_NAMESPACE\",\n                                        \"valueFrom\": {\n                                            \"fieldRef\": {\n                                                \"apiVersion\": \"v1\",\n                                                \"fieldPath\": \"metadata.namespace\"\n                                            }\n                                        }\n                                    },\n                                    {\n                                        \"name\": \"CILIUM_CLUSTERMESH_CONFIG\",\n                                        \"value\": \"/var/lib/cilium/clustermesh/\"\n                                    },\n                                    {\n                                        \"name\": \"CILIUM_CNI_CHAINING_MODE\",\n                                        \"valueFrom\": {\n                                            \"configMapKeyRef\": {\n                                                \"name\": \"cilium-config\",\n                                                \"key\": \"cni-chaining-mode\",\n                                                \"optional\": true\n                                            }\n                                        }\n                                    },\n                                    {\n                                        \"name\": \"CILIUM_CUSTOM_CNI_CONF\",\n                                        \"valueFrom\": {\n                                            \"configMapKeyRef\": {\n                                                \"name\": \"cilium-config\",\n                                                \"key\": \"custom-cni-conf\",\n                                                \"optional\": true\n                                            }\n                                        }\n                                    },\n                                    {\n                                        \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                        \"value\": \"api.internal.e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io\"\n                                    },\n                                    {\n                                        \"name\": \"KUBERNETES_SERVICE_PORT\",\n                                        \"value\": \"443\"\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"requests\": {\n                                        \"cpu\": \"25m\",\n                                        \"memory\": \"128Mi\"\n                                    }\n                                },\n                                \"volumeMounts\": [\n                                    {\n                                        \"name\": \"bpf-maps\",\n                                        \"mountPath\": \"/sys/fs/bpf\"\n                                    },\n                                    {\n                                        \"name\": \"cilium-run\",\n                                        \"mountPath\": \"/var/run/cilium\"\n                                    },\n                                    {\n                                        \"name\": \"cni-path\",\n                                        \"mountPath\": \"/host/opt/cni/bin\"\n                                    },\n                                    {\n                                        \"name\": \"etc-cni-netd\",\n                                        \"mountPath\": \"/host/etc/cni/net.d\"\n                                    },\n                                    {\n                                        \"name\": \"clustermesh-secrets\",\n                                        \"readOnly\": true,\n                                        \"mountPath\": \"/var/lib/cilium/clustermesh\"\n                                    },\n                                    {\n                                        \"name\": \"cilium-config-path\",\n                                        \"readOnly\": true,\n                                        \"mountPath\": \"/tmp/cilium/config-map\"\n                                    },\n                                    {\n                                        \"name\": \"lib-modules\",\n                                        \"readOnly\": true,\n                                        \"mountPath\": \"/lib/modules\"\n                                    },\n                                    {\n                                        \"name\": \"xtables-lock\",\n                                        \"mountPath\": \"/run/xtables.lock\"\n                                    }\n                                ],\n                                \"livenessProbe\": {\n                                    \"httpGet\": {\n                                        \"path\": \"/healthz\",\n                                        \"port\": 9876,\n                                        \"host\": \"127.0.0.1\",\n                                        \"scheme\": \"HTTP\",\n                                        \"httpHeaders\": [\n                                            {\n                                                \"name\": \"brief\",\n                                                \"value\": \"true\"\n                                            }\n                                        ]\n                                    },\n                                    \"timeoutSeconds\": 5,\n                                    \"periodSeconds\": 30,\n                                    \"successThreshold\": 1,\n                                    \"failureThreshold\": 10\n                                },\n                                \"readinessProbe\": {\n                                    \"httpGet\": {\n                                        \"path\": \"/healthz\",\n                                        \"port\": 9876,\n                                        \"host\": \"127.0.0.1\",\n                                        \"scheme\": \"HTTP\",\n                                        \"httpHeaders\": [\n                                            {\n                                                \"name\": \"brief\",\n                                                \"value\": \"true\"\n                                            }\n                                        ]\n                                    },\n                                    \"initialDelaySeconds\": 5,\n                                    \"timeoutSeconds\": 5,\n                                    \"periodSeconds\": 30,\n                                    \"successThreshold\": 1,\n                                    \"failureThreshold\": 3\n                                },\n                                \"startupProbe\": {\n                                    \"httpGet\": {\n                                        \"path\": \"/healthz\",\n                                        \"port\": 9876,\n                                        \"host\": \"127.0.0.1\",\n                                        \"scheme\": \"HTTP\",\n                                        \"httpHeaders\": [\n                                            {\n                                                \"name\": \"brief\",\n                                                \"value\": \"true\"\n                                            }\n                                        ]\n                                    },\n                                    \"timeoutSeconds\": 1,\n                                    \"periodSeconds\": 2,\n                                    \"successThreshold\": 1,\n                                    \"failureThreshold\": 24\n                                },\n                                \"lifecycle\": {\n                                    \"postStart\": {\n                                        \"exec\": {\n                                            \"command\": [\n                                                \"/cni-install.sh\",\n                                                \"--cni-exclusive=true\"\n                                            ]\n                                        }\n                                    },\n                                    \"preStop\": {\n                                        \"exec\": {\n                                            \"command\": [\n                                                \"/cni-uninstall.sh\"\n                                            ]\n                                        }\n                                    }\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\",\n                                \"securityContext\": {\n                                    \"capabilities\": {\n                                        \"add\": [\n                                            \"NET_ADMIN\",\n                                            \"SYS_MODULE\"\n                                        ]\n                                    },\n                                    \"privileged\": true\n                                }\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 1,\n                        \"dnsPolicy\": \"ClusterFirst\",\n                        \"serviceAccountName\": \"cilium\",\n                        \"serviceAccount\": \"cilium\",\n                        \"hostNetwork\": true,\n                        \"securityContext\": {},\n                        \"affinity\": {\n                            \"nodeAffinity\": {\n                                \"requiredDuringSchedulingIgnoredDuringExecution\": {\n                                    \"nodeSelectorTerms\": [\n                                        {\n                                            \"matchExpressions\": [\n                                                {\n                                                    \"key\": \"kubernetes.io/os\",\n                                                    \"operator\": \"In\",\n                                                    \"values\": [\n                                                        \"linux\"\n                                                    ]\n                                                }\n                                            ]\n                                        }\n                                    ]\n                                }\n                            },\n                            \"podAntiAffinity\": {\n                                \"requiredDuringSchedulingIgnoredDuringExecution\": [\n                                    {\n                                        \"labelSelector\": {\n                                            \"matchExpressions\": [\n                                                {\n                                                    \"key\": \"k8s-app\",\n                                                    \"operator\": \"In\",\n                                                    \"values\": [\n                                                        \"cilium\"\n                                                    ]\n                                                }\n                                            ]\n                                        },\n                                        \"topologyKey\": \"kubernetes.io/hostname\"\n                                    }\n                                ]\n                            }\n                        },\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-node-critical\"\n                    }\n                },\n                \"updateStrategy\": {\n                    \"type\": \"OnDelete\"\n                },\n                \"revisionHistoryLimit\": 10\n            },\n            \"status\": {\n                \"currentNumberScheduled\": 5,\n                \"numberMisscheduled\": 0,\n                \"desiredNumberScheduled\": 5,\n                \"numberReady\": 5,\n                \"observedGeneration\": 1,\n                \"updatedNumberScheduled\": 5,\n                \"numberAvailable\": 5\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"1381c6f6-e92f-4b7a-b5f0-38756ff58a47\",\n                \"resourceVersion\": \"500\",\n                \"generation\": 1,\n                \"creationTimestamp\": \"2021-06-05T07:07:43Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"kops-controller.addons.k8s.io\",\n                    \"addon.kops.k8s.io/version\": \"1.22.0-alpha.1\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"k8s-addon\": \"kops-controller.addons.k8s.io\",\n                    \"k8s-app\": \"kops-controller\",\n                    \"version\": \"v1.22.0-alpha.1\"\n                },\n                \"annotations\": {\n                    \"deprecated.daemonset.template.generation\": \"1\",\n                    \"kubectl.kubernetes.io/last-applied-configuration\": \"{\\\"apiVersion\\\":\\\"apps/v1\\\",\\\"kind\\\":\\\"DaemonSet\\\",\\\"metadata\\\":{\\\"annotations\\\":{},\\\"creationTimestamp\\\":null,\\\"labels\\\":{\\\"addon.kops.k8s.io/name\\\":\\\"kops-controller.addons.k8s.io\\\",\\\"addon.kops.k8s.io/version\\\":\\\"1.22.0-alpha.1\\\",\\\"app.kubernetes.io/managed-by\\\":\\\"kops\\\",\\\"k8s-addon\\\":\\\"kops-controller.addons.k8s.io\\\",\\\"k8s-app\\\":\\\"kops-controller\\\",\\\"version\\\":\\\"v1.22.0-alpha.1\\\"},\\\"name\\\":\\\"kops-controller\\\",\\\"namespace\\\":\\\"kube-system\\\"},\\\"spec\\\":{\\\"selector\\\":{\\\"matchLabels\\\":{\\\"k8s-app\\\":\\\"kops-controller\\\"}},\\\"template\\\":{\\\"metadata\\\":{\\\"annotations\\\":{\\\"dns.alpha.kubernetes.io/internal\\\":\\\"kops-controller.internal.e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io\\\"},\\\"labels\\\":{\\\"k8s-addon\\\":\\\"kops-controller.addons.k8s.io\\\",\\\"k8s-app\\\":\\\"kops-controller\\\",\\\"version\\\":\\\"v1.22.0-alpha.1\\\"}},\\\"spec\\\":{\\\"containers\\\":[{\\\"command\\\":[\\\"/kops-controller\\\",\\\"--v=2\\\",\\\"--conf=/etc/kubernetes/kops-controller/config/config.yaml\\\"],\\\"env\\\":[{\\\"name\\\":\\\"KUBERNETES_SERVICE_HOST\\\",\\\"value\\\":\\\"127.0.0.1\\\"}],\\\"image\\\":\\\"k8s.gcr.io/kops/kops-controller:1.22.0-alpha.1\\\",\\\"name\\\":\\\"kops-controller\\\",\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"50m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"securityContext\\\":{\\\"runAsNonRoot\\\":true},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/kops-controller/config/\\\",\\\"name\\\":\\\"kops-controller-config\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/kops-controller/pki/\\\",\\\"name\\\":\\\"kops-controller-pki\\\"}]}],\\\"dnsPolicy\\\":\\\"Default\\\",\\\"hostNetwork\\\":true,\\\"nodeSelector\\\":{\\\"kops.k8s.io/kops-controller-pki\\\":\\\"\\\",\\\"node-role.kubernetes.io/master\\\":\\\"\\\"},\\\"priorityClassName\\\":\\\"system-node-critical\\\",\\\"serviceAccount\\\":\\\"kops-controller\\\",\\\"tolerations\\\":[{\\\"key\\\":\\\"node-role.kubernetes.io/master\\\",\\\"operator\\\":\\\"Exists\\\"}],\\\"volumes\\\":[{\\\"configMap\\\":{\\\"name\\\":\\\"kops-controller\\\"},\\\"name\\\":\\\"kops-controller-config\\\"},{\\\"hostPath\\\":{\\\"path\\\":\\\"/etc/kubernetes/kops-controller/\\\",\\\"type\\\":\\\"Directory\\\"},\\\"name\\\":\\\"kops-controller-pki\\\"}]}},\\\"updateStrategy\\\":{\\\"type\\\":\\\"OnDelete\\\"}}}\\n\"\n                }\n            },\n            \"spec\": {\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"kops-controller\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-addon\": \"kops-controller.addons.k8s.io\",\n                            \"k8s-app\": \"kops-controller\",\n                            \"version\": \"v1.22.0-alpha.1\"\n                        },\n                        \"annotations\": {\n                            \"dns.alpha.kubernetes.io/internal\": \"kops-controller.internal.e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io\"\n                        }\n                    },\n                    \"spec\": {\n                        \"volumes\": [\n                            {\n                                \"name\": \"kops-controller-config\",\n                                \"configMap\": {\n                                    \"name\": \"kops-controller\",\n                                    \"defaultMode\": 420\n                                }\n                            },\n                            {\n                                \"name\": \"kops-controller-pki\",\n                                \"hostPath\": {\n                                    \"path\": \"/etc/kubernetes/kops-controller/\",\n                                    \"type\": \"Directory\"\n                                }\n                            }\n                        ],\n                        \"containers\": [\n                            {\n                                \"name\": \"kops-controller\",\n                                \"image\": \"k8s.gcr.io/kops/kops-controller:1.22.0-alpha.1\",\n                                \"command\": [\n                                    \"/kops-controller\",\n                                    \"--v=2\",\n                                    \"--conf=/etc/kubernetes/kops-controller/config/config.yaml\"\n                                ],\n                                \"env\": [\n                                    {\n                                        \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                        \"value\": \"127.0.0.1\"\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"requests\": {\n                                        \"cpu\": \"50m\",\n                                        \"memory\": \"50Mi\"\n                                    }\n                                },\n                                \"volumeMounts\": [\n                                    {\n                                        \"name\": \"kops-controller-config\",\n                                        \"mountPath\": \"/etc/kubernetes/kops-controller/config/\"\n                                    },\n                                    {\n                                        \"name\": \"kops-controller-pki\",\n                                        \"mountPath\": \"/etc/kubernetes/kops-controller/pki/\"\n                                    }\n                                ],\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\",\n                                \"securityContext\": {\n                                    \"runAsNonRoot\": true\n                                }\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"Default\",\n                        \"nodeSelector\": {\n                            \"kops.k8s.io/kops-controller-pki\": \"\",\n                            \"node-role.kubernetes.io/master\": \"\"\n                        },\n                        \"serviceAccountName\": \"kops-controller\",\n                        \"serviceAccount\": \"kops-controller\",\n                        \"hostNetwork\": true,\n                        \"securityContext\": {},\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"key\": \"node-role.kubernetes.io/master\",\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-node-critical\"\n                    }\n                },\n                \"updateStrategy\": {\n                    \"type\": \"OnDelete\"\n                },\n                \"revisionHistoryLimit\": 10\n            },\n            \"status\": {\n                \"currentNumberScheduled\": 1,\n                \"numberMisscheduled\": 0,\n                \"desiredNumberScheduled\": 1,\n                \"numberReady\": 1,\n                \"observedGeneration\": 1,\n                \"updatedNumberScheduled\": 1,\n                \"numberAvailable\": 1\n            }\n        }\n    ]\n}\n{\n    \"kind\": \"DeploymentList\",\n    \"apiVersion\": \"apps/v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"9566\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"cilium-operator\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"9235bb2b-6d9c-4050-9457-5fc9f21d00a9\",\n                \"resourceVersion\": \"728\",\n                \"generation\": 1,\n                \"creationTimestamp\": \"2021-06-05T07:07:43Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"networking.cilium.io\",\n                    \"addon.kops.k8s.io/version\": \"1.10.0-kops.1\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"io.cilium/app\": \"operator\",\n                    \"name\": \"cilium-operator\",\n                    \"role.kubernetes.io/networking\": \"1\"\n                },\n                \"annotations\": {\n                    \"deployment.kubernetes.io/revision\": \"1\",\n                    \"kubectl.kubernetes.io/last-applied-configuration\": \"{\\\"apiVersion\\\":\\\"apps/v1\\\",\\\"kind\\\":\\\"Deployment\\\",\\\"metadata\\\":{\\\"annotations\\\":{},\\\"creationTimestamp\\\":null,\\\"labels\\\":{\\\"addon.kops.k8s.io/name\\\":\\\"networking.cilium.io\\\",\\\"addon.kops.k8s.io/version\\\":\\\"1.10.0-kops.1\\\",\\\"app.kubernetes.io/managed-by\\\":\\\"kops\\\",\\\"io.cilium/app\\\":\\\"operator\\\",\\\"name\\\":\\\"cilium-operator\\\",\\\"role.kubernetes.io/networking\\\":\\\"1\\\"},\\\"name\\\":\\\"cilium-operator\\\",\\\"namespace\\\":\\\"kube-system\\\"},\\\"spec\\\":{\\\"replicas\\\":1,\\\"selector\\\":{\\\"matchLabels\\\":{\\\"io.cilium/app\\\":\\\"operator\\\",\\\"name\\\":\\\"cilium-operator\\\"}},\\\"strategy\\\":{\\\"rollingUpdate\\\":{\\\"maxSurge\\\":1,\\\"maxUnavailable\\\":1},\\\"type\\\":\\\"RollingUpdate\\\"},\\\"template\\\":{\\\"metadata\\\":{\\\"labels\\\":{\\\"io.cilium/app\\\":\\\"operator\\\",\\\"name\\\":\\\"cilium-operator\\\"}},\\\"spec\\\":{\\\"containers\\\":[{\\\"args\\\":[\\\"--config-dir=/tmp/cilium/config-map\\\",\\\"--debug=$(CILIUM_DEBUG)\\\",\\\"--eni-tags=KubernetesCluster=e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io\\\"],\\\"command\\\":[\\\"cilium-operator\\\"],\\\"env\\\":[{\\\"name\\\":\\\"K8S_NODE_NAME\\\",\\\"valueFrom\\\":{\\\"fieldRef\\\":{\\\"apiVersion\\\":\\\"v1\\\",\\\"fieldPath\\\":\\\"spec.nodeName\\\"}}},{\\\"name\\\":\\\"CILIUM_K8S_NAMESPACE\\\",\\\"valueFrom\\\":{\\\"fieldRef\\\":{\\\"apiVersion\\\":\\\"v1\\\",\\\"fieldPath\\\":\\\"metadata.namespace\\\"}}},{\\\"name\\\":\\\"CILIUM_DEBUG\\\",\\\"valueFrom\\\":{\\\"configMapKeyRef\\\":{\\\"key\\\":\\\"debug\\\",\\\"name\\\":\\\"cilium-config\\\",\\\"optional\\\":true}}},{\\\"name\\\":\\\"KUBERNETES_SERVICE_HOST\\\",\\\"value\\\":\\\"api.internal.e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io\\\"},{\\\"name\\\":\\\"KUBERNETES_SERVICE_PORT\\\",\\\"value\\\":\\\"443\\\"}],\\\"image\\\":\\\"docker.io/cilium/operator:v1.10.0\\\",\\\"imagePullPolicy\\\":\\\"IfNotPresent\\\",\\\"livenessProbe\\\":{\\\"httpGet\\\":{\\\"host\\\":\\\"127.0.0.1\\\",\\\"path\\\":\\\"/healthz\\\",\\\"port\\\":9234,\\\"scheme\\\":\\\"HTTP\\\"},\\\"initialDelaySeconds\\\":60,\\\"periodSeconds\\\":10,\\\"timeoutSeconds\\\":3},\\\"name\\\":\\\"cilium-operator\\\",\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"25m\\\",\\\"memory\\\":\\\"128Mi\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp/cilium/config-map\\\",\\\"name\\\":\\\"cilium-config-path\\\",\\\"readOnly\\\":true}]}],\\\"hostNetwork\\\":true,\\\"nodeSelector\\\":{\\\"node-role.kubernetes.io/master\\\":\\\"\\\"},\\\"priorityClassName\\\":\\\"system-cluster-critical\\\",\\\"restartPolicy\\\":\\\"Always\\\",\\\"serviceAccount\\\":\\\"cilium-operator\\\",\\\"serviceAccountName\\\":\\\"cilium-operator\\\",\\\"tolerations\\\":[{\\\"operator\\\":\\\"Exists\\\"}],\\\"volumes\\\":[{\\\"configMap\\\":{\\\"name\\\":\\\"cilium-config\\\"},\\\"name\\\":\\\"cilium-config-path\\\"}]}}}}\\n\"\n                }\n            },\n            \"spec\": {\n                \"replicas\": 1,\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"io.cilium/app\": \"operator\",\n                        \"name\": \"cilium-operator\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"io.cilium/app\": \"operator\",\n                            \"name\": \"cilium-operator\"\n                        }\n                    },\n                    \"spec\": {\n                        \"volumes\": [\n                            {\n                                \"name\": \"cilium-config-path\",\n                                \"configMap\": {\n                                    \"name\": \"cilium-config\",\n                                    \"defaultMode\": 420\n                                }\n                            }\n                        ],\n                        \"containers\": [\n                            {\n                                \"name\": \"cilium-operator\",\n                                \"image\": \"docker.io/cilium/operator:v1.10.0\",\n                                \"command\": [\n                                    \"cilium-operator\"\n                                ],\n                                \"args\": [\n                                    \"--config-dir=/tmp/cilium/config-map\",\n                                    \"--debug=$(CILIUM_DEBUG)\",\n                                    \"--eni-tags=KubernetesCluster=e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io\"\n                                ],\n                                \"env\": [\n                                    {\n                                        \"name\": \"K8S_NODE_NAME\",\n                                        \"valueFrom\": {\n                                            \"fieldRef\": {\n                                                \"apiVersion\": \"v1\",\n                                                \"fieldPath\": \"spec.nodeName\"\n                                            }\n                                        }\n                                    },\n                                    {\n                                        \"name\": \"CILIUM_K8S_NAMESPACE\",\n                                        \"valueFrom\": {\n                                            \"fieldRef\": {\n                                                \"apiVersion\": \"v1\",\n                                                \"fieldPath\": \"metadata.namespace\"\n                                            }\n                                        }\n                                    },\n                                    {\n                                        \"name\": \"CILIUM_DEBUG\",\n                                        \"valueFrom\": {\n                                            \"configMapKeyRef\": {\n                                                \"name\": \"cilium-config\",\n                                                \"key\": \"debug\",\n                                                \"optional\": true\n                                            }\n                                        }\n                                    },\n                                    {\n                                        \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                        \"value\": \"api.internal.e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io\"\n                                    },\n                                    {\n                                        \"name\": \"KUBERNETES_SERVICE_PORT\",\n                                        \"value\": \"443\"\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"requests\": {\n                                        \"cpu\": \"25m\",\n                                        \"memory\": \"128Mi\"\n                                    }\n                                },\n                                \"volumeMounts\": [\n                                    {\n                                        \"name\": \"cilium-config-path\",\n                                        \"readOnly\": true,\n                                        \"mountPath\": \"/tmp/cilium/config-map\"\n                                    }\n                                ],\n                                \"livenessProbe\": {\n                                    \"httpGet\": {\n                                        \"path\": \"/healthz\",\n                                        \"port\": 9234,\n                                        \"host\": \"127.0.0.1\",\n                                        \"scheme\": \"HTTP\"\n                                    },\n                                    \"initialDelaySeconds\": 60,\n                                    \"timeoutSeconds\": 3,\n                                    \"periodSeconds\": 10,\n                                    \"successThreshold\": 1,\n                                    \"failureThreshold\": 3\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\"\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"ClusterFirst\",\n                        \"nodeSelector\": {\n                            \"node-role.kubernetes.io/master\": \"\"\n                        },\n                        \"serviceAccountName\": \"cilium-operator\",\n                        \"serviceAccount\": \"cilium-operator\",\n                        \"hostNetwork\": true,\n                        \"securityContext\": {},\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\"\n                    }\n                },\n                \"strategy\": {\n                    \"type\": \"RollingUpdate\",\n                    \"rollingUpdate\": {\n                        \"maxUnavailable\": 1,\n                        \"maxSurge\": 1\n                    }\n                },\n                \"revisionHistoryLimit\": 10,\n                \"progressDeadlineSeconds\": 600\n            },\n            \"status\": {\n                \"observedGeneration\": 1,\n                \"replicas\": 1,\n                \"updatedReplicas\": 1,\n                \"readyReplicas\": 1,\n                \"availableReplicas\": 1,\n                \"conditions\": [\n                    {\n                        \"type\": \"Available\",\n                        \"status\": \"True\",\n                        \"lastUpdateTime\": \"2021-06-05T07:07:51Z\",\n                        \"lastTransitionTime\": \"2021-06-05T07:07:51Z\",\n                        \"reason\": \"MinimumReplicasAvailable\",\n                        \"message\": \"Deployment has minimum availability.\"\n                    },\n                    {\n                        \"type\": \"Progressing\",\n                        \"status\": \"True\",\n                        \"lastUpdateTime\": \"2021-06-05T07:08:04Z\",\n                        \"lastTransitionTime\": \"2021-06-05T07:07:51Z\",\n                        \"reason\": \"NewReplicaSetAvailable\",\n                        \"message\": \"ReplicaSet \\\"cilium-operator-794454784c\\\" has successfully progressed.\"\n                    }\n                ]\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"fe4b9906-7979-43c9-ae09-b031aa40e403\",\n                \"resourceVersion\": \"916\",\n                \"generation\": 2,\n                \"creationTimestamp\": \"2021-06-05T07:07:40Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"coredns.addons.k8s.io\",\n                    \"addon.kops.k8s.io/version\": \"1.8.3-kops.3\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"k8s-addon\": \"coredns.addons.k8s.io\",\n                    \"k8s-app\": \"kube-dns\",\n                    \"kubernetes.io/cluster-service\": \"true\",\n                    \"kubernetes.io/name\": \"CoreDNS\"\n                },\n                \"annotations\": {\n                    \"deployment.kubernetes.io/revision\": \"1\",\n                    \"kubectl.kubernetes.io/last-applied-configuration\": \"{\\\"apiVersion\\\":\\\"apps/v1\\\",\\\"kind\\\":\\\"Deployment\\\",\\\"metadata\\\":{\\\"annotations\\\":{},\\\"creationTimestamp\\\":null,\\\"labels\\\":{\\\"addon.kops.k8s.io/name\\\":\\\"coredns.addons.k8s.io\\\",\\\"addon.kops.k8s.io/version\\\":\\\"1.8.3-kops.3\\\",\\\"app.kubernetes.io/managed-by\\\":\\\"kops\\\",\\\"k8s-addon\\\":\\\"coredns.addons.k8s.io\\\",\\\"k8s-app\\\":\\\"kube-dns\\\",\\\"kubernetes.io/cluster-service\\\":\\\"true\\\",\\\"kubernetes.io/name\\\":\\\"CoreDNS\\\"},\\\"name\\\":\\\"coredns\\\",\\\"namespace\\\":\\\"kube-system\\\"},\\\"spec\\\":{\\\"selector\\\":{\\\"matchLabels\\\":{\\\"k8s-app\\\":\\\"kube-dns\\\"}},\\\"strategy\\\":{\\\"rollingUpdate\\\":{\\\"maxSurge\\\":\\\"10%\\\",\\\"maxUnavailable\\\":1},\\\"type\\\":\\\"RollingUpdate\\\"},\\\"template\\\":{\\\"metadata\\\":{\\\"labels\\\":{\\\"k8s-app\\\":\\\"kube-dns\\\"}},\\\"spec\\\":{\\\"affinity\\\":{\\\"podAntiAffinity\\\":{\\\"preferredDuringSchedulingIgnoredDuringExecution\\\":[{\\\"podAffinityTerm\\\":{\\\"labelSelector\\\":{\\\"matchExpressions\\\":[{\\\"key\\\":\\\"k8s-app\\\",\\\"operator\\\":\\\"In\\\",\\\"values\\\":[\\\"kube-dns\\\"]}]},\\\"topologyKey\\\":\\\"kubernetes.io/hostname\\\"},\\\"weight\\\":100}]}},\\\"containers\\\":[{\\\"args\\\":[\\\"-conf\\\",\\\"/etc/coredns/Corefile\\\"],\\\"image\\\":\\\"coredns/coredns:1.8.3\\\",\\\"imagePullPolicy\\\":\\\"IfNotPresent\\\",\\\"livenessProbe\\\":{\\\"failureThreshold\\\":5,\\\"httpGet\\\":{\\\"path\\\":\\\"/health\\\",\\\"port\\\":8080,\\\"scheme\\\":\\\"HTTP\\\"},\\\"initialDelaySeconds\\\":60,\\\"successThreshold\\\":1,\\\"timeoutSeconds\\\":5},\\\"name\\\":\\\"coredns\\\",\\\"ports\\\":[{\\\"containerPort\\\":53,\\\"name\\\":\\\"dns\\\",\\\"protocol\\\":\\\"UDP\\\"},{\\\"containerPort\\\":53,\\\"name\\\":\\\"dns-tcp\\\",\\\"protocol\\\":\\\"TCP\\\"},{\\\"containerPort\\\":9153,\\\"name\\\":\\\"metrics\\\",\\\"protocol\\\":\\\"TCP\\\"}],\\\"readinessProbe\\\":{\\\"httpGet\\\":{\\\"path\\\":\\\"/ready\\\",\\\"port\\\":8181,\\\"scheme\\\":\\\"HTTP\\\"}},\\\"resources\\\":{\\\"limits\\\":{\\\"memory\\\":\\\"170Mi\\\"},\\\"requests\\\":{\\\"cpu\\\":\\\"100m\\\",\\\"memory\\\":\\\"70Mi\\\"}},\\\"securityContext\\\":{\\\"allowPrivilegeEscalation\\\":false,\\\"capabilities\\\":{\\\"add\\\":[\\\"NET_BIND_SERVICE\\\"],\\\"drop\\\":[\\\"all\\\"]},\\\"readOnlyRootFilesystem\\\":true},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/coredns\\\",\\\"name\\\":\\\"config-volume\\\",\\\"readOnly\\\":true}]}],\\\"dnsPolicy\\\":\\\"Default\\\",\\\"nodeSelector\\\":{\\\"beta.kubernetes.io/os\\\":\\\"linux\\\"},\\\"priorityClassName\\\":\\\"system-cluster-critical\\\",\\\"serviceAccountName\\\":\\\"coredns\\\",\\\"tolerations\\\":[{\\\"key\\\":\\\"CriticalAddonsOnly\\\",\\\"operator\\\":\\\"Exists\\\"}],\\\"volumes\\\":[{\\\"configMap\\\":{\\\"items\\\":[{\\\"key\\\":\\\"Corefile\\\",\\\"path\\\":\\\"Corefile\\\"}],\\\"name\\\":\\\"coredns\\\"},\\\"name\\\":\\\"config-volume\\\"}]}}}}\\n\"\n                }\n            },\n            \"spec\": {\n                \"replicas\": 2,\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"kube-dns\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-app\": \"kube-dns\"\n                        }\n                    },\n                    \"spec\": {\n                        \"volumes\": [\n                            {\n                                \"name\": \"config-volume\",\n                                \"configMap\": {\n                                    \"name\": \"coredns\",\n                                    \"items\": [\n                                        {\n                                            \"key\": \"Corefile\",\n                                            \"path\": \"Corefile\"\n                                        }\n                                    ],\n                                    \"defaultMode\": 420\n                                }\n                            }\n                        ],\n                        \"containers\": [\n                            {\n                                \"name\": \"coredns\",\n                                \"image\": \"coredns/coredns:1.8.3\",\n                                \"args\": [\n                                    \"-conf\",\n                                    \"/etc/coredns/Corefile\"\n                                ],\n                                \"ports\": [\n                                    {\n                                        \"name\": \"dns\",\n                                        \"containerPort\": 53,\n                                        \"protocol\": \"UDP\"\n                                    },\n                                    {\n                                        \"name\": \"dns-tcp\",\n                                        \"containerPort\": 53,\n                                        \"protocol\": \"TCP\"\n                                    },\n                                    {\n                                        \"name\": \"metrics\",\n                                        \"containerPort\": 9153,\n                                        \"protocol\": \"TCP\"\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"limits\": {\n                                        \"memory\": \"170Mi\"\n                                    },\n                                    \"requests\": {\n                                        \"cpu\": \"100m\",\n                                        \"memory\": \"70Mi\"\n                                    }\n                                },\n                                \"volumeMounts\": [\n                                    {\n                                        \"name\": \"config-volume\",\n                                        \"readOnly\": true,\n                                        \"mountPath\": \"/etc/coredns\"\n                                    }\n                                ],\n                                \"livenessProbe\": {\n                                    \"httpGet\": {\n                                        \"path\": \"/health\",\n                                        \"port\": 8080,\n                                        \"scheme\": \"HTTP\"\n                                    },\n                                    \"initialDelaySeconds\": 60,\n                                    \"timeoutSeconds\": 5,\n                                    \"periodSeconds\": 10,\n                                    \"successThreshold\": 1,\n                                    \"failureThreshold\": 5\n                                },\n                                \"readinessProbe\": {\n                                    \"httpGet\": {\n                                        \"path\": \"/ready\",\n                                        \"port\": 8181,\n                                        \"scheme\": \"HTTP\"\n                                    },\n                                    \"timeoutSeconds\": 1,\n                                    \"periodSeconds\": 10,\n                                    \"successThreshold\": 1,\n                                    \"failureThreshold\": 3\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\",\n                                \"securityContext\": {\n                                    \"capabilities\": {\n                                        \"add\": [\n                                            \"NET_BIND_SERVICE\"\n                                        ],\n                                        \"drop\": [\n                                            \"all\"\n                                        ]\n                                    },\n                                    \"readOnlyRootFilesystem\": true,\n                                    \"allowPrivilegeEscalation\": false\n                                }\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"Default\",\n                        \"nodeSelector\": {\n                            \"beta.kubernetes.io/os\": \"linux\"\n                        },\n                        \"serviceAccountName\": \"coredns\",\n                        \"serviceAccount\": \"coredns\",\n                        \"securityContext\": {},\n                        \"affinity\": {\n                            \"podAntiAffinity\": {\n                                \"preferredDuringSchedulingIgnoredDuringExecution\": [\n                                    {\n                                        \"weight\": 100,\n                                        \"podAffinityTerm\": {\n                                            \"labelSelector\": {\n                                                \"matchExpressions\": [\n                                                    {\n                                                        \"key\": \"k8s-app\",\n                                                        \"operator\": \"In\",\n                                                        \"values\": [\n                                                            \"kube-dns\"\n                                                        ]\n                                                    }\n                                                ]\n                                            },\n                                            \"topologyKey\": \"kubernetes.io/hostname\"\n                                        }\n                                    }\n                                ]\n                            }\n                        },\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"key\": \"CriticalAddonsOnly\",\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\"\n                    }\n                },\n                \"strategy\": {\n                    \"type\": \"RollingUpdate\",\n                    \"rollingUpdate\": {\n                        \"maxUnavailable\": 1,\n                        \"maxSurge\": \"10%\"\n                    }\n                },\n                \"revisionHistoryLimit\": 10,\n                \"progressDeadlineSeconds\": 600\n            },\n            \"status\": {\n                \"observedGeneration\": 2,\n                \"replicas\": 2,\n                \"updatedReplicas\": 2,\n                \"readyReplicas\": 2,\n                \"availableReplicas\": 2,\n                \"conditions\": [\n                    {\n                        \"type\": \"Available\",\n                        \"status\": \"True\",\n                        \"lastUpdateTime\": \"2021-06-05T07:07:51Z\",\n                        \"lastTransitionTime\": \"2021-06-05T07:07:51Z\",\n                        \"reason\": \"MinimumReplicasAvailable\",\n                        \"message\": \"Deployment has minimum availability.\"\n                    },\n                    {\n                        \"type\": \"Progressing\",\n                        \"status\": \"True\",\n                        \"lastUpdateTime\": \"2021-06-05T07:09:32Z\",\n                        \"lastTransitionTime\": \"2021-06-05T07:07:51Z\",\n                        \"reason\": \"NewReplicaSetAvailable\",\n                        \"message\": \"ReplicaSet \\\"coredns-f45c4bf76\\\" has successfully progressed.\"\n                    }\n                ]\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"45fcec6f-a566-4e3b-a5fa-a0507cedee8a\",\n                \"resourceVersion\": \"877\",\n                \"generation\": 1,\n                \"creationTimestamp\": \"2021-06-05T07:07:40Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"coredns.addons.k8s.io\",\n                    \"addon.kops.k8s.io/version\": \"1.8.3-kops.3\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"k8s-addon\": \"coredns.addons.k8s.io\",\n                    \"k8s-app\": \"coredns-autoscaler\",\n                    \"kubernetes.io/cluster-service\": \"true\"\n                },\n                \"annotations\": {\n                    \"deployment.kubernetes.io/revision\": \"1\",\n                    \"kubectl.kubernetes.io/last-applied-configuration\": \"{\\\"apiVersion\\\":\\\"apps/v1\\\",\\\"kind\\\":\\\"Deployment\\\",\\\"metadata\\\":{\\\"annotations\\\":{},\\\"creationTimestamp\\\":null,\\\"labels\\\":{\\\"addon.kops.k8s.io/name\\\":\\\"coredns.addons.k8s.io\\\",\\\"addon.kops.k8s.io/version\\\":\\\"1.8.3-kops.3\\\",\\\"app.kubernetes.io/managed-by\\\":\\\"kops\\\",\\\"k8s-addon\\\":\\\"coredns.addons.k8s.io\\\",\\\"k8s-app\\\":\\\"coredns-autoscaler\\\",\\\"kubernetes.io/cluster-service\\\":\\\"true\\\"},\\\"name\\\":\\\"coredns-autoscaler\\\",\\\"namespace\\\":\\\"kube-system\\\"},\\\"spec\\\":{\\\"selector\\\":{\\\"matchLabels\\\":{\\\"k8s-app\\\":\\\"coredns-autoscaler\\\"}},\\\"template\\\":{\\\"metadata\\\":{\\\"annotations\\\":{\\\"scheduler.alpha.kubernetes.io/critical-pod\\\":\\\"\\\"},\\\"labels\\\":{\\\"k8s-app\\\":\\\"coredns-autoscaler\\\"}},\\\"spec\\\":{\\\"containers\\\":[{\\\"command\\\":[\\\"/cluster-proportional-autoscaler\\\",\\\"--namespace=kube-system\\\",\\\"--configmap=coredns-autoscaler\\\",\\\"--target=Deployment/coredns\\\",\\\"--default-params={\\\\\\\"linear\\\\\\\":{\\\\\\\"coresPerReplica\\\\\\\":256,\\\\\\\"nodesPerReplica\\\\\\\":16,\\\\\\\"preventSinglePointFailure\\\\\\\":true}}\\\",\\\"--logtostderr=true\\\",\\\"--v=2\\\"],\\\"image\\\":\\\"k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.3\\\",\\\"name\\\":\\\"autoscaler\\\",\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"10Mi\\\"}}}],\\\"priorityClassName\\\":\\\"system-cluster-critical\\\",\\\"serviceAccountName\\\":\\\"coredns-autoscaler\\\",\\\"tolerations\\\":[{\\\"key\\\":\\\"CriticalAddonsOnly\\\",\\\"operator\\\":\\\"Exists\\\"}]}}}}\\n\"\n                }\n            },\n            \"spec\": {\n                \"replicas\": 1,\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"coredns-autoscaler\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-app\": \"coredns-autoscaler\"\n                        },\n                        \"annotations\": {\n                            \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                        }\n                    },\n                    \"spec\": {\n                        \"containers\": [\n                            {\n                                \"name\": \"autoscaler\",\n                                \"image\": \"k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.3\",\n                                \"command\": [\n                                    \"/cluster-proportional-autoscaler\",\n                                    \"--namespace=kube-system\",\n                                    \"--configmap=coredns-autoscaler\",\n                                    \"--target=Deployment/coredns\",\n                                    \"--default-params={\\\"linear\\\":{\\\"coresPerReplica\\\":256,\\\"nodesPerReplica\\\":16,\\\"preventSinglePointFailure\\\":true}}\",\n                                    \"--logtostderr=true\",\n                                    \"--v=2\"\n                                ],\n                                \"resources\": {\n                                    \"requests\": {\n                                        \"cpu\": \"20m\",\n                                        \"memory\": \"10Mi\"\n                                    }\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\"\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"ClusterFirst\",\n                        \"serviceAccountName\": \"coredns-autoscaler\",\n                        \"serviceAccount\": \"coredns-autoscaler\",\n                        \"securityContext\": {},\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"key\": \"CriticalAddonsOnly\",\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\"\n                    }\n                },\n                \"strategy\": {\n                    \"type\": \"RollingUpdate\",\n                    \"rollingUpdate\": {\n                        \"maxUnavailable\": \"25%\",\n                        \"maxSurge\": \"25%\"\n                    }\n                },\n                \"revisionHistoryLimit\": 10,\n                \"progressDeadlineSeconds\": 600\n            },\n            \"status\": {\n                \"observedGeneration\": 1,\n                \"replicas\": 1,\n                \"updatedReplicas\": 1,\n                \"readyReplicas\": 1,\n                \"availableReplicas\": 1,\n                \"conditions\": [\n                    {\n                        \"type\": \"Available\",\n                        \"status\": \"True\",\n                        \"lastUpdateTime\": \"2021-06-05T07:09:32Z\",\n                        \"lastTransitionTime\": \"2021-06-05T07:09:32Z\",\n                        \"reason\": \"MinimumReplicasAvailable\",\n                        \"message\": \"Deployment has minimum availability.\"\n                    },\n                    {\n                        \"type\": \"Progressing\",\n                        \"status\": \"True\",\n                        \"lastUpdateTime\": \"2021-06-05T07:09:32Z\",\n                        \"lastTransitionTime\": \"2021-06-05T07:07:51Z\",\n                        \"reason\": \"NewReplicaSetAvailable\",\n                        \"message\": \"ReplicaSet \\\"coredns-autoscaler-6f594f4c58\\\" has successfully progressed.\"\n                    }\n                ]\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"fc408104-db62-47f5-a406-ab703372e22f\",\n                \"resourceVersion\": \"472\",\n                \"generation\": 1,\n                \"creationTimestamp\": \"2021-06-05T07:07:41Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"dns-controller.addons.k8s.io\",\n                    \"addon.kops.k8s.io/version\": \"1.22.0-alpha.1\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"k8s-addon\": \"dns-controller.addons.k8s.io\",\n                    \"k8s-app\": \"dns-controller\",\n                    \"version\": \"v1.22.0-alpha.1\"\n                },\n                \"annotations\": {\n                    \"deployment.kubernetes.io/revision\": \"1\",\n                    \"kubectl.kubernetes.io/last-applied-configuration\": \"{\\\"apiVersion\\\":\\\"apps/v1\\\",\\\"kind\\\":\\\"Deployment\\\",\\\"metadata\\\":{\\\"annotations\\\":{},\\\"creationTimestamp\\\":null,\\\"labels\\\":{\\\"addon.kops.k8s.io/name\\\":\\\"dns-controller.addons.k8s.io\\\",\\\"addon.kops.k8s.io/version\\\":\\\"1.22.0-alpha.1\\\",\\\"app.kubernetes.io/managed-by\\\":\\\"kops\\\",\\\"k8s-addon\\\":\\\"dns-controller.addons.k8s.io\\\",\\\"k8s-app\\\":\\\"dns-controller\\\",\\\"version\\\":\\\"v1.22.0-alpha.1\\\"},\\\"name\\\":\\\"dns-controller\\\",\\\"namespace\\\":\\\"kube-system\\\"},\\\"spec\\\":{\\\"replicas\\\":1,\\\"selector\\\":{\\\"matchLabels\\\":{\\\"k8s-app\\\":\\\"dns-controller\\\"}},\\\"strategy\\\":{\\\"type\\\":\\\"Recreate\\\"},\\\"template\\\":{\\\"metadata\\\":{\\\"annotations\\\":{\\\"scheduler.alpha.kubernetes.io/critical-pod\\\":\\\"\\\"},\\\"labels\\\":{\\\"k8s-addon\\\":\\\"dns-controller.addons.k8s.io\\\",\\\"k8s-app\\\":\\\"dns-controller\\\",\\\"version\\\":\\\"v1.22.0-alpha.1\\\"}},\\\"spec\\\":{\\\"containers\\\":[{\\\"command\\\":[\\\"/dns-controller\\\",\\\"--watch-ingress=false\\\",\\\"--dns=aws-route53\\\",\\\"--zone=*/ZEMLNXIIWQ0RV\\\",\\\"--zone=*/*\\\",\\\"-v=2\\\"],\\\"env\\\":[{\\\"name\\\":\\\"KUBERNETES_SERVICE_HOST\\\",\\\"value\\\":\\\"127.0.0.1\\\"}],\\\"image\\\":\\\"k8s.gcr.io/kops/dns-controller:1.22.0-alpha.1\\\",\\\"name\\\":\\\"dns-controller\\\",\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"50m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"securityContext\\\":{\\\"runAsNonRoot\\\":true}}],\\\"dnsPolicy\\\":\\\"Default\\\",\\\"hostNetwork\\\":true,\\\"nodeSelector\\\":{\\\"node-role.kubernetes.io/master\\\":\\\"\\\"},\\\"priorityClassName\\\":\\\"system-cluster-critical\\\",\\\"serviceAccount\\\":\\\"dns-controller\\\",\\\"tolerations\\\":[{\\\"operator\\\":\\\"Exists\\\"}]}}}}\\n\"\n                }\n            },\n            \"spec\": {\n                \"replicas\": 1,\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"dns-controller\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-addon\": \"dns-controller.addons.k8s.io\",\n                            \"k8s-app\": \"dns-controller\",\n                            \"version\": \"v1.22.0-alpha.1\"\n                        },\n                        \"annotations\": {\n                            \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                        }\n                    },\n                    \"spec\": {\n                        \"containers\": [\n                            {\n                                \"name\": \"dns-controller\",\n                                \"image\": \"k8s.gcr.io/kops/dns-controller:1.22.0-alpha.1\",\n                                \"command\": [\n                                    \"/dns-controller\",\n                                    \"--watch-ingress=false\",\n                                    \"--dns=aws-route53\",\n                                    \"--zone=*/ZEMLNXIIWQ0RV\",\n                                    \"--zone=*/*\",\n                                    \"-v=2\"\n                                ],\n                                \"env\": [\n                                    {\n                                        \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                        \"value\": \"127.0.0.1\"\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"requests\": {\n                                        \"cpu\": \"50m\",\n                                        \"memory\": \"50Mi\"\n                                    }\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\",\n                                \"securityContext\": {\n                                    \"runAsNonRoot\": true\n                                }\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"Default\",\n                        \"nodeSelector\": {\n                            \"node-role.kubernetes.io/master\": \"\"\n                        },\n                        \"serviceAccountName\": \"dns-controller\",\n                        \"serviceAccount\": \"dns-controller\",\n                        \"hostNetwork\": true,\n                        \"securityContext\": {},\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\"\n                    }\n                },\n                \"strategy\": {\n                    \"type\": \"Recreate\"\n                },\n                \"revisionHistoryLimit\": 10,\n                \"progressDeadlineSeconds\": 600\n            },\n            \"status\": {\n                \"observedGeneration\": 1,\n                \"replicas\": 1,\n                \"updatedReplicas\": 1,\n                \"readyReplicas\": 1,\n                \"availableReplicas\": 1,\n                \"conditions\": [\n                    {\n                        \"type\": \"Available\",\n                        \"status\": \"True\",\n                        \"lastUpdateTime\": \"2021-06-05T07:07:53Z\",\n                        \"lastTransitionTime\": \"2021-06-05T07:07:53Z\",\n                        \"reason\": \"MinimumReplicasAvailable\",\n                        \"message\": \"Deployment has minimum availability.\"\n                    },\n                    {\n                        \"type\": \"Progressing\",\n                        \"status\": \"True\",\n                        \"lastUpdateTime\": \"2021-06-05T07:07:53Z\",\n                        \"lastTransitionTime\": \"2021-06-05T07:07:51Z\",\n                        \"reason\": \"NewReplicaSetAvailable\",\n                        \"message\": \"ReplicaSet \\\"dns-controller-5f98b58844\\\" has successfully progressed.\"\n                    }\n                ]\n            }\n        }\n    ]\n}\n{\n    \"kind\": \"ReplicaSetList\",\n    \"apiVersion\": \"apps/v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"9571\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"cilium-operator-794454784c\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3adf6d33-0dd4-472b-9d08-68faeed2429e\",\n                \"resourceVersion\": \"727\",\n                \"generation\": 1,\n                \"creationTimestamp\": \"2021-06-05T07:07:51Z\",\n                \"labels\": {\n                    \"io.cilium/app\": \"operator\",\n                    \"name\": \"cilium-operator\",\n                    \"pod-template-hash\": \"794454784c\"\n                },\n                \"annotations\": {\n                    \"deployment.kubernetes.io/desired-replicas\": \"1\",\n                    \"deployment.kubernetes.io/max-replicas\": \"2\",\n                    \"deployment.kubernetes.io/revision\": \"1\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"Deployment\",\n                        \"name\": \"cilium-operator\",\n                        \"uid\": \"9235bb2b-6d9c-4050-9457-5fc9f21d00a9\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"replicas\": 1,\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"io.cilium/app\": \"operator\",\n                        \"name\": \"cilium-operator\",\n                        \"pod-template-hash\": \"794454784c\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"io.cilium/app\": \"operator\",\n                            \"name\": \"cilium-operator\",\n                            \"pod-template-hash\": \"794454784c\"\n                        }\n                    },\n                    \"spec\": {\n                        \"volumes\": [\n                            {\n                                \"name\": \"cilium-config-path\",\n                                \"configMap\": {\n                                    \"name\": \"cilium-config\",\n                                    \"defaultMode\": 420\n                                }\n                            }\n                        ],\n                        \"containers\": [\n                            {\n                                \"name\": \"cilium-operator\",\n                                \"image\": \"docker.io/cilium/operator:v1.10.0\",\n                                \"command\": [\n                                    \"cilium-operator\"\n                                ],\n                                \"args\": [\n                                    \"--config-dir=/tmp/cilium/config-map\",\n                                    \"--debug=$(CILIUM_DEBUG)\",\n                                    \"--eni-tags=KubernetesCluster=e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io\"\n                                ],\n                                \"env\": [\n                                    {\n                                        \"name\": \"K8S_NODE_NAME\",\n                                        \"valueFrom\": {\n                                            \"fieldRef\": {\n                                                \"apiVersion\": \"v1\",\n                                                \"fieldPath\": \"spec.nodeName\"\n                                            }\n                                        }\n                                    },\n                                    {\n                                        \"name\": \"CILIUM_K8S_NAMESPACE\",\n                                        \"valueFrom\": {\n                                            \"fieldRef\": {\n                                                \"apiVersion\": \"v1\",\n                                                \"fieldPath\": \"metadata.namespace\"\n                                            }\n                                        }\n                                    },\n                                    {\n                                        \"name\": \"CILIUM_DEBUG\",\n                                        \"valueFrom\": {\n                                            \"configMapKeyRef\": {\n                                                \"name\": \"cilium-config\",\n                                                \"key\": \"debug\",\n                                                \"optional\": true\n                                            }\n                                        }\n                                    },\n                                    {\n                                        \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                        \"value\": \"api.internal.e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io\"\n                                    },\n                                    {\n                                        \"name\": \"KUBERNETES_SERVICE_PORT\",\n                                        \"value\": \"443\"\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"requests\": {\n                                        \"cpu\": \"25m\",\n                                        \"memory\": \"128Mi\"\n                                    }\n                                },\n                                \"volumeMounts\": [\n                                    {\n                                        \"name\": \"cilium-config-path\",\n                                        \"readOnly\": true,\n                                        \"mountPath\": \"/tmp/cilium/config-map\"\n                                    }\n                                ],\n                                \"livenessProbe\": {\n                                    \"httpGet\": {\n                                        \"path\": \"/healthz\",\n                                        \"port\": 9234,\n                                        \"host\": \"127.0.0.1\",\n                                        \"scheme\": \"HTTP\"\n                                    },\n                                    \"initialDelaySeconds\": 60,\n                                    \"timeoutSeconds\": 3,\n                                    \"periodSeconds\": 10,\n                                    \"successThreshold\": 1,\n                                    \"failureThreshold\": 3\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\"\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"ClusterFirst\",\n                        \"nodeSelector\": {\n                            \"node-role.kubernetes.io/master\": \"\"\n                        },\n                        \"serviceAccountName\": \"cilium-operator\",\n                        \"serviceAccount\": \"cilium-operator\",\n                        \"hostNetwork\": true,\n                        \"securityContext\": {},\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\"\n                    }\n                }\n            },\n            \"status\": {\n                \"replicas\": 1,\n                \"fullyLabeledReplicas\": 1,\n                \"readyReplicas\": 1,\n                \"availableReplicas\": 1,\n                \"observedGeneration\": 1\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-6f594f4c58\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"2a2f93ff-2028-4dbc-aac4-c3e24eeff348\",\n                \"resourceVersion\": \"876\",\n                \"generation\": 1,\n                \"creationTimestamp\": \"2021-06-05T07:07:51Z\",\n                \"labels\": {\n                    \"k8s-app\": \"coredns-autoscaler\",\n                    \"pod-template-hash\": \"6f594f4c58\"\n                },\n                \"annotations\": {\n                    \"deployment.kubernetes.io/desired-replicas\": \"1\",\n                    \"deployment.kubernetes.io/max-replicas\": \"2\",\n                    \"deployment.kubernetes.io/revision\": \"1\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"Deployment\",\n                        \"name\": \"coredns-autoscaler\",\n                        \"uid\": \"45fcec6f-a566-4e3b-a5fa-a0507cedee8a\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"replicas\": 1,\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"coredns-autoscaler\",\n                        \"pod-template-hash\": \"6f594f4c58\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-app\": \"coredns-autoscaler\",\n                            \"pod-template-hash\": \"6f594f4c58\"\n                        },\n                        \"annotations\": {\n                            \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                        }\n                    },\n                    \"spec\": {\n                        \"containers\": [\n                            {\n                                \"name\": \"autoscaler\",\n                                \"image\": \"k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.3\",\n                                \"command\": [\n                                    \"/cluster-proportional-autoscaler\",\n                                    \"--namespace=kube-system\",\n                                    \"--configmap=coredns-autoscaler\",\n                                    \"--target=Deployment/coredns\",\n                                    \"--default-params={\\\"linear\\\":{\\\"coresPerReplica\\\":256,\\\"nodesPerReplica\\\":16,\\\"preventSinglePointFailure\\\":true}}\",\n                                    \"--logtostderr=true\",\n                                    \"--v=2\"\n                                ],\n                                \"resources\": {\n                                    \"requests\": {\n                                        \"cpu\": \"20m\",\n                                        \"memory\": \"10Mi\"\n                                    }\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\"\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"ClusterFirst\",\n                        \"serviceAccountName\": \"coredns-autoscaler\",\n                        \"serviceAccount\": \"coredns-autoscaler\",\n                        \"securityContext\": {},\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"key\": \"CriticalAddonsOnly\",\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\"\n                    }\n                }\n            },\n            \"status\": {\n                \"replicas\": 1,\n                \"fullyLabeledReplicas\": 1,\n                \"readyReplicas\": 1,\n                \"availableReplicas\": 1,\n                \"observedGeneration\": 1\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-f45c4bf76\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f30f550c-0d69-4278-8025-38052833403d\",\n                \"resourceVersion\": \"913\",\n                \"generation\": 2,\n                \"creationTimestamp\": \"2021-06-05T07:07:51Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-dns\",\n                    \"pod-template-hash\": \"f45c4bf76\"\n                },\n                \"annotations\": {\n                    \"deployment.kubernetes.io/desired-replicas\": \"2\",\n                    \"deployment.kubernetes.io/max-replicas\": \"3\",\n                    \"deployment.kubernetes.io/revision\": \"1\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"Deployment\",\n                        \"name\": \"coredns\",\n                        \"uid\": \"fe4b9906-7979-43c9-ae09-b031aa40e403\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"replicas\": 2,\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"kube-dns\",\n                        \"pod-template-hash\": \"f45c4bf76\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-app\": \"kube-dns\",\n                            \"pod-template-hash\": \"f45c4bf76\"\n                        }\n                    },\n                    \"spec\": {\n                        \"volumes\": [\n                            {\n                                \"name\": \"config-volume\",\n                                \"configMap\": {\n                                    \"name\": \"coredns\",\n                                    \"items\": [\n                                        {\n                                            \"key\": \"Corefile\",\n                                            \"path\": \"Corefile\"\n                                        }\n                                    ],\n                                    \"defaultMode\": 420\n                                }\n                            }\n                        ],\n                        \"containers\": [\n                            {\n                                \"name\": \"coredns\",\n                                \"image\": \"coredns/coredns:1.8.3\",\n                                \"args\": [\n                                    \"-conf\",\n                                    \"/etc/coredns/Corefile\"\n                                ],\n                                \"ports\": [\n                                    {\n                                        \"name\": \"dns\",\n                                        \"containerPort\": 53,\n                                        \"protocol\": \"UDP\"\n                                    },\n                                    {\n                                        \"name\": \"dns-tcp\",\n                                        \"containerPort\": 53,\n                                        \"protocol\": \"TCP\"\n                                    },\n                                    {\n                                        \"name\": \"metrics\",\n                                        \"containerPort\": 9153,\n                                        \"protocol\": \"TCP\"\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"limits\": {\n                                        \"memory\": \"170Mi\"\n                                    },\n                                    \"requests\": {\n                                        \"cpu\": \"100m\",\n                                        \"memory\": \"70Mi\"\n                                    }\n                                },\n                                \"volumeMounts\": [\n                                    {\n                                        \"name\": \"config-volume\",\n                                        \"readOnly\": true,\n                                        \"mountPath\": \"/etc/coredns\"\n                                    }\n                                ],\n                                \"livenessProbe\": {\n                                    \"httpGet\": {\n                                        \"path\": \"/health\",\n                                        \"port\": 8080,\n                                        \"scheme\": \"HTTP\"\n                                    },\n                                    \"initialDelaySeconds\": 60,\n                                    \"timeoutSeconds\": 5,\n                                    \"periodSeconds\": 10,\n                                    \"successThreshold\": 1,\n                                    \"failureThreshold\": 5\n                                },\n                                \"readinessProbe\": {\n                                    \"httpGet\": {\n                                        \"path\": \"/ready\",\n                                        \"port\": 8181,\n                                        \"scheme\": \"HTTP\"\n                                    },\n                                    \"timeoutSeconds\": 1,\n                                    \"periodSeconds\": 10,\n                                    \"successThreshold\": 1,\n                                    \"failureThreshold\": 3\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\",\n                                \"securityContext\": {\n                                    \"capabilities\": {\n                                        \"add\": [\n                                            \"NET_BIND_SERVICE\"\n                                        ],\n                                        \"drop\": [\n                                            \"all\"\n                                        ]\n                                    },\n                                    \"readOnlyRootFilesystem\": true,\n                                    \"allowPrivilegeEscalation\": false\n                                }\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"Default\",\n                        \"nodeSelector\": {\n                            \"beta.kubernetes.io/os\": \"linux\"\n                        },\n                        \"serviceAccountName\": \"coredns\",\n                        \"serviceAccount\": \"coredns\",\n                        \"securityContext\": {},\n                        \"affinity\": {\n                            \"podAntiAffinity\": {\n                                \"preferredDuringSchedulingIgnoredDuringExecution\": [\n                                    {\n                                        \"weight\": 100,\n                                        \"podAffinityTerm\": {\n                                            \"labelSelector\": {\n                                                \"matchExpressions\": [\n                                                    {\n                                                        \"key\": \"k8s-app\",\n                                                        \"operator\": \"In\",\n                                                        \"values\": [\n                                                            \"kube-dns\"\n                                                        ]\n                                                    }\n                                                ]\n                                            },\n                                            \"topologyKey\": \"kubernetes.io/hostname\"\n                                        }\n                                    }\n                                ]\n                            }\n                        },\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"key\": \"CriticalAddonsOnly\",\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\"\n                    }\n                }\n            },\n            \"status\": {\n                \"replicas\": 2,\n                \"fullyLabeledReplicas\": 2,\n                \"readyReplicas\": 2,\n                \"availableReplicas\": 2,\n                \"observedGeneration\": 2\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-5f98b58844\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"cb72c25c-93e6-4611-8219-899d8960d79c\",\n                \"resourceVersion\": \"471\",\n                \"generation\": 1,\n                \"creationTimestamp\": \"2021-06-05T07:07:51Z\",\n                \"labels\": {\n                    \"k8s-addon\": \"dns-controller.addons.k8s.io\",\n                    \"k8s-app\": \"dns-controller\",\n                    \"pod-template-hash\": \"5f98b58844\",\n                    \"version\": \"v1.22.0-alpha.1\"\n                },\n                \"annotations\": {\n                    \"deployment.kubernetes.io/desired-replicas\": \"1\",\n                    \"deployment.kubernetes.io/max-replicas\": \"1\",\n                    \"deployment.kubernetes.io/revision\": \"1\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"Deployment\",\n                        \"name\": \"dns-controller\",\n                        \"uid\": \"fc408104-db62-47f5-a406-ab703372e22f\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"replicas\": 1,\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"dns-controller\",\n                        \"pod-template-hash\": \"5f98b58844\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-addon\": \"dns-controller.addons.k8s.io\",\n                            \"k8s-app\": \"dns-controller\",\n                            \"pod-template-hash\": \"5f98b58844\",\n                            \"version\": \"v1.22.0-alpha.1\"\n                        },\n                        \"annotations\": {\n                            \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                        }\n                    },\n                    \"spec\": {\n                        \"containers\": [\n                            {\n                                \"name\": \"dns-controller\",\n                                \"image\": \"k8s.gcr.io/kops/dns-controller:1.22.0-alpha.1\",\n                                \"command\": [\n                                    \"/dns-controller\",\n                                    \"--watch-ingress=false\",\n                                    \"--dns=aws-route53\",\n                                    \"--zone=*/ZEMLNXIIWQ0RV\",\n                                    \"--zone=*/*\",\n                                    \"-v=2\"\n                                ],\n                                \"env\": [\n                                    {\n                                        \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                        \"value\": \"127.0.0.1\"\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"requests\": {\n                                        \"cpu\": \"50m\",\n                                        \"memory\": \"50Mi\"\n                                    }\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\",\n                                \"securityContext\": {\n                                    \"runAsNonRoot\": true\n                                }\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"Default\",\n                        \"nodeSelector\": {\n                            \"node-role.kubernetes.io/master\": \"\"\n                        },\n                        \"serviceAccountName\": \"dns-controller\",\n                        \"serviceAccount\": \"dns-controller\",\n                        \"hostNetwork\": true,\n                        \"securityContext\": {},\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\"\n                    }\n                }\n            },\n            \"status\": {\n                \"replicas\": 1,\n                \"fullyLabeledReplicas\": 1,\n                \"readyReplicas\": 1,\n                \"availableReplicas\": 1,\n                \"observedGeneration\": 1\n            }\n        }\n    ]\n}\n{\n    \"kind\": \"PodList\",\n    \"apiVersion\": \"v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"9571\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"cilium-25vms\",\n                \"generateName\": \"cilium-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"8bafd635-e24b-4bf2-a44d-dc1ae6972cca\",\n                \"resourceVersion\": \"789\",\n                \"creationTimestamp\": \"2021-06-05T07:07:52Z\",\n                \"labels\": {\n                    \"controller-revision-hash\": \"6554fb78ff\",\n                    \"k8s-app\": \"cilium\",\n                    \"kubernetes.io/cluster-service\": \"true\",\n                    \"pod-template-generation\": \"1\"\n                },\n                \"annotations\": {\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"DaemonSet\",\n                        \"name\": \"cilium\",\n                        \"uid\": \"a43e0fc8-0e8f-4934-b573-82baa5f51c0c\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"cilium-run\",\n                        \"hostPath\": {\n                            \"path\": \"/var/run/cilium\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"bpf-maps\",\n                        \"hostPath\": {\n                            \"path\": \"/sys/fs/bpf\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"cni-path\",\n                        \"hostPath\": {\n                            \"path\": \"/opt/cni/bin\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"etc-cni-netd\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/cni/net.d\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"lib-modules\",\n                        \"hostPath\": {\n                            \"path\": \"/lib/modules\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"xtables-lock\",\n                        \"hostPath\": {\n                            \"path\": \"/run/xtables.lock\",\n                            \"type\": \"FileOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"clustermesh-secrets\",\n                        \"secret\": {\n                            \"secretName\": \"cilium-clustermesh\",\n                            \"defaultMode\": 420,\n                            \"optional\": true\n                        }\n                    },\n                    {\n                        \"name\": \"cilium-config-path\",\n                        \"configMap\": {\n                            \"name\": \"cilium-config\",\n                            \"defaultMode\": 420\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-frsnw\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"initContainers\": [\n                    {\n                        \"name\": \"clean-cilium-state\",\n                        \"image\": \"docker.io/cilium/cilium:v1.10.0\",\n                        \"command\": [\n                            \"/init-container.sh\"\n                        ],\n                        \"env\": [\n                            {\n                                \"name\": \"CILIUM_ALL_STATE\",\n                                \"valueFrom\": {\n                                    \"configMapKeyRef\": {\n                                        \"name\": \"cilium-config\",\n                                        \"key\": \"clean-cilium-state\",\n                                        \"optional\": true\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"CILIUM_BPF_STATE\",\n                                \"valueFrom\": {\n                                    \"configMapKeyRef\": {\n                                        \"name\": \"cilium-config\",\n                                        \"key\": \"clean-cilium-bpf-state\",\n                                        \"optional\": true\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"CILIUM_WAIT_BPF_MOUNT\",\n                                \"valueFrom\": {\n                                    \"configMapKeyRef\": {\n                                        \"name\": \"cilium-config\",\n                                        \"key\": \"wait-bpf-mount\",\n                                        \"optional\": true\n                                    }\n                                }\n                            }\n                        ],\n                        \"resources\": {\n                            \"limits\": {\n                                \"memory\": \"100Mi\"\n                            },\n                            \"requests\": {\n                                \"cpu\": \"100m\",\n                                \"memory\": \"100Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"bpf-maps\",\n                                \"mountPath\": \"/sys/fs/bpf\",\n                                \"mountPropagation\": \"HostToContainer\"\n                            },\n                            {\n                                \"name\": \"cilium-run\",\n                                \"mountPath\": \"/var/run/cilium\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-frsnw\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"capabilities\": {\n                                \"add\": [\n                                    \"NET_ADMIN\"\n                                ]\n                            },\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"cilium-agent\",\n                        \"image\": \"docker.io/cilium/cilium:v1.10.0\",\n                        \"command\": [\n                            \"cilium-agent\"\n                        ],\n                        \"args\": [\n                            \"--config-dir=/tmp/cilium/config-map\"\n                        ],\n                        \"env\": [\n                            {\n                                \"name\": \"K8S_NODE_NAME\",\n                                \"valueFrom\": {\n                                    \"fieldRef\": {\n                                        \"apiVersion\": \"v1\",\n                                        \"fieldPath\": \"spec.nodeName\"\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"CILIUM_K8S_NAMESPACE\",\n                                \"valueFrom\": {\n                                    \"fieldRef\": {\n                                        \"apiVersion\": \"v1\",\n                                        \"fieldPath\": \"metadata.namespace\"\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"CILIUM_CLUSTERMESH_CONFIG\",\n                                \"value\": \"/var/lib/cilium/clustermesh/\"\n                            },\n                            {\n                                \"name\": \"CILIUM_CNI_CHAINING_MODE\",\n                                \"valueFrom\": {\n                                    \"configMapKeyRef\": {\n                                        \"name\": \"cilium-config\",\n                                        \"key\": \"cni-chaining-mode\",\n                                        \"optional\": true\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"CILIUM_CUSTOM_CNI_CONF\",\n                                \"valueFrom\": {\n                                    \"configMapKeyRef\": {\n                                        \"name\": \"cilium-config\",\n                                        \"key\": \"custom-cni-conf\",\n                                        \"optional\": true\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                \"value\": \"api.internal.e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io\"\n                            },\n                            {\n                                \"name\": \"KUBERNETES_SERVICE_PORT\",\n                                \"value\": \"443\"\n                            }\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"25m\",\n                                \"memory\": \"128Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"bpf-maps\",\n                                \"mountPath\": \"/sys/fs/bpf\"\n                            },\n                            {\n                                \"name\": \"cilium-run\",\n                                \"mountPath\": \"/var/run/cilium\"\n                            },\n                            {\n                                \"name\": \"cni-path\",\n                                \"mountPath\": \"/host/opt/cni/bin\"\n                            },\n                            {\n                                \"name\": \"etc-cni-netd\",\n                                \"mountPath\": \"/host/etc/cni/net.d\"\n                            },\n                            {\n                                \"name\": \"clustermesh-secrets\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/lib/cilium/clustermesh\"\n                            },\n                            {\n                                \"name\": \"cilium-config-path\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/tmp/cilium/config-map\"\n                            },\n                            {\n                                \"name\": \"lib-modules\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/lib/modules\"\n                            },\n                            {\n                                \"name\": \"xtables-lock\",\n                                \"mountPath\": \"/run/xtables.lock\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-frsnw\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"livenessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/healthz\",\n                                \"port\": 9876,\n                                \"host\": \"127.0.0.1\",\n                                \"scheme\": \"HTTP\",\n                                \"httpHeaders\": [\n                                    {\n                                        \"name\": \"brief\",\n                                        \"value\": \"true\"\n                                    }\n                                ]\n                            },\n                            \"timeoutSeconds\": 5,\n                            \"periodSeconds\": 30,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 10\n                        },\n                        \"readinessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/healthz\",\n                                \"port\": 9876,\n                                \"host\": \"127.0.0.1\",\n                                \"scheme\": \"HTTP\",\n                                \"httpHeaders\": [\n                                    {\n                                        \"name\": \"brief\",\n                                        \"value\": \"true\"\n                                    }\n                                ]\n                            },\n                            \"initialDelaySeconds\": 5,\n                            \"timeoutSeconds\": 5,\n                            \"periodSeconds\": 30,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 3\n                        },\n                        \"startupProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/healthz\",\n                                \"port\": 9876,\n                                \"host\": \"127.0.0.1\",\n                                \"scheme\": \"HTTP\",\n                                \"httpHeaders\": [\n                                    {\n                                        \"name\": \"brief\",\n                                        \"value\": \"true\"\n                                    }\n                                ]\n                            },\n                            \"timeoutSeconds\": 1,\n                            \"periodSeconds\": 2,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 24\n                        },\n                        \"lifecycle\": {\n                            \"postStart\": {\n                                \"exec\": {\n                                    \"command\": [\n                                        \"/cni-install.sh\",\n                                        \"--cni-exclusive=true\"\n                                    ]\n                                }\n                            },\n                            \"preStop\": {\n                                \"exec\": {\n                                    \"command\": [\n                                        \"/cni-uninstall.sh\"\n                                    ]\n                                }\n                            }\n                        },\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"capabilities\": {\n                                \"add\": [\n                                    \"NET_ADMIN\",\n                                    \"SYS_MODULE\"\n                                ]\n                            },\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 1,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"serviceAccountName\": \"cilium\",\n                \"serviceAccount\": \"cilium\",\n                \"nodeName\": \"ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"affinity\": {\n                    \"nodeAffinity\": {\n                        \"requiredDuringSchedulingIgnoredDuringExecution\": {\n                            \"nodeSelectorTerms\": [\n                                {\n                                    \"matchFields\": [\n                                        {\n                                            \"key\": \"metadata.name\",\n                                            \"operator\": \"In\",\n                                            \"values\": [\n                                                \"ip-172-20-37-235.ca-central-1.compute.internal\"\n                                            ]\n                                        }\n                                    ]\n                                }\n                            ]\n                        }\n                    },\n                    \"podAntiAffinity\": {\n                        \"requiredDuringSchedulingIgnoredDuringExecution\": [\n                            {\n                                \"labelSelector\": {\n                                    \"matchExpressions\": [\n                                        {\n                                            \"key\": \"k8s-app\",\n                                            \"operator\": \"In\",\n                                            \"values\": [\n                                                \"cilium\"\n                                            ]\n                                        }\n                                    ]\n                                },\n                                \"topologyKey\": \"kubernetes.io/hostname\"\n                            }\n                        ]\n                    }\n                },\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/disk-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/memory-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/pid-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unschedulable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/network-unavailable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:08:02Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:09:20Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:09:20Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:07:52Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.37.235\",\n                \"podIP\": \"172.20.37.235\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.37.235\"\n                    }\n                ],\n                \"startTime\": \"2021-06-05T07:07:52Z\",\n                \"initContainerStatuses\": [\n                    {\n                        \"name\": \"clean-cilium-state\",\n                        \"state\": {\n                            \"terminated\": {\n                                \"exitCode\": 0,\n                                \"reason\": \"Completed\",\n                                \"startedAt\": \"2021-06-05T07:08:01Z\",\n                                \"finishedAt\": \"2021-06-05T07:08:01Z\",\n                                \"containerID\": \"containerd://1e78c4beed61ebc710832cea4fb10eeee3d056d26f23744b2705d36bf9260a6f\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"docker.io/cilium/cilium:v1.10.0\",\n                        \"imageID\": \"docker.io/cilium/cilium@sha256:587627d909ffe0418c0bd907516496844867a21812946af82096d367760e4c1e\",\n                        \"containerID\": \"containerd://1e78c4beed61ebc710832cea4fb10eeee3d056d26f23744b2705d36bf9260a6f\"\n                    }\n                ],\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"cilium-agent\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-06-05T07:08:52Z\"\n                            }\n                        },\n                        \"lastState\": {\n                            \"terminated\": {\n                                \"exitCode\": 137,\n                                \"reason\": \"Error\",\n                                \"startedAt\": \"2021-06-05T07:08:02Z\",\n                                \"finishedAt\": \"2021-06-05T07:08:52Z\",\n                                \"containerID\": \"containerd://4623563db1583423cd147eb10bc9f2c58ab5d25061e573d66c89d8c7c66ca13f\"\n                            }\n                        },\n                        \"ready\": true,\n                        \"restartCount\": 1,\n                        \"image\": \"docker.io/cilium/cilium:v1.10.0\",\n                        \"imageID\": \"docker.io/cilium/cilium@sha256:587627d909ffe0418c0bd907516496844867a21812946af82096d367760e4c1e\",\n                        \"containerID\": \"containerd://d3f9f468940bf30d0dc0e45ceaa625aebdc593f3a6d1a7c884782b39e034b3d6\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-d9szd\",\n                \"generateName\": \"cilium-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"e788479b-eca9-4458-9645-8de4589a2e0b\",\n                \"resourceVersion\": \"814\",\n                \"creationTimestamp\": \"2021-06-05T07:09:01Z\",\n                \"labels\": {\n                    \"controller-revision-hash\": \"6554fb78ff\",\n                    \"k8s-app\": \"cilium\",\n                    \"kubernetes.io/cluster-service\": \"true\",\n                    \"pod-template-generation\": \"1\"\n                },\n                \"annotations\": {\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"DaemonSet\",\n                        \"name\": \"cilium\",\n                        \"uid\": \"a43e0fc8-0e8f-4934-b573-82baa5f51c0c\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"cilium-run\",\n                        \"hostPath\": {\n                            \"path\": \"/var/run/cilium\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"bpf-maps\",\n                        \"hostPath\": {\n                            \"path\": \"/sys/fs/bpf\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"cni-path\",\n                        \"hostPath\": {\n                            \"path\": \"/opt/cni/bin\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"etc-cni-netd\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/cni/net.d\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"lib-modules\",\n                        \"hostPath\": {\n                            \"path\": \"/lib/modules\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"xtables-lock\",\n                        \"hostPath\": {\n                            \"path\": \"/run/xtables.lock\",\n                            \"type\": \"FileOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"clustermesh-secrets\",\n                        \"secret\": {\n                            \"secretName\": \"cilium-clustermesh\",\n                            \"defaultMode\": 420,\n                            \"optional\": true\n                        }\n                    },\n                    {\n                        \"name\": \"cilium-config-path\",\n                        \"configMap\": {\n                            \"name\": \"cilium-config\",\n                            \"defaultMode\": 420\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-q8mct\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"initContainers\": [\n                    {\n                        \"name\": \"clean-cilium-state\",\n                        \"image\": \"docker.io/cilium/cilium:v1.10.0\",\n                        \"command\": [\n                            \"/init-container.sh\"\n                        ],\n                        \"env\": [\n                            {\n                                \"name\": \"CILIUM_ALL_STATE\",\n                                \"valueFrom\": {\n                                    \"configMapKeyRef\": {\n                                        \"name\": \"cilium-config\",\n                                        \"key\": \"clean-cilium-state\",\n                                        \"optional\": true\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"CILIUM_BPF_STATE\",\n                                \"valueFrom\": {\n                                    \"configMapKeyRef\": {\n                                        \"name\": \"cilium-config\",\n                                        \"key\": \"clean-cilium-bpf-state\",\n                                        \"optional\": true\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"CILIUM_WAIT_BPF_MOUNT\",\n                                \"valueFrom\": {\n                                    \"configMapKeyRef\": {\n                                        \"name\": \"cilium-config\",\n                                        \"key\": \"wait-bpf-mount\",\n                                        \"optional\": true\n                                    }\n                                }\n                            }\n                        ],\n                        \"resources\": {\n                            \"limits\": {\n                                \"memory\": \"100Mi\"\n                            },\n                            \"requests\": {\n                                \"cpu\": \"100m\",\n                                \"memory\": \"100Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"bpf-maps\",\n                                \"mountPath\": \"/sys/fs/bpf\",\n                                \"mountPropagation\": \"HostToContainer\"\n                            },\n                            {\n                                \"name\": \"cilium-run\",\n                                \"mountPath\": \"/var/run/cilium\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-q8mct\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"capabilities\": {\n                                \"add\": [\n                                    \"NET_ADMIN\"\n                                ]\n                            },\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"cilium-agent\",\n                        \"image\": \"docker.io/cilium/cilium:v1.10.0\",\n                        \"command\": [\n                            \"cilium-agent\"\n                        ],\n                        \"args\": [\n                            \"--config-dir=/tmp/cilium/config-map\"\n                        ],\n                        \"env\": [\n                            {\n                                \"name\": \"K8S_NODE_NAME\",\n                                \"valueFrom\": {\n                                    \"fieldRef\": {\n                                        \"apiVersion\": \"v1\",\n                                        \"fieldPath\": \"spec.nodeName\"\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"CILIUM_K8S_NAMESPACE\",\n                                \"valueFrom\": {\n                                    \"fieldRef\": {\n                                        \"apiVersion\": \"v1\",\n                                        \"fieldPath\": \"metadata.namespace\"\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"CILIUM_CLUSTERMESH_CONFIG\",\n                                \"value\": \"/var/lib/cilium/clustermesh/\"\n                            },\n                            {\n                                \"name\": \"CILIUM_CNI_CHAINING_MODE\",\n                                \"valueFrom\": {\n                                    \"configMapKeyRef\": {\n                                        \"name\": \"cilium-config\",\n                                        \"key\": \"cni-chaining-mode\",\n                                        \"optional\": true\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"CILIUM_CUSTOM_CNI_CONF\",\n                                \"valueFrom\": {\n                                    \"configMapKeyRef\": {\n                                        \"name\": \"cilium-config\",\n                                        \"key\": \"custom-cni-conf\",\n                                        \"optional\": true\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                \"value\": \"api.internal.e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io\"\n                            },\n                            {\n                                \"name\": \"KUBERNETES_SERVICE_PORT\",\n                                \"value\": \"443\"\n                            }\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"25m\",\n                                \"memory\": \"128Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"bpf-maps\",\n                                \"mountPath\": \"/sys/fs/bpf\"\n                            },\n                            {\n                                \"name\": \"cilium-run\",\n                                \"mountPath\": \"/var/run/cilium\"\n                            },\n                            {\n                                \"name\": \"cni-path\",\n                                \"mountPath\": \"/host/opt/cni/bin\"\n                            },\n                            {\n                                \"name\": \"etc-cni-netd\",\n                                \"mountPath\": \"/host/etc/cni/net.d\"\n                            },\n                            {\n                                \"name\": \"clustermesh-secrets\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/lib/cilium/clustermesh\"\n                            },\n                            {\n                                \"name\": \"cilium-config-path\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/tmp/cilium/config-map\"\n                            },\n                            {\n                                \"name\": \"lib-modules\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/lib/modules\"\n                            },\n                            {\n                                \"name\": \"xtables-lock\",\n                                \"mountPath\": \"/run/xtables.lock\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-q8mct\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"livenessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/healthz\",\n                                \"port\": 9876,\n                                \"host\": \"127.0.0.1\",\n                                \"scheme\": \"HTTP\",\n                                \"httpHeaders\": [\n                                    {\n                                        \"name\": \"brief\",\n                                        \"value\": \"true\"\n                                    }\n                                ]\n                            },\n                            \"timeoutSeconds\": 5,\n                            \"periodSeconds\": 30,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 10\n                        },\n                        \"readinessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/healthz\",\n                                \"port\": 9876,\n                                \"host\": \"127.0.0.1\",\n                                \"scheme\": \"HTTP\",\n                                \"httpHeaders\": [\n                                    {\n                                        \"name\": \"brief\",\n                                        \"value\": \"true\"\n                                    }\n                                ]\n                            },\n                            \"initialDelaySeconds\": 5,\n                            \"timeoutSeconds\": 5,\n                            \"periodSeconds\": 30,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 3\n                        },\n                        \"startupProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/healthz\",\n                                \"port\": 9876,\n                                \"host\": \"127.0.0.1\",\n                                \"scheme\": \"HTTP\",\n                                \"httpHeaders\": [\n                                    {\n                                        \"name\": \"brief\",\n                                        \"value\": \"true\"\n                                    }\n                                ]\n                            },\n                            \"timeoutSeconds\": 1,\n                            \"periodSeconds\": 2,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 24\n                        },\n                        \"lifecycle\": {\n                            \"postStart\": {\n                                \"exec\": {\n                                    \"command\": [\n                                        \"/cni-install.sh\",\n                                        \"--cni-exclusive=true\"\n                                    ]\n                                }\n                            },\n                            \"preStop\": {\n                                \"exec\": {\n                                    \"command\": [\n                                        \"/cni-uninstall.sh\"\n                                    ]\n                                }\n                            }\n                        },\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"capabilities\": {\n                                \"add\": [\n                                    \"NET_ADMIN\",\n                                    \"SYS_MODULE\"\n                                ]\n                            },\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 1,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"serviceAccountName\": \"cilium\",\n                \"serviceAccount\": \"cilium\",\n                \"nodeName\": \"ip-172-20-48-31.ca-central-1.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"affinity\": {\n                    \"nodeAffinity\": {\n                        \"requiredDuringSchedulingIgnoredDuringExecution\": {\n                            \"nodeSelectorTerms\": [\n                                {\n                                    \"matchFields\": [\n                                        {\n                                            \"key\": \"metadata.name\",\n                                            \"operator\": \"In\",\n                                            \"values\": [\n                                                \"ip-172-20-48-31.ca-central-1.compute.internal\"\n                                            ]\n                                        }\n                                    ]\n                                }\n                            ]\n                        }\n                    },\n                    \"podAntiAffinity\": {\n                        \"requiredDuringSchedulingIgnoredDuringExecution\": [\n                            {\n                                \"labelSelector\": {\n                                    \"matchExpressions\": [\n                                        {\n                                            \"key\": \"k8s-app\",\n                                            \"operator\": \"In\",\n                                            \"values\": [\n                                                \"cilium\"\n                                            ]\n                                        }\n                                    ]\n                                },\n                                \"topologyKey\": \"kubernetes.io/hostname\"\n                            }\n                        ]\n                    }\n                },\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/disk-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/memory-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/pid-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unschedulable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/network-unavailable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:09:11Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:09:22Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:09:22Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:09:01Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.48.31\",\n                \"podIP\": \"172.20.48.31\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.48.31\"\n                    }\n                ],\n                \"startTime\": \"2021-06-05T07:09:02Z\",\n                \"initContainerStatuses\": [\n                    {\n                        \"name\": \"clean-cilium-state\",\n                        \"state\": {\n                            \"terminated\": {\n                                \"exitCode\": 0,\n                                \"reason\": \"Completed\",\n                                \"startedAt\": \"2021-06-05T07:09:11Z\",\n                                \"finishedAt\": \"2021-06-05T07:09:11Z\",\n                                \"containerID\": \"containerd://17ef3c4489019cdbd5f7898ef1a18d1cbd3d4f63cc566ad23caa10635fd7fcac\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"docker.io/cilium/cilium:v1.10.0\",\n                        \"imageID\": \"docker.io/cilium/cilium@sha256:587627d909ffe0418c0bd907516496844867a21812946af82096d367760e4c1e\",\n                        \"containerID\": \"containerd://17ef3c4489019cdbd5f7898ef1a18d1cbd3d4f63cc566ad23caa10635fd7fcac\"\n                    }\n                ],\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"cilium-agent\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-06-05T07:09:12Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"docker.io/cilium/cilium:v1.10.0\",\n                        \"imageID\": \"docker.io/cilium/cilium@sha256:587627d909ffe0418c0bd907516496844867a21812946af82096d367760e4c1e\",\n                        \"containerID\": \"containerd://abfd89346182a24d0e69f5f0076e66e4115cf35e99ef4a7967a3258a26874902\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-lnws2\",\n                \"generateName\": \"cilium-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"06ecc1cd-9366-457e-85c9-d1a4a336344e\",\n                \"resourceVersion\": \"818\",\n                \"creationTimestamp\": \"2021-06-05T07:09:01Z\",\n                \"labels\": {\n                    \"controller-revision-hash\": \"6554fb78ff\",\n                    \"k8s-app\": \"cilium\",\n                    \"kubernetes.io/cluster-service\": \"true\",\n                    \"pod-template-generation\": \"1\"\n                },\n                \"annotations\": {\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"DaemonSet\",\n                        \"name\": \"cilium\",\n                        \"uid\": \"a43e0fc8-0e8f-4934-b573-82baa5f51c0c\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"cilium-run\",\n                        \"hostPath\": {\n                            \"path\": \"/var/run/cilium\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"bpf-maps\",\n                        \"hostPath\": {\n                            \"path\": \"/sys/fs/bpf\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"cni-path\",\n                        \"hostPath\": {\n                            \"path\": \"/opt/cni/bin\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"etc-cni-netd\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/cni/net.d\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"lib-modules\",\n                        \"hostPath\": {\n                            \"path\": \"/lib/modules\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"xtables-lock\",\n                        \"hostPath\": {\n                            \"path\": \"/run/xtables.lock\",\n                            \"type\": \"FileOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"clustermesh-secrets\",\n                        \"secret\": {\n                            \"secretName\": \"cilium-clustermesh\",\n                            \"defaultMode\": 420,\n                            \"optional\": true\n                        }\n                    },\n                    {\n                        \"name\": \"cilium-config-path\",\n                        \"configMap\": {\n                            \"name\": \"cilium-config\",\n                            \"defaultMode\": 420\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-pk4d6\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"initContainers\": [\n                    {\n                        \"name\": \"clean-cilium-state\",\n                        \"image\": \"docker.io/cilium/cilium:v1.10.0\",\n                        \"command\": [\n                            \"/init-container.sh\"\n                        ],\n                        \"env\": [\n                            {\n                                \"name\": \"CILIUM_ALL_STATE\",\n                                \"valueFrom\": {\n                                    \"configMapKeyRef\": {\n                                        \"name\": \"cilium-config\",\n                                        \"key\": \"clean-cilium-state\",\n                                        \"optional\": true\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"CILIUM_BPF_STATE\",\n                                \"valueFrom\": {\n                                    \"configMapKeyRef\": {\n                                        \"name\": \"cilium-config\",\n                                        \"key\": \"clean-cilium-bpf-state\",\n                                        \"optional\": true\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"CILIUM_WAIT_BPF_MOUNT\",\n                                \"valueFrom\": {\n                                    \"configMapKeyRef\": {\n                                        \"name\": \"cilium-config\",\n                                        \"key\": \"wait-bpf-mount\",\n                                        \"optional\": true\n                                    }\n                                }\n                            }\n                        ],\n                        \"resources\": {\n                            \"limits\": {\n                                \"memory\": \"100Mi\"\n                            },\n                            \"requests\": {\n                                \"cpu\": \"100m\",\n                                \"memory\": \"100Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"bpf-maps\",\n                                \"mountPath\": \"/sys/fs/bpf\",\n                                \"mountPropagation\": \"HostToContainer\"\n                            },\n                            {\n                                \"name\": \"cilium-run\",\n                                \"mountPath\": \"/var/run/cilium\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-pk4d6\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"capabilities\": {\n                                \"add\": [\n                                    \"NET_ADMIN\"\n                                ]\n                            },\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"cilium-agent\",\n                        \"image\": \"docker.io/cilium/cilium:v1.10.0\",\n                        \"command\": [\n                            \"cilium-agent\"\n                        ],\n                        \"args\": [\n                            \"--config-dir=/tmp/cilium/config-map\"\n                        ],\n                        \"env\": [\n                            {\n                                \"name\": \"K8S_NODE_NAME\",\n                                \"valueFrom\": {\n                                    \"fieldRef\": {\n                                        \"apiVersion\": \"v1\",\n                                        \"fieldPath\": \"spec.nodeName\"\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"CILIUM_K8S_NAMESPACE\",\n                                \"valueFrom\": {\n                                    \"fieldRef\": {\n                                        \"apiVersion\": \"v1\",\n                                        \"fieldPath\": \"metadata.namespace\"\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"CILIUM_CLUSTERMESH_CONFIG\",\n                                \"value\": \"/var/lib/cilium/clustermesh/\"\n                            },\n                            {\n                                \"name\": \"CILIUM_CNI_CHAINING_MODE\",\n                                \"valueFrom\": {\n                                    \"configMapKeyRef\": {\n                                        \"name\": \"cilium-config\",\n                                        \"key\": \"cni-chaining-mode\",\n                                        \"optional\": true\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"CILIUM_CUSTOM_CNI_CONF\",\n                                \"valueFrom\": {\n                                    \"configMapKeyRef\": {\n                                        \"name\": \"cilium-config\",\n                                        \"key\": \"custom-cni-conf\",\n                                        \"optional\": true\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                \"value\": \"api.internal.e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io\"\n                            },\n                            {\n                                \"name\": \"KUBERNETES_SERVICE_PORT\",\n                                \"value\": \"443\"\n                            }\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"25m\",\n                                \"memory\": \"128Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"bpf-maps\",\n                                \"mountPath\": \"/sys/fs/bpf\"\n                            },\n                            {\n                                \"name\": \"cilium-run\",\n                                \"mountPath\": \"/var/run/cilium\"\n                            },\n                            {\n                                \"name\": \"cni-path\",\n                                \"mountPath\": \"/host/opt/cni/bin\"\n                            },\n                            {\n                                \"name\": \"etc-cni-netd\",\n                                \"mountPath\": \"/host/etc/cni/net.d\"\n                            },\n                            {\n                                \"name\": \"clustermesh-secrets\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/lib/cilium/clustermesh\"\n                            },\n                            {\n                                \"name\": \"cilium-config-path\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/tmp/cilium/config-map\"\n                            },\n                            {\n                                \"name\": \"lib-modules\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/lib/modules\"\n                            },\n                            {\n                                \"name\": \"xtables-lock\",\n                                \"mountPath\": \"/run/xtables.lock\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-pk4d6\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"livenessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/healthz\",\n                                \"port\": 9876,\n                                \"host\": \"127.0.0.1\",\n                                \"scheme\": \"HTTP\",\n                                \"httpHeaders\": [\n                                    {\n                                        \"name\": \"brief\",\n                                        \"value\": \"true\"\n                                    }\n                                ]\n                            },\n                            \"timeoutSeconds\": 5,\n                            \"periodSeconds\": 30,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 10\n                        },\n                        \"readinessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/healthz\",\n                                \"port\": 9876,\n                                \"host\": \"127.0.0.1\",\n                                \"scheme\": \"HTTP\",\n                                \"httpHeaders\": [\n                                    {\n                                        \"name\": \"brief\",\n                                        \"value\": \"true\"\n                                    }\n                                ]\n                            },\n                            \"initialDelaySeconds\": 5,\n                            \"timeoutSeconds\": 5,\n                            \"periodSeconds\": 30,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 3\n                        },\n                        \"startupProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/healthz\",\n                                \"port\": 9876,\n                                \"host\": \"127.0.0.1\",\n                                \"scheme\": \"HTTP\",\n                                \"httpHeaders\": [\n                                    {\n                                        \"name\": \"brief\",\n                                        \"value\": \"true\"\n                                    }\n                                ]\n                            },\n                            \"timeoutSeconds\": 1,\n                            \"periodSeconds\": 2,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 24\n                        },\n                        \"lifecycle\": {\n                            \"postStart\": {\n                                \"exec\": {\n                                    \"command\": [\n                                        \"/cni-install.sh\",\n                                        \"--cni-exclusive=true\"\n                                    ]\n                                }\n                            },\n                            \"preStop\": {\n                                \"exec\": {\n                                    \"command\": [\n                                        \"/cni-uninstall.sh\"\n                                    ]\n                                }\n                            }\n                        },\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"capabilities\": {\n                                \"add\": [\n                                    \"NET_ADMIN\",\n                                    \"SYS_MODULE\"\n                                ]\n                            },\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 1,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"serviceAccountName\": \"cilium\",\n                \"serviceAccount\": \"cilium\",\n                \"nodeName\": \"ip-172-20-55-143.ca-central-1.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"affinity\": {\n                    \"nodeAffinity\": {\n                        \"requiredDuringSchedulingIgnoredDuringExecution\": {\n                            \"nodeSelectorTerms\": [\n                                {\n                                    \"matchFields\": [\n                                        {\n                                            \"key\": \"metadata.name\",\n                                            \"operator\": \"In\",\n                                            \"values\": [\n                                                \"ip-172-20-55-143.ca-central-1.compute.internal\"\n                                            ]\n                                        }\n                                    ]\n                                }\n                            ]\n                        }\n                    },\n                    \"podAntiAffinity\": {\n                        \"requiredDuringSchedulingIgnoredDuringExecution\": [\n                            {\n                                \"labelSelector\": {\n                                    \"matchExpressions\": [\n                                        {\n                                            \"key\": \"k8s-app\",\n                                            \"operator\": \"In\",\n                                            \"values\": [\n                                                \"cilium\"\n                                            ]\n                                        }\n                                    ]\n                                },\n                                \"topologyKey\": \"kubernetes.io/hostname\"\n                            }\n                        ]\n                    }\n                },\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/disk-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/memory-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/pid-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unschedulable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/network-unavailable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:09:12Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:09:23Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:09:23Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:09:01Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.55.143\",\n                \"podIP\": \"172.20.55.143\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.55.143\"\n                    }\n                ],\n                \"startTime\": \"2021-06-05T07:09:03Z\",\n                \"initContainerStatuses\": [\n                    {\n                        \"name\": \"clean-cilium-state\",\n                        \"state\": {\n                            \"terminated\": {\n                                \"exitCode\": 0,\n                                \"reason\": \"Completed\",\n                                \"startedAt\": \"2021-06-05T07:09:11Z\",\n                                \"finishedAt\": \"2021-06-05T07:09:11Z\",\n                                \"containerID\": \"containerd://137c0ac880aa6214986df13e8cab6a2706face3e7cf0e0178276671e391045e4\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"docker.io/cilium/cilium:v1.10.0\",\n                        \"imageID\": \"docker.io/cilium/cilium@sha256:587627d909ffe0418c0bd907516496844867a21812946af82096d367760e4c1e\",\n                        \"containerID\": \"containerd://137c0ac880aa6214986df13e8cab6a2706face3e7cf0e0178276671e391045e4\"\n                    }\n                ],\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"cilium-agent\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-06-05T07:09:12Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"docker.io/cilium/cilium:v1.10.0\",\n                        \"imageID\": \"docker.io/cilium/cilium@sha256:587627d909ffe0418c0bd907516496844867a21812946af82096d367760e4c1e\",\n                        \"containerID\": \"containerd://5db93b203b3e3edcfcf64b5a31569437b7ee60e8eab73101b2fe8275c932c3de\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-operator-794454784c-dc7nv\",\n                \"generateName\": \"cilium-operator-794454784c-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"c035a725-54ce-4b02-bfe6-f6cc1a42464a\",\n                \"resourceVersion\": \"726\",\n                \"creationTimestamp\": \"2021-06-05T07:07:52Z\",\n                \"labels\": {\n                    \"io.cilium/app\": \"operator\",\n                    \"name\": \"cilium-operator\",\n                    \"pod-template-hash\": \"794454784c\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"ReplicaSet\",\n                        \"name\": \"cilium-operator-794454784c\",\n                        \"uid\": \"3adf6d33-0dd4-472b-9d08-68faeed2429e\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"cilium-config-path\",\n                        \"configMap\": {\n                            \"name\": \"cilium-config\",\n                            \"defaultMode\": 420\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-xjdzk\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"cilium-operator\",\n                        \"image\": \"docker.io/cilium/operator:v1.10.0\",\n                        \"command\": [\n                            \"cilium-operator\"\n                        ],\n                        \"args\": [\n                            \"--config-dir=/tmp/cilium/config-map\",\n                            \"--debug=$(CILIUM_DEBUG)\",\n                            \"--eni-tags=KubernetesCluster=e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io\"\n                        ],\n                        \"env\": [\n                            {\n                                \"name\": \"K8S_NODE_NAME\",\n                                \"valueFrom\": {\n                                    \"fieldRef\": {\n                                        \"apiVersion\": \"v1\",\n                                        \"fieldPath\": \"spec.nodeName\"\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"CILIUM_K8S_NAMESPACE\",\n                                \"valueFrom\": {\n                                    \"fieldRef\": {\n                                        \"apiVersion\": \"v1\",\n                                        \"fieldPath\": \"metadata.namespace\"\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"CILIUM_DEBUG\",\n                                \"valueFrom\": {\n                                    \"configMapKeyRef\": {\n                                        \"name\": \"cilium-config\",\n                                        \"key\": \"debug\",\n                                        \"optional\": true\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                \"value\": \"api.internal.e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io\"\n                            },\n                            {\n                                \"name\": \"KUBERNETES_SERVICE_PORT\",\n                                \"value\": \"443\"\n                            }\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"25m\",\n                                \"memory\": \"128Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"cilium-config-path\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/tmp/cilium/config-map\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-xjdzk\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"livenessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/healthz\",\n                                \"port\": 9234,\n                                \"host\": \"127.0.0.1\",\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"initialDelaySeconds\": 60,\n                            \"timeoutSeconds\": 3,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 3\n                        },\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\"\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeSelector\": {\n                    \"node-role.kubernetes.io/master\": \"\"\n                },\n                \"serviceAccountName\": \"cilium-operator\",\n                \"serviceAccount\": \"cilium-operator\",\n                \"nodeName\": \"ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"operator\": \"Exists\"\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:07:52Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:09:10Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:09:10Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:07:52Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.37.235\",\n                \"podIP\": \"172.20.37.235\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.37.235\"\n                    }\n                ],\n                \"startTime\": \"2021-06-05T07:07:52Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"cilium-operator\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-06-05T07:09:09Z\"\n                            }\n                        },\n                        \"lastState\": {\n                            \"terminated\": {\n                                \"exitCode\": 1,\n                                \"reason\": \"Error\",\n                                \"startedAt\": \"2021-06-05T07:08:03Z\",\n                                \"finishedAt\": \"2021-06-05T07:09:08Z\",\n                                \"containerID\": \"containerd://1fa0eb34ebbb9bcebe1e4bfcede075af11be191d07721c8e90cf511c508a224e\"\n                            }\n                        },\n                        \"ready\": true,\n                        \"restartCount\": 1,\n                        \"image\": \"docker.io/cilium/operator:v1.10.0\",\n                        \"imageID\": \"docker.io/cilium/operator@sha256:d0ec430f14a39e0993abef058176c8e41387b58b4354e4bf658af47411867be7\",\n                        \"containerID\": \"containerd://abb1b2b2d1957c111d8e7977abdb48653f07e6be909fed549dfb0a43bd437405\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-swx97\",\n                \"generateName\": \"cilium-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"0044d02a-34ea-49fd-83b7-3993265daa4e\",\n                \"resourceVersion\": \"845\",\n                \"creationTimestamp\": \"2021-06-05T07:09:06Z\",\n                \"labels\": {\n                    \"controller-revision-hash\": \"6554fb78ff\",\n                    \"k8s-app\": \"cilium\",\n                    \"kubernetes.io/cluster-service\": \"true\",\n                    \"pod-template-generation\": \"1\"\n                },\n                \"annotations\": {\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"DaemonSet\",\n                        \"name\": \"cilium\",\n                        \"uid\": \"a43e0fc8-0e8f-4934-b573-82baa5f51c0c\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"cilium-run\",\n                        \"hostPath\": {\n                            \"path\": \"/var/run/cilium\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"bpf-maps\",\n                        \"hostPath\": {\n                            \"path\": \"/sys/fs/bpf\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"cni-path\",\n                        \"hostPath\": {\n                            \"path\": \"/opt/cni/bin\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"etc-cni-netd\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/cni/net.d\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"lib-modules\",\n                        \"hostPath\": {\n                            \"path\": \"/lib/modules\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"xtables-lock\",\n                        \"hostPath\": {\n                            \"path\": \"/run/xtables.lock\",\n                            \"type\": \"FileOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"clustermesh-secrets\",\n                        \"secret\": {\n                            \"secretName\": \"cilium-clustermesh\",\n                            \"defaultMode\": 420,\n                            \"optional\": true\n                        }\n                    },\n                    {\n                        \"name\": \"cilium-config-path\",\n                        \"configMap\": {\n                            \"name\": \"cilium-config\",\n                            \"defaultMode\": 420\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-nr6ws\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"initContainers\": [\n                    {\n                        \"name\": \"clean-cilium-state\",\n                        \"image\": \"docker.io/cilium/cilium:v1.10.0\",\n                        \"command\": [\n                            \"/init-container.sh\"\n                        ],\n                        \"env\": [\n                            {\n                                \"name\": \"CILIUM_ALL_STATE\",\n                                \"valueFrom\": {\n                                    \"configMapKeyRef\": {\n                                        \"name\": \"cilium-config\",\n                                        \"key\": \"clean-cilium-state\",\n                                        \"optional\": true\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"CILIUM_BPF_STATE\",\n                                \"valueFrom\": {\n                                    \"configMapKeyRef\": {\n                                        \"name\": \"cilium-config\",\n                                        \"key\": \"clean-cilium-bpf-state\",\n                                        \"optional\": true\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"CILIUM_WAIT_BPF_MOUNT\",\n                                \"valueFrom\": {\n                                    \"configMapKeyRef\": {\n                                        \"name\": \"cilium-config\",\n                                        \"key\": \"wait-bpf-mount\",\n                                        \"optional\": true\n                                    }\n                                }\n                            }\n                        ],\n                        \"resources\": {\n                            \"limits\": {\n                                \"memory\": \"100Mi\"\n                            },\n                            \"requests\": {\n                                \"cpu\": \"100m\",\n                                \"memory\": \"100Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"bpf-maps\",\n                                \"mountPath\": \"/sys/fs/bpf\",\n                                \"mountPropagation\": \"HostToContainer\"\n                            },\n                            {\n                                \"name\": \"cilium-run\",\n                                \"mountPath\": \"/var/run/cilium\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-nr6ws\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"capabilities\": {\n                                \"add\": [\n                                    \"NET_ADMIN\"\n                                ]\n                            },\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"cilium-agent\",\n                        \"image\": \"docker.io/cilium/cilium:v1.10.0\",\n                        \"command\": [\n                            \"cilium-agent\"\n                        ],\n                        \"args\": [\n                            \"--config-dir=/tmp/cilium/config-map\"\n                        ],\n                        \"env\": [\n                            {\n                                \"name\": \"K8S_NODE_NAME\",\n                                \"valueFrom\": {\n                                    \"fieldRef\": {\n                                        \"apiVersion\": \"v1\",\n                                        \"fieldPath\": \"spec.nodeName\"\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"CILIUM_K8S_NAMESPACE\",\n                                \"valueFrom\": {\n                                    \"fieldRef\": {\n                                        \"apiVersion\": \"v1\",\n                                        \"fieldPath\": \"metadata.namespace\"\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"CILIUM_CLUSTERMESH_CONFIG\",\n                                \"value\": \"/var/lib/cilium/clustermesh/\"\n                            },\n                            {\n                                \"name\": \"CILIUM_CNI_CHAINING_MODE\",\n                                \"valueFrom\": {\n                                    \"configMapKeyRef\": {\n                                        \"name\": \"cilium-config\",\n                                        \"key\": \"cni-chaining-mode\",\n                                        \"optional\": true\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"CILIUM_CUSTOM_CNI_CONF\",\n                                \"valueFrom\": {\n                                    \"configMapKeyRef\": {\n                                        \"name\": \"cilium-config\",\n                                        \"key\": \"custom-cni-conf\",\n                                        \"optional\": true\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                \"value\": \"api.internal.e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io\"\n                            },\n                            {\n                                \"name\": \"KUBERNETES_SERVICE_PORT\",\n                                \"value\": \"443\"\n                            }\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"25m\",\n                                \"memory\": \"128Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"bpf-maps\",\n                                \"mountPath\": \"/sys/fs/bpf\"\n                            },\n                            {\n                                \"name\": \"cilium-run\",\n                                \"mountPath\": \"/var/run/cilium\"\n                            },\n                            {\n                                \"name\": \"cni-path\",\n                                \"mountPath\": \"/host/opt/cni/bin\"\n                            },\n                            {\n                                \"name\": \"etc-cni-netd\",\n                                \"mountPath\": \"/host/etc/cni/net.d\"\n                            },\n                            {\n                                \"name\": \"clustermesh-secrets\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/lib/cilium/clustermesh\"\n                            },\n                            {\n                                \"name\": \"cilium-config-path\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/tmp/cilium/config-map\"\n                            },\n                            {\n                                \"name\": \"lib-modules\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/lib/modules\"\n                            },\n                            {\n                                \"name\": \"xtables-lock\",\n                                \"mountPath\": \"/run/xtables.lock\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-nr6ws\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"livenessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/healthz\",\n                                \"port\": 9876,\n                                \"host\": \"127.0.0.1\",\n                                \"scheme\": \"HTTP\",\n                                \"httpHeaders\": [\n                                    {\n                                        \"name\": \"brief\",\n                                        \"value\": \"true\"\n                                    }\n                                ]\n                            },\n                            \"timeoutSeconds\": 5,\n                            \"periodSeconds\": 30,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 10\n                        },\n                        \"readinessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/healthz\",\n                                \"port\": 9876,\n                                \"host\": \"127.0.0.1\",\n                                \"scheme\": \"HTTP\",\n                                \"httpHeaders\": [\n                                    {\n                                        \"name\": \"brief\",\n                                        \"value\": \"true\"\n                                    }\n                                ]\n                            },\n                            \"initialDelaySeconds\": 5,\n                            \"timeoutSeconds\": 5,\n                            \"periodSeconds\": 30,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 3\n                        },\n                        \"startupProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/healthz\",\n                                \"port\": 9876,\n                                \"host\": \"127.0.0.1\",\n                                \"scheme\": \"HTTP\",\n                                \"httpHeaders\": [\n                                    {\n                                        \"name\": \"brief\",\n                                        \"value\": \"true\"\n                                    }\n                                ]\n                            },\n                            \"timeoutSeconds\": 1,\n                            \"periodSeconds\": 2,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 24\n                        },\n                        \"lifecycle\": {\n                            \"postStart\": {\n                                \"exec\": {\n                                    \"command\": [\n                                        \"/cni-install.sh\",\n                                        \"--cni-exclusive=true\"\n                                    ]\n                                }\n                            },\n                            \"preStop\": {\n                                \"exec\": {\n                                    \"command\": [\n                                        \"/cni-uninstall.sh\"\n                                    ]\n                                }\n                            }\n                        },\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"capabilities\": {\n                                \"add\": [\n                                    \"NET_ADMIN\",\n                                    \"SYS_MODULE\"\n                                ]\n                            },\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 1,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"serviceAccountName\": \"cilium\",\n                \"serviceAccount\": \"cilium\",\n                \"nodeName\": \"ip-172-20-62-33.ca-central-1.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"affinity\": {\n                    \"nodeAffinity\": {\n                        \"requiredDuringSchedulingIgnoredDuringExecution\": {\n                            \"nodeSelectorTerms\": [\n                                {\n                                    \"matchFields\": [\n                                        {\n                                            \"key\": \"metadata.name\",\n                                            \"operator\": \"In\",\n                                            \"values\": [\n                                                \"ip-172-20-62-33.ca-central-1.compute.internal\"\n                                            ]\n                                        }\n                                    ]\n                                }\n                            ]\n                        }\n                    },\n                    \"podAntiAffinity\": {\n                        \"requiredDuringSchedulingIgnoredDuringExecution\": [\n                            {\n                                \"labelSelector\": {\n                                    \"matchExpressions\": [\n                                        {\n                                            \"key\": \"k8s-app\",\n                                            \"operator\": \"In\",\n                                            \"values\": [\n                                                \"cilium\"\n                                            ]\n                                        }\n                                    ]\n                                },\n                                \"topologyKey\": \"kubernetes.io/hostname\"\n                            }\n                        ]\n                    }\n                },\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/disk-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/memory-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/pid-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unschedulable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/network-unavailable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:09:17Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:09:27Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:09:27Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:09:06Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.62.33\",\n                \"podIP\": \"172.20.62.33\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.62.33\"\n                    }\n                ],\n                \"startTime\": \"2021-06-05T07:09:07Z\",\n                \"initContainerStatuses\": [\n                    {\n                        \"name\": \"clean-cilium-state\",\n                        \"state\": {\n                            \"terminated\": {\n                                \"exitCode\": 0,\n                                \"reason\": \"Completed\",\n                                \"startedAt\": \"2021-06-05T07:09:16Z\",\n                                \"finishedAt\": \"2021-06-05T07:09:16Z\",\n                                \"containerID\": \"containerd://9d5151cec02a63aa2c7afa746179176044c4b70e1312556bb4c18f3d162ae0de\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"docker.io/cilium/cilium:v1.10.0\",\n                        \"imageID\": \"docker.io/cilium/cilium@sha256:587627d909ffe0418c0bd907516496844867a21812946af82096d367760e4c1e\",\n                        \"containerID\": \"containerd://9d5151cec02a63aa2c7afa746179176044c4b70e1312556bb4c18f3d162ae0de\"\n                    }\n                ],\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"cilium-agent\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-06-05T07:09:17Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"docker.io/cilium/cilium:v1.10.0\",\n                        \"imageID\": \"docker.io/cilium/cilium@sha256:587627d909ffe0418c0bd907516496844867a21812946af82096d367760e4c1e\",\n                        \"containerID\": \"containerd://44dd4b05abd38c45b8210a05ea7a0127647ecc12d9c365947dd75e1bb825a334\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"cilium-wqwtd\",\n                \"generateName\": \"cilium-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3e81529b-0170-44ef-82c1-6261de4c6999\",\n                \"resourceVersion\": \"831\",\n                \"creationTimestamp\": \"2021-06-05T07:09:03Z\",\n                \"labels\": {\n                    \"controller-revision-hash\": \"6554fb78ff\",\n                    \"k8s-app\": \"cilium\",\n                    \"kubernetes.io/cluster-service\": \"true\",\n                    \"pod-template-generation\": \"1\"\n                },\n                \"annotations\": {\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"DaemonSet\",\n                        \"name\": \"cilium\",\n                        \"uid\": \"a43e0fc8-0e8f-4934-b573-82baa5f51c0c\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"cilium-run\",\n                        \"hostPath\": {\n                            \"path\": \"/var/run/cilium\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"bpf-maps\",\n                        \"hostPath\": {\n                            \"path\": \"/sys/fs/bpf\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"cni-path\",\n                        \"hostPath\": {\n                            \"path\": \"/opt/cni/bin\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"etc-cni-netd\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/cni/net.d\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"lib-modules\",\n                        \"hostPath\": {\n                            \"path\": \"/lib/modules\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"xtables-lock\",\n                        \"hostPath\": {\n                            \"path\": \"/run/xtables.lock\",\n                            \"type\": \"FileOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"clustermesh-secrets\",\n                        \"secret\": {\n                            \"secretName\": \"cilium-clustermesh\",\n                            \"defaultMode\": 420,\n                            \"optional\": true\n                        }\n                    },\n                    {\n                        \"name\": \"cilium-config-path\",\n                        \"configMap\": {\n                            \"name\": \"cilium-config\",\n                            \"defaultMode\": 420\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-vtjn9\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"initContainers\": [\n                    {\n                        \"name\": \"clean-cilium-state\",\n                        \"image\": \"docker.io/cilium/cilium:v1.10.0\",\n                        \"command\": [\n                            \"/init-container.sh\"\n                        ],\n                        \"env\": [\n                            {\n                                \"name\": \"CILIUM_ALL_STATE\",\n                                \"valueFrom\": {\n                                    \"configMapKeyRef\": {\n                                        \"name\": \"cilium-config\",\n                                        \"key\": \"clean-cilium-state\",\n                                        \"optional\": true\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"CILIUM_BPF_STATE\",\n                                \"valueFrom\": {\n                                    \"configMapKeyRef\": {\n                                        \"name\": \"cilium-config\",\n                                        \"key\": \"clean-cilium-bpf-state\",\n                                        \"optional\": true\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"CILIUM_WAIT_BPF_MOUNT\",\n                                \"valueFrom\": {\n                                    \"configMapKeyRef\": {\n                                        \"name\": \"cilium-config\",\n                                        \"key\": \"wait-bpf-mount\",\n                                        \"optional\": true\n                                    }\n                                }\n                            }\n                        ],\n                        \"resources\": {\n                            \"limits\": {\n                                \"memory\": \"100Mi\"\n                            },\n                            \"requests\": {\n                                \"cpu\": \"100m\",\n                                \"memory\": \"100Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"bpf-maps\",\n                                \"mountPath\": \"/sys/fs/bpf\",\n                                \"mountPropagation\": \"HostToContainer\"\n                            },\n                            {\n                                \"name\": \"cilium-run\",\n                                \"mountPath\": \"/var/run/cilium\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-vtjn9\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"capabilities\": {\n                                \"add\": [\n                                    \"NET_ADMIN\"\n                                ]\n                            },\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"cilium-agent\",\n                        \"image\": \"docker.io/cilium/cilium:v1.10.0\",\n                        \"command\": [\n                            \"cilium-agent\"\n                        ],\n                        \"args\": [\n                            \"--config-dir=/tmp/cilium/config-map\"\n                        ],\n                        \"env\": [\n                            {\n                                \"name\": \"K8S_NODE_NAME\",\n                                \"valueFrom\": {\n                                    \"fieldRef\": {\n                                        \"apiVersion\": \"v1\",\n                                        \"fieldPath\": \"spec.nodeName\"\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"CILIUM_K8S_NAMESPACE\",\n                                \"valueFrom\": {\n                                    \"fieldRef\": {\n                                        \"apiVersion\": \"v1\",\n                                        \"fieldPath\": \"metadata.namespace\"\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"CILIUM_CLUSTERMESH_CONFIG\",\n                                \"value\": \"/var/lib/cilium/clustermesh/\"\n                            },\n                            {\n                                \"name\": \"CILIUM_CNI_CHAINING_MODE\",\n                                \"valueFrom\": {\n                                    \"configMapKeyRef\": {\n                                        \"name\": \"cilium-config\",\n                                        \"key\": \"cni-chaining-mode\",\n                                        \"optional\": true\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"CILIUM_CUSTOM_CNI_CONF\",\n                                \"valueFrom\": {\n                                    \"configMapKeyRef\": {\n                                        \"name\": \"cilium-config\",\n                                        \"key\": \"custom-cni-conf\",\n                                        \"optional\": true\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                \"value\": \"api.internal.e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io\"\n                            },\n                            {\n                                \"name\": \"KUBERNETES_SERVICE_PORT\",\n                                \"value\": \"443\"\n                            }\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"25m\",\n                                \"memory\": \"128Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"bpf-maps\",\n                                \"mountPath\": \"/sys/fs/bpf\"\n                            },\n                            {\n                                \"name\": \"cilium-run\",\n                                \"mountPath\": \"/var/run/cilium\"\n                            },\n                            {\n                                \"name\": \"cni-path\",\n                                \"mountPath\": \"/host/opt/cni/bin\"\n                            },\n                            {\n                                \"name\": \"etc-cni-netd\",\n                                \"mountPath\": \"/host/etc/cni/net.d\"\n                            },\n                            {\n                                \"name\": \"clustermesh-secrets\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/lib/cilium/clustermesh\"\n                            },\n                            {\n                                \"name\": \"cilium-config-path\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/tmp/cilium/config-map\"\n                            },\n                            {\n                                \"name\": \"lib-modules\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/lib/modules\"\n                            },\n                            {\n                                \"name\": \"xtables-lock\",\n                                \"mountPath\": \"/run/xtables.lock\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-vtjn9\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"livenessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/healthz\",\n                                \"port\": 9876,\n                                \"host\": \"127.0.0.1\",\n                                \"scheme\": \"HTTP\",\n                                \"httpHeaders\": [\n                                    {\n                                        \"name\": \"brief\",\n                                        \"value\": \"true\"\n                                    }\n                                ]\n                            },\n                            \"timeoutSeconds\": 5,\n                            \"periodSeconds\": 30,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 10\n                        },\n                        \"readinessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/healthz\",\n                                \"port\": 9876,\n                                \"host\": \"127.0.0.1\",\n                                \"scheme\": \"HTTP\",\n                                \"httpHeaders\": [\n                                    {\n                                        \"name\": \"brief\",\n                                        \"value\": \"true\"\n                                    }\n                                ]\n                            },\n                            \"initialDelaySeconds\": 5,\n                            \"timeoutSeconds\": 5,\n                            \"periodSeconds\": 30,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 3\n                        },\n                        \"startupProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/healthz\",\n                                \"port\": 9876,\n                                \"host\": \"127.0.0.1\",\n                                \"scheme\": \"HTTP\",\n                                \"httpHeaders\": [\n                                    {\n                                        \"name\": \"brief\",\n                                        \"value\": \"true\"\n                                    }\n                                ]\n                            },\n                            \"timeoutSeconds\": 1,\n                            \"periodSeconds\": 2,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 24\n                        },\n                        \"lifecycle\": {\n                            \"postStart\": {\n                                \"exec\": {\n                                    \"command\": [\n                                        \"/cni-install.sh\",\n                                        \"--cni-exclusive=true\"\n                                    ]\n                                }\n                            },\n                            \"preStop\": {\n                                \"exec\": {\n                                    \"command\": [\n                                        \"/cni-uninstall.sh\"\n                                    ]\n                                }\n                            }\n                        },\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"capabilities\": {\n                                \"add\": [\n                                    \"NET_ADMIN\",\n                                    \"SYS_MODULE\"\n                                ]\n                            },\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 1,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"serviceAccountName\": \"cilium\",\n                \"serviceAccount\": \"cilium\",\n                \"nodeName\": \"ip-172-20-42-252.ca-central-1.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"affinity\": {\n                    \"nodeAffinity\": {\n                        \"requiredDuringSchedulingIgnoredDuringExecution\": {\n                            \"nodeSelectorTerms\": [\n                                {\n                                    \"matchFields\": [\n                                        {\n                                            \"key\": \"metadata.name\",\n                                            \"operator\": \"In\",\n                                            \"values\": [\n                                                \"ip-172-20-42-252.ca-central-1.compute.internal\"\n                                            ]\n                                        }\n                                    ]\n                                }\n                            ]\n                        }\n                    },\n                    \"podAntiAffinity\": {\n                        \"requiredDuringSchedulingIgnoredDuringExecution\": [\n                            {\n                                \"labelSelector\": {\n                                    \"matchExpressions\": [\n                                        {\n                                            \"key\": \"k8s-app\",\n                                            \"operator\": \"In\",\n                                            \"values\": [\n                                                \"cilium\"\n                                            ]\n                                        }\n                                    ]\n                                },\n                                \"topologyKey\": \"kubernetes.io/hostname\"\n                            }\n                        ]\n                    }\n                },\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/disk-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/memory-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/pid-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unschedulable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/network-unavailable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:09:14Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:09:25Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:09:25Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:09:03Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.42.252\",\n                \"podIP\": \"172.20.42.252\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.42.252\"\n                    }\n                ],\n                \"startTime\": \"2021-06-05T07:09:05Z\",\n                \"initContainerStatuses\": [\n                    {\n                        \"name\": \"clean-cilium-state\",\n                        \"state\": {\n                            \"terminated\": {\n                                \"exitCode\": 0,\n                                \"reason\": \"Completed\",\n                                \"startedAt\": \"2021-06-05T07:09:13Z\",\n                                \"finishedAt\": \"2021-06-05T07:09:13Z\",\n                                \"containerID\": \"containerd://5d209354b65f9ebc9b8bb23ce74d202f8187d9ac118157dbd7424d0a45718fdb\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"docker.io/cilium/cilium:v1.10.0\",\n                        \"imageID\": \"docker.io/cilium/cilium@sha256:587627d909ffe0418c0bd907516496844867a21812946af82096d367760e4c1e\",\n                        \"containerID\": \"containerd://5d209354b65f9ebc9b8bb23ce74d202f8187d9ac118157dbd7424d0a45718fdb\"\n                    }\n                ],\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"cilium-agent\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-06-05T07:09:14Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"docker.io/cilium/cilium:v1.10.0\",\n                        \"imageID\": \"docker.io/cilium/cilium@sha256:587627d909ffe0418c0bd907516496844867a21812946af82096d367760e4c1e\",\n                        \"containerID\": \"containerd://79c163553accb71a1280d9737bce1364ff380c0cde23f8504240016732063e3c\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-6f594f4c58-8v4pg\",\n                \"generateName\": \"coredns-autoscaler-6f594f4c58-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"0caaa7c9-6536-401a-ad35-aafec12ab709\",\n                \"resourceVersion\": \"875\",\n                \"creationTimestamp\": \"2021-06-05T07:07:52Z\",\n                \"labels\": {\n                    \"k8s-app\": \"coredns-autoscaler\",\n                    \"pod-template-hash\": \"6f594f4c58\"\n                },\n                \"annotations\": {\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"ReplicaSet\",\n                        \"name\": \"coredns-autoscaler-6f594f4c58\",\n                        \"uid\": \"2a2f93ff-2028-4dbc-aac4-c3e24eeff348\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"kube-api-access-vsx2x\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"autoscaler\",\n                        \"image\": \"k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.3\",\n                        \"command\": [\n                            \"/cluster-proportional-autoscaler\",\n                            \"--namespace=kube-system\",\n                            \"--configmap=coredns-autoscaler\",\n                            \"--target=Deployment/coredns\",\n                            \"--default-params={\\\"linear\\\":{\\\"coresPerReplica\\\":256,\\\"nodesPerReplica\\\":16,\\\"preventSinglePointFailure\\\":true}}\",\n                            \"--logtostderr=true\",\n                            \"--v=2\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"20m\",\n                                \"memory\": \"10Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"kube-api-access-vsx2x\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\"\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"serviceAccountName\": \"coredns-autoscaler\",\n                \"serviceAccount\": \"coredns-autoscaler\",\n                \"nodeName\": \"ip-172-20-55-143.ca-central-1.compute.internal\",\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\",\n                        \"tolerationSeconds\": 300\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\",\n                        \"tolerationSeconds\": 300\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:09:22Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:09:32Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:09:32Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:09:22Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.55.143\",\n                \"podIP\": \"100.96.2.234\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"100.96.2.234\"\n                    }\n                ],\n                \"startTime\": \"2021-06-05T07:09:22Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"autoscaler\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-06-05T07:09:32Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.3\",\n                        \"imageID\": \"k8s.gcr.io/cpa/cluster-proportional-autoscaler@sha256:67640771ad9fc56f109d5b01e020f0c858e7c890bb0eb15ba0ebd325df3285e7\",\n                        \"containerID\": \"containerd://9a0ec678fd3f3350c5de5467f37ec339645441f58541f0f8b1f5db37c78c0116\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-f45c4bf76-f85fb\",\n                \"generateName\": \"coredns-f45c4bf76-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"690d673f-67cd-440e-a3e6-c371cf6b6ecc\",\n                \"resourceVersion\": \"910\",\n                \"creationTimestamp\": \"2021-06-05T07:09:32Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-dns\",\n                    \"pod-template-hash\": \"f45c4bf76\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"ReplicaSet\",\n                        \"name\": \"coredns-f45c4bf76\",\n                        \"uid\": \"f30f550c-0d69-4278-8025-38052833403d\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"config-volume\",\n                        \"configMap\": {\n                            \"name\": \"coredns\",\n                            \"items\": [\n                                {\n                                    \"key\": \"Corefile\",\n                                    \"path\": \"Corefile\"\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-l4br5\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"coredns\",\n                        \"image\": \"coredns/coredns:1.8.3\",\n                        \"args\": [\n                            \"-conf\",\n                            \"/etc/coredns/Corefile\"\n                        ],\n                        \"ports\": [\n                            {\n                                \"name\": \"dns\",\n                                \"containerPort\": 53,\n                                \"protocol\": \"UDP\"\n                            },\n                            {\n                                \"name\": \"dns-tcp\",\n                                \"containerPort\": 53,\n                                \"protocol\": \"TCP\"\n                            },\n                            {\n                                \"name\": \"metrics\",\n                                \"containerPort\": 9153,\n                                \"protocol\": \"TCP\"\n                            }\n                        ],\n                        \"resources\": {\n                            \"limits\": {\n                                \"memory\": \"170Mi\"\n                            },\n                            \"requests\": {\n                                \"cpu\": \"100m\",\n                                \"memory\": \"70Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"config-volume\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/coredns\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-l4br5\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"livenessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/health\",\n                                \"port\": 8080,\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"initialDelaySeconds\": 60,\n                            \"timeoutSeconds\": 5,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 5\n                        },\n                        \"readinessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/ready\",\n                                \"port\": 8181,\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"timeoutSeconds\": 1,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 3\n                        },\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"capabilities\": {\n                                \"add\": [\n                                    \"NET_BIND_SERVICE\"\n                                ],\n                                \"drop\": [\n                                    \"all\"\n                                ]\n                            },\n                            \"readOnlyRootFilesystem\": true,\n                            \"allowPrivilegeEscalation\": false\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"Default\",\n                \"nodeSelector\": {\n                    \"beta.kubernetes.io/os\": \"linux\"\n                },\n                \"serviceAccountName\": \"coredns\",\n                \"serviceAccount\": \"coredns\",\n                \"nodeName\": \"ip-172-20-42-252.ca-central-1.compute.internal\",\n                \"securityContext\": {},\n                \"affinity\": {\n                    \"podAntiAffinity\": {\n                        \"preferredDuringSchedulingIgnoredDuringExecution\": [\n                            {\n                                \"weight\": 100,\n                                \"podAffinityTerm\": {\n                                    \"labelSelector\": {\n                                        \"matchExpressions\": [\n                                            {\n                                                \"key\": \"k8s-app\",\n                                                \"operator\": \"In\",\n                                                \"values\": [\n                                                    \"kube-dns\"\n                                                ]\n                                            }\n                                        ]\n                                    },\n                                    \"topologyKey\": \"kubernetes.io/hostname\"\n                                }\n                            }\n                        ]\n                    }\n                },\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\",\n                        \"tolerationSeconds\": 300\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\",\n                        \"tolerationSeconds\": 300\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:09:32Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:09:36Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:09:36Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:09:32Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.42.252\",\n                \"podIP\": \"100.96.3.43\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"100.96.3.43\"\n                    }\n                ],\n                \"startTime\": \"2021-06-05T07:09:32Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"coredns\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-06-05T07:09:35Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"docker.io/coredns/coredns:1.8.3\",\n                        \"imageID\": \"docker.io/coredns/coredns@sha256:642ff9910da6ea9a8624b0234eef52af9ca75ecbec474c5507cb096bdfbae4e5\",\n                        \"containerID\": \"containerd://33672934a759c5309f23186b23623b8ff2b9afc43a2c429abbf6b6c911acce75\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-f45c4bf76-gr4z9\",\n                \"generateName\": \"coredns-f45c4bf76-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"116a374d-38a2-4e8d-8f33-4e42c49717fa\",\n                \"resourceVersion\": \"865\",\n                \"creationTimestamp\": \"2021-06-05T07:07:52Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-dns\",\n                    \"pod-template-hash\": \"f45c4bf76\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"ReplicaSet\",\n                        \"name\": \"coredns-f45c4bf76\",\n                        \"uid\": \"f30f550c-0d69-4278-8025-38052833403d\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"config-volume\",\n                        \"configMap\": {\n                            \"name\": \"coredns\",\n                            \"items\": [\n                                {\n                                    \"key\": \"Corefile\",\n                                    \"path\": \"Corefile\"\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-zgm9z\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"coredns\",\n                        \"image\": \"coredns/coredns:1.8.3\",\n                        \"args\": [\n                            \"-conf\",\n                            \"/etc/coredns/Corefile\"\n                        ],\n                        \"ports\": [\n                            {\n                                \"name\": \"dns\",\n                                \"containerPort\": 53,\n                                \"protocol\": \"UDP\"\n                            },\n                            {\n                                \"name\": \"dns-tcp\",\n                                \"containerPort\": 53,\n                                \"protocol\": \"TCP\"\n                            },\n                            {\n                                \"name\": \"metrics\",\n                                \"containerPort\": 9153,\n                                \"protocol\": \"TCP\"\n                            }\n                        ],\n                        \"resources\": {\n                            \"limits\": {\n                                \"memory\": \"170Mi\"\n                            },\n                            \"requests\": {\n                                \"cpu\": \"100m\",\n                                \"memory\": \"70Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"config-volume\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/coredns\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-zgm9z\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"livenessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/health\",\n                                \"port\": 8080,\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"initialDelaySeconds\": 60,\n                            \"timeoutSeconds\": 5,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 5\n                        },\n                        \"readinessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/ready\",\n                                \"port\": 8181,\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"timeoutSeconds\": 1,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 3\n                        },\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"capabilities\": {\n                                \"add\": [\n                                    \"NET_BIND_SERVICE\"\n                                ],\n                                \"drop\": [\n                                    \"all\"\n                                ]\n                            },\n                            \"readOnlyRootFilesystem\": true,\n                            \"allowPrivilegeEscalation\": false\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"Default\",\n                \"nodeSelector\": {\n                    \"beta.kubernetes.io/os\": \"linux\"\n                },\n                \"serviceAccountName\": \"coredns\",\n                \"serviceAccount\": \"coredns\",\n                \"nodeName\": \"ip-172-20-48-31.ca-central-1.compute.internal\",\n                \"securityContext\": {},\n                \"affinity\": {\n                    \"podAntiAffinity\": {\n                        \"preferredDuringSchedulingIgnoredDuringExecution\": [\n                            {\n                                \"weight\": 100,\n                                \"podAffinityTerm\": {\n                                    \"labelSelector\": {\n                                        \"matchExpressions\": [\n                                            {\n                                                \"key\": \"k8s-app\",\n                                                \"operator\": \"In\",\n                                                \"values\": [\n                                                    \"kube-dns\"\n                                                ]\n                                            }\n                                        ]\n                                    },\n                                    \"topologyKey\": \"kubernetes.io/hostname\"\n                                }\n                            }\n                        ]\n                    }\n                },\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\",\n                        \"tolerationSeconds\": 300\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\",\n                        \"tolerationSeconds\": 300\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:09:21Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:09:32Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:09:32Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:09:21Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.48.31\",\n                \"podIP\": \"100.96.1.144\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"100.96.1.144\"\n                    }\n                ],\n                \"startTime\": \"2021-06-05T07:09:21Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"coredns\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-06-05T07:09:31Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"docker.io/coredns/coredns:1.8.3\",\n                        \"imageID\": \"docker.io/coredns/coredns@sha256:642ff9910da6ea9a8624b0234eef52af9ca75ecbec474c5507cb096bdfbae4e5\",\n                        \"containerID\": \"containerd://4aebb2768c136848f5f7d02a66351f98fb987bde4e7e5fc1423c4aa75102ae44\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-5f98b58844-jctdt\",\n                \"generateName\": \"dns-controller-5f98b58844-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d9b5af02-309d-4f2d-b0ad-0ddaf949bc4a\",\n                \"resourceVersion\": \"470\",\n                \"creationTimestamp\": \"2021-06-05T07:07:52Z\",\n                \"labels\": {\n                    \"k8s-addon\": \"dns-controller.addons.k8s.io\",\n                    \"k8s-app\": \"dns-controller\",\n                    \"pod-template-hash\": \"5f98b58844\",\n                    \"version\": \"v1.22.0-alpha.1\"\n                },\n                \"annotations\": {\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"ReplicaSet\",\n                        \"name\": \"dns-controller-5f98b58844\",\n                        \"uid\": \"cb72c25c-93e6-4611-8219-899d8960d79c\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"kube-api-access-t9pdf\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"dns-controller\",\n                        \"image\": \"k8s.gcr.io/kops/dns-controller:1.22.0-alpha.1\",\n                        \"command\": [\n                            \"/dns-controller\",\n                            \"--watch-ingress=false\",\n                            \"--dns=aws-route53\",\n                            \"--zone=*/ZEMLNXIIWQ0RV\",\n                            \"--zone=*/*\",\n                            \"-v=2\"\n                        ],\n                        \"env\": [\n                            {\n                                \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                \"value\": \"127.0.0.1\"\n                            }\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"50m\",\n                                \"memory\": \"50Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"kube-api-access-t9pdf\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"runAsNonRoot\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"Default\",\n                \"nodeSelector\": {\n                    \"node-role.kubernetes.io/master\": \"\"\n                },\n                \"serviceAccountName\": \"dns-controller\",\n                \"serviceAccount\": \"dns-controller\",\n                \"nodeName\": \"ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"operator\": \"Exists\"\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:07:52Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:07:53Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:07:53Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:07:52Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.37.235\",\n                \"podIP\": \"172.20.37.235\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.37.235\"\n                    }\n                ],\n                \"startTime\": \"2021-06-05T07:07:52Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"dns-controller\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-06-05T07:07:52Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/kops/dns-controller:1.22.0-alpha.1\",\n                        \"imageID\": \"sha256:0e7bee53bbe47eca71db4e59a6e9cac83888cc5391da5df6a74cc5a8bd193ebc\",\n                        \"containerID\": \"containerd://739e372272ebb4eddd0549413b948ff4056bddfd732a1068299de18c6a45f057\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-events-ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"e4f5c81b-b17c-46ed-b84c-8ec3e1a75485\",\n                \"resourceVersion\": \"598\",\n                \"creationTimestamp\": \"2021-06-05T07:08:39Z\",\n                \"labels\": {\n                    \"k8s-app\": \"etcd-manager-events\"\n                },\n                \"annotations\": {\n                    \"kubernetes.io/config.hash\": \"df915144f6a8fb9cabcadfbe68a42ad1\",\n                    \"kubernetes.io/config.mirror\": \"df915144f6a8fb9cabcadfbe68a42ad1\",\n                    \"kubernetes.io/config.seen\": \"2021-06-05T07:06:42.918226171Z\",\n                    \"kubernetes.io/config.source\": \"file\",\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"ip-172-20-37-235.ca-central-1.compute.internal\",\n                        \"uid\": \"d04e1632-a1ba-422d-99b5-e68359212bb9\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"rootfs\",\n                        \"hostPath\": {\n                            \"path\": \"/\",\n                            \"type\": \"Directory\"\n                        }\n                    },\n                    {\n                        \"name\": \"run\",\n                        \"hostPath\": {\n                            \"path\": \"/run\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"pki\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/kubernetes/pki/etcd-manager-events\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"varlogetcd\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/etcd-events.log\",\n                            \"type\": \"FileOrCreate\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"etcd-manager\",\n                        \"image\": \"k8s.gcr.io/etcdadm/etcd-manager:3.0.20210430\",\n                        \"command\": [\n                            \"/bin/sh\",\n                            \"-c\",\n                            \"mkfifo /tmp/pipe; (tee -a /var/log/etcd.log \\u003c /tmp/pipe \\u0026 ) ; exec /etcd-manager --backup-store=s3://k8s-kops-prow/e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io/backups/etcd/events --client-urls=https://__name__:4002 --cluster-name=etcd-events --containerized=true --dns-suffix=.internal.e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io --etcd-insecure=false --grpc-port=3997 --insecure=false --peer-urls=https://__name__:2381 --quarantine-client-urls=https://__name__:3995 --v=6 --volume-name-tag=k8s.io/etcd/events --volume-provider=aws --volume-tag=k8s.io/etcd/events --volume-tag=k8s.io/role/master=1 --volume-tag=kubernetes.io/cluster/e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io=owned \\u003e /tmp/pipe 2\\u003e\\u00261\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"100m\",\n                                \"memory\": \"100Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"rootfs\",\n                                \"mountPath\": \"/rootfs\"\n                            },\n                            {\n                                \"name\": \"run\",\n                                \"mountPath\": \"/run\"\n                            },\n                            {\n                                \"name\": \"pki\",\n                                \"mountPath\": \"/etc/kubernetes/pki/etcd-manager\"\n                            },\n                            {\n                                \"name\": \"varlogetcd\",\n                                \"mountPath\": \"/var/log/etcd.log\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"hostNetwork\": true,\n                \"hostPID\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:06:43Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:07:11Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:07:11Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:06:43Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.37.235\",\n                \"podIP\": \"172.20.37.235\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.37.235\"\n                    }\n                ],\n                \"startTime\": \"2021-06-05T07:06:43Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"etcd-manager\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-06-05T07:07:10Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/etcdadm/etcd-manager:3.0.20210430\",\n                        \"imageID\": \"k8s.gcr.io/etcdadm/etcd-manager@sha256:ebb73d3d4a99da609f9e01c556cd9f9aa7a0aecba8f5bc5588d7c45eb38e3a7e\",\n                        \"containerID\": \"containerd://e2715191501bc000ae49da64a7c7fbb6c967f7ba0c5ba2158512d515a9ed77eb\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-main-ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d530b686-7c19-444c-9170-b248cff8b227\",\n                \"resourceVersion\": \"549\",\n                \"creationTimestamp\": \"2021-06-05T07:08:17Z\",\n                \"labels\": {\n                    \"k8s-app\": \"etcd-manager-main\"\n                },\n                \"annotations\": {\n                    \"kubernetes.io/config.hash\": \"058fc19f9bde90a5c86ff3888d747f3c\",\n                    \"kubernetes.io/config.mirror\": \"058fc19f9bde90a5c86ff3888d747f3c\",\n                    \"kubernetes.io/config.seen\": \"2021-06-05T07:06:42.918242211Z\",\n                    \"kubernetes.io/config.source\": \"file\",\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"ip-172-20-37-235.ca-central-1.compute.internal\",\n                        \"uid\": \"d04e1632-a1ba-422d-99b5-e68359212bb9\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"rootfs\",\n                        \"hostPath\": {\n                            \"path\": \"/\",\n                            \"type\": \"Directory\"\n                        }\n                    },\n                    {\n                        \"name\": \"run\",\n                        \"hostPath\": {\n                            \"path\": \"/run\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"pki\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/kubernetes/pki/etcd-manager-main\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"varlogetcd\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/etcd.log\",\n                            \"type\": \"FileOrCreate\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"etcd-manager\",\n                        \"image\": \"k8s.gcr.io/etcdadm/etcd-manager:3.0.20210430\",\n                        \"command\": [\n                            \"/bin/sh\",\n                            \"-c\",\n                            \"mkfifo /tmp/pipe; (tee -a /var/log/etcd.log \\u003c /tmp/pipe \\u0026 ) ; exec /etcd-manager --backup-store=s3://k8s-kops-prow/e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io/backups/etcd/main --client-urls=https://__name__:4001 --cluster-name=etcd --containerized=true --dns-suffix=.internal.e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io --etcd-insecure=false --grpc-port=3996 --insecure=false --peer-urls=https://__name__:2380 --quarantine-client-urls=https://__name__:3994 --v=6 --volume-name-tag=k8s.io/etcd/main --volume-provider=aws --volume-tag=k8s.io/etcd/main --volume-tag=k8s.io/role/master=1 --volume-tag=kubernetes.io/cluster/e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io=owned \\u003e /tmp/pipe 2\\u003e\\u00261\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"200m\",\n                                \"memory\": \"100Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"rootfs\",\n                                \"mountPath\": \"/rootfs\"\n                            },\n                            {\n                                \"name\": \"run\",\n                                \"mountPath\": \"/run\"\n                            },\n                            {\n                                \"name\": \"pki\",\n                                \"mountPath\": \"/etc/kubernetes/pki/etcd-manager\"\n                            },\n                            {\n                                \"name\": \"varlogetcd\",\n                                \"mountPath\": \"/var/log/etcd.log\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"hostNetwork\": true,\n                \"hostPID\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:06:43Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:07:11Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:07:11Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:06:43Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.37.235\",\n                \"podIP\": \"172.20.37.235\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.37.235\"\n                    }\n                ],\n                \"startTime\": \"2021-06-05T07:06:43Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"etcd-manager\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-06-05T07:07:10Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/etcdadm/etcd-manager:3.0.20210430\",\n                        \"imageID\": \"k8s.gcr.io/etcdadm/etcd-manager@sha256:ebb73d3d4a99da609f9e01c556cd9f9aa7a0aecba8f5bc5588d7c45eb38e3a7e\",\n                        \"containerID\": \"containerd://61cd8958f46d36593259e47d0003fa09b543b431a9b396eec24f68a8c8d9867b\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller-sh4nx\",\n                \"generateName\": \"kops-controller-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"260f3752-1748-4c13-b9ce-00056a6d04f1\",\n                \"resourceVersion\": \"499\",\n                \"creationTimestamp\": \"2021-06-05T07:08:03Z\",\n                \"labels\": {\n                    \"controller-revision-hash\": \"6d76d68c88\",\n                    \"k8s-addon\": \"kops-controller.addons.k8s.io\",\n                    \"k8s-app\": \"kops-controller\",\n                    \"pod-template-generation\": \"1\",\n                    \"version\": \"v1.22.0-alpha.1\"\n                },\n                \"annotations\": {\n                    \"dns.alpha.kubernetes.io/internal\": \"kops-controller.internal.e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"DaemonSet\",\n                        \"name\": \"kops-controller\",\n                        \"uid\": \"1381c6f6-e92f-4b7a-b5f0-38756ff58a47\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"kops-controller-config\",\n                        \"configMap\": {\n                            \"name\": \"kops-controller\",\n                            \"defaultMode\": 420\n                        }\n                    },\n                    {\n                        \"name\": \"kops-controller-pki\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/kubernetes/kops-controller/\",\n                            \"type\": \"Directory\"\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-zzcc8\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kops-controller\",\n                        \"image\": \"k8s.gcr.io/kops/kops-controller:1.22.0-alpha.1\",\n                        \"command\": [\n                            \"/kops-controller\",\n                            \"--v=2\",\n                            \"--conf=/etc/kubernetes/kops-controller/config/config.yaml\"\n                        ],\n                        \"env\": [\n                            {\n                                \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                \"value\": \"127.0.0.1\"\n                            }\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"50m\",\n                                \"memory\": \"50Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"kops-controller-config\",\n                                \"mountPath\": \"/etc/kubernetes/kops-controller/config/\"\n                            },\n                            {\n                                \"name\": \"kops-controller-pki\",\n                                \"mountPath\": \"/etc/kubernetes/kops-controller/pki/\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-zzcc8\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"runAsNonRoot\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"Default\",\n                \"nodeSelector\": {\n                    \"kops.k8s.io/kops-controller-pki\": \"\",\n                    \"node-role.kubernetes.io/master\": \"\"\n                },\n                \"serviceAccountName\": \"kops-controller\",\n                \"serviceAccount\": \"kops-controller\",\n                \"nodeName\": \"ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"affinity\": {\n                    \"nodeAffinity\": {\n                        \"requiredDuringSchedulingIgnoredDuringExecution\": {\n                            \"nodeSelectorTerms\": [\n                                {\n                                    \"matchFields\": [\n                                        {\n                                            \"key\": \"metadata.name\",\n                                            \"operator\": \"In\",\n                                            \"values\": [\n                                                \"ip-172-20-37-235.ca-central-1.compute.internal\"\n                                            ]\n                                        }\n                                    ]\n                                }\n                            ]\n                        }\n                    }\n                },\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"node-role.kubernetes.io/master\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/disk-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/memory-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/pid-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unschedulable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/network-unavailable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:08:03Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:08:05Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:08:05Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:08:03Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.37.235\",\n                \"podIP\": \"172.20.37.235\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.37.235\"\n                    }\n                ],\n                \"startTime\": \"2021-06-05T07:08:03Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"kops-controller\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-06-05T07:08:04Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/kops/kops-controller:1.22.0-alpha.1\",\n                        \"imageID\": \"sha256:2c2c756fc6b2d2b057e0d063287b910202178a68a7cbef03fc7edb9546535032\",\n                        \"containerID\": \"containerd://aadbc5af946457a3cfe0a74a8903e086d32b62f7b8cb24081c50994a115a7ff9\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"5111a54d-ad03-4616-90c2-b76255572ebe\",\n                \"resourceVersion\": \"574\",\n                \"creationTimestamp\": \"2021-06-05T07:08:26Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-apiserver\"\n                },\n                \"annotations\": {\n                    \"dns.alpha.kubernetes.io/external\": \"api.e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io\",\n                    \"dns.alpha.kubernetes.io/internal\": \"api.internal.e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io\",\n                    \"kubernetes.io/config.hash\": \"177a790a8a5a474e7fa67573f21ba254\",\n                    \"kubernetes.io/config.mirror\": \"177a790a8a5a474e7fa67573f21ba254\",\n                    \"kubernetes.io/config.seen\": \"2021-06-05T07:06:42.918244008Z\",\n                    \"kubernetes.io/config.source\": \"file\",\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"ip-172-20-37-235.ca-central-1.compute.internal\",\n                        \"uid\": \"d04e1632-a1ba-422d-99b5-e68359212bb9\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"logfile\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/kube-apiserver.log\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etcssl\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/ssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etcpkitls\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/pki/tls\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etcpkica-trust\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/pki/ca-trust\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"usrsharessl\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/share/ssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"usrssl\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/ssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"usrlibssl\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/lib/ssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"usrlocalopenssl\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/local/openssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"varssl\",\n                        \"hostPath\": {\n                            \"path\": \"/var/ssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etcopenssl\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/openssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"pki\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/kubernetes/pki/kube-apiserver\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"cloudconfig\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/kubernetes/cloud.config\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"srvkube\",\n                        \"hostPath\": {\n                            \"path\": \"/srv/kubernetes\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"srvsshproxy\",\n                        \"hostPath\": {\n                            \"path\": \"/srv/sshproxy\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"healthcheck-secrets\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/kubernetes/kube-apiserver-healthcheck/secrets\",\n                            \"type\": \"Directory\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kube-apiserver\",\n                        \"image\": \"k8s.gcr.io/kube-apiserver-amd64:v1.21.1\",\n                        \"command\": [\n                            \"/usr/local/bin/kube-apiserver\"\n                        ],\n                        \"args\": [\n                            \"--allow-privileged=true\",\n                            \"--anonymous-auth=false\",\n                            \"--api-audiences=kubernetes.svc.default\",\n                            \"--apiserver-count=1\",\n                            \"--authorization-mode=Node,RBAC\",\n                            \"--bind-address=0.0.0.0\",\n                            \"--client-ca-file=/srv/kubernetes/ca.crt\",\n                            \"--cloud-config=/etc/kubernetes/cloud.config\",\n                            \"--cloud-provider=aws\",\n                            \"--enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,PersistentVolumeLabel,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,NodeRestriction,ResourceQuota\",\n                            \"--etcd-cafile=/etc/kubernetes/pki/kube-apiserver/etcd-ca.crt\",\n                            \"--etcd-certfile=/etc/kubernetes/pki/kube-apiserver/etcd-client.crt\",\n                            \"--etcd-keyfile=/etc/kubernetes/pki/kube-apiserver/etcd-client.key\",\n                            \"--etcd-servers-overrides=/events#https://127.0.0.1:4002\",\n                            \"--etcd-servers=https://127.0.0.1:4001\",\n                            \"--insecure-port=0\",\n                            \"--kubelet-client-certificate=/srv/kubernetes/kubelet-api.crt\",\n                            \"--kubelet-client-key=/srv/kubernetes/kubelet-api.key\",\n                            \"--kubelet-preferred-address-types=InternalIP,Hostname,ExternalIP\",\n                            \"--proxy-client-cert-file=/srv/kubernetes/apiserver-aggregator.crt\",\n                            \"--proxy-client-key-file=/srv/kubernetes/apiserver-aggregator.key\",\n                            \"--requestheader-allowed-names=aggregator\",\n                            \"--requestheader-client-ca-file=/srv/kubernetes/apiserver-aggregator-ca.crt\",\n                            \"--requestheader-extra-headers-prefix=X-Remote-Extra-\",\n                            \"--requestheader-group-headers=X-Remote-Group\",\n                            \"--requestheader-username-headers=X-Remote-User\",\n                            \"--secure-port=443\",\n                            \"--service-account-issuer=https://api.internal.e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io\",\n                            \"--service-account-jwks-uri=https://api.internal.e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io/openid/v1/jwks\",\n                            \"--service-account-key-file=/srv/kubernetes/service-account.key\",\n                            \"--service-account-signing-key-file=/srv/kubernetes/service-account.key\",\n                            \"--service-cluster-ip-range=100.64.0.0/13\",\n                            \"--storage-backend=etcd3\",\n                            \"--tls-cert-file=/srv/kubernetes/server.crt\",\n                            \"--tls-private-key-file=/srv/kubernetes/server.key\",\n                            \"--v=2\",\n                            \"--logtostderr=false\",\n                            \"--alsologtostderr\",\n                            \"--log-file=/var/log/kube-apiserver.log\"\n                        ],\n                        \"ports\": [\n                            {\n                                \"name\": \"https\",\n                                \"hostPort\": 443,\n                                \"containerPort\": 443,\n                                \"protocol\": \"TCP\"\n                            }\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"150m\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"logfile\",\n                                \"mountPath\": \"/var/log/kube-apiserver.log\"\n                            },\n                            {\n                                \"name\": \"etcssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/ssl\"\n                            },\n                            {\n                                \"name\": \"etcpkitls\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/pki/tls\"\n                            },\n                            {\n                                \"name\": \"etcpkica-trust\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/pki/ca-trust\"\n                            },\n                            {\n                                \"name\": \"usrsharessl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/usr/share/ssl\"\n                            },\n                            {\n                                \"name\": \"usrssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/usr/ssl\"\n                            },\n                            {\n                                \"name\": \"usrlibssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/usr/lib/ssl\"\n                            },\n                            {\n                                \"name\": \"usrlocalopenssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/usr/local/openssl\"\n                            },\n                            {\n                                \"name\": \"varssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/ssl\"\n                            },\n                            {\n                                \"name\": \"etcopenssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/openssl\"\n                            },\n                            {\n                                \"name\": \"pki\",\n                                \"mountPath\": \"/etc/kubernetes/pki/kube-apiserver\"\n                            },\n                            {\n                                \"name\": \"cloudconfig\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/kubernetes/cloud.config\"\n                            },\n                            {\n                                \"name\": \"srvkube\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/srv/kubernetes\"\n                            },\n                            {\n                                \"name\": \"srvsshproxy\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/srv/sshproxy\"\n                            }\n                        ],\n                        \"livenessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/healthz\",\n                                \"port\": 3990,\n                                \"host\": \"127.0.0.1\",\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"initialDelaySeconds\": 45,\n                            \"timeoutSeconds\": 15,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 3\n                        },\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\"\n                    },\n                    {\n                        \"name\": \"healthcheck\",\n                        \"image\": \"k8s.gcr.io/kops/kube-apiserver-healthcheck:1.22.0-alpha.1\",\n                        \"command\": [\n                            \"/kube-apiserver-healthcheck\"\n                        ],\n                        \"args\": [\n                            \"--ca-cert=/secrets/ca.crt\",\n                            \"--client-cert=/secrets/client.crt\",\n                            \"--client-key=/secrets/client.key\"\n                        ],\n                        \"resources\": {},\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"healthcheck-secrets\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/secrets\"\n                            }\n                        ],\n                        \"livenessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/.kube-apiserver-healthcheck/healthz\",\n                                \"port\": 3990,\n                                \"host\": \"127.0.0.1\",\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"initialDelaySeconds\": 5,\n                            \"timeoutSeconds\": 5,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 3\n                        },\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\"\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:06:43Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:07:25Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:07:25Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:06:43Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.37.235\",\n                \"podIP\": \"172.20.37.235\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.37.235\"\n                    }\n                ],\n                \"startTime\": \"2021-06-05T07:06:43Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"healthcheck\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-06-05T07:07:04Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/kops/kube-apiserver-healthcheck:1.22.0-alpha.1\",\n                        \"imageID\": \"sha256:63993127c057a4cb58c89664d102fc80ffe63b2635798c6fe887b2b64300966a\",\n                        \"containerID\": \"containerd://1cc5ce0d7503a6249e8ef0f1f42cb8ea0aaddb9ddf77e3bbdf61a9f90a075165\",\n                        \"started\": true\n                    },\n                    {\n                        \"name\": \"kube-apiserver\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-06-05T07:07:24Z\"\n                            }\n                        },\n                        \"lastState\": {\n                            \"terminated\": {\n                                \"exitCode\": 1,\n                                \"reason\": \"Error\",\n                                \"startedAt\": \"2021-06-05T07:07:02Z\",\n                                \"finishedAt\": \"2021-06-05T07:07:23Z\",\n                                \"containerID\": \"containerd://3502941adad2d73745ffffc1b3886fbaecc57e8312a067c239a20ba4e1c84020\"\n                            }\n                        },\n                        \"ready\": true,\n                        \"restartCount\": 1,\n                        \"image\": \"k8s.gcr.io/kube-apiserver-amd64:v1.21.1\",\n                        \"imageID\": \"sha256:771ffcf9ca634e37cbd3202fd86bd7e2df48ecba4067d1992541bfa00e88a9bb\",\n                        \"containerID\": \"containerd://c47dbfc964aa1005afcb86ab7f425006a18eb27f1765e4ebc37777b0ed590ad9\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-controller-manager-ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"52211f20-5204-437a-9c27-adb49cf0c849\",\n                \"resourceVersion\": \"523\",\n                \"creationTimestamp\": \"2021-06-05T07:08:09Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-controller-manager\"\n                },\n                \"annotations\": {\n                    \"kubernetes.io/config.hash\": \"51db6116056772a430a6e21769ef149d\",\n                    \"kubernetes.io/config.mirror\": \"51db6116056772a430a6e21769ef149d\",\n                    \"kubernetes.io/config.seen\": \"2021-06-05T07:06:42.918245883Z\",\n                    \"kubernetes.io/config.source\": \"file\",\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"ip-172-20-37-235.ca-central-1.compute.internal\",\n                        \"uid\": \"d04e1632-a1ba-422d-99b5-e68359212bb9\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"logfile\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/kube-controller-manager.log\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etcssl\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/ssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etcpkitls\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/pki/tls\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etcpkica-trust\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/pki/ca-trust\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"usrsharessl\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/share/ssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"usrssl\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/ssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"usrlibssl\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/lib/ssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"usrlocalopenssl\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/local/openssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"varssl\",\n                        \"hostPath\": {\n                            \"path\": \"/var/ssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etcopenssl\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/openssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"cloudconfig\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/kubernetes/cloud.config\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"srvkube\",\n                        \"hostPath\": {\n                            \"path\": \"/srv/kubernetes\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"varlibkcm\",\n                        \"hostPath\": {\n                            \"path\": \"/var/lib/kube-controller-manager\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"volplugins\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/libexec/kubernetes/kubelet-plugins/volume/exec/\",\n                            \"type\": \"\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kube-controller-manager\",\n                        \"image\": \"k8s.gcr.io/kube-controller-manager-amd64:v1.21.1\",\n                        \"command\": [\n                            \"/usr/local/bin/kube-controller-manager\"\n                        ],\n                        \"args\": [\n                            \"--allocate-node-cidrs=true\",\n                            \"--attach-detach-reconcile-sync-period=1m0s\",\n                            \"--cloud-config=/etc/kubernetes/cloud.config\",\n                            \"--cloud-provider=aws\",\n                            \"--cluster-cidr=100.96.0.0/11\",\n                            \"--cluster-name=e2e-188ab922c3-cb70c.test-cncf-aws.k8s.io\",\n                            \"--cluster-signing-cert-file=/srv/kubernetes/ca.crt\",\n                            \"--cluster-signing-key-file=/srv/kubernetes/ca.key\",\n                            \"--configure-cloud-routes=false\",\n                            \"--flex-volume-plugin-dir=/usr/libexec/kubernetes/kubelet-plugins/volume/exec/\",\n                            \"--kubeconfig=/var/lib/kube-controller-manager/kubeconfig\",\n                            \"--leader-elect=true\",\n                            \"--root-ca-file=/srv/kubernetes/ca.crt\",\n                            \"--service-account-private-key-file=/srv/kubernetes/service-account.key\",\n                            \"--use-service-account-credentials=true\",\n                            \"--v=2\",\n                            \"--logtostderr=false\",\n                            \"--alsologtostderr\",\n                            \"--log-file=/var/log/kube-controller-manager.log\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"100m\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"logfile\",\n                                \"mountPath\": \"/var/log/kube-controller-manager.log\"\n                            },\n                            {\n                                \"name\": \"etcssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/ssl\"\n                            },\n                            {\n                                \"name\": \"etcpkitls\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/pki/tls\"\n                            },\n                            {\n                                \"name\": \"etcpkica-trust\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/pki/ca-trust\"\n                            },\n                            {\n                                \"name\": \"usrsharessl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/usr/share/ssl\"\n                            },\n                            {\n                                \"name\": \"usrssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/usr/ssl\"\n                            },\n                            {\n                                \"name\": \"usrlibssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/usr/lib/ssl\"\n                            },\n                            {\n                                \"name\": \"usrlocalopenssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/usr/local/openssl\"\n                            },\n                            {\n                                \"name\": \"varssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/ssl\"\n                            },\n                            {\n                                \"name\": \"etcopenssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/openssl\"\n                            },\n                            {\n                                \"name\": \"cloudconfig\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/kubernetes/cloud.config\"\n                            },\n                            {\n                                \"name\": \"srvkube\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/srv/kubernetes\"\n                            },\n                            {\n                                \"name\": \"varlibkcm\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/lib/kube-controller-manager\"\n                            },\n                            {\n                                \"name\": \"volplugins\",\n                                \"mountPath\": \"/usr/libexec/kubernetes/kubelet-plugins/volume/exec/\"\n                            }\n                        ],\n                        \"livenessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/healthz\",\n                                \"port\": 10257,\n                                \"host\": \"127.0.0.1\",\n                                \"scheme\": \"HTTPS\"\n                            },\n                            \"initialDelaySeconds\": 15,\n                            \"timeoutSeconds\": 15,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 3\n                        },\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\"\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:06:43Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:07:03Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:07:03Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:06:43Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.37.235\",\n                \"podIP\": \"172.20.37.235\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.37.235\"\n                    }\n                ],\n                \"startTime\": \"2021-06-05T07:06:43Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"kube-controller-manager\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-06-05T07:07:02Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/kube-controller-manager-amd64:v1.21.1\",\n                        \"imageID\": \"sha256:e16544fd47b02fea6201a1c39f0ffae170968b6dd48ac2643c4db3cab0011ed4\",\n                        \"containerID\": \"containerd://32121146a569d81243d4475008674eda3860b15146e278fd839ee43047f3b38a\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-scheduler-ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"aedd4767-d4ea-487f-9563-8e10c52314c5\",\n                \"resourceVersion\": \"550\",\n                \"creationTimestamp\": \"2021-06-05T07:08:16Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-scheduler\"\n                },\n                \"annotations\": {\n                    \"kubernetes.io/config.hash\": \"606be56347d3792a698c7498153af420\",\n                    \"kubernetes.io/config.mirror\": \"606be56347d3792a698c7498153af420\",\n                    \"kubernetes.io/config.seen\": \"2021-06-05T07:06:42.918247617Z\",\n                    \"kubernetes.io/config.source\": \"file\",\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"ip-172-20-37-235.ca-central-1.compute.internal\",\n                        \"uid\": \"d04e1632-a1ba-422d-99b5-e68359212bb9\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"varlibkubescheduler\",\n                        \"hostPath\": {\n                            \"path\": \"/var/lib/kube-scheduler\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"logfile\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/kube-scheduler.log\",\n                            \"type\": \"\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kube-scheduler\",\n                        \"image\": \"k8s.gcr.io/kube-scheduler-amd64:v1.21.1\",\n                        \"command\": [\n                            \"/usr/local/bin/kube-scheduler\"\n                        ],\n                        \"args\": [\n                            \"--config=/var/lib/kube-scheduler/config.yaml\",\n                            \"--leader-elect=true\",\n                            \"--v=2\",\n                            \"--logtostderr=false\",\n                            \"--alsologtostderr\",\n                            \"--log-file=/var/log/kube-scheduler.log\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"100m\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"varlibkubescheduler\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/lib/kube-scheduler\"\n                            },\n                            {\n                                \"name\": \"logfile\",\n                                \"mountPath\": \"/var/log/kube-scheduler.log\"\n                            }\n                        ],\n                        \"livenessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/healthz\",\n                                \"port\": 10251,\n                                \"host\": \"127.0.0.1\",\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"initialDelaySeconds\": 15,\n                            \"timeoutSeconds\": 15,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 3\n                        },\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\"\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"ip-172-20-37-235.ca-central-1.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:06:43Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:07:02Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:07:02Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-06-05T07:06:43Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.37.235\",\n                \"podIP\": \"172.20.37.235\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.37.235\"\n                    }\n                ],\n                \"startTime\": \"2021-06-05T07:06:43Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"kube-scheduler\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-06-05T07:07:02Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/kube-scheduler-amd64:v1.21.1\",\n                        \"imageID\": \"sha256:a4183b88f6e65972c4b176b43ca59de31868635a7e43805f4c6e26203de1742f\",\n                        \"containerID\": \"containerd://ffac981d56d5d4e3ba710cae55e4e0271c76e47e1a3af4c92f25b87a70bb7057\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        }\n    ]\n}\n==== START logs for container clean-cilium-state of pod kube-system/cilium-25vms ====\n==== END logs for container clean-cilium-state of pod kube-system/cilium-25vms ====\n==== START logs for container cilium-agent of pod kube-system/cilium-25vms ====\nlevel=info msg=\"Started gops server\" address=\"127.0.0.1:9890\" subsys=daemon\nlevel=info msg=\"  --agent-health-port='9876'\" subsys=daemon\nlevel=info msg=\"  --agent-labels=''\" subsys=daemon\nlevel=info msg=\"  --allocator-list-timeout='3m0s'\" subsys=daemon\nlevel=info msg=\"  --allow-icmp-frag-needed='true'\" subsys=daemon\nlevel=info msg=\"  --allow-localhost='auto'\" subsys=daemon\nlevel=info msg=\"  --annotate-k8s-node='true'\" subsys=daemon\nlevel=info msg=\"  --api-rate-limit='map[]'\" subsys=daemon\nlevel=info msg=\"  --arping-refresh-period='5m0s'\" subsys=daemon\nlevel=info msg=\"  --auto-create-cilium-node-resource='true'\" subsys=daemon\nlevel=info msg=\"  --auto-direct-node-routes='false'\" subsys=daemon\nlevel=info msg=\"  --bgp-announce-lb-ip='false'\" subsys=daemon\nlevel=info msg=\"  --bgp-config-path='/var/lib/cilium/bgp/config.yaml'\" subsys=daemon\nlevel=info msg=\"  --bpf-compile-debug='true'\" subsys=daemon\nlevel=info msg=\"  --bpf-ct-global-any-max='262144'\" subsys=daemon\nlevel=info msg=\"  --bpf-ct-global-tcp-max='524288'\" subsys=daemon\nlevel=info msg=\"  --bpf-ct-timeout-regular-any='1m0s'\" subsys=daemon\nlevel=info msg=\"  --bpf-ct-timeout-regular-tcp='6h0m0s'\" subsys=daemon\nlevel=info msg=\"  --bpf-ct-timeout-regular-tcp-fin='10s'\" subsys=daemon\nlevel=info msg=\"  --bpf-ct-timeout-regular-tcp-syn='1m0s'\" subsys=daemon\nlevel=info msg=\"  --bpf-ct-timeout-service-any='1m0s'\" subsys=daemon\nlevel=info msg=\"  --bpf-ct-timeout-service-tcp='6h0m0s'\" subsys=daemon\nlevel=info msg=\"  --bpf-fragments-map-max='8192'\" subsys=daemon\nlevel=info msg=\"  --bpf-lb-acceleration='disabled'\" subsys=daemon\nlevel=info msg=\"  --bpf-lb-algorithm='random'\" subsys=daemon\nlevel=info msg=\"  --bpf-lb-bypass-fib-lookup='true'\" subsys=daemon\nlevel=info msg=\"  --bpf-lb-dev-ip-addr-inherit=''\" subsys=daemon\nlevel=info msg=\"  --bpf-lb-dsr-dispatch='opt'\" subsys=daemon\nlevel=info msg=\"  --bpf-lb-dsr-l4-xlate='frontend'\" subsys=daemon\nlevel=info msg=\"  --bpf-lb-maglev-hash-seed='JLfvgnHc2kaSUFaI'\" subsys=daemon\nlevel=info msg=\"  --bpf-lb-maglev-table-size='16381'\" subsys=daemon\nlevel=info msg=\"  --bpf-lb-map-max='65536'\" subsys=daemon\nlevel=info msg=\"  --bpf-lb-mode='snat'\" subsys=daemon\nlevel=info msg=\"  --bpf-lb-rss-ipv4-src-cidr=''\" subsys=daemon\nlevel=info msg=\"  --bpf-lb-rss-ipv6-src-cidr=''\" subsys=daemon\nlevel=info msg=\"  --bpf-map-dynamic-size-ratio='0'\" subsys=daemon\nlevel=info msg=\"  --bpf-nat-global-max='524288'\" subsys=daemon\nlevel=info msg=\"  --bpf-neigh-global-max='524288'\" subsys=daemon\nlevel=info msg=\"  --bpf-policy-map-max='16384'\" subsys=daemon\nlevel=info msg=\"  --bpf-root=''\" subsys=daemon\nlevel=info msg=\"  --bpf-sock-rev-map-max='262144'\" subsys=daemon\nlevel=info msg=\"  --certificates-directory='/var/run/cilium/certs'\" subsys=daemon\nlevel=info msg=\"  --cflags=''\" subsys=daemon\nlevel=info msg=\"  --cgroup-root=''\" subsys=daemon\nlevel=info msg=\"  --cluster-id='0'\" subsys=daemon\nlevel=info msg=\"  --cluster-name='default'\" subsys=daemon\nlevel=info msg=\"  --clustermesh-config='/var/lib/cilium/clustermesh/'\" subsys=daemon\nlevel=info msg=\"  --cmdref=''\" subsys=daemon\nlevel=info msg=\"  --config=''\" subsys=daemon\nlevel=info msg=\"  --config-dir='/tmp/cilium/config-map'\" subsys=daemon\nlevel=info msg=\"  --conntrack-gc-interval='0s'\" subsys=daemon\nlevel=info msg=\"  --crd-wait-timeout='5m0s'\" subsys=daemon\nlevel=info msg=\"  --datapath-mode='veth'\" subsys=daemon\nlevel=info msg=\"  --debug='false'\" subsys=daemon\nlevel=info msg=\"  --debug-verbose=''\" subsys=daemon\nlevel=info msg=\"  --devices=''\" subsys=daemon\nlevel=info msg=\"  --direct-routing-device=''\" subsys=daemon\nlevel=info msg=\"  --disable-cnp-status-updates='false'\" subsys=daemon\nlevel=info msg=\"  --disable-conntrack='false'\" subsys=daemon\nlevel=info msg=\"  --disable-endpoint-crd='false'\" subsys=daemon\nlevel=info msg=\"  --disable-envoy-version-check='false'\" subsys=daemon\nlevel=info msg=\"  --disable-iptables-feeder-rules=''\" subsys=daemon\nlevel=info msg=\"  --dns-max-ips-per-restored-rule='1000'\" subsys=daemon\nlevel=info msg=\"  --egress-masquerade-interfaces=''\" subsys=daemon\nlevel=info msg=\"  --egress-multi-home-ip-rule-compat='false'\" subsys=daemon\nlevel=info msg=\"  --enable-auto-protect-node-port-range='true'\" subsys=daemon\nlevel=info msg=\"  --enable-bandwidth-manager='false'\" subsys=daemon\nlevel=info msg=\"  --enable-bpf-clock-probe='false'\" subsys=daemon\nlevel=info msg=\"  --enable-bpf-masquerade='false'\" subsys=daemon\nlevel=info msg=\"  --enable-bpf-tproxy='false'\" subsys=daemon\nlevel=info msg=\"  --enable-custom-calls='false'\" subsys=daemon\nlevel=info msg=\"  --enable-egress-gateway='false'\" subsys=daemon\nlevel=info msg=\"  --enable-endpoint-health-checking='true'\" subsys=daemon\nlevel=info msg=\"  --enable-endpoint-routes='false'\" subsys=daemon\nlevel=info msg=\"  --enable-external-ips='true'\" subsys=daemon\nlevel=info msg=\"  --enable-health-check-nodeport='true'\" subsys=daemon\nlevel=info msg=\"  --enable-health-checking='true'\" subsys=daemon\nlevel=info msg=\"  --enable-host-firewall='false'\" subsys=daemon\nlevel=info msg=\"  --enable-host-legacy-routing='false'\" subsys=daemon\nlevel=info msg=\"  --enable-host-port='true'\" subsys=daemon\nlevel=info msg=\"  --enable-host-reachable-services='false'\" subsys=daemon\nlevel=info msg=\"  --enable-hubble='false'\" subsys=daemon\nlevel=info msg=\"  --enable-hubble-recorder-api='true'\" subsys=daemon\nlevel=info msg=\"  --enable-identity-mark='true'\" subsys=daemon\nlevel=info msg=\"  --enable-ip-masq-agent='false'\" subsys=daemon\nlevel=info msg=\"  --enable-ipsec='false'\" subsys=daemon\nlevel=info msg=\"  --enable-ipv4='true'\" subsys=daemon\nlevel=info msg=\"  --enable-ipv4-fragment-tracking='true'\" subsys=daemon\nlevel=info msg=\"  --enable-ipv4-masquerade='true'\" subsys=daemon\nlevel=info msg=\"  --enable-ipv6='false'\" subsys=daemon\nlevel=info msg=\"  --enable-ipv6-masquerade='true'\" subsys=daemon\nlevel=info msg=\"  --enable-ipv6-ndp='false'\" subsys=daemon\nlevel=info msg=\"  --enable-k8s-api-discovery='false'\" subsys=daemon\nlevel=info msg=\"  --enable-k8s-endpoint-slice='true'\" subsys=daemon\nlevel=info msg=\"  --enable-k8s-event-handover='false'\" subsys=daemon\nlevel=info msg=\"  --enable-l7-proxy='true'\" subsys=daemon\nlevel=info msg=\"  --enable-local-node-route='true'\" subsys=daemon\nlevel=info msg=\"  --enable-local-redirect-policy='false'\" subsys=daemon\nlevel=info msg=\"  --enable-monitor='true'\" subsys=daemon\nlevel=info msg=\"  --enable-node-port='true'\" subsys=daemon\nlevel=info msg=\"  --enable-policy='default'\" subsys=daemon\nlevel=info msg=\"  --enable-recorder='false'\" subsys=daemon\nlevel=info msg=\"  --enable-remote-node-identity='true'\" subsys=daemon\nlevel=info msg=\"  --enable-selective-regeneration='true'\" subsys=daemon\nlevel=info msg=\"  --enable-session-affinity='false'\" subsys=daemon\nlevel=info msg=\"  --enable-svc-source-range-check='true'\" subsys=daemon\nlevel=info msg=\"  --enable-tracing='false'\" subsys=daemon\nlevel=info msg=\"  --enable-well-known-identities='true'\" subsys=daemon\nlevel=info msg=\"  --enable-wireguard='false'\" subsys=daemon\nlevel=info msg=\"  --enable-xt-socket-fallback='true'\" subsys=daemon\nlevel=info msg=\"  --encrypt-interface=''\" subsys=daemon\nlevel=info msg=\"  --encrypt-node='false'\" subsys=daemon\nlevel=info msg=\"  --endpoint-gc-interval='5m0s'\" subsys=daemon\nlevel=info msg=\"  --endpoint-interface-name-prefix='lxc+'\" subsys=daemon\nlevel=info msg=\"  --endpoint-queue-size='25'\" subsys=daemon\nlevel=info msg=\"  --endpoint-status=''\" subsys=daemon\nlevel=info msg=\"  --envoy-log=''\" subsys=daemon\nlevel=info msg=\"  --exclude-local-address=''\" subsys=daemon\nlevel=info msg=\"  --fixed-identity-mapping='map[]'\" subsys=daemon\nlevel=info msg=\"  --force-local-policy-eval-at-source='true'\" subsys=daemon\nlevel=info msg=\"  --gops-port='9890'\" subsys=daemon\nlevel=info msg=\"  --host-reachable-services-protos='tcp,udp'\" subsys=daemon\nlevel=info msg=\"  --http-403-msg=''\" subsys=daemon\nlevel=info msg=\"  --http-idle-timeout='0'\" subsys=daemon\nlevel=info msg=\"  --http-max-grpc-timeout='0'\" subsys=daemon\nlevel=info msg=\"  --http-normalize-path='true'\" subsys=daemon\nlevel=info msg=\"  --http-request-timeout='3600'\" subsys=daemon\nlevel=info msg=\"  --http-retry-count='3'\" subsys=daemon\nlevel=info msg=\"  --http-retry-timeout='0'\" subsys=daemon\nlevel=info msg=\"  --hubble-disable-tls='false'\" subsys=daemon\nlevel=info msg=\"  --hubble-event-buffer-capacity='4095'\" sub