This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 5 succeeded
Started2020-09-29 01:47
Elapsed18m37s
Revision
job-versionv1.19.2
revisionv1.19.2

Test Failures


Up 15m31s

kops validate cluster failed: error during /tmp/kops710574247/kops validate cluster e2e-kops-cilium-u1604-k19.test-cncf-aws.k8s.io --wait 15m: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 5 Passed Tests

Error lines from build-log.txt

Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
fatal: not a git repository (or any of the parent directories): .git
+ /workspace/scenarios/kubernetes_e2e.py --cluster=e2e-kops-cilium-u1604-k19.test-cncf-aws.k8s.io --deployment=kops --kops-ssh-user=ubuntu --env=KUBE_SSH_USER=ubuntu --env=KOPS_DEPLOY_LATEST_URL=https://storage.googleapis.com/kubernetes-release/release/stable-1.19.txt --env=KOPS_KUBE_RELEASE_URL=https://storage.googleapis.com/kubernetes-release/release --env=KOPS_RUN_TOO_NEW_VERSION=1 --extract=release/stable-1.19 --ginkgo-parallel --kops-args=--networking=cilium --kops-image=099720109477/ubuntu/images/hvm-ssd/ubuntu-xenial-16.04-amd64-server-20200429 --kops-priority-path=/workspace/kubernetes/platforms/linux/amd64 --kops-version=https://storage.googleapis.com/kops-ci/bin/latest-ci-updown-green.txt --provider=aws '--test_args=--ginkgo.skip=\[Slow\]|\[Serial\]|\[Disruptive\]|\[Flaky\]|\[Feature:.+\]|\[HPA\]|Dashboard|Services.*functioning.*NodePort|Services.*rejected.*endpoints|Services.*affinity' --timeout=60m
starts with local mode
Environment:
ARTIFACTS=/logs/artifacts
AWS_DEFAULT_PROFILE=default
AWS_PROFILE=default
... skipping 146 lines ...
2020/09/29 01:48:38 process.go:155: Step './get-kube.sh' finished in 52.808648011s
2020/09/29 01:48:38 process.go:153: Running: /tmp/kops710574247/kops get clusters e2e-kops-cilium-u1604-k19.test-cncf-aws.k8s.io

cluster not found "e2e-kops-cilium-u1604-k19.test-cncf-aws.k8s.io"
2020/09/29 01:48:39 process.go:155: Step '/tmp/kops710574247/kops get clusters e2e-kops-cilium-u1604-k19.test-cncf-aws.k8s.io' finished in 1.176977708s
2020/09/29 01:48:39 util.go:42: curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip
2020/09/29 01:48:39 kops.go:514: failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404
2020/09/29 01:48:39 util.go:68: curl https://ip.jsb.workers.dev
2020/09/29 01:48:39 kops.go:439: Using external IP for admin access: 104.155.134.21/32
2020/09/29 01:48:39 process.go:153: Running: /tmp/kops710574247/kops create cluster --name e2e-kops-cilium-u1604-k19.test-cncf-aws.k8s.io --ssh-public-key /workspace/.ssh/kube_aws_rsa.pub --node-count 4 --node-volume-size 48 --master-volume-size 48 --master-count 1 --zones sa-east-1a --master-size c5.large --kubernetes-version https://storage.googleapis.com/kubernetes-release/release/v1.19.2 --admin-access 104.155.134.21/32 --image 099720109477/ubuntu/images/hvm-ssd/ubuntu-xenial-16.04-amd64-server-20200429 --cloud aws --networking=cilium --override cluster.spec.nodePortAccess=0.0.0.0/0 --yes
I0929 01:48:39.982036     154 featureflag.go:167] FeatureFlag "SpecOverrideFlag"=true
I0929 01:48:40.188870     154 create_cluster.go:711] Using SSH public key: /workspace/.ssh/kube_aws_rsa.pub
I0929 01:48:41.712787     154 subnets.go:184] Assigned CIDR 172.20.32.0/19 to subnet sa-east-1a
... skipping 28 lines ...

2020/09/29 01:49:05 process.go:155: Step '/tmp/kops710574247/kops create cluster --name e2e-kops-cilium-u1604-k19.test-cncf-aws.k8s.io --ssh-public-key /workspace/.ssh/kube_aws_rsa.pub --node-count 4 --node-volume-size 48 --master-volume-size 48 --master-count 1 --zones sa-east-1a --master-size c5.large --kubernetes-version https://storage.googleapis.com/kubernetes-release/release/v1.19.2 --admin-access 104.155.134.21/32 --image 099720109477/ubuntu/images/hvm-ssd/ubuntu-xenial-16.04-amd64-server-20200429 --cloud aws --networking=cilium --override cluster.spec.nodePortAccess=0.0.0.0/0 --yes' finished in 25.90156597s
2020/09/29 01:49:05 process.go:153: Running: /tmp/kops710574247/kops validate cluster e2e-kops-cilium-u1604-k19.test-cncf-aws.k8s.io --wait 15m
I0929 01:49:05.879554     176 featureflag.go:167] FeatureFlag "SpecOverrideFlag"=true
Validating cluster e2e-kops-cilium-u1604-k19.test-cncf-aws.k8s.io

W0929 01:49:07.746372     176 validate_cluster.go:173] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-kops-cilium-u1604-k19.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
W0929 01:49:17.804768     176 validate_cluster.go:173] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-kops-cilium-u1604-k19.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0929 01:49:27.858678     176 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0929 01:49:37.976746     176 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0929 01:49:48.054915     176 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0929 01:49:58.104425     176 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0929 01:50:08.167170     176 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0929 01:50:18.236390     176 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0929 01:50:28.327226     176 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0929 01:50:38.414837     176 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0929 01:50:48.530194     176 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0929 01:50:58.568018     176 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0929 01:51:08.632720     176 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0929 01:51:18.682810     176 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0929 01:51:28.740706     176 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0929 01:51:38.814375     176 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0929 01:51:48.848811     176 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0929 01:51:58.894861     176 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0929 01:52:08.959873     176 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0929 01:52:19.027358     176 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0929 01:52:29.088935     176 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0929 01:52:39.143401     176 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0929 01:52:49.198995     176 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0929 01:52:59.255920     176 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0929 01:53:09.332766     176 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0929 01:53:19.395648     176 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0929 01:53:29.447846     176 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0929 01:53:39.564990     176 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0929 01:53:49.631507     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 01:54:02.564537     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 10 lines ...
Machine	i-0efb00bb4d821857a					machine "i-0efb00bb4d821857a" has not yet joined cluster
Pod	kube-system/cilium-28rdx				system-node-critical pod "cilium-28rdx" is not ready (cilium-agent)
Pod	kube-system/cilium-operator-67c47cf9cb-cl8rb		system-cluster-critical pod "cilium-operator-67c47cf9cb-cl8rb" is pending
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 01:54:03.022637     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 01:54:14.818813     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 11 lines ...
Pod	kube-system/cilium-28rdx				system-node-critical pod "cilium-28rdx" is not ready (cilium-agent)
Pod	kube-system/cilium-operator-67c47cf9cb-cl8rb		system-cluster-critical pod "cilium-operator-67c47cf9cb-cl8rb" is pending
Pod	kube-system/kops-controller-7brcs			system-node-critical pod "kops-controller-7brcs" is not ready (kops-controller)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 01:54:14.967307     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 01:54:26.746748     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 10 lines ...
Machine	i-0efb00bb4d821857a					machine "i-0efb00bb4d821857a" has not yet joined cluster
Pod	kube-system/cilium-28rdx				system-node-critical pod "cilium-28rdx" is not ready (cilium-agent)
Pod	kube-system/cilium-operator-67c47cf9cb-cl8rb		system-cluster-critical pod "cilium-operator-67c47cf9cb-cl8rb" is pending
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 01:54:26.913182     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 01:54:38.838772     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 10 lines ...
Machine	i-0efb00bb4d821857a					machine "i-0efb00bb4d821857a" has not yet joined cluster
Pod	kube-system/cilium-28rdx				system-node-critical pod "cilium-28rdx" is not ready (cilium-agent)
Pod	kube-system/cilium-operator-67c47cf9cb-cl8rb		system-cluster-critical pod "cilium-operator-67c47cf9cb-cl8rb" is pending
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 01:54:38.989120     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 01:54:50.843762     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 11 lines ...
Pod	kube-system/cilium-28rdx				system-node-critical pod "cilium-28rdx" is not ready (cilium-agent)
Pod	kube-system/cilium-operator-67c47cf9cb-cl8rb		system-cluster-critical pod "cilium-operator-67c47cf9cb-cl8rb" is pending
Pod	kube-system/kops-controller-7brcs			system-node-critical pod "kops-controller-7brcs" is not ready (kops-controller)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 01:54:51.004884     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 01:55:02.754666     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 10 lines ...
Machine	i-0efb00bb4d821857a					machine "i-0efb00bb4d821857a" has not yet joined cluster
Pod	kube-system/cilium-28rdx				system-node-critical pod "cilium-28rdx" is not ready (cilium-agent)
Pod	kube-system/cilium-operator-67c47cf9cb-cl8rb		system-cluster-critical pod "cilium-operator-67c47cf9cb-cl8rb" is pending
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 01:55:02.903856     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 01:55:14.726110     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 18 lines ...
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is pending
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is pending
Pod	kube-system/cilium-operator-67c47cf9cb-cl8rb		system-cluster-critical pod "cilium-operator-67c47cf9cb-cl8rb" is pending
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 01:55:14.879585     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 01:55:26.612230     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 18 lines ...
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/cilium-operator-67c47cf9cb-cl8rb		system-cluster-critical pod "cilium-operator-67c47cf9cb-cl8rb" is pending
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 01:55:26.791558     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 01:55:38.607563     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 14 lines ...
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kops-controller-7brcs			system-node-critical pod "kops-controller-7brcs" is not ready (kops-controller)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 01:55:38.760770     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 01:55:50.552612     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 14 lines ...
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kops-controller-7brcs			system-node-critical pod "kops-controller-7brcs" is not ready (kops-controller)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 01:55:50.709252     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 01:56:02.494041     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 13 lines ...
Pod	kube-system/cilium-8dwzs				system-node-critical pod "cilium-8dwzs" is not ready (cilium-agent)
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 01:56:02.649473     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 01:56:14.453014     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 13 lines ...
Pod	kube-system/cilium-8dwzs				system-node-critical pod "cilium-8dwzs" is not ready (cilium-agent)
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 01:56:14.612753     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 01:56:26.300532     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 13 lines ...
Pod	kube-system/cilium-8dwzs				system-node-critical pod "cilium-8dwzs" is not ready (cilium-agent)
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 01:56:26.452900     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 01:56:38.122361     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 14 lines ...
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kops-controller-7brcs			system-node-critical pod "kops-controller-7brcs" is not ready (kops-controller)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 01:56:38.280127     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 01:56:49.944444     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 14 lines ...
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kops-controller-7brcs			system-node-critical pod "kops-controller-7brcs" is not ready (kops-controller)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 01:56:50.096719     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 01:57:01.831198     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 14 lines ...
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kops-controller-7brcs			system-node-critical pod "kops-controller-7brcs" is not ready (kops-controller)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 01:57:01.988132     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 01:57:13.715783     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 13 lines ...
Pod	kube-system/cilium-8dwzs				system-node-critical pod "cilium-8dwzs" is not ready (cilium-agent)
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 01:57:13.869508     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 01:57:25.534516     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 13 lines ...
Pod	kube-system/cilium-8dwzs				system-node-critical pod "cilium-8dwzs" is not ready (cilium-agent)
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 01:57:25.687678     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 01:57:37.627115     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 13 lines ...
Pod	kube-system/cilium-8dwzs				system-node-critical pod "cilium-8dwzs" is not ready (cilium-agent)
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 01:57:37.779508     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 01:57:49.562510     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 14 lines ...
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kops-controller-7brcs			system-node-critical pod "kops-controller-7brcs" is not ready (kops-controller)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 01:57:49.715780     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 01:58:01.977126     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 14 lines ...
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kops-controller-7brcs			system-node-critical pod "kops-controller-7brcs" is not ready (kops-controller)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 01:58:02.134250     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 01:58:13.863481     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 14 lines ...
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kops-controller-7brcs			system-node-critical pod "kops-controller-7brcs" is not ready (kops-controller)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 01:58:14.026451     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 01:58:25.774925     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 14 lines ...
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kops-controller-7brcs			system-node-critical pod "kops-controller-7brcs" is not ready (kops-controller)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 01:58:25.928373     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 01:58:37.648438     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 14 lines ...
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kops-controller-7brcs			system-node-critical pod "kops-controller-7brcs" is not ready (kops-controller)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 01:58:37.805059     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 01:58:49.642364     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 14 lines ...
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kops-controller-7brcs			system-node-critical pod "kops-controller-7brcs" is not ready (kops-controller)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 01:58:49.795339     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 01:59:01.468558     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 13 lines ...
Pod	kube-system/cilium-8dwzs				system-node-critical pod "cilium-8dwzs" is not ready (cilium-agent)
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 01:59:01.627819     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 01:59:13.510555     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 13 lines ...
Pod	kube-system/cilium-8dwzs				system-node-critical pod "cilium-8dwzs" is not ready (cilium-agent)
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 01:59:13.662953     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 01:59:25.523422     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 13 lines ...
Pod	kube-system/cilium-8dwzs				system-node-critical pod "cilium-8dwzs" is not ready (cilium-agent)
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 01:59:25.677892     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 01:59:37.381600     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 14 lines ...
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kops-controller-7brcs			system-node-critical pod "kops-controller-7brcs" is not ready (kops-controller)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 01:59:37.533949     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 01:59:49.302467     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 14 lines ...
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kops-controller-7brcs			system-node-critical pod "kops-controller-7brcs" is not ready (kops-controller)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 01:59:49.456106     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 02:00:01.415433     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 14 lines ...
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kops-controller-7brcs			system-node-critical pod "kops-controller-7brcs" is not ready (kops-controller)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 02:00:01.578834     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 02:00:13.466337     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 14 lines ...
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kops-controller-7brcs			system-node-critical pod "kops-controller-7brcs" is not ready (kops-controller)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 02:00:13.620526     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 02:00:25.364135     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 14 lines ...
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kops-controller-7brcs			system-node-critical pod "kops-controller-7brcs" is not ready (kops-controller)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 02:00:25.527227     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 02:00:37.190547     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 14 lines ...
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kops-controller-7brcs			system-node-critical pod "kops-controller-7brcs" is not ready (kops-controller)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 02:00:37.344296     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 02:00:48.994789     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 14 lines ...
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kops-controller-7brcs			system-node-critical pod "kops-controller-7brcs" is not ready (kops-controller)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 02:00:49.151751     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 02:01:00.957110     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 14 lines ...
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kops-controller-7brcs			system-node-critical pod "kops-controller-7brcs" is not ready (kops-controller)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 02:01:01.111840     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 02:01:12.805786     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 14 lines ...
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kops-controller-7brcs			system-node-critical pod "kops-controller-7brcs" is not ready (kops-controller)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 02:01:12.958737     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 02:01:24.673973     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 14 lines ...
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kops-controller-7brcs			system-node-critical pod "kops-controller-7brcs" is not ready (kops-controller)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 02:01:24.827254     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 02:01:36.543214     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 14 lines ...
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kops-controller-7brcs			system-node-critical pod "kops-controller-7brcs" is not ready (kops-controller)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 02:01:36.697428     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 02:01:48.488540     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 14 lines ...
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kops-controller-7brcs			system-node-critical pod "kops-controller-7brcs" is not ready (kops-controller)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 02:01:48.644665     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 02:02:00.846306     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 14 lines ...
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kops-controller-7brcs			system-node-critical pod "kops-controller-7brcs" is not ready (kops-controller)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 02:02:01.000855     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 02:02:12.697843     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 14 lines ...
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kops-controller-7brcs			system-node-critical pod "kops-controller-7brcs" is not ready (kops-controller)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 02:02:12.851879     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 02:02:24.652597     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 13 lines ...
Pod	kube-system/cilium-8dwzs				system-node-critical pod "cilium-8dwzs" is not ready (cilium-agent)
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 02:02:24.804253     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 02:02:36.598693     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 13 lines ...
Pod	kube-system/cilium-8dwzs				system-node-critical pod "cilium-8dwzs" is not ready (cilium-agent)
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 02:02:36.754799     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 02:02:48.564015     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 13 lines ...
Pod	kube-system/cilium-8dwzs				system-node-critical pod "cilium-8dwzs" is not ready (cilium-agent)
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 02:02:48.719068     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 02:03:00.603916     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 14 lines ...
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kops-controller-7brcs			system-node-critical pod "kops-controller-7brcs" is not ready (kops-controller)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 02:03:00.756018     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 02:03:12.745089     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 14 lines ...
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kops-controller-7brcs			system-node-critical pod "kops-controller-7brcs" is not ready (kops-controller)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 02:03:12.898491     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 02:03:24.708316     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 14 lines ...
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kops-controller-7brcs			system-node-critical pod "kops-controller-7brcs" is not ready (kops-controller)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 02:03:24.864036     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 02:03:36.734756     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 14 lines ...
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kops-controller-7brcs			system-node-critical pod "kops-controller-7brcs" is not ready (kops-controller)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 02:03:36.888011     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 02:03:48.563891     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 14 lines ...
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kops-controller-7brcs			system-node-critical pod "kops-controller-7brcs" is not ready (kops-controller)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 02:03:48.718934     176 validate_cluster.go:221] (will retry): cluster not yet healthy
W0929 02:04:00.468842     176 warnings.go:67] v1 ComponentStatus is deprecated in v1.19+
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-sa-east-1a	Master	c5.large	1	1	sa-east-1a
nodes-sa-east-1a	Node	t3.medium	4	4	sa-east-1a
... skipping 14 lines ...
Pod	kube-system/cilium-kkx9k				system-node-critical pod "cilium-kkx9k" is not ready (cilium-agent)
Pod	kube-system/cilium-lgv9r				system-node-critical pod "cilium-lgv9r" is not ready (cilium-agent)
Pod	kube-system/kops-controller-7brcs			system-node-critical pod "kops-controller-7brcs" is not ready (kops-controller)
Pod	kube-system/kube-dns-696cb84c7-w75ls			system-cluster-critical pod "kube-dns-696cb84c7-w75ls" is pending
Pod	kube-system/kube-dns-autoscaler-55f8f75459-7ndjx	system-cluster-critical pod "kube-dns-autoscaler-55f8f75459-7ndjx" is pending

Validation Failed
W0929 02:04:00.622654     176 validate_cluster.go:221] (will retry): cluster not yet healthy

Validation failed: wait time exceeded during validation
2020/09/29 02:04:10 process.go:155: Step '/tmp/kops710574247/kops validate cluster e2e-kops-cilium-u1604-k19.test-cncf-aws.k8s.io --wait 15m' finished in 15m4.95525042s
2020/09/29 02:04:10 process.go:153: Running: kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller
2020/09/29 02:04:10 process.go:153: Running: /tmp/kops710574247/kops toolbox dump --name e2e-kops-cilium-u1604-k19.test-cncf-aws.k8s.io -ojson
I0929 02:04:10.833430     189 featureflag.go:167] FeatureFlag "SpecOverrideFlag"=true
2020/09/29 02:04:12 process.go:155: Step 'kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller' finished in 1.790033228s
2020/09/29 02:04:12 process.go:153: Running: kubectl -n kube-system logs --all-containers kops-controller-7brcs
... skipping 170 lines ...
	vpc:vpc-05d6ce72f50f40061
	security-group:sg-0bf016433c9741662
	volume:vol-0a77f1aa97b4a5ab1
	volume:vol-0ce55f7d271fa6e87
	volume:vol-0edc7707e61453269
	volume:vol-0293607e7667d0f3b
I0929 02:05:28.615707     242 errors.go:32] unexpected aws error code: "InvalidVolume.NotFound"
volume:vol-0d245a2e91d313e40	ok
I0929 02:05:28.618382     242 errors.go:32] unexpected aws error code: "InvalidVolume.NotFound"
volume:vol-0a77f1aa97b4a5ab1	ok
volume:vol-0f29c7ad95c1751db	still has dependencies, will retry
volume:vol-0293607e7667d0f3b	still has dependencies, will retry
volume:vol-0edc7707e61453269	still has dependencies, will retry
volume:vol-0ce55f7d271fa6e87	still has dependencies, will retry
volume:vol-0b73b45c2eef19ff7	ok
... skipping 30 lines ...
	volume:vol-0f29c7ad95c1751db
	dhcp-options:dopt-01a9d65e7b8c88e04
	security-group:sg-02f066fe15d94a76d
	route-table:rtb-0989967cc2e428fc5
	subnet:subnet-079f119b575d4c5b9
	internet-gateway:igw-0d52f8f99a4da637a
I0929 02:05:51.014676     242 errors.go:32] unexpected aws error code: "InvalidVolume.NotFound"
volume:vol-0293607e7667d0f3b	ok
volume:vol-0edc7707e61453269	still has dependencies, will retry
volume:vol-0ce55f7d271fa6e87	still has dependencies, will retry
volume:vol-0f29c7ad95c1751db	still has dependencies, will retry
subnet:subnet-079f119b575d4c5b9	still has dependencies, will retry
security-group:sg-02f066fe15d94a76d	still has dependencies, will retry
... skipping 5 lines ...
	security-group:sg-02f066fe15d94a76d
	subnet:subnet-079f119b575d4c5b9
	vpc:vpc-05d6ce72f50f40061
	volume:vol-0ce55f7d271fa6e87
	volume:vol-0edc7707e61453269
	volume:vol-0f29c7ad95c1751db
I0929 02:06:01.798817     242 errors.go:32] unexpected aws error code: "InvalidVolume.NotFound"
volume:vol-0f29c7ad95c1751db	ok
volume:vol-0ce55f7d271fa6e87	ok
volume:vol-0edc7707e61453269	ok
security-group:sg-02f066fe15d94a76d	ok
subnet:subnet-079f119b575d4c5b9	ok
route-table:rtb-0989967cc2e428fc5	ok
vpc:vpc-05d6ce72f50f40061	ok
dhcp-options:dopt-01a9d65e7b8c88e04	ok
Deleted kubectl config for e2e-kops-cilium-u1604-k19.test-cncf-aws.k8s.io

Deleted cluster: "e2e-kops-cilium-u1604-k19.test-cncf-aws.k8s.io"
2020/09/29 02:06:09 process.go:155: Step '/tmp/kops710574247/kops delete cluster e2e-kops-cilium-u1604-k19.test-cncf-aws.k8s.io --yes' finished in 1m15.101059849s
2020/09/29 02:06:09 process.go:96: Saved XML output to /logs/artifacts/junit_runner.xml.
2020/09/29 02:06:09 main.go:312: Something went wrong: starting e2e cluster: kops validate cluster failed: error during /tmp/kops710574247/kops validate cluster e2e-kops-cilium-u1604-k19.test-cncf-aws.k8s.io --wait 15m: exit status 1
Traceback (most recent call last):
  File "/workspace/scenarios/kubernetes_e2e.py", line 720, in <module>
    main(parse_args())
  File "/workspace/scenarios/kubernetes_e2e.py", line 570, in main
    mode.start(runner_args)
  File "/workspace/scenarios/kubernetes_e2e.py", line 228, in start
... skipping 9 lines ...