This job view page is being replaced by Spyglass soon. Check out the new job view.
PRjohngmyers: Upgrade k8s-dns-node-cache to 1.22.16
ResultFAILURE
Tests 1 failed / 2 succeeded
Started2023-01-05 01:58
Elapsed30m57s
Revisionc55cc836db760efedba6a4f2a93b9527a19c778d
Refs 14951

Test Failures


kubetest2 Up 15m57s

exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 2 Passed Tests

Error lines from build-log.txt

... skipping 400 lines ...
I0105 02:09:31.362626    5645 build.go:45] setting kops base url to "https://storage.googleapis.com/kops-ci/pulls/pull-kops-e2e-aws-node-local-dns/pull-c55cc836db760efedba6a4f2a93b9527a19c778d/1.27.0-alpha.2+v1.27.0-alpha.1-105-gabf6a5b60a" from build results
I0105 02:09:31.362662    5645 copy.go:30] cp /home/prow/go/src/k8s.io/kops/.build/dist/linux/amd64/kops /home/prow/go/src/k8s.io/kops/_rundir/5fbb1d8d-8c9c-11ed-9652-26fbe2da2d33/kops
I0105 02:09:31.362676    5645 local.go:42] ⚙️ cp /home/prow/go/src/k8s.io/kops/.build/dist/linux/amd64/kops /home/prow/go/src/k8s.io/kops/_rundir/5fbb1d8d-8c9c-11ed-9652-26fbe2da2d33/kops
I0105 02:09:31.533622    5645 up.go:44] Cleaning up any leaked resources from previous cluster
I0105 02:09:31.533763    5645 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/.build/dist/linux/amd64/kops toolbox dump --name e2e-pr14951.pull-kops-e2e-aws-node-local-dns.test-cncf-aws.k8s.io --dir /logs/artifacts --private-key /tmp/kops/e2e-pr14951.pull-kops-e2e-aws-node-local-dns.test-cncf-aws.k8s.io/id_ed25519 --ssh-user ubuntu
I0105 02:09:31.533799    5645 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/.build/dist/linux/amd64/kops toolbox dump --name e2e-pr14951.pull-kops-e2e-aws-node-local-dns.test-cncf-aws.k8s.io --dir /logs/artifacts --private-key /tmp/kops/e2e-pr14951.pull-kops-e2e-aws-node-local-dns.test-cncf-aws.k8s.io/id_ed25519 --ssh-user ubuntu
W0105 02:09:32.031640    5645 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1
I0105 02:09:32.031709    5645 down.go:48] /home/prow/go/src/k8s.io/kops/.build/dist/linux/amd64/kops delete cluster --name e2e-pr14951.pull-kops-e2e-aws-node-local-dns.test-cncf-aws.k8s.io --yes
I0105 02:09:32.031723    5645 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/.build/dist/linux/amd64/kops delete cluster --name e2e-pr14951.pull-kops-e2e-aws-node-local-dns.test-cncf-aws.k8s.io --yes
I0105 02:09:32.062857   39204 featureflag.go:166] FeatureFlag "SpecOverrideFlag"=true
Error: error reading cluster configuration: Cluster.kops.k8s.io "e2e-pr14951.pull-kops-e2e-aws-node-local-dns.test-cncf-aws.k8s.io" not found
I0105 02:09:32.539940    5645 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip
2023/01/05 02:09:32 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404
I0105 02:09:32.553463    5645 http.go:37] curl https://ip.jsb.workers.dev
I0105 02:09:32.654314    5645 up.go:167] /home/prow/go/src/k8s.io/kops/.build/dist/linux/amd64/kops create cluster --name e2e-pr14951.pull-kops-e2e-aws-node-local-dns.test-cncf-aws.k8s.io --cloud aws --kubernetes-version https://storage.googleapis.com/kubernetes-release/release/v1.26.0 --ssh-public-key /tmp/kops/e2e-pr14951.pull-kops-e2e-aws-node-local-dns.test-cncf-aws.k8s.io/id_ed25519.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --image=099720109477/ubuntu/images/hvm-ssd/ubuntu-jammy-22.04-arm64-server-20221206 --channel=alpha --networking=cilium --container-runtime=containerd --set=cluster.spec.kubeDNS.nodeLocalDNS.enabled=true --discovery-store=s3://k8s-kops-prow/discovery --admin-access 104.197.33.66/32 --master-count 1 --master-volume-size 48 --node-count 4 --node-volume-size 48 --zones ap-northeast-2a --master-size c6g.large
I0105 02:09:32.654350    5645 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/.build/dist/linux/amd64/kops create cluster --name e2e-pr14951.pull-kops-e2e-aws-node-local-dns.test-cncf-aws.k8s.io --cloud aws --kubernetes-version https://storage.googleapis.com/kubernetes-release/release/v1.26.0 --ssh-public-key /tmp/kops/e2e-pr14951.pull-kops-e2e-aws-node-local-dns.test-cncf-aws.k8s.io/id_ed25519.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --image=099720109477/ubuntu/images/hvm-ssd/ubuntu-jammy-22.04-arm64-server-20221206 --channel=alpha --networking=cilium --container-runtime=containerd --set=cluster.spec.kubeDNS.nodeLocalDNS.enabled=true --discovery-store=s3://k8s-kops-prow/discovery --admin-access 104.197.33.66/32 --master-count 1 --master-volume-size 48 --node-count 4 --node-volume-size 48 --zones ap-northeast-2a --master-size c6g.large
I0105 02:09:32.685178   39214 featureflag.go:166] FeatureFlag "SpecOverrideFlag"=true
I0105 02:09:32.700318   39214 create_cluster.go:878] Using SSH public key: /tmp/kops/e2e-pr14951.pull-kops-e2e-aws-node-local-dns.test-cncf-aws.k8s.io/id_ed25519.pub
I0105 02:09:33.163762   39214 new_cluster.go:1327] Cloud Provider ID: "aws"
... skipping 560 lines ...

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a control plane node to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0105 02:10:16.287236   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a control plane node to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0105 02:10:26.318496   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a control plane node to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0105 02:10:36.351735   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a control plane node to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0105 02:10:46.382944   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a control plane node to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0105 02:10:56.399807   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a control plane node to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0105 02:11:06.418039   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a control plane node to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0105 02:11:16.442335   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a control plane node to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0105 02:11:26.461643   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a control plane node to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0105 02:11:36.479406   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a control plane node to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0105 02:11:46.511780   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a control plane node to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0105 02:11:56.528743   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a control plane node to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0105 02:12:06.545189   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a control plane node to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0105 02:12:16.563030   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a control plane node to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0105 02:12:26.581278   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a control plane node to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0105 02:12:36.613476   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a control plane node to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0105 02:12:46.645093   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a control plane node to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0105 02:12:56.670363   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a control plane node to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0105 02:13:06.689170   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a control plane node to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0105 02:13:16.710781   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a control plane node to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0105 02:13:26.727572   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a control plane node to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0105 02:13:36.744776   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a control plane node to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0105 02:13:46.777787   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a control plane node to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0105 02:13:56.797735   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a control plane node to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0105 02:14:06.831115   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 12 lines ...
Pod	kube-system/coredns-autoscaler-7cb5c5b969-wm4xk	system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-wm4xk" is pending
Pod	kube-system/ebs-csi-controller-589675749b-9kf6k	system-cluster-critical pod "ebs-csi-controller-589675749b-9kf6k" is pending
Pod	kube-system/ebs-csi-controller-589675749b-rg46c	system-cluster-critical pod "ebs-csi-controller-589675749b-rg46c" is pending
Pod	kube-system/ebs-csi-node-mddnc			system-node-critical pod "ebs-csi-node-mddnc" is pending
Pod	kube-system/node-local-dns-lzpbp		system-node-critical pod "node-local-dns-lzpbp" is pending

Validation Failed
W0105 02:14:20.648935   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 11 lines ...
Pod	kube-system/coredns-autoscaler-7cb5c5b969-wm4xk	system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-wm4xk" is pending
Pod	kube-system/ebs-csi-controller-589675749b-9kf6k	system-cluster-critical pod "ebs-csi-controller-589675749b-9kf6k" is pending
Pod	kube-system/ebs-csi-controller-589675749b-rg46c	system-cluster-critical pod "ebs-csi-controller-589675749b-rg46c" is pending
Pod	kube-system/ebs-csi-node-mddnc			system-node-critical pod "ebs-csi-node-mddnc" is pending
Pod	kube-system/node-local-dns-lzpbp		system-node-critical pod "node-local-dns-lzpbp" is pending

Validation Failed
W0105 02:14:33.504636   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 11 lines ...
Pod	kube-system/coredns-autoscaler-7cb5c5b969-wm4xk	system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-wm4xk" is pending
Pod	kube-system/ebs-csi-controller-589675749b-9kf6k	system-cluster-critical pod "ebs-csi-controller-589675749b-9kf6k" is pending
Pod	kube-system/ebs-csi-controller-589675749b-rg46c	system-cluster-critical pod "ebs-csi-controller-589675749b-rg46c" is pending
Pod	kube-system/ebs-csi-node-mddnc			system-node-critical pod "ebs-csi-node-mddnc" is pending
Pod	kube-system/node-local-dns-lzpbp		system-node-critical pod "node-local-dns-lzpbp" is pending

Validation Failed
W0105 02:14:46.340565   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 25 lines ...
Pod	kube-system/node-local-dns-28ndk		system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n		system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz		system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp		system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl		system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:14:59.211340   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 23 lines ...
Pod	kube-system/node-local-dns-28ndk		system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n		system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz		system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp		system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl		system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:15:12.035946   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 19 lines ...
Pod	kube-system/node-local-dns-28ndk		system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n		system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz		system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp		system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl		system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:15:24.918986   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 11 lines ...
Pod	kube-system/node-local-dns-28ndk		system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n		system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz		system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp		system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl		system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:15:37.735082   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:15:50.577334   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:16:03.407273   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:16:16.339446   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:16:29.161491   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:16:42.083374   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:16:54.868997   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:17:07.769524   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:17:20.631761   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:17:33.462887   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:17:46.366442   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:17:59.236827   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:18:12.784825   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:18:25.695656   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:18:38.577124   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:18:51.473324   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:19:04.332375   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:19:17.215714   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:19:30.083210   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:19:42.923671   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:19:55.837994   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:20:08.626983   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:20:21.508480   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:20:34.319699   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:20:47.241757   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:21:00.161691   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:21:13.168386   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:21:26.057777   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:21:38.854671   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:21:51.789801   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:22:05.319282   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:22:18.266043   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:22:31.218565   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:22:44.048004   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:22:56.864769   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:23:09.825863   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:23:22.667921   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:23:35.532896   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:23:48.304315   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:24:01.318149   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:24:14.244419   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:24:27.183104   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:24:40.058469   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:24:53.084389   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:25:05.924042   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME				ROLE		MACHINETYPE	MIN	MAX	SUBNETS
control-plane-ap-northeast-2a	ControlPlane	c6g.large	1	1	ap-northeast-2a
nodes-ap-northeast-2a		Node		t4g.medium	4	4	ap-northeast-2a

... skipping 10 lines ...
Pod	kube-system/node-local-dns-28ndk	system-node-critical pod "node-local-dns-28ndk" is pending
Pod	kube-system/node-local-dns-7hk8n	system-node-critical pod "node-local-dns-7hk8n" is pending
Pod	kube-system/node-local-dns-g6qvz	system-node-critical pod "node-local-dns-g6qvz" is pending
Pod	kube-system/node-local-dns-lzpbp	system-node-critical pod "node-local-dns-lzpbp" is pending
Pod	kube-system/node-local-dns-p8stl	system-node-critical pod "node-local-dns-p8stl" is pending

Validation Failed
W0105 02:25:18.777267   39254 validate_cluster.go:232] (will retry): cluster not yet healthy
Error: validation failed: wait time exceeded during validation
I0105 02:25:28.785974    5645 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/.build/dist/linux/amd64/kops toolbox dump --name e2e-pr14951.pull-kops-e2e-aws-node-local-dns.test-cncf-aws.k8s.io --dir /logs/artifacts --private-key /tmp/kops/e2e-pr14951.pull-kops-e2e-aws-node-local-dns.test-cncf-aws.k8s.io/id_ed25519 --ssh-user ubuntu
I0105 02:25:28.786045    5645 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/.build/dist/linux/amd64/kops toolbox dump --name e2e-pr14951.pull-kops-e2e-aws-node-local-dns.test-cncf-aws.k8s.io --dir /logs/artifacts --private-key /tmp/kops/e2e-pr14951.pull-kops-e2e-aws-node-local-dns.test-cncf-aws.k8s.io/id_ed25519 --ssh-user ubuntu
I0105 02:26:37.582769    5645 dumplogs.go:78] /home/prow/go/src/k8s.io/kops/.build/dist/linux/amd64/kops get cluster --name e2e-pr14951.pull-kops-e2e-aws-node-local-dns.test-cncf-aws.k8s.io -o yaml
I0105 02:26:37.582843    5645 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/.build/dist/linux/amd64/kops get cluster --name e2e-pr14951.pull-kops-e2e-aws-node-local-dns.test-cncf-aws.k8s.io -o yaml
I0105 02:26:38.083157    5645 dumplogs.go:78] /home/prow/go/src/k8s.io/kops/.build/dist/linux/amd64/kops get instancegroups --name e2e-pr14951.pull-kops-e2e-aws-node-local-dns.test-cncf-aws.k8s.io -o yaml
I0105 02:26:38.083196    5645 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/.build/dist/linux/amd64/kops get instancegroups --name e2e-pr14951.pull-kops-e2e-aws-node-local-dns.test-cncf-aws.k8s.io -o yaml
... skipping 294 lines ...
route-table:rtb-01ade53d9e7a3e9f1	ok
vpc:vpc-031f26d45470b34f8	ok
dhcp-options:dopt-00c04392e361a36a6	ok
Deleted kubectl config for e2e-pr14951.pull-kops-e2e-aws-node-local-dns.test-cncf-aws.k8s.io

Deleted cluster: "e2e-pr14951.pull-kops-e2e-aws-node-local-dns.test-cncf-aws.k8s.io"
Error: exit status 1
+ EXIT_VALUE=1
+ set +o xtrace
Cleaning up after docker in docker.
================================================================================
Cleaning up after docker
Stopping Docker: dockerProgram process in pidfile '/var/run/docker-ssd.pid', 1 process(es), refused to die.
... skipping 3 lines ...