e2e-kops-gce-leader-migration #1620509291813277696
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 1 failed / 1 succeeded |
| Started | |
| Elapsed | 20m11s |
| Revision | master |
exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
kubetest2 Down
... skipping 156 lines ... ...........................................Updated [https://www.googleapis.com/compute/v1/projects/k8s-gce-gci-mstr-1-6-ctl-skew]. .done. WARNING: No host aliases were added to your SSH configs because you do not have any running instances. Try running this command again after running some instances. I0131 19:50:22.056217 5718 up.go:44] Cleaning up any leaked resources from previous cluster I0131 19:50:22.056342 5718 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/34fd1dca-a1a0-11ed-9994-daecb65d57ab/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh1405117744/key --ssh-user prow I0131 19:50:22.056358 5718 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/34fd1dca-a1a0-11ed-9994-daecb65d57ab/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh1405117744/key --ssh-user prow Error: Cluster.kops.k8s.io "ha-migration.k8s.local" not found W0131 19:50:22.313831 5718 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1 I0131 19:50:22.313872 5718 down.go:48] /home/prow/go/src/k8s.io/kops/_rundir/34fd1dca-a1a0-11ed-9994-daecb65d57ab/kops delete cluster --name ha-migration.k8s.local --yes I0131 19:50:22.313884 5718 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/34fd1dca-a1a0-11ed-9994-daecb65d57ab/kops delete cluster --name ha-migration.k8s.local --yes Error: error reading cluster configuration: Cluster.kops.k8s.io "ha-migration.k8s.local" not found I0131 19:50:22.442648 5718 gcs.go:51] gsutil ls -b -p k8s-gce-gci-mstr-1-6-ctl-skew gs://k8s-gce-gci-mstr-1-6-ctl-skew-state-34 I0131 19:50:22.442688 5718 local.go:42] ⚙️ gsutil ls -b -p k8s-gce-gci-mstr-1-6-ctl-skew gs://k8s-gce-gci-mstr-1-6-ctl-skew-state-34 I0131 19:50:24.411336 5718 gcs.go:70] gsutil mb -p k8s-gce-gci-mstr-1-6-ctl-skew gs://k8s-gce-gci-mstr-1-6-ctl-skew-state-34 I0131 19:50:24.411371 5718 local.go:42] ⚙️ gsutil mb -p k8s-gce-gci-mstr-1-6-ctl-skew gs://k8s-gce-gci-mstr-1-6-ctl-skew-state-34 Creating gs://k8s-gce-gci-mstr-1-6-ctl-skew-state-34/... I0131 19:50:26.822869 5718 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip 2023/01/31 19:50:26 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404 I0131 19:50:26.837176 5718 http.go:37] curl https://ip.jsb.workers.dev I0131 19:50:26.965396 5718 up.go:167] /home/prow/go/src/k8s.io/kops/_rundir/34fd1dca-a1a0-11ed-9994-daecb65d57ab/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh1405117744/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 35.239.116.242/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project k8s-gce-gci-mstr-1-6-ctl-skew I0131 19:50:26.965439 5718 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/34fd1dca-a1a0-11ed-9994-daecb65d57ab/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh1405117744/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 35.239.116.242/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project k8s-gce-gci-mstr-1-6-ctl-skew I0131 19:50:27.011982 6037 create_cluster.go:882] Using SSH public key: /tmp/kops-ssh1405117744/key.pub I0131 19:50:27.341280 6037 new_cluster.go:573] VMs will be configured to use specified Service Account: default I0131 19:50:27.341399 6037 new_cluster.go:1339] Cloud Provider ID: "gce" ... skipping 527 lines ... I0131 19:50:40.073230 6058 keypair.go:226] Issuing new certificate: "etcd-peers-ca-events" I0131 19:50:40.074704 6058 keypair.go:226] Issuing new certificate: "apiserver-aggregator-ca" W0131 19:50:40.179315 6058 vfs_keystorereader.go:143] CA private key was not found I0131 19:50:40.323986 6058 keypair.go:226] Issuing new certificate: "service-account" I0131 19:50:40.382613 6058 keypair.go:226] Issuing new certificate: "kubernetes-ca" I0131 19:50:52.817313 6058 executor.go:111] Tasks: 50 done / 91 total; 23 can run W0131 19:51:02.689185 6058 executor.go:139] error running task "ForwardingRule/api-ha-migration-k8s-local" (9m50s remaining to succeed): error creating ForwardingRule "api-ha-migration-k8s-local": googleapi: Error 400: The resource 'projects/k8s-gce-gci-mstr-1-6-ctl-skew/regions/us-central1/targetPools/api-ha-migration-k8s-local' is not ready, resourceNotReady I0131 19:51:02.689252 6058 executor.go:111] Tasks: 72 done / 91 total; 13 can run I0131 19:51:09.507398 6058 executor.go:111] Tasks: 85 done / 91 total; 6 can run I0131 19:51:23.475229 6058 executor.go:111] Tasks: 91 done / 91 total; 0 can run I0131 19:51:23.552090 6058 update_cluster.go:323] Exporting kubeconfig for cluster kOps has set your kubectl context to ha-migration.k8s.local ... skipping 7 lines ... * read about installing addons at: https://kops.sigs.k8s.io/addons. I0131 19:51:33.891919 5718 up.go:251] /home/prow/go/src/k8s.io/kops/_rundir/34fd1dca-a1a0-11ed-9994-daecb65d57ab/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s I0131 19:51:33.891977 5718 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/34fd1dca-a1a0-11ed-9994-daecb65d57ab/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s Validating cluster ha-migration.k8s.local W0131 19:52:04.367942 6078 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.202.100.22/api/v1/nodes": dial tcp 35.202.100.22:443: i/o timeout W0131 19:52:29.620623 6078 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.202.100.22/api/v1/nodes": dial tcp 35.202.100.22:443: connect: connection refused W0131 19:52:39.626468 6078 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.202.100.22/api/v1/nodes": dial tcp 35.202.100.22:443: connect: connection refused W0131 19:52:49.634312 6078 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.202.100.22/api/v1/nodes": dial tcp 35.202.100.22:443: connect: connection refused W0131 19:52:59.642358 6078 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.202.100.22/api/v1/nodes": dial tcp 35.202.100.22:443: connect: connection refused W0131 19:53:09.650988 6078 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.202.100.22/api/v1/nodes": dial tcp 35.202.100.22:443: connect: connection refused W0131 19:53:19.653771 6078 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.202.100.22/api/v1/nodes": dial tcp 35.202.100.22:443: connect: connection refused W0131 19:53:29.657402 6078 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.202.100.22/api/v1/nodes": dial tcp 35.202.100.22:443: connect: connection refused W0131 19:53:39.662550 6078 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.202.100.22/api/v1/nodes": dial tcp 35.202.100.22:443: connect: connection refused W0131 19:53:49.670516 6078 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.202.100.22/api/v1/nodes": dial tcp 35.202.100.22:443: connect: connection refused W0131 19:54:09.683793 6078 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.202.100.22/api/v1/nodes": net/http: TLS handshake timeout W0131 19:54:29.696844 6078 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.202.100.22/api/v1/nodes": net/http: TLS handshake timeout W0131 19:54:49.709990 6078 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.202.100.22/api/v1/nodes": net/http: TLS handshake timeout I0131 19:55:08.906614 5718 boskos.go:86] Sending heartbeat to Boskos W0131 19:55:09.718237 6078 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.202.100.22/api/v1/nodes": net/http: TLS handshake timeout W0131 19:55:19.726722 6078 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.202.100.22/api/v1/nodes": dial tcp 35.202.100.22:443: connect: connection refused W0131 19:55:29.729834 6078 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.202.100.22/api/v1/nodes": dial tcp 35.202.100.22:443: connect: connection refused W0131 19:55:39.733528 6078 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.202.100.22/api/v1/nodes": dial tcp 35.202.100.22:443: connect: connection refused W0131 19:55:49.740599 6078 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.202.100.22/api/v1/nodes": dial tcp 35.202.100.22:443: connect: connection refused W0131 19:56:09.754005 6078 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.202.100.22/api/v1/nodes": net/http: TLS handshake timeout W0131 19:56:19.762050 6078 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.202.100.22/api/v1/nodes": dial tcp 35.202.100.22:443: connect: connection refused W0131 19:56:29.766378 6078 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.202.100.22/api/v1/nodes": dial tcp 35.202.100.22:443: connect: connection refused W0131 19:56:39.774470 6078 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.202.100.22/api/v1/nodes": dial tcp 35.202.100.22:443: connect: connection refused W0131 19:56:49.782351 6078 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.202.100.22/api/v1/nodes": dial tcp 35.202.100.22:443: connect: connection refused W0131 19:56:59.790428 6078 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.202.100.22/api/v1/nodes": dial tcp 35.202.100.22:443: connect: connection refused I0131 19:57:10.240344 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-c ControlPlane e2-standard-2 1 1 us-central1 ... skipping 12 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-gci-mstr-1-6-ctl-skew/zones/us-central1-c/instances/control-plane-us-central1-c-dnxb machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-gci-mstr-1-6-ctl-skew/zones/us-central1-c/instances/control-plane-us-central1-c-dnxb" has not yet joined cluster Node control-plane-us-central1-a-k65t node "control-plane-us-central1-a-k65t" of role "control-plane" is not ready Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Pod kube-system/etcd-manager-events-control-plane-us-central1-a-k65t system-cluster-critical pod "etcd-manager-events-control-plane-us-central1-a-k65t" is pending Pod kube-system/etcd-manager-main-control-plane-us-central1-a-k65t system-cluster-critical pod "etcd-manager-main-control-plane-us-central1-a-k65t" is pending Validation Failed W0131 19:57:11.187822 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 19:57:21.463772 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 13 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-gci-mstr-1-6-ctl-skew/zones/us-central1-a/instances/nodes-us-central1-a-bbns machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-gci-mstr-1-6-ctl-skew/zones/us-central1-a/instances/nodes-us-central1-a-bbns" has not yet joined cluster Node control-plane-us-central1-a-k65t node "control-plane-us-central1-a-k65t" of role "control-plane" is not ready Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-a-k65t system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-k65t" is not ready (kube-controller-manager) Validation Failed W0131 19:57:22.351173 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 19:57:32.678575 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 14 lines ... Node control-plane-us-central1-a-k65t node "control-plane-us-central1-a-k65t" of role "control-plane" is not ready Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-a-k65t system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-k65t" is not ready (kube-controller-manager) Pod kube-system/kube-controller-manager-control-plane-us-central1-b-fhgn system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-fhgn" is not ready (kube-controller-manager) Validation Failed W0131 19:57:33.574491 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 19:57:43.898861 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 12 lines ... KIND NAME MESSAGE Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-gci-mstr-1-6-ctl-skew/zones/us-central1-a/instances/nodes-us-central1-a-bbns machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-gci-mstr-1-6-ctl-skew/zones/us-central1-a/instances/nodes-us-central1-a-bbns" has not yet joined cluster Node control-plane-us-central1-a-k65t node "control-plane-us-central1-a-k65t" of role "control-plane" is not ready Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Validation Failed W0131 19:57:44.860570 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 19:57:55.151673 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 22 lines ... Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Pod kube-system/kube-apiserver-control-plane-us-central1-a-k65t system-cluster-critical pod "kube-apiserver-control-plane-us-central1-a-k65t" is pending Pod kube-system/kube-scheduler-control-plane-us-central1-b-fhgn system-cluster-critical pod "kube-scheduler-control-plane-us-central1-b-fhgn" is pending Validation Failed W0131 19:57:56.016302 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 19:58:06.265545 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 19 lines ... Pod kube-system/cilium-qgqk2 system-node-critical pod "cilium-qgqk2" is pending Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Pod kube-system/kube-scheduler-control-plane-us-central1-a-k65t system-cluster-critical pod "kube-scheduler-control-plane-us-central1-a-k65t" is pending Validation Failed W0131 19:58:07.159918 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 19:58:17.617203 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 21 lines ... Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Pod kube-system/etcd-manager-events-control-plane-us-central1-b-fhgn system-cluster-critical pod "etcd-manager-events-control-plane-us-central1-b-fhgn" is pending Pod kube-system/etcd-manager-main-control-plane-us-central1-c-dnxb system-cluster-critical pod "etcd-manager-main-control-plane-us-central1-c-dnxb" is pending Pod kube-system/kube-apiserver-control-plane-us-central1-b-fhgn system-cluster-critical pod "kube-apiserver-control-plane-us-central1-b-fhgn" is pending Validation Failed W0131 19:58:18.499807 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 19:58:28.777385 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 17 lines ... Pod kube-system/cilium-7qzrp system-node-critical pod "cilium-7qzrp" is not ready (cilium-agent) Pod kube-system/cilium-qgqk2 system-node-critical pod "cilium-qgqk2" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 19:58:29.631572 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 19:58:39.921982 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 19:58:40.800491 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 19:58:51.102855 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 19:58:51.901283 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 19:59:02.181562 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 19:59:03.050566 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 19:59:13.494818 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 19:59:14.295509 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 19:59:24.744102 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 19:59:25.627748 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 19:59:35.995017 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 19:59:36.802244 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 19:59:47.146156 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 19:59:47.964804 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 19:59:58.296383 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 19:59:59.093570 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:00:08.918036 5718 boskos.go:86] Sending heartbeat to Boskos I0131 20:00:09.469832 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:00:10.337528 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:00:20.694833 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:00:21.579309 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:00:31.980599 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:00:32.851836 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:00:43.175227 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:00:44.083653 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:00:54.381962 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:00:55.293330 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:01:05.666993 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:01:06.562308 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:01:16.858963 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:01:17.767315 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:01:28.178905 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:01:29.032495 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:01:39.392809 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:01:40.242229 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:01:50.583961 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:01:51.559316 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:02:01.836723 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:02:02.726648 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:02:13.120635 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:02:14.003577 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:02:24.290653 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:02:25.095680 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:02:35.407075 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:02:36.394045 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:02:46.767472 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:02:47.629346 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:02:57.933336 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:02:58.862811 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:03:09.284706 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:03:10.106752 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:03:20.514967 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:03:21.437792 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:03:31.893975 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:03:32.732207 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:03:43.111197 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:03:43.962259 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:03:54.423355 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:03:55.232193 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:04:05.673774 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:04:06.532219 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:04:16.849285 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:04:17.740610 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:04:28.018017 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:04:28.907890 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:04:39.233228 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:04:40.172122 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:04:50.637223 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:04:51.606161 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:05:01.961595 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:05:02.827983 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:05:08.928849 5718 boskos.go:86] Sending heartbeat to Boskos I0131 20:05:13.151395 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:05:13.959619 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:05:24.286685 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:05:25.129445 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:05:35.448967 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:05:36.327983 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:05:46.711924 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:05:47.592926 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:05:57.928639 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:05:58.747611 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:06:09.157326 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:06:09.983505 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:06:20.346736 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:06:21.171966 6078 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 20:06:31.500524 6078 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-fhgn node "control-plane-us-central1-b-fhgn" of role "control-plane" is not ready Node control-plane-us-central1-c-dnxb node "control-plane-us-central1-c-dnxb" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-7sjrw system-cluster-critical pod "coredns-5d479c4f64-7sjrw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wz5pj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wz5pj" is pending Pod kube-system/dns-controller-6f69f47785-vq8jq system-cluster-critical pod "dns-controller-6f69f47785-vq8jq" is pending Validation Failed W0131 20:06:32.342043 6078 validate_cluster.go:232] (will retry): cluster not yet healthy Error: validation failed: wait time exceeded during validation I0131 20:06:42.358099 5718 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/34fd1dca-a1a0-11ed-9994-daecb65d57ab/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh1405117744/key --ssh-user prow I0131 20:06:42.358146 5718 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/34fd1dca-a1a0-11ed-9994-daecb65d57ab/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh1405117744/key --ssh-user prow I0131 20:06:42.843014 6089 gce.go:99] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] 2023/01/31 20:06:47 Dumping node control-plane-us-central1-a-k65t 2023/01/31 20:06:51 error dumping node control-plane-us-central1-a-k65t: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/31 20:06:51 error dumping node control-plane-us-central1-a-k65t: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/31 20:06:51 Dumping node control-plane-us-central1-b-fhgn 2023/01/31 20:06:55 error dumping node control-plane-us-central1-b-fhgn: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/31 20:06:55 error dumping node control-plane-us-central1-b-fhgn: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/31 20:06:55 Dumping node control-plane-us-central1-c-dnxb 2023/01/31 20:06:58 error dumping node control-plane-us-central1-c-dnxb: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/31 20:06:58 error dumping node control-plane-us-central1-c-dnxb: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/31 20:06:58 dumping node not registered in kubernetes: 34.172.199.134 2023/01/31 20:06:58 Dumping node 34.172.199.134 I0131 20:07:00.889607 5718 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/34fd1dca-a1a0-11ed-9994-daecb65d57ab/kops get cluster --name ha-migration.k8s.local -o yaml I0131 20:07:00.889652 5718 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/34fd1dca-a1a0-11ed-9994-daecb65d57ab/kops get cluster --name ha-migration.k8s.local -o yaml I0131 20:07:01.049890 5718 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/34fd1dca-a1a0-11ed-9994-daecb65d57ab/kops get instancegroups --name ha-migration.k8s.local -o yaml I0131 20:07:01.049926 5718 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/34fd1dca-a1a0-11ed-9994-daecb65d57ab/kops get instancegroups --name ha-migration.k8s.local -o yaml ... skipping 166 lines ... Deleted cluster: "ha-migration.k8s.local" I0131 20:09:10.455689 5718 gcs.go:88] gsutil -u k8s-gce-gci-mstr-1-6-ctl-skew rm -r gs://k8s-gce-gci-mstr-1-6-ctl-skew-state-34 I0131 20:09:10.455750 5718 local.go:42] ⚙️ gsutil -u k8s-gce-gci-mstr-1-6-ctl-skew rm -r gs://k8s-gce-gci-mstr-1-6-ctl-skew-state-34 Removing gs://k8s-gce-gci-mstr-1-6-ctl-skew-state-34/... I0131 20:09:12.795334 5718 down.go:62] releasing boskos project I0131 20:09:12.804333 5718 boskos.go:83] Boskos heartbeat func received signal to close Error: exit status 1 + EXIT_VALUE=1 + set +o xtrace