e2e-kops-gce-leader-migration #1620917097200619520
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 1 failed / 1 succeeded |
| Started | |
| Elapsed | 20m2s |
| Revision | master |
exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
kubetest2 Down
... skipping 156 lines ... ..........................Updated [https://www.googleapis.com/compute/v1/projects/k8s-gce-1-5]. .done. WARNING: No host aliases were added to your SSH configs because you do not have any running instances. Try running this command again after running some instances. I0201 22:50:45.703896 5788 up.go:44] Cleaning up any leaked resources from previous cluster I0201 22:50:45.704066 5788 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/959ebc42-a282-11ed-aff3-c6e29dfe916e/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh2439320577/key --ssh-user prow I0201 22:50:45.704080 5788 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/959ebc42-a282-11ed-aff3-c6e29dfe916e/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh2439320577/key --ssh-user prow Error: Cluster.kops.k8s.io "ha-migration.k8s.local" not found W0201 22:50:46.103000 5788 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1 I0201 22:50:46.103153 5788 down.go:48] /home/prow/go/src/k8s.io/kops/_rundir/959ebc42-a282-11ed-aff3-c6e29dfe916e/kops delete cluster --name ha-migration.k8s.local --yes I0201 22:50:46.103214 5788 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/959ebc42-a282-11ed-aff3-c6e29dfe916e/kops delete cluster --name ha-migration.k8s.local --yes Error: error reading cluster configuration: Cluster.kops.k8s.io "ha-migration.k8s.local" not found I0201 22:50:46.373638 5788 gcs.go:51] gsutil ls -b -p k8s-gce-1-5 gs://k8s-gce-1-5-state-95 I0201 22:50:46.373679 5788 local.go:42] ⚙️ gsutil ls -b -p k8s-gce-1-5 gs://k8s-gce-1-5-state-95 I0201 22:50:48.473592 5788 gcs.go:70] gsutil mb -p k8s-gce-1-5 gs://k8s-gce-1-5-state-95 I0201 22:50:48.473637 5788 local.go:42] ⚙️ gsutil mb -p k8s-gce-1-5 gs://k8s-gce-1-5-state-95 Creating gs://k8s-gce-1-5-state-95/... I0201 22:50:51.225982 5788 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip 2023/02/01 22:50:51 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404 I0201 22:50:51.241633 5788 http.go:37] curl https://ip.jsb.workers.dev I0201 22:50:51.370297 5788 up.go:167] /home/prow/go/src/k8s.io/kops/_rundir/959ebc42-a282-11ed-aff3-c6e29dfe916e/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh2439320577/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 34.68.176.126/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project k8s-gce-1-5 I0201 22:50:51.370354 5788 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/959ebc42-a282-11ed-aff3-c6e29dfe916e/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh2439320577/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 34.68.176.126/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project k8s-gce-1-5 I0201 22:50:51.421015 6110 create_cluster.go:882] Using SSH public key: /tmp/kops-ssh2439320577/key.pub I0201 22:50:51.635584 6110 new_cluster.go:573] VMs will be configured to use specified Service Account: default I0201 22:50:51.635713 6110 new_cluster.go:1339] Cloud Provider ID: "gce" ... skipping 527 lines ... I0201 22:51:04.490594 6130 keypair.go:226] Issuing new certificate: "apiserver-aggregator-ca" I0201 22:51:04.494177 6130 keypair.go:226] Issuing new certificate: "etcd-clients-ca" W0201 22:51:04.681310 6130 vfs_keystorereader.go:143] CA private key was not found I0201 22:51:04.879294 6130 keypair.go:226] Issuing new certificate: "kubernetes-ca" I0201 22:51:04.879526 6130 keypair.go:226] Issuing new certificate: "service-account" I0201 22:51:16.973218 6130 executor.go:111] Tasks: 50 done / 91 total; 23 can run W0201 22:51:26.889922 6130 executor.go:139] error running task "ForwardingRule/api-ha-migration-k8s-local" (9m50s remaining to succeed): error creating ForwardingRule "api-ha-migration-k8s-local": googleapi: Error 400: The resource 'projects/k8s-gce-1-5/regions/us-central1/targetPools/api-ha-migration-k8s-local' is not ready, resourceNotReady I0201 22:51:26.889997 6130 executor.go:111] Tasks: 72 done / 91 total; 13 can run I0201 22:51:33.684897 6130 executor.go:111] Tasks: 85 done / 91 total; 6 can run I0201 22:51:47.763063 6130 executor.go:111] Tasks: 91 done / 91 total; 0 can run I0201 22:51:47.832575 6130 update_cluster.go:323] Exporting kubeconfig for cluster kOps has set your kubectl context to ha-migration.k8s.local ... skipping 7 lines ... * read about installing addons at: https://kops.sigs.k8s.io/addons. I0201 22:51:58.289742 5788 up.go:251] /home/prow/go/src/k8s.io/kops/_rundir/959ebc42-a282-11ed-aff3-c6e29dfe916e/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s I0201 22:51:58.289805 5788 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/959ebc42-a282-11ed-aff3-c6e29dfe916e/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s Validating cluster ha-migration.k8s.local W0201 22:52:28.943791 6149 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.66.26.240/api/v1/nodes": dial tcp 34.66.26.240:443: i/o timeout W0201 22:53:08.944985 6149 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.66.26.240/api/v1/nodes": dial tcp 34.66.26.240:443: i/o timeout W0201 22:53:18.948963 6149 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.66.26.240/api/v1/nodes": dial tcp 34.66.26.240:443: connect: connection refused W0201 22:53:28.953308 6149 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.66.26.240/api/v1/nodes": dial tcp 34.66.26.240:443: connect: connection refused W0201 22:53:38.957147 6149 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.66.26.240/api/v1/nodes": dial tcp 34.66.26.240:443: connect: connection refused W0201 22:53:48.961438 6149 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.66.26.240/api/v1/nodes": dial tcp 34.66.26.240:443: connect: connection refused W0201 22:53:58.965955 6149 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.66.26.240/api/v1/nodes": dial tcp 34.66.26.240:443: connect: connection refused W0201 22:54:08.968980 6149 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.66.26.240/api/v1/nodes": dial tcp 34.66.26.240:443: connect: connection refused W0201 22:54:18.974214 6149 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.66.26.240/api/v1/nodes": dial tcp 34.66.26.240:443: connect: connection refused W0201 22:54:28.977866 6149 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.66.26.240/api/v1/nodes": dial tcp 34.66.26.240:443: connect: connection refused W0201 22:54:48.980941 6149 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.66.26.240/api/v1/nodes": net/http: TLS handshake timeout W0201 22:54:58.984911 6149 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.66.26.240/api/v1/nodes": dial tcp 34.66.26.240:443: connect: connection refused W0201 22:55:16.325247 6149 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.66.26.240/api/v1/nodes": dial tcp 34.66.26.240:443: connect: connection refused - error from a previous attempt: read tcp 10.60.71.98:42386->34.66.26.240:443: read: connection reset by peer W0201 22:55:31.736629 6149 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.66.26.240/api/v1/nodes": dial tcp 34.66.26.240:443: connect: connection refused - error from a previous attempt: read tcp 10.60.71.98:37070->34.66.26.240:443: read: connection reset by peer I0201 22:55:36.457041 5788 boskos.go:86] Sending heartbeat to Boskos W0201 22:55:51.744138 6149 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.66.26.240/api/v1/nodes": net/http: TLS handshake timeout W0201 22:56:01.748628 6149 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.66.26.240/api/v1/nodes": dial tcp 34.66.26.240:443: connect: connection refused W0201 22:56:11.753587 6149 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.66.26.240/api/v1/nodes": dial tcp 34.66.26.240:443: connect: connection refused W0201 22:56:31.760373 6149 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.66.26.240/api/v1/nodes": net/http: TLS handshake timeout I0201 22:56:45.577235 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-c ControlPlane e2-standard-2 1 1 us-central1 ... skipping 8 lines ... KIND NAME MESSAGE Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-1-5/zones/us-central1-a/instances/control-plane-us-central1-a-kws8 machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-1-5/zones/us-central1-a/instances/control-plane-us-central1-a-kws8" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-1-5/zones/us-central1-a/instances/nodes-us-central1-a-nndv machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-1-5/zones/us-central1-a/instances/nodes-us-central1-a-nndv" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-1-5/zones/us-central1-b/instances/control-plane-us-central1-b-n43q machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-1-5/zones/us-central1-b/instances/control-plane-us-central1-b-n43q" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-1-5/zones/us-central1-c/instances/control-plane-us-central1-c-2mbx machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-1-5/zones/us-central1-c/instances/control-plane-us-central1-c-2mbx" has not yet joined cluster Validation Failed W0201 22:56:46.530707 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 22:56:56.853547 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 11 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-1-5/zones/us-central1-a/instances/nodes-us-central1-a-nndv machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-1-5/zones/us-central1-a/instances/nodes-us-central1-a-nndv" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-1-5/zones/us-central1-b/instances/control-plane-us-central1-b-n43q machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-1-5/zones/us-central1-b/instances/control-plane-us-central1-b-n43q" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-1-5/zones/us-central1-c/instances/control-plane-us-central1-c-2mbx machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-1-5/zones/us-central1-c/instances/control-plane-us-central1-c-2mbx" has not yet joined cluster Node control-plane-us-central1-a-kws8 node "control-plane-us-central1-a-kws8" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-a-kws8 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-kws8" is pending Validation Failed W0201 22:56:57.799666 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 22:57:08.108308 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 13 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-1-5/zones/us-central1-c/instances/control-plane-us-central1-c-2mbx machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-1-5/zones/us-central1-c/instances/control-plane-us-central1-c-2mbx" has not yet joined cluster Node control-plane-us-central1-a-kws8 node "control-plane-us-central1-a-kws8" of role "control-plane" is not ready Pod kube-system/etcd-manager-events-control-plane-us-central1-a-kws8 system-cluster-critical pod "etcd-manager-events-control-plane-us-central1-a-kws8" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-a-kws8 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-kws8" is not ready (kube-controller-manager) Pod kube-system/kube-scheduler-control-plane-us-central1-a-kws8 system-cluster-critical pod "kube-scheduler-control-plane-us-central1-a-kws8" is pending Validation Failed W0201 22:57:09.025020 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 22:57:19.315466 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 12 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-1-5/zones/us-central1-a/instances/nodes-us-central1-a-nndv machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-1-5/zones/us-central1-a/instances/nodes-us-central1-a-nndv" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-1-5/zones/us-central1-c/instances/control-plane-us-central1-c-2mbx machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-1-5/zones/us-central1-c/instances/control-plane-us-central1-c-2mbx" has not yet joined cluster Node control-plane-us-central1-a-kws8 node "control-plane-us-central1-a-kws8" of role "control-plane" is not ready Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-a-kws8 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-kws8" is not ready (kube-controller-manager) Validation Failed W0201 22:57:20.198193 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 22:57:30.605990 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 23 lines ... Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Pod kube-system/kops-controller-9wpdn system-cluster-critical pod "kops-controller-9wpdn" is pending Pod kube-system/kops-controller-l87md system-cluster-critical pod "kops-controller-l87md" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-a-kws8 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-kws8" is not ready (kube-controller-manager) Validation Failed W0201 22:57:31.600438 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 22:57:41.929238 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 23 lines ... Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Pod kube-system/kops-controller-9wpdn system-cluster-critical pod "kops-controller-9wpdn" is pending Pod kube-system/kops-controller-l87md system-cluster-critical pod "kops-controller-l87md" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-c-2mbx system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-2mbx" is pending Validation Failed W0201 22:57:42.758834 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 22:57:53.050962 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 20 lines ... Pod kube-system/cilium-operator-b4b4c5b48-pfwgd system-cluster-critical pod "cilium-operator-b4b4c5b48-pfwgd" is pending Pod kube-system/cilium-tvlvv system-node-critical pod "cilium-tvlvv" is pending Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 22:57:53.999334 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 22:58:04.312569 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 20 lines ... Pod kube-system/cilium-tvlvv system-node-critical pod "cilium-tvlvv" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Pod kube-system/etcd-manager-main-control-plane-us-central1-b-n43q system-cluster-critical pod "etcd-manager-main-control-plane-us-central1-b-n43q" is pending Validation Failed W0201 22:58:05.156671 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 22:58:15.553200 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 20 lines ... Pod kube-system/cilium-tvlvv system-node-critical pod "cilium-tvlvv" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Pod kube-system/kops-controller-szlds system-cluster-critical pod "kops-controller-szlds" is pending Validation Failed W0201 22:58:16.397263 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 22:58:26.710791 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 18 lines ... Pod kube-system/cilium-khq6z system-node-critical pod "cilium-khq6z" is not ready (cilium-agent) Pod kube-system/cilium-operator-b4b4c5b48-6hx8v system-cluster-critical pod "cilium-operator-b4b4c5b48-6hx8v" is pending Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 22:58:27.594513 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 22:58:37.896594 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 18 lines ... Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Pod kube-system/kube-apiserver-control-plane-us-central1-b-n43q system-cluster-critical pod "kube-apiserver-control-plane-us-central1-b-n43q" is pending Pod kube-system/kube-apiserver-control-plane-us-central1-c-2mbx system-cluster-critical pod "kube-apiserver-control-plane-us-central1-c-2mbx" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-n43q system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-n43q" is pending Validation Failed W0201 22:58:38.697990 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 22:58:49.044166 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 17 lines ... Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Pod kube-system/etcd-manager-events-control-plane-us-central1-c-2mbx system-cluster-critical pod "etcd-manager-events-control-plane-us-central1-c-2mbx" is pending Pod kube-system/kube-scheduler-control-plane-us-central1-b-n43q system-cluster-critical pod "kube-scheduler-control-plane-us-central1-b-n43q" is pending Validation Failed W0201 22:58:49.923529 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 22:59:00.258620 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 22:59:01.132765 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 22:59:11.512530 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 22:59:12.314821 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 22:59:22.660648 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 22:59:23.429106 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 22:59:33.846406 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 22:59:34.753596 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 22:59:45.056571 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 22:59:45.968503 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 22:59:56.276910 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 22:59:57.181033 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:00:07.511293 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:00:08.388621 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:00:18.717333 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:00:19.546178 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:00:29.848269 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:00:30.673305 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:00:36.467099 5788 boskos.go:86] Sending heartbeat to Boskos I0201 23:00:41.046281 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:00:41.837796 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:00:52.167995 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:00:52.981743 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:01:03.266190 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:01:04.060818 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:01:14.515109 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:01:15.403249 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:01:25.764308 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:01:26.710269 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:01:37.106027 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:01:37.920821 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:01:48.290747 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:01:49.144546 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:01:59.465942 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:02:00.372936 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:02:10.729171 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:02:11.530434 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:02:22.010742 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:02:22.839608 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:02:33.204940 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:02:34.013890 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:02:44.336022 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:02:45.152357 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:02:55.597086 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:02:56.417713 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:03:06.716566 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:03:07.562738 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:03:17.889335 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:03:18.785551 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:03:29.107191 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:03:29.949757 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:03:40.297318 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:03:41.196130 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:03:51.479910 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:03:52.404992 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:04:02.703227 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:04:03.562093 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:04:13.925437 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:04:14.748895 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:04:25.168271 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:04:26.059029 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:04:36.480489 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:04:37.292123 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:04:47.576931 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:04:48.417924 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:04:58.673347 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:04:59.610291 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:05:09.897225 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:05:10.832789 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:05:21.176697 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:05:21.969995 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:05:32.325504 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:05:33.172547 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:05:36.480955 5788 boskos.go:86] Sending heartbeat to Boskos I0201 23:05:43.601582 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:05:44.409127 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:05:54.790139 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:05:55.679181 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:06:06.205557 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:06:07.046719 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:06:17.350922 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:06:18.225329 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:06:28.639981 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:06:29.496962 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:06:39.865440 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:06:40.664800 6149 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 23:06:51.002068 6149 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-n43q node "control-plane-us-central1-b-n43q" of role "control-plane" is not ready Node control-plane-us-central1-c-2mbx node "control-plane-us-central1-c-2mbx" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-gjpkl system-cluster-critical pod "coredns-5d479c4f64-gjpkl" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-nd6cz system-cluster-critical pod "coredns-autoscaler-557ccb4c66-nd6cz" is pending Pod kube-system/dns-controller-6f69f47785-drgzq system-cluster-critical pod "dns-controller-6f69f47785-drgzq" is pending Validation Failed W0201 23:06:51.853424 6149 validate_cluster.go:232] (will retry): cluster not yet healthy Error: validation failed: wait time exceeded during validation I0201 23:07:01.858411 5788 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/959ebc42-a282-11ed-aff3-c6e29dfe916e/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh2439320577/key --ssh-user prow I0201 23:07:01.858456 5788 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/959ebc42-a282-11ed-aff3-c6e29dfe916e/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh2439320577/key --ssh-user prow I0201 23:07:02.257330 6159 gce.go:99] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] 2023/02/01 23:07:06 Dumping node control-plane-us-central1-a-kws8 2023/02/01 23:07:09 error dumping node control-plane-us-central1-a-kws8: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/02/01 23:07:09 error dumping node control-plane-us-central1-a-kws8: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/02/01 23:07:09 Dumping node control-plane-us-central1-b-n43q 2023/02/01 23:07:12 error dumping node control-plane-us-central1-b-n43q: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/02/01 23:07:12 error dumping node control-plane-us-central1-b-n43q: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/02/01 23:07:12 Dumping node control-plane-us-central1-c-2mbx 2023/02/01 23:07:17 error dumping node control-plane-us-central1-c-2mbx: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/02/01 23:07:17 error dumping node control-plane-us-central1-c-2mbx: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/02/01 23:07:17 dumping node not registered in kubernetes: 35.184.193.60 2023/02/01 23:07:17 Dumping node 35.184.193.60 I0201 23:07:18.846264 5788 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/959ebc42-a282-11ed-aff3-c6e29dfe916e/kops get cluster --name ha-migration.k8s.local -o yaml I0201 23:07:18.846332 5788 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/959ebc42-a282-11ed-aff3-c6e29dfe916e/kops get cluster --name ha-migration.k8s.local -o yaml I0201 23:07:19.027353 5788 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/959ebc42-a282-11ed-aff3-c6e29dfe916e/kops get instancegroups --name ha-migration.k8s.local -o yaml I0201 23:07:19.027397 5788 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/959ebc42-a282-11ed-aff3-c6e29dfe916e/kops get instancegroups --name ha-migration.k8s.local -o yaml ... skipping 166 lines ... Deleted cluster: "ha-migration.k8s.local" I0201 23:09:30.687397 5788 gcs.go:88] gsutil -u k8s-gce-1-5 rm -r gs://k8s-gce-1-5-state-95 I0201 23:09:30.687448 5788 local.go:42] ⚙️ gsutil -u k8s-gce-1-5 rm -r gs://k8s-gce-1-5-state-95 Removing gs://k8s-gce-1-5-state-95/... I0201 23:09:33.552864 5788 down.go:62] releasing boskos project I0201 23:09:33.564384 5788 boskos.go:83] Boskos heartbeat func received signal to close Error: exit status 1 + EXIT_VALUE=1 + set +o xtrace