e2e-kops-gce-leader-migration #1620871798138605568
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 1 failed / 1 succeeded |
| Started | |
| Elapsed | 20m20s |
| Revision | master |
exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
kubetest2 Down
... skipping 156 lines ... ..............................................Updated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-alpha-1-6]. .done. WARNING: No host aliases were added to your SSH configs because you do not have any running instances. Try running this command again after running some instances. I0201 19:50:53.911573 5791 up.go:44] Cleaning up any leaked resources from previous cluster I0201 19:50:53.911723 5791 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/703c535a-a269-11ed-aff3-c6e29dfe916e/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh4117836480/key --ssh-user prow I0201 19:50:53.911746 5791 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/703c535a-a269-11ed-aff3-c6e29dfe916e/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh4117836480/key --ssh-user prow Error: Cluster.kops.k8s.io "ha-migration.k8s.local" not found W0201 19:50:54.244787 5791 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1 I0201 19:50:54.244928 5791 down.go:48] /home/prow/go/src/k8s.io/kops/_rundir/703c535a-a269-11ed-aff3-c6e29dfe916e/kops delete cluster --name ha-migration.k8s.local --yes I0201 19:50:54.244943 5791 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/703c535a-a269-11ed-aff3-c6e29dfe916e/kops delete cluster --name ha-migration.k8s.local --yes Error: error reading cluster configuration: Cluster.kops.k8s.io "ha-migration.k8s.local" not found I0201 19:50:54.478266 5791 gcs.go:51] gsutil ls -b -p k8s-jkns-gce-alpha-1-6 gs://k8s-jkns-gce-alpha-1-6-state-70 I0201 19:50:54.478322 5791 local.go:42] ⚙️ gsutil ls -b -p k8s-jkns-gce-alpha-1-6 gs://k8s-jkns-gce-alpha-1-6-state-70 I0201 19:50:56.553432 5791 gcs.go:70] gsutil mb -p k8s-jkns-gce-alpha-1-6 gs://k8s-jkns-gce-alpha-1-6-state-70 I0201 19:50:56.553504 5791 local.go:42] ⚙️ gsutil mb -p k8s-jkns-gce-alpha-1-6 gs://k8s-jkns-gce-alpha-1-6-state-70 Creating gs://k8s-jkns-gce-alpha-1-6-state-70/... I0201 19:50:59.218576 5791 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip 2023/02/01 19:50:59 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404 I0201 19:50:59.232518 5791 http.go:37] curl https://ip.jsb.workers.dev I0201 19:50:59.327521 5791 up.go:167] /home/prow/go/src/k8s.io/kops/_rundir/703c535a-a269-11ed-aff3-c6e29dfe916e/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh4117836480/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 34.171.12.199/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project k8s-jkns-gce-alpha-1-6 I0201 19:50:59.327558 5791 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/703c535a-a269-11ed-aff3-c6e29dfe916e/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh4117836480/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 34.171.12.199/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project k8s-jkns-gce-alpha-1-6 I0201 19:50:59.376787 6112 create_cluster.go:882] Using SSH public key: /tmp/kops-ssh4117836480/key.pub I0201 19:50:59.686269 6112 new_cluster.go:573] VMs will be configured to use specified Service Account: default I0201 19:50:59.686379 6112 new_cluster.go:1339] Cloud Provider ID: "gce" ... skipping 527 lines ... I0201 19:51:12.385548 6132 keypair.go:226] Issuing new certificate: "etcd-manager-ca-main" I0201 19:51:12.385722 6132 keypair.go:226] Issuing new certificate: "etcd-peers-ca-events" W0201 19:51:12.570070 6132 vfs_keystorereader.go:143] CA private key was not found I0201 19:51:12.681429 6132 keypair.go:226] Issuing new certificate: "kubernetes-ca" I0201 19:51:12.684238 6132 keypair.go:226] Issuing new certificate: "service-account" I0201 19:51:25.053638 6132 executor.go:111] Tasks: 50 done / 91 total; 23 can run W0201 19:51:38.033679 6132 executor.go:139] error running task "ForwardingRule/api-ha-migration-k8s-local" (9m47s remaining to succeed): error creating ForwardingRule "api-ha-migration-k8s-local": googleapi: Error 400: The resource 'projects/k8s-jkns-gce-alpha-1-6/regions/us-central1/targetPools/api-ha-migration-k8s-local' is not ready, resourceNotReady I0201 19:51:38.033911 6132 executor.go:111] Tasks: 72 done / 91 total; 13 can run I0201 19:51:44.875947 6132 executor.go:111] Tasks: 85 done / 91 total; 6 can run I0201 19:51:58.778006 6132 executor.go:111] Tasks: 91 done / 91 total; 0 can run I0201 19:51:58.849126 6132 update_cluster.go:323] Exporting kubeconfig for cluster kOps has set your kubectl context to ha-migration.k8s.local ... skipping 7 lines ... * read about installing addons at: https://kops.sigs.k8s.io/addons. I0201 19:52:09.276053 5791 up.go:251] /home/prow/go/src/k8s.io/kops/_rundir/703c535a-a269-11ed-aff3-c6e29dfe916e/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s I0201 19:52:09.276120 5791 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/703c535a-a269-11ed-aff3-c6e29dfe916e/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s Validating cluster ha-migration.k8s.local W0201 19:52:39.742070 6152 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.142.13/api/v1/nodes": dial tcp 34.132.142.13:443: i/o timeout W0201 19:53:19.743868 6152 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.142.13/api/v1/nodes": dial tcp 34.132.142.13:443: i/o timeout W0201 19:53:29.747474 6152 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.142.13/api/v1/nodes": dial tcp 34.132.142.13:443: connect: connection refused W0201 19:53:39.750240 6152 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.142.13/api/v1/nodes": dial tcp 34.132.142.13:443: connect: connection refused W0201 19:53:49.753296 6152 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.142.13/api/v1/nodes": dial tcp 34.132.142.13:443: connect: connection refused W0201 19:53:59.755883 6152 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.142.13/api/v1/nodes": dial tcp 34.132.142.13:443: connect: connection refused W0201 19:54:09.760399 6152 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.142.13/api/v1/nodes": dial tcp 34.132.142.13:443: connect: connection refused W0201 19:54:19.763806 6152 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.142.13/api/v1/nodes": dial tcp 34.132.142.13:443: connect: connection refused W0201 19:54:29.766527 6152 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.142.13/api/v1/nodes": dial tcp 34.132.142.13:443: connect: connection refused W0201 19:54:49.770531 6152 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.142.13/api/v1/nodes": net/http: TLS handshake timeout W0201 19:55:09.774183 6152 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.142.13/api/v1/nodes": net/http: TLS handshake timeout W0201 19:55:25.052681 6152 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.142.13/api/v1/nodes": dial tcp 34.132.142.13:443: connect: connection refused - error from a previous attempt: read tcp 10.60.26.46:59916->34.132.142.13:443: read: connection reset by peer W0201 19:55:35.056137 6152 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.142.13/api/v1/nodes": dial tcp 34.132.142.13:443: connect: connection refused I0201 19:55:40.764450 5791 boskos.go:86] Sending heartbeat to Boskos W0201 19:55:55.065969 6152 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.142.13/api/v1/nodes": net/http: TLS handshake timeout W0201 19:56:05.071602 6152 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.142.13/api/v1/nodes": dial tcp 34.132.142.13:443: connect: connection refused W0201 19:56:15.076062 6152 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.142.13/api/v1/nodes": dial tcp 34.132.142.13:443: connect: connection refused W0201 19:56:25.083881 6152 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.142.13/api/v1/nodes": dial tcp 34.132.142.13:443: connect: connection refused W0201 19:56:45.094845 6152 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.142.13/api/v1/nodes": net/http: TLS handshake timeout W0201 19:56:55.102736 6152 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.142.13/api/v1/nodes": dial tcp 34.132.142.13:443: connect: connection refused W0201 19:57:05.111129 6152 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.142.13/api/v1/nodes": dial tcp 34.132.142.13:443: connect: connection refused W0201 19:57:15.120422 6152 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.142.13/api/v1/nodes": dial tcp 34.132.142.13:443: connect: connection refused W0201 19:57:25.129630 6152 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.142.13/api/v1/nodes": dial tcp 34.132.142.13:443: connect: connection refused I0201 19:57:35.559370 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-c ControlPlane e2-standard-2 1 1 us-central1 ... skipping 10 lines ... KIND NAME MESSAGE Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-alpha-1-6/zones/us-central1-a/instances/nodes-us-central1-a-52hf machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-alpha-1-6/zones/us-central1-a/instances/nodes-us-central1-a-52hf" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-alpha-1-6/zones/us-central1-b/instances/control-plane-us-central1-b-d4d7 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-alpha-1-6/zones/us-central1-b/instances/control-plane-us-central1-b-d4d7" has not yet joined cluster Node control-plane-us-central1-a-c3mt node "control-plane-us-central1-a-c3mt" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Validation Failed W0201 19:57:36.429555 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 19:57:46.874902 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 13 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-alpha-1-6/zones/us-central1-a/instances/nodes-us-central1-a-52hf machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-alpha-1-6/zones/us-central1-a/instances/nodes-us-central1-a-52hf" has not yet joined cluster Node control-plane-us-central1-a-c3mt node "control-plane-us-central1-a-c3mt" of role "control-plane" is not ready Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-a-c3mt system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-c3mt" is not ready (kube-controller-manager) Validation Failed W0201 19:57:47.739557 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 19:57:59.193156 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 13 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-alpha-1-6/zones/us-central1-a/instances/nodes-us-central1-a-52hf machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-alpha-1-6/zones/us-central1-a/instances/nodes-us-central1-a-52hf" has not yet joined cluster Node control-plane-us-central1-a-c3mt node "control-plane-us-central1-a-c3mt" of role "control-plane" is not ready Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-a-c3mt system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-c3mt" is not ready (kube-controller-manager) Validation Failed W0201 19:58:00.033540 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 19:58:10.474247 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 13 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-alpha-1-6/zones/us-central1-a/instances/nodes-us-central1-a-52hf machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-alpha-1-6/zones/us-central1-a/instances/nodes-us-central1-a-52hf" has not yet joined cluster Node control-plane-us-central1-a-c3mt node "control-plane-us-central1-a-c3mt" of role "control-plane" is not ready Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-c-7kks system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-7kks" is pending Validation Failed W0201 19:58:14.228762 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 19:58:24.608503 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 23 lines ... Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Pod kube-system/kops-controller-lntxk system-cluster-critical pod "kops-controller-lntxk" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-d4d7 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-d4d7" is not ready (kube-controller-manager) Pod kube-system/kube-scheduler-control-plane-us-central1-c-7kks system-cluster-critical pod "kube-scheduler-control-plane-us-central1-c-7kks" is pending Validation Failed W0201 19:58:25.458016 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 19:58:35.875626 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 24 lines ... Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Pod kube-system/etcd-manager-main-control-plane-us-central1-a-c3mt system-cluster-critical pod "etcd-manager-main-control-plane-us-central1-a-c3mt" is pending Pod kube-system/etcd-manager-main-control-plane-us-central1-b-d4d7 system-cluster-critical pod "etcd-manager-main-control-plane-us-central1-b-d4d7" is pending Pod kube-system/kops-controller-lntxk system-cluster-critical pod "kops-controller-lntxk" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-d4d7 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-d4d7" is not ready (kube-controller-manager) Validation Failed W0201 19:58:36.738817 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 19:58:47.162743 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 19 lines ... Pod kube-system/cilium-tgqh2 system-node-critical pod "cilium-tgqh2" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-d4d7 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-d4d7" is not ready (kube-controller-manager) Validation Failed W0201 19:58:48.077127 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 19:58:58.478031 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 21 lines ... Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Pod kube-system/etcd-manager-events-control-plane-us-central1-c-7kks system-cluster-critical pod "etcd-manager-events-control-plane-us-central1-c-7kks" is pending Pod kube-system/kube-apiserver-control-plane-us-central1-c-7kks system-cluster-critical pod "kube-apiserver-control-plane-us-central1-c-7kks" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-d4d7 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-d4d7" is not ready (kube-controller-manager) Validation Failed W0201 19:58:59.288693 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 19:59:09.695391 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-d4d7 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-d4d7" is not ready (kube-controller-manager) Validation Failed W0201 19:59:10.631351 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 19:59:21.088850 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-d4d7 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-d4d7" is not ready (kube-controller-manager) Validation Failed W0201 19:59:21.931687 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 19:59:32.329824 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-d4d7 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-d4d7" is not ready (kube-controller-manager) Validation Failed W0201 19:59:33.129428 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 19:59:43.536512 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-d4d7 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-d4d7" is not ready (kube-controller-manager) Validation Failed W0201 19:59:44.374253 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 19:59:54.825063 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-d4d7 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-d4d7" is not ready (kube-controller-manager) Validation Failed W0201 19:59:55.597896 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:00:06.041566 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-d4d7 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-d4d7" is not ready (kube-controller-manager) Validation Failed W0201 20:00:06.902001 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:00:17.297519 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:00:18.161326 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:00:28.603438 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:00:29.451408 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:00:39.860574 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] I0201 20:00:40.775147 5791 boskos.go:86] Sending heartbeat to Boskos INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:00:40.835085 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:00:51.252394 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:00:52.084138 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:01:02.542487 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:01:03.377391 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:01:13.895357 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:01:14.807904 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:01:25.259665 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:01:26.154692 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:01:36.643577 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:01:37.508335 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:01:48.012204 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:01:48.921984 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:01:59.370092 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:02:00.422821 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:02:10.874439 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:02:11.712504 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:02:22.164175 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:02:23.016318 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:02:33.445589 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:02:34.321619 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:02:44.830127 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:02:45.701861 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:02:56.076111 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:02:56.933081 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:03:07.380563 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:03:08.206799 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:03:18.671082 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:03:19.485850 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:03:29.892980 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:03:30.705718 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:03:41.168272 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:03:42.033472 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:03:52.485559 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:03:53.312288 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:04:03.705589 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:04:04.490607 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:04:14.934186 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:04:15.884389 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:04:26.277175 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:04:27.133156 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:04:37.556212 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:04:38.448878 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:04:48.862585 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:04:49.698097 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:05:00.077690 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:05:00.971209 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:05:11.392470 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:05:12.230874 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:05:22.655310 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:05:23.485694 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:05:33.853455 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:05:34.723399 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:05:40.786668 5791 boskos.go:86] Sending heartbeat to Boskos I0201 20:05:45.138226 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:05:45.989969 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:05:56.461391 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:05:57.258733 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:06:07.665100 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:06:08.531932 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:06:18.963044 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:06:19.747900 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:06:30.121695 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:06:31.053105 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:06:41.518528 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:06:42.387590 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:06:52.804336 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:06:53.646553 6152 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 20:07:04.161302 6152 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-d4d7 node "control-plane-us-central1-b-d4d7" of role "control-plane" is not ready Node control-plane-us-central1-c-7kks node "control-plane-us-central1-c-7kks" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-2ggv8 system-cluster-critical pod "coredns-5d479c4f64-2ggv8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-tnmsx system-cluster-critical pod "coredns-autoscaler-557ccb4c66-tnmsx" is pending Pod kube-system/dns-controller-6f69f47785-hb8jj system-cluster-critical pod "dns-controller-6f69f47785-hb8jj" is pending Validation Failed W0201 20:07:05.025145 6152 validate_cluster.go:232] (will retry): cluster not yet healthy Error: validation failed: wait time exceeded during validation I0201 20:07:15.030787 5791 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/703c535a-a269-11ed-aff3-c6e29dfe916e/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh4117836480/key --ssh-user prow I0201 20:07:15.030881 5791 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/703c535a-a269-11ed-aff3-c6e29dfe916e/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh4117836480/key --ssh-user prow I0201 20:07:15.488891 6162 gce.go:99] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] 2023/02/01 20:07:20 Dumping node control-plane-us-central1-a-c3mt 2023/02/01 20:07:23 error dumping node control-plane-us-central1-a-c3mt: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/02/01 20:07:23 error dumping node control-plane-us-central1-a-c3mt: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/02/01 20:07:23 Dumping node control-plane-us-central1-b-d4d7 2023/02/01 20:07:27 error dumping node control-plane-us-central1-b-d4d7: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/02/01 20:07:27 error dumping node control-plane-us-central1-b-d4d7: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/02/01 20:07:27 Dumping node control-plane-us-central1-c-7kks 2023/02/01 20:07:31 error dumping node control-plane-us-central1-c-7kks: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/02/01 20:07:31 error dumping node control-plane-us-central1-c-7kks: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/02/01 20:07:31 dumping node not registered in kubernetes: 34.121.2.164 2023/02/01 20:07:31 Dumping node 34.121.2.164 I0201 20:07:33.374852 5791 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/703c535a-a269-11ed-aff3-c6e29dfe916e/kops get cluster --name ha-migration.k8s.local -o yaml I0201 20:07:33.374930 5791 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/703c535a-a269-11ed-aff3-c6e29dfe916e/kops get cluster --name ha-migration.k8s.local -o yaml I0201 20:07:33.545173 5791 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/703c535a-a269-11ed-aff3-c6e29dfe916e/kops get instancegroups --name ha-migration.k8s.local -o yaml I0201 20:07:33.545234 5791 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/703c535a-a269-11ed-aff3-c6e29dfe916e/kops get instancegroups --name ha-migration.k8s.local -o yaml ... skipping 167 lines ... Deleted cluster: "ha-migration.k8s.local" I0201 20:09:48.872649 5791 gcs.go:88] gsutil -u k8s-jkns-gce-alpha-1-6 rm -r gs://k8s-jkns-gce-alpha-1-6-state-70 I0201 20:09:48.872729 5791 local.go:42] ⚙️ gsutil -u k8s-jkns-gce-alpha-1-6 rm -r gs://k8s-jkns-gce-alpha-1-6-state-70 Removing gs://k8s-jkns-gce-alpha-1-6-state-70/... I0201 20:09:51.728042 5791 down.go:62] releasing boskos project I0201 20:09:51.739475 5791 boskos.go:83] Boskos heartbeat func received signal to close Error: exit status 1 + EXIT_VALUE=1 + set +o xtrace