e2e-kops-gce-leader-migration #1620463992726097920
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 1 failed / 1 succeeded |
| Started | |
| Elapsed | 20m38s |
| Revision | master |
exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
kubetest2 Down
... skipping 156 lines ... .................................Updated [https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-07]. ..done. WARNING: No host aliases were added to your SSH configs because you do not have any running instances. Try running this command again after running some instances. I0131 16:51:05.036538 5757 up.go:44] Cleaning up any leaked resources from previous cluster I0131 16:51:05.036653 5757 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/0f99caed-a187-11ed-9994-daecb65d57ab/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh1517425395/key --ssh-user prow I0131 16:51:05.036668 5757 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/0f99caed-a187-11ed-9994-daecb65d57ab/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh1517425395/key --ssh-user prow Error: Cluster.kops.k8s.io "ha-migration.k8s.local" not found W0131 16:51:05.306430 5757 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1 I0131 16:51:05.306480 5757 down.go:48] /home/prow/go/src/k8s.io/kops/_rundir/0f99caed-a187-11ed-9994-daecb65d57ab/kops delete cluster --name ha-migration.k8s.local --yes I0131 16:51:05.306496 5757 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/0f99caed-a187-11ed-9994-daecb65d57ab/kops delete cluster --name ha-migration.k8s.local --yes Error: error reading cluster configuration: Cluster.kops.k8s.io "ha-migration.k8s.local" not found I0131 16:51:05.520635 5757 gcs.go:51] gsutil ls -b -p k8s-boskos-gce-project-07 gs://k8s-boskos-gce-project-07-state-0f I0131 16:51:05.520678 5757 local.go:42] ⚙️ gsutil ls -b -p k8s-boskos-gce-project-07 gs://k8s-boskos-gce-project-07-state-0f I0131 16:51:08.550738 5757 gcs.go:70] gsutil mb -p k8s-boskos-gce-project-07 gs://k8s-boskos-gce-project-07-state-0f I0131 16:51:08.550785 5757 local.go:42] ⚙️ gsutil mb -p k8s-boskos-gce-project-07 gs://k8s-boskos-gce-project-07-state-0f Creating gs://k8s-boskos-gce-project-07-state-0f/... I0131 16:51:12.329876 5757 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip 2023/01/31 16:51:12 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404 I0131 16:51:12.346702 5757 http.go:37] curl https://ip.jsb.workers.dev I0131 16:51:12.449205 5757 up.go:167] /home/prow/go/src/k8s.io/kops/_rundir/0f99caed-a187-11ed-9994-daecb65d57ab/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh1517425395/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 34.134.182.8/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project k8s-boskos-gce-project-07 I0131 16:51:12.449244 5757 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/0f99caed-a187-11ed-9994-daecb65d57ab/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh1517425395/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 34.134.182.8/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project k8s-boskos-gce-project-07 I0131 16:51:12.531233 6077 create_cluster.go:882] Using SSH public key: /tmp/kops-ssh1517425395/key.pub I0131 16:51:12.923131 6077 new_cluster.go:573] VMs will be configured to use specified Service Account: default I0131 16:51:12.923546 6077 new_cluster.go:1339] Cloud Provider ID: "gce" ... skipping 527 lines ... I0131 16:51:25.890904 6097 keypair.go:226] Issuing new certificate: "etcd-manager-ca-main" I0131 16:51:25.890843 6097 keypair.go:226] Issuing new certificate: "etcd-manager-ca-events" W0131 16:51:25.981133 6097 vfs_keystorereader.go:143] CA private key was not found I0131 16:51:26.179668 6097 keypair.go:226] Issuing new certificate: "kubernetes-ca" I0131 16:51:26.281870 6097 keypair.go:226] Issuing new certificate: "service-account" I0131 16:51:38.429725 6097 executor.go:111] Tasks: 50 done / 91 total; 23 can run W0131 16:51:48.400276 6097 executor.go:139] error running task "ForwardingRule/api-ha-migration-k8s-local" (9m50s remaining to succeed): error creating ForwardingRule "api-ha-migration-k8s-local": googleapi: Error 400: The resource 'projects/k8s-boskos-gce-project-07/regions/us-central1/targetPools/api-ha-migration-k8s-local' is not ready, resourceNotReady I0131 16:51:48.400347 6097 executor.go:111] Tasks: 72 done / 91 total; 13 can run I0131 16:51:55.214168 6097 executor.go:111] Tasks: 85 done / 91 total; 6 can run I0131 16:52:09.228749 6097 executor.go:111] Tasks: 91 done / 91 total; 0 can run I0131 16:52:09.362741 6097 update_cluster.go:323] Exporting kubeconfig for cluster kOps has set your kubectl context to ha-migration.k8s.local ... skipping 7 lines ... * read about installing addons at: https://kops.sigs.k8s.io/addons. I0131 16:52:19.692161 5757 up.go:251] /home/prow/go/src/k8s.io/kops/_rundir/0f99caed-a187-11ed-9994-daecb65d57ab/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s I0131 16:52:19.692207 5757 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/0f99caed-a187-11ed-9994-daecb65d57ab/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s Validating cluster ha-migration.k8s.local W0131 16:52:50.452562 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.121.174.69/api/v1/nodes": dial tcp 34.121.174.69:443: i/o timeout W0131 16:53:30.455158 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.121.174.69/api/v1/nodes": dial tcp 34.121.174.69:443: i/o timeout W0131 16:53:40.458630 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.121.174.69/api/v1/nodes": dial tcp 34.121.174.69:443: connect: connection refused W0131 16:53:50.463469 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.121.174.69/api/v1/nodes": dial tcp 34.121.174.69:443: connect: connection refused W0131 16:54:00.468509 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.121.174.69/api/v1/nodes": dial tcp 34.121.174.69:443: connect: connection refused W0131 16:54:10.472617 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.121.174.69/api/v1/nodes": dial tcp 34.121.174.69:443: connect: connection refused W0131 16:54:20.478855 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.121.174.69/api/v1/nodes": dial tcp 34.121.174.69:443: connect: connection refused W0131 16:54:30.492649 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.121.174.69/api/v1/nodes": dial tcp 34.121.174.69:443: connect: connection refused W0131 16:54:40.499881 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.121.174.69/api/v1/nodes": dial tcp 34.121.174.69:443: connect: connection refused W0131 16:55:00.506750 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.121.174.69/api/v1/nodes": net/http: TLS handshake timeout W0131 16:55:21.507788 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.121.174.69/api/v1/nodes": dial tcp 34.121.174.69:443: connect: connection refused - error from a previous attempt: read tcp 10.60.78.4:34812->34.121.174.69:443: read: connection reset by peer W0131 16:55:31.511977 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.121.174.69/api/v1/nodes": dial tcp 34.121.174.69:443: connect: connection refused W0131 16:55:51.518535 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.121.174.69/api/v1/nodes": net/http: TLS handshake timeout I0131 16:55:54.127446 5757 boskos.go:86] Sending heartbeat to Boskos W0131 16:56:01.522704 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.121.174.69/api/v1/nodes": dial tcp 34.121.174.69:443: connect: connection refused W0131 16:56:11.526799 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.121.174.69/api/v1/nodes": dial tcp 34.121.174.69:443: connect: connection refused W0131 16:56:21.533371 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.121.174.69/api/v1/nodes": dial tcp 34.121.174.69:443: connect: connection refused I0131 16:56:32.321422 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-c ControlPlane e2-standard-2 1 1 us-central1 ... skipping 8 lines ... KIND NAME MESSAGE Machine https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-07/zones/us-central1-a/instances/control-plane-us-central1-a-7rkd machine "https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-07/zones/us-central1-a/instances/control-plane-us-central1-a-7rkd" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-07/zones/us-central1-a/instances/nodes-us-central1-a-9j29 machine "https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-07/zones/us-central1-a/instances/nodes-us-central1-a-9j29" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-07/zones/us-central1-b/instances/control-plane-us-central1-b-sm28 machine "https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-07/zones/us-central1-b/instances/control-plane-us-central1-b-sm28" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-07/zones/us-central1-c/instances/control-plane-us-central1-c-8wqf machine "https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-07/zones/us-central1-c/instances/control-plane-us-central1-c-8wqf" has not yet joined cluster Validation Failed W0131 16:56:33.271524 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 16:56:43.583354 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 12 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-07/zones/us-central1-a/instances/nodes-us-central1-a-9j29 machine "https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-07/zones/us-central1-a/instances/nodes-us-central1-a-9j29" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-07/zones/us-central1-b/instances/control-plane-us-central1-b-sm28 machine "https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-07/zones/us-central1-b/instances/control-plane-us-central1-b-sm28" has not yet joined cluster Node control-plane-us-central1-a-7rkd node "control-plane-us-central1-a-7rkd" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-a-7rkd system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-7rkd" is not ready (kube-controller-manager) Validation Failed W0131 16:56:44.577516 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 16:56:54.964793 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 12 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-07/zones/us-central1-a/instances/nodes-us-central1-a-9j29 machine "https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-07/zones/us-central1-a/instances/nodes-us-central1-a-9j29" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-07/zones/us-central1-b/instances/control-plane-us-central1-b-sm28 machine "https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-07/zones/us-central1-b/instances/control-plane-us-central1-b-sm28" has not yet joined cluster Node control-plane-us-central1-a-7rkd node "control-plane-us-central1-a-7rkd" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/kube-scheduler-control-plane-us-central1-a-7rkd system-cluster-critical pod "kube-scheduler-control-plane-us-central1-a-7rkd" is pending Validation Failed W0131 16:56:55.884384 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 16:57:06.347876 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 19 lines ... Pod kube-system/cilium-operator-b4b4c5b48-ptmqz system-cluster-critical pod "cilium-operator-b4b4c5b48-ptmqz" is pending Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Pod kube-system/kops-controller-znkff system-cluster-critical pod "kops-controller-znkff" is pending Validation Failed W0131 16:57:07.209680 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 16:57:17.567917 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 18 lines ... Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Pod kube-system/etcd-manager-main-control-plane-us-central1-c-8wqf system-cluster-critical pod "etcd-manager-main-control-plane-us-central1-c-8wqf" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-c-8wqf system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-8wqf" is not ready (kube-controller-manager) Validation Failed W0131 16:57:18.486234 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 16:57:28.786371 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 17 lines ... Pod kube-system/cilium-ff88x system-node-critical pod "cilium-ff88x" is pending Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-c-8wqf system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-8wqf" is not ready (kube-controller-manager) Validation Failed W0131 16:57:29.704539 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 16:57:40.091581 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 20 lines ... Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Pod kube-system/kops-controller-hnttb system-cluster-critical pod "kops-controller-hnttb" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-c-8wqf system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-8wqf" is not ready (kube-controller-manager) Validation Failed W0131 16:57:40.987964 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 16:57:51.406021 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 20 lines ... Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Pod kube-system/kops-controller-hnttb system-cluster-critical pod "kops-controller-hnttb" is pending Pod kube-system/kube-apiserver-control-plane-us-central1-c-8wqf system-cluster-critical pod "kube-apiserver-control-plane-us-central1-c-8wqf" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-c-8wqf system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-8wqf" is not ready (kube-controller-manager) Validation Failed W0131 16:57:52.263811 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 16:58:02.652631 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/cilium-dghdm system-node-critical pod "cilium-dghdm" is pending Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 16:58:03.591465 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 16:58:14.000719 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/cilium-dghdm system-node-critical pod "cilium-dghdm" is pending Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 16:58:14.886576 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 16:58:25.254035 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/cilium-dghdm system-node-critical pod "cilium-dghdm" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 16:58:26.102261 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 16:58:36.531340 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/cilium-dghdm system-node-critical pod "cilium-dghdm" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 16:58:37.343651 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 16:58:47.698056 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 16:58:48.537474 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 16:58:59.005929 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 18 lines ... Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Pod kube-system/kube-apiserver-control-plane-us-central1-b-sm28 system-cluster-critical pod "kube-apiserver-control-plane-us-central1-b-sm28" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-sm28 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-sm28" is pending Pod kube-system/kube-scheduler-control-plane-us-central1-b-sm28 system-cluster-critical pod "kube-scheduler-control-plane-us-central1-b-sm28" is pending Validation Failed W0131 16:58:59.870185 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 16:59:10.234150 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 16:59:11.062775 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 16:59:21.473298 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 16:59:22.358290 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 16:59:32.778737 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 16:59:33.631276 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 16:59:43.971771 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 16:59:44.815181 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 16:59:55.116183 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 16:59:55.914372 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:00:06.328415 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:00:07.275164 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:00:17.683099 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:00:18.481968 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:00:28.791868 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:00:29.617129 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:00:40.043834 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:00:40.996208 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:00:51.370897 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:00:52.224936 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:00:54.141479 5757 boskos.go:86] Sending heartbeat to Boskos I0131 17:01:02.642441 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:01:03.493185 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:01:13.852161 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:01:14.729168 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:01:25.121383 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:01:25.998863 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:01:36.447080 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:01:37.415133 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:01:47.732083 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:01:48.650666 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:01:59.059603 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:01:59.874551 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:02:10.196299 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:02:11.096816 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:02:21.441455 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:02:22.250703 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:02:32.727167 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:02:33.580541 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:02:43.971157 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:02:44.763168 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:02:55.154010 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:02:56.056470 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:03:06.361602 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:03:07.326800 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:03:17.612927 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:03:18.487278 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:03:28.829197 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:03:29.644238 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:03:40.164186 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:03:41.100560 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:03:51.456395 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:03:52.432037 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:04:02.813309 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:04:03.654965 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:04:14.052625 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:04:14.920622 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:04:25.276464 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:04:26.098309 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:04:36.611875 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:04:37.425474 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:04:47.806479 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:04:48.675095 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:04:59.020812 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:04:59.869599 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:05:10.270716 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:05:11.071138 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:05:21.393301 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:05:22.244209 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:05:32.612100 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:05:33.438946 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:05:43.763276 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:05:44.623944 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:05:54.152233 5757 boskos.go:86] Sending heartbeat to Boskos I0131 17:05:54.953849 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:05:55.834274 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:06:06.172260 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:06:06.951103 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:06:17.374692 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:06:18.221837 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:06:28.558698 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:06:29.389350 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:06:39.749351 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:06:40.684265 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:06:51.013479 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:06:51.870226 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:07:02.241231 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:07:03.099889 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 17:07:13.546071 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-sm28 node "control-plane-us-central1-b-sm28" of role "control-plane" is not ready Node control-plane-us-central1-c-8wqf node "control-plane-us-central1-c-8wqf" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-cqnp2 system-cluster-critical pod "coredns-5d479c4f64-cqnp2" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-vhp8n system-cluster-critical pod "coredns-autoscaler-557ccb4c66-vhp8n" is pending Pod kube-system/dns-controller-6f69f47785-q8vb4 system-cluster-critical pod "dns-controller-6f69f47785-q8vb4" is pending Validation Failed W0131 17:07:14.394747 6116 validate_cluster.go:232] (will retry): cluster not yet healthy Error: validation failed: wait time exceeded during validation I0131 17:07:24.399560 5757 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/0f99caed-a187-11ed-9994-daecb65d57ab/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh1517425395/key --ssh-user prow I0131 17:07:24.399623 5757 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/0f99caed-a187-11ed-9994-daecb65d57ab/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh1517425395/key --ssh-user prow I0131 17:07:24.924517 6126 gce.go:99] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] 2023/01/31 17:07:31 Dumping node control-plane-us-central1-a-7rkd 2023/01/31 17:07:35 error dumping node control-plane-us-central1-a-7rkd: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/31 17:07:35 error dumping node control-plane-us-central1-a-7rkd: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/31 17:07:35 Dumping node control-plane-us-central1-b-sm28 2023/01/31 17:07:40 error dumping node control-plane-us-central1-b-sm28: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/31 17:07:40 error dumping node control-plane-us-central1-b-sm28: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/31 17:07:40 Dumping node control-plane-us-central1-c-8wqf 2023/01/31 17:07:43 error dumping node control-plane-us-central1-c-8wqf: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/31 17:07:43 error dumping node control-plane-us-central1-c-8wqf: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/31 17:07:43 dumping node not registered in kubernetes: 35.223.42.208 2023/01/31 17:07:43 Dumping node 35.223.42.208 I0131 17:07:45.311569 5757 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/0f99caed-a187-11ed-9994-daecb65d57ab/kops get cluster --name ha-migration.k8s.local -o yaml I0131 17:07:45.311618 5757 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/0f99caed-a187-11ed-9994-daecb65d57ab/kops get cluster --name ha-migration.k8s.local -o yaml I0131 17:07:45.532843 5757 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/0f99caed-a187-11ed-9994-daecb65d57ab/kops get instancegroups --name ha-migration.k8s.local -o yaml I0131 17:07:45.532886 5757 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/0f99caed-a187-11ed-9994-daecb65d57ab/kops get instancegroups --name ha-migration.k8s.local -o yaml ... skipping 166 lines ... Deleted cluster: "ha-migration.k8s.local" I0131 17:09:58.170684 5757 gcs.go:88] gsutil -u k8s-boskos-gce-project-07 rm -r gs://k8s-boskos-gce-project-07-state-0f I0131 17:09:58.170769 5757 local.go:42] ⚙️ gsutil -u k8s-boskos-gce-project-07 rm -r gs://k8s-boskos-gce-project-07-state-0f Removing gs://k8s-boskos-gce-project-07-state-0f/... I0131 17:10:00.653789 5757 down.go:62] releasing boskos project I0131 17:10:00.662556 5757 boskos.go:83] Boskos heartbeat func received signal to close Error: exit status 1 + EXIT_VALUE=1 + set +o xtrace