e2e-kops-gce-leader-migration #1619829834819571712
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 1 failed / 1 succeeded |
| Started | |
| Elapsed | 20m17s |
| Revision | master |
exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
kubetest2 Down
... skipping 156 lines ... .............................................Updated [https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5]. .done. WARNING: No host aliases were added to your SSH configs because you do not have any running instances. Try running this command again after running some instances. I0129 22:50:51.550540 5761 up.go:44] Cleaning up any leaked resources from previous cluster I0129 22:50:51.550681 5761 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/08579fd3-a027-11ed-9a0c-f25a29267a91/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh1490496053/key --ssh-user prow I0129 22:50:51.550704 5761 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/08579fd3-a027-11ed-9a0c-f25a29267a91/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh1490496053/key --ssh-user prow Error: Cluster.kops.k8s.io "ha-migration.k8s.local" not found W0129 22:50:51.857298 5761 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1 I0129 22:50:51.857359 5761 down.go:48] /home/prow/go/src/k8s.io/kops/_rundir/08579fd3-a027-11ed-9a0c-f25a29267a91/kops delete cluster --name ha-migration.k8s.local --yes I0129 22:50:51.857371 5761 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/08579fd3-a027-11ed-9a0c-f25a29267a91/kops delete cluster --name ha-migration.k8s.local --yes Error: error reading cluster configuration: Cluster.kops.k8s.io "ha-migration.k8s.local" not found I0129 22:50:52.078790 5761 gcs.go:51] gsutil ls -b -p k8s-gce-reboot-1-5 gs://k8s-gce-reboot-1-5-state-08 I0129 22:50:52.078828 5761 local.go:42] ⚙️ gsutil ls -b -p k8s-gce-reboot-1-5 gs://k8s-gce-reboot-1-5-state-08 I0129 22:50:54.142171 5761 gcs.go:70] gsutil mb -p k8s-gce-reboot-1-5 gs://k8s-gce-reboot-1-5-state-08 I0129 22:50:54.142212 5761 local.go:42] ⚙️ gsutil mb -p k8s-gce-reboot-1-5 gs://k8s-gce-reboot-1-5-state-08 Creating gs://k8s-gce-reboot-1-5-state-08/... I0129 22:50:56.788887 5761 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip 2023/01/29 22:50:56 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404 I0129 22:50:56.803631 5761 http.go:37] curl https://ip.jsb.workers.dev I0129 22:50:56.901843 5761 up.go:167] /home/prow/go/src/k8s.io/kops/_rundir/08579fd3-a027-11ed-9a0c-f25a29267a91/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh1490496053/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 35.239.116.242/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project k8s-gce-reboot-1-5 I0129 22:50:56.901943 5761 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/08579fd3-a027-11ed-9a0c-f25a29267a91/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh1490496053/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 35.239.116.242/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project k8s-gce-reboot-1-5 I0129 22:50:56.953015 6082 create_cluster.go:882] Using SSH public key: /tmp/kops-ssh1490496053/key.pub I0129 22:50:57.242328 6082 new_cluster.go:573] VMs will be configured to use specified Service Account: default I0129 22:50:57.242463 6082 new_cluster.go:1338] Cloud Provider ID: "gce" ... skipping 527 lines ... I0129 22:51:10.181728 6102 keypair.go:226] Issuing new certificate: "apiserver-aggregator-ca" I0129 22:51:10.186574 6102 keypair.go:226] Issuing new certificate: "etcd-manager-ca-events" W0129 22:51:10.382487 6102 vfs_keystorereader.go:143] CA private key was not found I0129 22:51:10.575331 6102 keypair.go:226] Issuing new certificate: "kubernetes-ca" I0129 22:51:10.575742 6102 keypair.go:226] Issuing new certificate: "service-account" I0129 22:51:25.744982 6102 executor.go:111] Tasks: 50 done / 91 total; 23 can run W0129 22:51:35.653861 6102 executor.go:139] error running task "ForwardingRule/api-ha-migration-k8s-local" (9m50s remaining to succeed): error creating ForwardingRule "api-ha-migration-k8s-local": googleapi: Error 400: The resource 'projects/k8s-gce-reboot-1-5/regions/us-central1/targetPools/api-ha-migration-k8s-local' is not ready, resourceNotReady I0129 22:51:35.654166 6102 executor.go:111] Tasks: 72 done / 91 total; 13 can run I0129 22:51:42.475317 6102 executor.go:111] Tasks: 85 done / 91 total; 6 can run I0129 22:51:56.508091 6102 executor.go:111] Tasks: 91 done / 91 total; 0 can run I0129 22:51:56.585931 6102 update_cluster.go:323] Exporting kubeconfig for cluster kOps has set your kubectl context to ha-migration.k8s.local ... skipping 7 lines ... * read about installing addons at: https://kops.sigs.k8s.io/addons. I0129 22:52:06.947544 5761 up.go:251] /home/prow/go/src/k8s.io/kops/_rundir/08579fd3-a027-11ed-9a0c-f25a29267a91/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s I0129 22:52:06.947638 5761 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/08579fd3-a027-11ed-9a0c-f25a29267a91/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s Validating cluster ha-migration.k8s.local W0129 22:52:37.582055 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://146.148.58.29/api/v1/nodes": dial tcp 146.148.58.29:443: i/o timeout W0129 22:53:17.583752 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://146.148.58.29/api/v1/nodes": dial tcp 146.148.58.29:443: i/o timeout W0129 22:53:27.587171 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://146.148.58.29/api/v1/nodes": dial tcp 146.148.58.29:443: connect: connection refused W0129 22:53:37.592347 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://146.148.58.29/api/v1/nodes": dial tcp 146.148.58.29:443: connect: connection refused W0129 22:53:47.596913 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://146.148.58.29/api/v1/nodes": dial tcp 146.148.58.29:443: connect: connection refused W0129 22:53:57.601491 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://146.148.58.29/api/v1/nodes": dial tcp 146.148.58.29:443: connect: connection refused W0129 22:54:07.608946 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://146.148.58.29/api/v1/nodes": dial tcp 146.148.58.29:443: connect: connection refused W0129 22:54:21.699390 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://146.148.58.29/api/v1/nodes": dial tcp 146.148.58.29:443: connect: connection refused - error from a previous attempt: read tcp 10.60.85.161:37754->146.148.58.29:443: read: connection reset by peer W0129 22:54:46.129999 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://146.148.58.29/api/v1/nodes": net/http: TLS handshake timeout - error from a previous attempt: read tcp 10.60.85.161:56082->146.148.58.29:443: read: connection reset by peer W0129 22:55:07.237676 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://146.148.58.29/api/v1/nodes": net/http: TLS handshake timeout - error from a previous attempt: read tcp 10.60.85.161:37236->146.148.58.29:443: read: connection reset by peer W0129 22:55:27.241589 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://146.148.58.29/api/v1/nodes": net/http: TLS handshake timeout W0129 22:55:37.245218 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://146.148.58.29/api/v1/nodes": dial tcp 146.148.58.29:443: connect: connection refused I0129 22:55:38.740539 5761 boskos.go:86] Sending heartbeat to Boskos W0129 22:55:47.248726 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://146.148.58.29/api/v1/nodes": dial tcp 146.148.58.29:443: connect: connection refused I0129 22:55:57.675996 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-c ControlPlane e2-standard-2 1 1 us-central1 ... skipping 8 lines ... KIND NAME MESSAGE Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-central1-a/instances/control-plane-us-central1-a-69kn machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-central1-a/instances/control-plane-us-central1-a-69kn" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-central1-a/instances/nodes-us-central1-a-bvg6 machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-central1-a/instances/nodes-us-central1-a-bvg6" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-central1-b/instances/control-plane-us-central1-b-j75w machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-central1-b/instances/control-plane-us-central1-b-j75w" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-central1-c/instances/control-plane-us-central1-c-98kw machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-central1-c/instances/control-plane-us-central1-c-98kw" has not yet joined cluster Validation Failed W0129 22:55:58.709832 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 22:56:09.178249 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 11 lines ... KIND NAME MESSAGE Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-central1-a/instances/nodes-us-central1-a-bvg6 machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-central1-a/instances/nodes-us-central1-a-bvg6" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-central1-c/instances/control-plane-us-central1-c-98kw machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-central1-c/instances/control-plane-us-central1-c-98kw" has not yet joined cluster Node control-plane-us-central1-a-69kn node "control-plane-us-central1-a-69kn" of role "control-plane" is not ready Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Validation Failed W0129 22:56:10.140370 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 22:56:20.519526 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 17 lines ... Pod kube-system/cilium-operator-b4b4c5b48-27t96 system-cluster-critical pod "cilium-operator-b4b4c5b48-27t96" is pending Pod kube-system/cilium-operator-b4b4c5b48-sw8n7 system-cluster-critical pod "cilium-operator-b4b4c5b48-sw8n7" is pending Pod kube-system/cilium-z6j8b system-node-critical pod "cilium-z6j8b" is pending Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 22:56:21.385059 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 22:56:31.775521 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 21 lines ... Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Pod kube-system/kops-controller-btkd9 system-cluster-critical pod "kops-controller-btkd9" is pending Pod kube-system/kops-controller-tvz7c system-cluster-critical pod "kops-controller-tvz7c" is pending Pod kube-system/kube-scheduler-control-plane-us-central1-b-j75w system-cluster-critical pod "kube-scheduler-control-plane-us-central1-b-j75w" is pending Validation Failed W0129 22:56:32.713482 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 22:56:43.162917 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 18 lines ... Pod kube-system/cilium-operator-b4b4c5b48-sw8n7 system-cluster-critical pod "cilium-operator-b4b4c5b48-sw8n7" is pending Pod kube-system/cilium-z6j8b system-node-critical pod "cilium-z6j8b" is pending Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 22:56:44.033102 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 22:56:54.605295 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 19 lines ... Pod kube-system/cilium-z6j8b system-node-critical pod "cilium-z6j8b" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Pod kube-system/etcd-manager-events-control-plane-us-central1-a-69kn system-cluster-critical pod "etcd-manager-events-control-plane-us-central1-a-69kn" is pending Validation Failed W0129 22:56:55.487848 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 22:57:05.914492 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 19 lines ... Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Pod kube-system/kube-apiserver-control-plane-us-central1-b-j75w system-cluster-critical pod "kube-apiserver-control-plane-us-central1-b-j75w" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-c-98kw system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-98kw" is not ready (kube-controller-manager) Validation Failed W0129 22:57:06.719115 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 22:57:17.124134 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 18 lines ... Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-j75w system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-j75w" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-c-98kw system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-98kw" is not ready (kube-controller-manager) Validation Failed W0129 22:57:17.971217 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 22:57:28.403957 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 19 lines ... Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Pod kube-system/etcd-manager-main-control-plane-us-central1-c-98kw system-cluster-critical pod "etcd-manager-main-control-plane-us-central1-c-98kw" is pending Pod kube-system/kube-apiserver-control-plane-us-central1-a-69kn system-cluster-critical pod "kube-apiserver-control-plane-us-central1-a-69kn" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-c-98kw system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-98kw" is not ready (kube-controller-manager) Validation Failed W0129 22:57:29.373905 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 22:57:39.730337 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 18 lines ... Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Pod kube-system/etcd-manager-main-control-plane-us-central1-b-j75w system-cluster-critical pod "etcd-manager-main-control-plane-us-central1-b-j75w" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-c-98kw system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-98kw" is not ready (kube-controller-manager) Validation Failed W0129 22:57:40.576812 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 22:57:51.017654 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-c-98kw system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-98kw" is not ready (kube-controller-manager) Validation Failed W0129 22:57:51.829261 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 22:58:02.230241 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-c-98kw system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-98kw" is not ready (kube-controller-manager) Validation Failed W0129 22:58:03.088557 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 22:58:13.490891 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 22:58:14.317236 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 22:58:24.811403 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 22:58:25.674319 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 22:58:36.039385 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 22:58:36.838855 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 22:58:47.314100 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 22:58:48.222835 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 22:58:58.614193 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 22:58:59.500528 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 22:59:09.943036 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 22:59:10.818458 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 22:59:21.193836 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 22:59:22.084394 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 22:59:32.459024 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 22:59:33.391489 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 22:59:43.824572 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 22:59:44.676183 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 22:59:55.061088 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 22:59:55.940495 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:00:06.381271 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:00:07.277199 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:00:17.750956 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:00:18.640985 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:00:29.058465 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:00:29.947824 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:00:38.751548 5761 boskos.go:86] Sending heartbeat to Boskos I0129 23:00:40.344221 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:00:41.176359 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:00:51.554869 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:00:52.413666 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:01:02.879196 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:01:03.731462 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:01:14.148343 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:01:15.033166 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:01:25.487546 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:01:26.311576 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:01:36.739388 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:01:37.647988 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:01:48.013873 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:01:48.876306 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:01:59.343658 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:02:00.255915 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:02:10.672914 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:02:11.550696 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:02:21.953483 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:02:22.860758 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:02:33.238993 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:02:34.138769 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:02:44.516441 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:02:45.325058 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:02:55.699777 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:02:56.612059 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:03:07.035760 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:03:07.925462 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:03:18.365040 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:03:19.223836 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:03:29.721899 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:03:30.603615 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:03:41.000664 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:03:41.961378 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:03:52.345850 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:03:53.261870 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:04:03.696908 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:04:04.597018 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:04:15.042215 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:04:15.890739 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:04:26.246580 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:04:27.072724 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:04:37.513409 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:04:38.432934 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:04:48.774033 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:04:49.662282 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:05:00.092316 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:05:00.923018 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:05:11.327084 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:05:12.172304 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:05:22.554450 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:05:23.487791 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:05:33.879289 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:05:34.810959 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:05:38.762402 5761 boskos.go:86] Sending heartbeat to Boskos I0129 23:05:45.218929 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:05:46.057263 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:05:56.531332 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:05:57.372550 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:06:07.781948 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:06:08.679875 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:06:19.088415 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:06:19.959849 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:06:30.444988 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:06:31.296669 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:06:41.759225 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:06:42.597001 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:06:53.013602 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:06:53.873294 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0129 23:07:04.315797 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-j75w node "control-plane-us-central1-b-j75w" of role "control-plane" is not ready Node control-plane-us-central1-c-98kw node "control-plane-us-central1-c-98kw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-ffn2c system-cluster-critical pod "coredns-5d479c4f64-ffn2c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-wzjbw system-cluster-critical pod "coredns-autoscaler-557ccb4c66-wzjbw" is pending Pod kube-system/dns-controller-6f69f47785-dh7zk system-cluster-critical pod "dns-controller-6f69f47785-dh7zk" is pending Validation Failed W0129 23:07:05.267152 6121 validate_cluster.go:232] (will retry): cluster not yet healthy Error: validation failed: wait time exceeded during validation I0129 23:07:15.280095 5761 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/08579fd3-a027-11ed-9a0c-f25a29267a91/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh1490496053/key --ssh-user prow I0129 23:07:15.280147 5761 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/08579fd3-a027-11ed-9a0c-f25a29267a91/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh1490496053/key --ssh-user prow I0129 23:07:15.786588 6131 gce.go:99] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] 2023/01/29 23:07:21 Dumping node control-plane-us-central1-a-69kn 2023/01/29 23:07:23 error dumping node control-plane-us-central1-a-69kn: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/29 23:07:23 error dumping node control-plane-us-central1-a-69kn: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/29 23:07:23 Dumping node control-plane-us-central1-b-j75w 2023/01/29 23:07:27 error dumping node control-plane-us-central1-b-j75w: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/29 23:07:27 error dumping node control-plane-us-central1-b-j75w: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/29 23:07:27 Dumping node control-plane-us-central1-c-98kw 2023/01/29 23:07:31 error dumping node control-plane-us-central1-c-98kw: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/29 23:07:31 error dumping node control-plane-us-central1-c-98kw: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/29 23:07:31 dumping node not registered in kubernetes: 35.184.45.231 2023/01/29 23:07:31 Dumping node 35.184.45.231 I0129 23:07:32.935434 5761 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/08579fd3-a027-11ed-9a0c-f25a29267a91/kops get cluster --name ha-migration.k8s.local -o yaml I0129 23:07:32.935482 5761 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/08579fd3-a027-11ed-9a0c-f25a29267a91/kops get cluster --name ha-migration.k8s.local -o yaml I0129 23:07:33.111131 5761 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/08579fd3-a027-11ed-9a0c-f25a29267a91/kops get instancegroups --name ha-migration.k8s.local -o yaml I0129 23:07:33.111180 5761 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/08579fd3-a027-11ed-9a0c-f25a29267a91/kops get instancegroups --name ha-migration.k8s.local -o yaml ... skipping 166 lines ... Deleted cluster: "ha-migration.k8s.local" I0129 23:09:45.593324 5761 gcs.go:88] gsutil -u k8s-gce-reboot-1-5 rm -r gs://k8s-gce-reboot-1-5-state-08 I0129 23:09:45.596979 5761 local.go:42] ⚙️ gsutil -u k8s-gce-reboot-1-5 rm -r gs://k8s-gce-reboot-1-5-state-08 Removing gs://k8s-gce-reboot-1-5-state-08/... I0129 23:09:48.413853 5761 down.go:62] releasing boskos project I0129 23:09:48.422936 5761 boskos.go:83] Boskos heartbeat func received signal to close Error: exit status 1 + EXIT_VALUE=1 + set +o xtrace