e2e-kops-gce-leader-migration #1621369953305235456
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 1 failed / 1 succeeded |
| Started | |
| Elapsed | 20m14s |
| Revision | master |
exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
kubetest2 Down
... skipping 156 lines ... ...........................................Updated [https://www.googleapis.com/compute/v1/projects/gce-cvm-upg-lat-1-3-ctl-skew]. .done. WARNING: No host aliases were added to your SSH configs because you do not have any running instances. Try running this command again after running some instances. I0203 04:50:13.776499 5716 up.go:44] Cleaning up any leaked resources from previous cluster I0203 04:50:13.776646 5716 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/f856d35c-a37d-11ed-987c-c2f4825a9650/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh3058472784/key --ssh-user prow I0203 04:50:13.776663 5716 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/f856d35c-a37d-11ed-987c-c2f4825a9650/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh3058472784/key --ssh-user prow Error: Cluster.kops.k8s.io "ha-migration.k8s.local" not found W0203 04:50:14.068410 5716 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1 I0203 04:50:14.068448 5716 down.go:48] /home/prow/go/src/k8s.io/kops/_rundir/f856d35c-a37d-11ed-987c-c2f4825a9650/kops delete cluster --name ha-migration.k8s.local --yes I0203 04:50:14.068459 5716 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/f856d35c-a37d-11ed-987c-c2f4825a9650/kops delete cluster --name ha-migration.k8s.local --yes Error: error reading cluster configuration: Cluster.kops.k8s.io "ha-migration.k8s.local" not found I0203 04:50:14.278216 5716 gcs.go:51] gsutil ls -b -p gce-cvm-upg-lat-1-3-ctl-skew gs://gce-cvm-upg-lat-1-3-ctl-skew-state-f8 I0203 04:50:14.278264 5716 local.go:42] ⚙️ gsutil ls -b -p gce-cvm-upg-lat-1-3-ctl-skew gs://gce-cvm-upg-lat-1-3-ctl-skew-state-f8 I0203 04:50:16.225221 5716 gcs.go:70] gsutil mb -p gce-cvm-upg-lat-1-3-ctl-skew gs://gce-cvm-upg-lat-1-3-ctl-skew-state-f8 I0203 04:50:16.225268 5716 local.go:42] ⚙️ gsutil mb -p gce-cvm-upg-lat-1-3-ctl-skew gs://gce-cvm-upg-lat-1-3-ctl-skew-state-f8 Creating gs://gce-cvm-upg-lat-1-3-ctl-skew-state-f8/... I0203 04:50:18.734754 5716 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip 2023/02/03 04:50:18 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404 I0203 04:50:18.746072 5716 http.go:37] curl https://ip.jsb.workers.dev I0203 04:50:18.869039 5716 up.go:167] /home/prow/go/src/k8s.io/kops/_rundir/f856d35c-a37d-11ed-987c-c2f4825a9650/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh3058472784/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 34.134.250.158/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project gce-cvm-upg-lat-1-3-ctl-skew I0203 04:50:18.869089 5716 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/f856d35c-a37d-11ed-987c-c2f4825a9650/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh3058472784/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 34.134.250.158/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project gce-cvm-upg-lat-1-3-ctl-skew I0203 04:50:18.917226 6037 create_cluster.go:882] Using SSH public key: /tmp/kops-ssh3058472784/key.pub I0203 04:50:19.157518 6037 new_cluster.go:573] VMs will be configured to use specified Service Account: default I0203 04:50:19.157631 6037 new_cluster.go:1339] Cloud Provider ID: "gce" ... skipping 527 lines ... I0203 04:50:32.282198 6056 keypair.go:226] Issuing new certificate: "etcd-manager-ca-main" I0203 04:50:32.289371 6056 keypair.go:226] Issuing new certificate: "etcd-manager-ca-events" W0203 04:50:32.472863 6056 vfs_keystorereader.go:143] CA private key was not found I0203 04:50:32.579878 6056 keypair.go:226] Issuing new certificate: "kubernetes-ca" I0203 04:50:32.585303 6056 keypair.go:226] Issuing new certificate: "service-account" I0203 04:50:47.819659 6056 executor.go:111] Tasks: 50 done / 91 total; 23 can run W0203 04:50:57.587547 6056 executor.go:139] error running task "ForwardingRule/api-ha-migration-k8s-local" (9m50s remaining to succeed): error creating ForwardingRule "api-ha-migration-k8s-local": googleapi: Error 400: The resource 'projects/gce-cvm-upg-lat-1-3-ctl-skew/regions/us-central1/targetPools/api-ha-migration-k8s-local' is not ready, resourceNotReady I0203 04:50:57.587606 6056 executor.go:111] Tasks: 72 done / 91 total; 13 can run I0203 04:51:04.517032 6056 executor.go:111] Tasks: 85 done / 91 total; 6 can run I0203 04:51:18.481170 6056 executor.go:111] Tasks: 91 done / 91 total; 0 can run I0203 04:51:18.552853 6056 update_cluster.go:323] Exporting kubeconfig for cluster kOps has set your kubectl context to ha-migration.k8s.local ... skipping 7 lines ... * read about installing addons at: https://kops.sigs.k8s.io/addons. I0203 04:51:28.849456 5716 up.go:251] /home/prow/go/src/k8s.io/kops/_rundir/f856d35c-a37d-11ed-987c-c2f4825a9650/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s I0203 04:51:28.849524 5716 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/f856d35c-a37d-11ed-987c-c2f4825a9650/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s Validating cluster ha-migration.k8s.local W0203 04:51:59.578378 6073 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://104.154.135.86/api/v1/nodes": dial tcp 104.154.135.86:443: i/o timeout W0203 04:52:39.579310 6073 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://104.154.135.86/api/v1/nodes": dial tcp 104.154.135.86:443: i/o timeout W0203 04:52:49.582368 6073 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://104.154.135.86/api/v1/nodes": dial tcp 104.154.135.86:443: connect: connection refused W0203 04:52:59.586507 6073 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://104.154.135.86/api/v1/nodes": dial tcp 104.154.135.86:443: connect: connection refused W0203 04:53:09.589230 6073 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://104.154.135.86/api/v1/nodes": dial tcp 104.154.135.86:443: connect: connection refused W0203 04:53:19.591980 6073 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://104.154.135.86/api/v1/nodes": dial tcp 104.154.135.86:443: connect: connection refused W0203 04:53:29.596408 6073 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://104.154.135.86/api/v1/nodes": dial tcp 104.154.135.86:443: connect: connection refused W0203 04:53:39.599802 6073 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://104.154.135.86/api/v1/nodes": dial tcp 104.154.135.86:443: connect: connection refused W0203 04:53:49.603798 6073 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://104.154.135.86/api/v1/nodes": dial tcp 104.154.135.86:443: connect: connection refused W0203 04:53:59.606601 6073 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://104.154.135.86/api/v1/nodes": dial tcp 104.154.135.86:443: connect: connection refused W0203 04:54:11.809967 6073 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://104.154.135.86/api/v1/nodes": dial tcp 104.154.135.86:443: connect: connection refused - error from a previous attempt: read tcp 10.60.178.127:57260->104.154.135.86:443: read: connection reset by peer W0203 04:54:38.192863 6073 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://104.154.135.86/api/v1/nodes": net/http: TLS handshake timeout - error from a previous attempt: read tcp 10.60.178.127:60534->104.154.135.86:443: read: connection reset by peer W0203 04:54:48.195798 6073 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://104.154.135.86/api/v1/nodes": dial tcp 104.154.135.86:443: connect: connection refused I0203 04:55:01.372510 5716 boskos.go:86] Sending heartbeat to Boskos W0203 04:55:08.208454 6073 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://104.154.135.86/api/v1/nodes": net/http: TLS handshake timeout W0203 04:55:18.220622 6073 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://104.154.135.86/api/v1/nodes": dial tcp 104.154.135.86:443: connect: connection refused W0203 04:55:28.231094 6073 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://104.154.135.86/api/v1/nodes": dial tcp 104.154.135.86:443: connect: connection refused W0203 04:55:38.235062 6073 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://104.154.135.86/api/v1/nodes": dial tcp 104.154.135.86:443: connect: connection refused W0203 04:55:53.283062 6073 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://104.154.135.86/api/v1/nodes": dial tcp 104.154.135.86:443: connect: connection refused - error from a previous attempt: read tcp 10.60.178.127:44816->104.154.135.86:443: read: connection reset by peer W0203 04:56:08.688325 6073 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://104.154.135.86/api/v1/nodes": dial tcp 104.154.135.86:443: connect: connection refused - error from a previous attempt: read tcp 10.60.178.127:58936->104.154.135.86:443: read: connection reset by peer W0203 04:56:18.691575 6073 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://104.154.135.86/api/v1/nodes": dial tcp 104.154.135.86:443: connect: connection refused W0203 04:56:28.698276 6073 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://104.154.135.86/api/v1/nodes": dial tcp 104.154.135.86:443: connect: connection refused W0203 04:56:38.710184 6073 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://104.154.135.86/api/v1/nodes": dial tcp 104.154.135.86:443: connect: connection refused W0203 04:56:48.723725 6073 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://104.154.135.86/api/v1/nodes": dial tcp 104.154.135.86:443: connect: connection refused I0203 04:56:59.126732 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-c ControlPlane e2-standard-2 1 1 us-central1 ... skipping 11 lines ... Machine https://www.googleapis.com/compute/v1/projects/gce-cvm-upg-lat-1-3-ctl-skew/zones/us-central1-a/instances/control-plane-us-central1-a-2t21 machine "https://www.googleapis.com/compute/v1/projects/gce-cvm-upg-lat-1-3-ctl-skew/zones/us-central1-a/instances/control-plane-us-central1-a-2t21" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/gce-cvm-upg-lat-1-3-ctl-skew/zones/us-central1-a/instances/nodes-us-central1-a-fvn1 machine "https://www.googleapis.com/compute/v1/projects/gce-cvm-upg-lat-1-3-ctl-skew/zones/us-central1-a/instances/nodes-us-central1-a-fvn1" has not yet joined cluster Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-c-8g9c system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-8g9c" is not ready (kube-controller-manager) Validation Failed W0203 04:57:00.055899 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 04:57:10.461778 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 14 lines ... Node control-plane-us-central1-a-2t21 node "control-plane-us-central1-a-2t21" of role "control-plane" is not ready Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-b-b9mg system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-b9mg" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-c-8g9c system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-8g9c" is not ready (kube-controller-manager) Validation Failed W0203 04:57:11.437833 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 04:57:21.803189 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 14 lines ... Node control-plane-us-central1-a-2t21 node "control-plane-us-central1-a-2t21" of role "control-plane" is not ready Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-b-b9mg system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-b9mg" is not ready (kube-controller-manager) Pod kube-system/kube-controller-manager-control-plane-us-central1-c-8g9c system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-8g9c" is not ready (kube-controller-manager) Validation Failed W0203 04:57:22.696178 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 04:57:33.028785 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 25 lines ... Pod kube-system/kops-controller-5lrjl system-cluster-critical pod "kops-controller-5lrjl" is pending Pod kube-system/kops-controller-m49dr system-cluster-critical pod "kops-controller-m49dr" is pending Pod kube-system/kops-controller-pcbh7 system-cluster-critical pod "kops-controller-pcbh7" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-b9mg system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-b9mg" is not ready (kube-controller-manager) Pod kube-system/kube-controller-manager-control-plane-us-central1-c-8g9c system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-8g9c" is not ready (kube-controller-manager) Validation Failed W0203 04:57:33.920395 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 04:57:44.334490 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 23 lines ... Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Pod kube-system/kube-apiserver-control-plane-us-central1-c-8g9c system-cluster-critical pod "kube-apiserver-control-plane-us-central1-c-8g9c" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-b9mg system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-b9mg" is not ready (kube-controller-manager) Pod kube-system/kube-controller-manager-control-plane-us-central1-c-8g9c system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-8g9c" is not ready (kube-controller-manager) Validation Failed W0203 04:57:45.168736 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 04:57:55.499833 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 19 lines ... Pod kube-system/cilium-sv6f8 system-node-critical pod "cilium-sv6f8" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-b9mg system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-b9mg" is not ready (kube-controller-manager) Validation Failed W0203 04:57:56.466635 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 04:58:06.802279 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 19 lines ... Pod kube-system/cilium-sv6f8 system-node-critical pod "cilium-sv6f8" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-b9mg system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-b9mg" is not ready (kube-controller-manager) Validation Failed W0203 04:58:07.689479 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 04:58:18.105149 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 18 lines ... Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Pod kube-system/etcd-manager-events-control-plane-us-central1-b-b9mg system-cluster-critical pod "etcd-manager-events-control-plane-us-central1-b-b9mg" is pending Pod kube-system/kube-apiserver-control-plane-us-central1-b-b9mg system-cluster-critical pod "kube-apiserver-control-plane-us-central1-b-b9mg" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-b9mg system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-b9mg" is not ready (kube-controller-manager) Validation Failed W0203 04:58:18.991510 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 04:58:29.320640 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 17 lines ... Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Pod kube-system/kube-apiserver-control-plane-us-central1-a-2t21 system-cluster-critical pod "kube-apiserver-control-plane-us-central1-a-2t21" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-b9mg system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-b9mg" is not ready (kube-controller-manager) Validation Failed W0203 04:58:30.147425 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 04:58:40.567626 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-b9mg system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-b9mg" is not ready (kube-controller-manager) Validation Failed W0203 04:58:41.413575 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 04:58:51.761186 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-b9mg system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-b9mg" is not ready (kube-controller-manager) Validation Failed W0203 04:58:52.621569 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 04:59:02.976463 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-b9mg system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-b9mg" is not ready (kube-controller-manager) Validation Failed W0203 04:59:03.809362 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 04:59:14.176853 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-b9mg system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-b9mg" is not ready (kube-controller-manager) Validation Failed W0203 04:59:15.030806 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 04:59:25.334382 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-b9mg system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-b9mg" is not ready (kube-controller-manager) Validation Failed W0203 04:59:26.168221 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 04:59:36.488971 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 04:59:37.270678 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 04:59:47.568967 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 04:59:48.469616 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 04:59:58.764042 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 04:59:59.557019 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:00:01.382156 5716 boskos.go:86] Sending heartbeat to Boskos I0203 05:00:09.921299 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:00:10.762525 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:00:21.073578 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:00:21.936009 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:00:32.261662 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:00:33.127172 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:00:43.399844 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:00:44.302413 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:00:54.622744 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:00:55.491906 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:01:05.762772 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:01:06.601057 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:01:16.911368 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:01:17.752400 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:01:28.097067 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:01:28.948480 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:01:39.342186 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:01:40.237455 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:01:50.515418 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:01:51.427461 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:02:01.759625 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:02:02.623022 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:02:12.953410 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:02:13.804914 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:02:24.122428 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:02:25.002565 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:02:35.300065 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:02:36.205618 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:02:46.567990 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:02:47.474021 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:02:57.845412 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:02:58.732100 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:03:09.168539 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:03:10.004316 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:03:20.451812 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:03:21.339504 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:03:31.681167 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:03:32.547158 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:03:42.859493 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:03:43.704519 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:03:54.104064 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:03:54.865016 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:04:05.276189 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:04:06.110909 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:04:16.399303 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:04:17.321726 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:04:27.684376 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:04:28.604300 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:04:38.951113 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:04:39.837123 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:04:50.263845 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:04:51.092901 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:05:01.422794 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] I0203 05:05:01.526693 5716 boskos.go:86] Sending heartbeat to Boskos INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:05:02.310311 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:05:12.701405 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:05:13.530201 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:05:23.884022 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:05:24.777643 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:05:35.140256 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:05:36.050029 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:05:46.466054 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:05:47.319016 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:05:57.681793 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:05:58.532408 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:06:09.009886 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:06:09.891965 6073 validate_cluster.go:232] (will retry): cluster not yet healthy I0203 05:06:20.295426 6073 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-b9mg node "control-plane-us-central1-b-b9mg" of role "control-plane" is not ready Node control-plane-us-central1-c-8g9c node "control-plane-us-central1-c-8g9c" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-z7hsq system-cluster-critical pod "coredns-5d479c4f64-z7hsq" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-bg8lv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-bg8lv" is pending Pod kube-system/dns-controller-6f69f47785-l44mc system-cluster-critical pod "dns-controller-6f69f47785-l44mc" is pending Validation Failed W0203 05:06:21.155923 6073 validate_cluster.go:232] (will retry): cluster not yet healthy Error: validation failed: wait time exceeded during validation I0203 05:06:31.167098 5716 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/f856d35c-a37d-11ed-987c-c2f4825a9650/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh3058472784/key --ssh-user prow I0203 05:06:31.167165 5716 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/f856d35c-a37d-11ed-987c-c2f4825a9650/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh3058472784/key --ssh-user prow I0203 05:06:31.606086 6083 gce.go:99] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] 2023/02/03 05:06:36 Dumping node control-plane-us-central1-a-2t21 2023/02/03 05:06:40 error dumping node control-plane-us-central1-a-2t21: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/02/03 05:06:40 error dumping node control-plane-us-central1-a-2t21: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/02/03 05:06:40 Dumping node control-plane-us-central1-b-b9mg 2023/02/03 05:06:44 error dumping node control-plane-us-central1-b-b9mg: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/02/03 05:06:44 error dumping node control-plane-us-central1-b-b9mg: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/02/03 05:06:44 Dumping node control-plane-us-central1-c-8g9c 2023/02/03 05:06:49 error dumping node control-plane-us-central1-c-8g9c: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/02/03 05:06:49 error dumping node control-plane-us-central1-c-8g9c: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/02/03 05:06:49 dumping node not registered in kubernetes: 35.202.102.71 2023/02/03 05:06:49 Dumping node 35.202.102.71 I0203 05:06:51.727477 5716 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/f856d35c-a37d-11ed-987c-c2f4825a9650/kops get cluster --name ha-migration.k8s.local -o yaml I0203 05:06:51.727548 5716 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/f856d35c-a37d-11ed-987c-c2f4825a9650/kops get cluster --name ha-migration.k8s.local -o yaml I0203 05:06:51.880570 5716 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/f856d35c-a37d-11ed-987c-c2f4825a9650/kops get instancegroups --name ha-migration.k8s.local -o yaml I0203 05:06:51.880614 5716 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/f856d35c-a37d-11ed-987c-c2f4825a9650/kops get instancegroups --name ha-migration.k8s.local -o yaml ... skipping 166 lines ... Deleted cluster: "ha-migration.k8s.local" I0203 05:09:09.585554 5716 gcs.go:88] gsutil -u gce-cvm-upg-lat-1-3-ctl-skew rm -r gs://gce-cvm-upg-lat-1-3-ctl-skew-state-f8 I0203 05:09:09.585626 5716 local.go:42] ⚙️ gsutil -u gce-cvm-upg-lat-1-3-ctl-skew rm -r gs://gce-cvm-upg-lat-1-3-ctl-skew-state-f8 Removing gs://gce-cvm-upg-lat-1-3-ctl-skew-state-f8/... I0203 05:09:12.185578 5716 down.go:62] releasing boskos project I0203 05:09:12.196285 5716 boskos.go:83] Boskos heartbeat func received signal to close Error: exit status 1 + EXIT_VALUE=1 + set +o xtrace