e2e-kops-gce-leader-migration #1619965731783315456
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 1 failed / 1 succeeded |
| Started | |
| Elapsed | 20m48s |
| Revision | master |
exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
kubetest2 Down
... skipping 156 lines ... .....................................Updated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-serial-1-6]. .done. WARNING: No host aliases were added to your SSH configs because you do not have any running instances. Try running this command again after running some instances. I0130 07:51:11.729200 5754 up.go:44] Cleaning up any leaked resources from previous cluster I0130 07:51:11.729352 5754 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/7876a0a3-a072-11ed-9a0c-f25a29267a91/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh2977222388/key --ssh-user prow I0130 07:51:11.729373 5754 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/7876a0a3-a072-11ed-9a0c-f25a29267a91/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh2977222388/key --ssh-user prow Error: Cluster.kops.k8s.io "ha-migration.k8s.local" not found W0130 07:51:12.115958 5754 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1 I0130 07:51:12.116042 5754 down.go:48] /home/prow/go/src/k8s.io/kops/_rundir/7876a0a3-a072-11ed-9a0c-f25a29267a91/kops delete cluster --name ha-migration.k8s.local --yes I0130 07:51:12.116052 5754 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/7876a0a3-a072-11ed-9a0c-f25a29267a91/kops delete cluster --name ha-migration.k8s.local --yes Error: error reading cluster configuration: Cluster.kops.k8s.io "ha-migration.k8s.local" not found I0130 07:51:12.424016 5754 gcs.go:51] gsutil ls -b -p k8s-jkns-gce-serial-1-6 gs://k8s-jkns-gce-serial-1-6-state-78 I0130 07:51:12.424066 5754 local.go:42] ⚙️ gsutil ls -b -p k8s-jkns-gce-serial-1-6 gs://k8s-jkns-gce-serial-1-6-state-78 I0130 07:51:16.390409 5754 gcs.go:70] gsutil mb -p k8s-jkns-gce-serial-1-6 gs://k8s-jkns-gce-serial-1-6-state-78 I0130 07:51:16.390467 5754 local.go:42] ⚙️ gsutil mb -p k8s-jkns-gce-serial-1-6 gs://k8s-jkns-gce-serial-1-6-state-78 Creating gs://k8s-jkns-gce-serial-1-6-state-78/... I0130 07:51:20.487443 5754 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip 2023/01/30 07:51:20 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404 I0130 07:51:20.507735 5754 http.go:37] curl https://ip.jsb.workers.dev I0130 07:51:20.566110 5754 up.go:167] /home/prow/go/src/k8s.io/kops/_rundir/7876a0a3-a072-11ed-9a0c-f25a29267a91/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh2977222388/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 35.192.22.29/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project k8s-jkns-gce-serial-1-6 I0130 07:51:20.566164 5754 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/7876a0a3-a072-11ed-9a0c-f25a29267a91/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh2977222388/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 35.192.22.29/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project k8s-jkns-gce-serial-1-6 I0130 07:51:20.641310 6076 create_cluster.go:882] Using SSH public key: /tmp/kops-ssh2977222388/key.pub I0130 07:51:20.940232 6076 new_cluster.go:573] VMs will be configured to use specified Service Account: default I0130 07:51:20.940588 6076 new_cluster.go:1338] Cloud Provider ID: "gce" ... skipping 527 lines ... I0130 07:51:32.895911 6096 keypair.go:226] Issuing new certificate: "etcd-manager-ca-events" I0130 07:51:32.906927 6096 keypair.go:226] Issuing new certificate: "etcd-manager-ca-main" W0130 07:51:33.075746 6096 vfs_keystorereader.go:143] CA private key was not found I0130 07:51:33.227194 6096 keypair.go:226] Issuing new certificate: "service-account" I0130 07:51:33.234933 6096 keypair.go:226] Issuing new certificate: "kubernetes-ca" I0130 07:51:45.367216 6096 executor.go:111] Tasks: 50 done / 91 total; 23 can run W0130 07:51:58.413775 6096 executor.go:139] error running task "ForwardingRule/api-ha-migration-k8s-local" (9m46s remaining to succeed): error creating ForwardingRule "api-ha-migration-k8s-local": googleapi: Error 400: The resource 'projects/k8s-jkns-gce-serial-1-6/regions/us-central1/targetPools/api-ha-migration-k8s-local' is not ready, resourceNotReady I0130 07:51:58.414103 6096 executor.go:111] Tasks: 72 done / 91 total; 13 can run I0130 07:52:05.189464 6096 executor.go:111] Tasks: 85 done / 91 total; 6 can run I0130 07:52:19.236872 6096 executor.go:111] Tasks: 91 done / 91 total; 0 can run I0130 07:52:19.730369 6096 update_cluster.go:323] Exporting kubeconfig for cluster kOps has set your kubectl context to ha-migration.k8s.local ... skipping 7 lines ... * read about installing addons at: https://kops.sigs.k8s.io/addons. I0130 07:52:30.146871 5754 up.go:251] /home/prow/go/src/k8s.io/kops/_rundir/7876a0a3-a072-11ed-9a0c-f25a29267a91/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s I0130 07:52:30.146927 5754 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/7876a0a3-a072-11ed-9a0c-f25a29267a91/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s Validating cluster ha-migration.k8s.local W0130 07:53:00.733438 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.234.40/api/v1/nodes": dial tcp 35.193.234.40:443: i/o timeout W0130 07:53:18.029584 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.234.40/api/v1/nodes": dial tcp 35.193.234.40:443: connect: connection refused W0130 07:53:28.036960 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.234.40/api/v1/nodes": dial tcp 35.193.234.40:443: connect: connection refused W0130 07:53:38.041600 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.234.40/api/v1/nodes": dial tcp 35.193.234.40:443: connect: connection refused W0130 07:53:48.050849 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.234.40/api/v1/nodes": dial tcp 35.193.234.40:443: connect: connection refused W0130 07:53:58.057448 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.234.40/api/v1/nodes": dial tcp 35.193.234.40:443: connect: connection refused W0130 07:54:08.066538 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.234.40/api/v1/nodes": dial tcp 35.193.234.40:443: connect: connection refused W0130 07:54:18.070603 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.234.40/api/v1/nodes": dial tcp 35.193.234.40:443: connect: connection refused W0130 07:54:28.079548 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.234.40/api/v1/nodes": dial tcp 35.193.234.40:443: connect: connection refused W0130 07:54:38.086474 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.234.40/api/v1/nodes": dial tcp 35.193.234.40:443: connect: connection refused W0130 07:54:48.094868 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.234.40/api/v1/nodes": dial tcp 35.193.234.40:443: connect: connection refused W0130 07:55:08.104583 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.234.40/api/v1/nodes": net/http: TLS handshake timeout W0130 07:55:29.318381 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.234.40/api/v1/nodes": net/http: TLS handshake timeout - error from a previous attempt: read tcp 10.60.70.248:56100->35.193.234.40:443: read: connection reset by peer W0130 07:55:39.320547 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.234.40/api/v1/nodes": dial tcp 35.193.234.40:443: connect: connection refused W0130 07:55:49.327777 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.234.40/api/v1/nodes": dial tcp 35.193.234.40:443: connect: connection refused I0130 07:55:58.271004 5754 boskos.go:86] Sending heartbeat to Boskos W0130 07:55:59.330909 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.234.40/api/v1/nodes": dial tcp 35.193.234.40:443: connect: connection refused W0130 07:56:19.352751 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.234.40/api/v1/nodes": net/http: TLS handshake timeout W0130 07:56:29.361664 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.234.40/api/v1/nodes": dial tcp 35.193.234.40:443: connect: connection refused W0130 07:56:39.365996 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.234.40/api/v1/nodes": dial tcp 35.193.234.40:443: connect: connection refused W0130 07:56:59.387147 6116 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.234.40/api/v1/nodes": net/http: TLS handshake timeout I0130 07:57:09.872150 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-c ControlPlane e2-standard-2 1 1 us-central1 ... skipping 11 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-serial-1-6/zones/us-central1-a/instances/nodes-us-central1-a-pd9v machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-serial-1-6/zones/us-central1-a/instances/nodes-us-central1-a-pd9v" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-serial-1-6/zones/us-central1-b/instances/control-plane-us-central1-b-1fwx machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-serial-1-6/zones/us-central1-b/instances/control-plane-us-central1-b-1fwx" has not yet joined cluster Node control-plane-us-central1-a-mkm5 node "control-plane-us-central1-a-mkm5" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-a-mkm5 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-mkm5" is pending Validation Failed W0130 07:57:10.861804 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 07:57:21.363885 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 23 lines ... Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Pod kube-system/etcd-manager-events-control-plane-us-central1-a-mkm5 system-cluster-critical pod "etcd-manager-events-control-plane-us-central1-a-mkm5" is pending Pod kube-system/kops-controller-2pqqr system-cluster-critical pod "kops-controller-2pqqr" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-a-mkm5 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-mkm5" is not ready (kube-controller-manager) Validation Failed W0130 07:57:22.319940 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 07:57:32.717517 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 24 lines ... Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Pod kube-system/kops-controller-2pqqr system-cluster-critical pod "kops-controller-2pqqr" is pending Pod kube-system/kops-controller-glthp system-cluster-critical pod "kops-controller-glthp" is pending Pod kube-system/kops-controller-hc2c8 system-cluster-critical pod "kops-controller-hc2c8" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-a-mkm5 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-mkm5" is not ready (kube-controller-manager) Validation Failed W0130 07:57:33.625254 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 07:57:44.247342 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 25 lines ... Pod kube-system/etcd-manager-main-control-plane-us-central1-a-mkm5 system-cluster-critical pod "etcd-manager-main-control-plane-us-central1-a-mkm5" is pending Pod kube-system/kops-controller-2pqqr system-cluster-critical pod "kops-controller-2pqqr" is pending Pod kube-system/kops-controller-glthp system-cluster-critical pod "kops-controller-glthp" is pending Pod kube-system/kops-controller-hc2c8 system-cluster-critical pod "kops-controller-hc2c8" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-a-mkm5 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-mkm5" is not ready (kube-controller-manager) Validation Failed W0130 07:57:45.149479 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 07:57:55.577358 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 27 lines ... Pod kube-system/kops-controller-glthp system-cluster-critical pod "kops-controller-glthp" is pending Pod kube-system/kops-controller-hc2c8 system-cluster-critical pod "kops-controller-hc2c8" is pending Pod kube-system/kube-apiserver-control-plane-us-central1-a-mkm5 system-cluster-critical pod "kube-apiserver-control-plane-us-central1-a-mkm5" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-a-mkm5 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-mkm5" is not ready (kube-controller-manager) Pod kube-system/kube-controller-manager-control-plane-us-central1-b-1fwx system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-1fwx" is not ready (kube-controller-manager) Validation Failed W0130 07:57:56.416096 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 07:58:06.833957 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 21 lines ... Pod kube-system/cilium-operator-b4b4c5b48-5bw2t system-cluster-critical pod "cilium-operator-b4b4c5b48-5bw2t" is pending Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-1fwx system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-1fwx" is not ready (kube-controller-manager) Validation Failed W0130 07:58:07.654473 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 07:58:18.057516 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 19 lines ... Pod kube-system/cilium-ndxq6 system-node-critical pod "cilium-ndxq6" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-1fwx system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-1fwx" is not ready (kube-controller-manager) Validation Failed W0130 07:58:18.970826 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 07:58:29.439647 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 19 lines ... Pod kube-system/cilium-ndxq6 system-node-critical pod "cilium-ndxq6" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-1fwx system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-1fwx" is not ready (kube-controller-manager) Validation Failed W0130 07:58:30.342779 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 07:58:40.845775 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 17 lines ... Pod kube-system/cilium-ndxq6 system-node-critical pod "cilium-ndxq6" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Pod kube-system/kube-scheduler-control-plane-us-central1-b-1fwx system-cluster-critical pod "kube-scheduler-control-plane-us-central1-b-1fwx" is pending Validation Failed W0130 07:58:41.707328 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 07:58:52.071090 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 07:58:52.847820 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 07:59:03.244151 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Pod kube-system/kube-apiserver-control-plane-us-central1-b-1fwx system-cluster-critical pod "kube-apiserver-control-plane-us-central1-b-1fwx" is pending Validation Failed W0130 07:59:04.120523 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 07:59:14.551056 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Pod kube-system/etcd-manager-main-control-plane-us-central1-b-1fwx system-cluster-critical pod "etcd-manager-main-control-plane-us-central1-b-1fwx" is pending Validation Failed W0130 07:59:15.433503 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 07:59:25.856777 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 07:59:26.677673 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 07:59:37.153890 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 07:59:37.971639 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 07:59:48.337546 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 07:59:49.197122 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 07:59:59.622557 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:00:00.815947 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:00:11.259700 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:00:12.180111 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:00:22.589218 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:00:23.426556 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:00:33.919242 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:00:34.766516 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:00:45.288527 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:00:46.102748 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:00:56.577657 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:00:57.483821 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:00:58.282886 5754 boskos.go:86] Sending heartbeat to Boskos I0130 08:01:07.941434 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:01:08.825659 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:01:19.272469 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:01:20.045943 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:01:30.446673 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:01:31.306515 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:01:41.714998 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:01:42.576510 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:01:53.074619 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:01:53.887580 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:02:04.316946 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:02:05.220217 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:02:15.631571 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:02:16.552794 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:02:26.975535 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:02:27.817133 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:02:38.249599 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:02:39.125509 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:02:49.610627 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:02:50.564564 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:03:00.970269 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:03:01.790078 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:03:12.258793 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:03:13.077434 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:03:23.484351 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:03:24.343866 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:03:34.825714 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:03:35.726114 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:03:46.129147 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:03:46.996817 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:03:57.429390 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:03:58.267397 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:04:08.648956 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:04:09.524855 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:04:19.944142 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:04:20.701094 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:04:31.213930 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:04:32.050538 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:04:42.423824 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:04:43.252755 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:04:53.597714 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:04:54.381078 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:05:04.792124 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:05:05.579011 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:05:16.026852 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:05:16.894433 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:05:27.294538 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:05:28.208819 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:05:38.596839 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:05:39.388345 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:05:49.849333 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:05:50.624706 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:05:58.294158 5754 boskos.go:86] Sending heartbeat to Boskos I0130 08:06:01.021928 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:06:01.903765 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:06:12.345925 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:06:13.176076 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:06:23.671275 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:06:24.586950 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:06:35.048969 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:06:35.912056 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:06:46.374132 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:06:47.203952 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:06:57.670188 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:06:58.484357 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:07:08.926921 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:07:09.723360 6116 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 08:07:20.207844 6116 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1fwx node "control-plane-us-central1-b-1fwx" of role "control-plane" is not ready Node control-plane-us-central1-c-lnm9 node "control-plane-us-central1-c-lnm9" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-47zs8 system-cluster-critical pod "coredns-5d479c4f64-47zs8" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-fdjpj system-cluster-critical pod "coredns-autoscaler-557ccb4c66-fdjpj" is pending Pod kube-system/dns-controller-6f69f47785-hk2m7 system-cluster-critical pod "dns-controller-6f69f47785-hk2m7" is pending Validation Failed W0130 08:07:21.001025 6116 validate_cluster.go:232] (will retry): cluster not yet healthy Error: validation failed: wait time exceeded during validation I0130 08:07:31.005636 5754 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/7876a0a3-a072-11ed-9a0c-f25a29267a91/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh2977222388/key --ssh-user prow I0130 08:07:31.005687 5754 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/7876a0a3-a072-11ed-9a0c-f25a29267a91/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh2977222388/key --ssh-user prow I0130 08:07:31.558301 6126 gce.go:99] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] 2023/01/30 08:07:36 Dumping node control-plane-us-central1-a-mkm5 2023/01/30 08:07:38 error dumping node control-plane-us-central1-a-mkm5: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/30 08:07:38 error dumping node control-plane-us-central1-a-mkm5: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/30 08:07:38 Dumping node control-plane-us-central1-b-1fwx 2023/01/30 08:07:43 error dumping node control-plane-us-central1-b-1fwx: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/30 08:07:43 error dumping node control-plane-us-central1-b-1fwx: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/30 08:07:43 Dumping node control-plane-us-central1-c-lnm9 2023/01/30 08:07:47 error dumping node control-plane-us-central1-c-lnm9: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/30 08:07:47 error dumping node control-plane-us-central1-c-lnm9: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/30 08:07:47 dumping node not registered in kubernetes: 34.170.60.64 2023/01/30 08:07:47 Dumping node 34.170.60.64 I0130 08:07:49.078874 5754 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/7876a0a3-a072-11ed-9a0c-f25a29267a91/kops get cluster --name ha-migration.k8s.local -o yaml I0130 08:07:49.078908 5754 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/7876a0a3-a072-11ed-9a0c-f25a29267a91/kops get cluster --name ha-migration.k8s.local -o yaml I0130 08:07:49.244949 5754 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/7876a0a3-a072-11ed-9a0c-f25a29267a91/kops get instancegroups --name ha-migration.k8s.local -o yaml I0130 08:07:49.244989 5754 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/7876a0a3-a072-11ed-9a0c-f25a29267a91/kops get instancegroups --name ha-migration.k8s.local -o yaml ... skipping 167 lines ... Deleted cluster: "ha-migration.k8s.local" I0130 08:10:16.073197 5754 gcs.go:88] gsutil -u k8s-jkns-gce-serial-1-6 rm -r gs://k8s-jkns-gce-serial-1-6-state-78 I0130 08:10:16.073239 5754 local.go:42] ⚙️ gsutil -u k8s-jkns-gce-serial-1-6 rm -r gs://k8s-jkns-gce-serial-1-6-state-78 Removing gs://k8s-jkns-gce-serial-1-6-state-78/... I0130 08:10:18.937082 5754 down.go:62] releasing boskos project I0130 08:10:18.946526 5754 boskos.go:83] Boskos heartbeat func received signal to close Error: exit status 1 + EXIT_VALUE=1 + set +o xtrace