e2e-kops-gce-leader-migration #1621053015127494656
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 1 failed / 1 succeeded |
| Started | |
| Elapsed | 20m34s |
| Revision | master |
exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
kubetest2 Down
... skipping 156 lines ... ..................................Updated [https://www.googleapis.com/compute/v1/projects/k8s-gce-cvm-1-6-mstr-ctl-skew]. .done. WARNING: No host aliases were added to your SSH configs because you do not have any running instances. Try running this command again after running some instances. I0202 07:50:54.625836 5752 up.go:44] Cleaning up any leaked resources from previous cluster I0202 07:50:54.625957 5752 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/08b7df1f-a2ce-11ed-8c0a-1250e2f4dc61/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh3114457135/key --ssh-user prow I0202 07:50:54.625989 5752 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/08b7df1f-a2ce-11ed-8c0a-1250e2f4dc61/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh3114457135/key --ssh-user prow Error: Cluster.kops.k8s.io "ha-migration.k8s.local" not found W0202 07:50:54.945488 5752 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1 I0202 07:50:54.945607 5752 down.go:48] /home/prow/go/src/k8s.io/kops/_rundir/08b7df1f-a2ce-11ed-8c0a-1250e2f4dc61/kops delete cluster --name ha-migration.k8s.local --yes I0202 07:50:54.945652 5752 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/08b7df1f-a2ce-11ed-8c0a-1250e2f4dc61/kops delete cluster --name ha-migration.k8s.local --yes Error: error reading cluster configuration: Cluster.kops.k8s.io "ha-migration.k8s.local" not found I0202 07:50:55.195781 5752 gcs.go:51] gsutil ls -b -p k8s-gce-cvm-1-6-mstr-ctl-skew gs://k8s-gce-cvm-1-6-mstr-ctl-skew-state-08 I0202 07:50:55.195814 5752 local.go:42] ⚙️ gsutil ls -b -p k8s-gce-cvm-1-6-mstr-ctl-skew gs://k8s-gce-cvm-1-6-mstr-ctl-skew-state-08 I0202 07:50:57.242275 5752 gcs.go:70] gsutil mb -p k8s-gce-cvm-1-6-mstr-ctl-skew gs://k8s-gce-cvm-1-6-mstr-ctl-skew-state-08 I0202 07:50:57.242315 5752 local.go:42] ⚙️ gsutil mb -p k8s-gce-cvm-1-6-mstr-ctl-skew gs://k8s-gce-cvm-1-6-mstr-ctl-skew-state-08 Creating gs://k8s-gce-cvm-1-6-mstr-ctl-skew-state-08/... I0202 07:50:59.837476 5752 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip 2023/02/02 07:50:59 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404 I0202 07:50:59.851850 5752 http.go:37] curl https://ip.jsb.workers.dev I0202 07:50:59.910687 5752 up.go:167] /home/prow/go/src/k8s.io/kops/_rundir/08b7df1f-a2ce-11ed-8c0a-1250e2f4dc61/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh3114457135/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 104.198.245.181/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project k8s-gce-cvm-1-6-mstr-ctl-skew I0202 07:50:59.910729 5752 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/08b7df1f-a2ce-11ed-8c0a-1250e2f4dc61/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh3114457135/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 104.198.245.181/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project k8s-gce-cvm-1-6-mstr-ctl-skew I0202 07:50:59.965500 6074 create_cluster.go:882] Using SSH public key: /tmp/kops-ssh3114457135/key.pub I0202 07:51:00.236957 6074 new_cluster.go:573] VMs will be configured to use specified Service Account: default I0202 07:51:00.237282 6074 new_cluster.go:1339] Cloud Provider ID: "gce" ... skipping 527 lines ... I0202 07:51:11.985328 6094 keypair.go:226] Issuing new certificate: "etcd-peers-ca-events" I0202 07:51:11.985713 6094 keypair.go:226] Issuing new certificate: "etcd-peers-ca-main" W0202 07:51:12.177198 6094 vfs_keystorereader.go:143] CA private key was not found I0202 07:51:12.284479 6094 keypair.go:226] Issuing new certificate: "service-account" I0202 07:51:12.330883 6094 keypair.go:226] Issuing new certificate: "kubernetes-ca" I0202 07:51:23.619678 6094 executor.go:111] Tasks: 50 done / 91 total; 23 can run W0202 07:51:42.388208 6094 executor.go:139] error running task "ForwardingRule/api-ha-migration-k8s-local" (9m41s remaining to succeed): error creating ForwardingRule "api-ha-migration-k8s-local": googleapi: Error 400: The resource 'projects/k8s-gce-cvm-1-6-mstr-ctl-skew/regions/us-central1/targetPools/api-ha-migration-k8s-local' is not ready, resourceNotReady I0202 07:51:42.388267 6094 executor.go:111] Tasks: 72 done / 91 total; 13 can run I0202 07:51:49.229880 6094 executor.go:111] Tasks: 85 done / 91 total; 6 can run I0202 07:52:06.283426 6094 executor.go:111] Tasks: 91 done / 91 total; 0 can run I0202 07:52:06.388020 6094 update_cluster.go:323] Exporting kubeconfig for cluster kOps has set your kubectl context to ha-migration.k8s.local ... skipping 7 lines ... * read about installing addons at: https://kops.sigs.k8s.io/addons. I0202 07:52:16.796133 5752 up.go:251] /home/prow/go/src/k8s.io/kops/_rundir/08b7df1f-a2ce-11ed-8c0a-1250e2f4dc61/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s I0202 07:52:16.796177 5752 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/08b7df1f-a2ce-11ed-8c0a-1250e2f4dc61/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s Validating cluster ha-migration.k8s.local W0202 07:52:47.337053 6114 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.26.109/api/v1/nodes": dial tcp 35.188.26.109:443: i/o timeout W0202 07:53:27.338902 6114 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.26.109/api/v1/nodes": dial tcp 35.188.26.109:443: i/o timeout W0202 07:53:37.342592 6114 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.26.109/api/v1/nodes": dial tcp 35.188.26.109:443: connect: connection refused W0202 07:53:47.346438 6114 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.26.109/api/v1/nodes": dial tcp 35.188.26.109:443: connect: connection refused W0202 07:53:57.349976 6114 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.26.109/api/v1/nodes": dial tcp 35.188.26.109:443: connect: connection refused W0202 07:54:07.352861 6114 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.26.109/api/v1/nodes": dial tcp 35.188.26.109:443: connect: connection refused W0202 07:54:17.356495 6114 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.26.109/api/v1/nodes": dial tcp 35.188.26.109:443: connect: connection refused W0202 07:54:27.359991 6114 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.26.109/api/v1/nodes": dial tcp 35.188.26.109:443: connect: connection refused W0202 07:54:47.363770 6114 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.26.109/api/v1/nodes": net/http: TLS handshake timeout W0202 07:55:07.366608 6114 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.26.109/api/v1/nodes": net/http: TLS handshake timeout W0202 07:55:17.369391 6114 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.26.109/api/v1/nodes": dial tcp 35.188.26.109:443: connect: connection refused W0202 07:55:37.374090 6114 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.26.109/api/v1/nodes": net/http: TLS handshake timeout I0202 07:55:43.608590 5752 boskos.go:86] Sending heartbeat to Boskos W0202 07:55:57.114146 6114 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.26.109/api/v1/nodes": dial tcp 35.188.26.109:443: connect: connection refused - error from a previous attempt: read tcp 10.60.167.245:50844->35.188.26.109:443: read: connection reset by peer W0202 07:56:07.117982 6114 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.26.109/api/v1/nodes": dial tcp 35.188.26.109:443: connect: connection refused W0202 07:56:17.120779 6114 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.26.109/api/v1/nodes": dial tcp 35.188.26.109:443: connect: connection refused W0202 07:56:37.125266 6114 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.26.109/api/v1/nodes": net/http: TLS handshake timeout W0202 07:56:47.128332 6114 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.26.109/api/v1/nodes": dial tcp 35.188.26.109:443: connect: connection refused W0202 07:56:57.133421 6114 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.26.109/api/v1/nodes": dial tcp 35.188.26.109:443: connect: connection refused W0202 07:57:07.136138 6114 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.26.109/api/v1/nodes": dial tcp 35.188.26.109:443: connect: connection refused W0202 07:57:20.148615 6114 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.26.109/api/v1/nodes": dial tcp 35.188.26.109:443: connect: connection refused - error from a previous attempt: read tcp 10.60.167.245:37504->35.188.26.109:443: read: connection reset by peer W0202 07:57:30.154670 6114 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.26.109/api/v1/nodes": dial tcp 35.188.26.109:443: connect: connection refused I0202 07:57:40.538572 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-c ControlPlane e2-standard-2 1 1 us-central1 ... skipping 10 lines ... KIND NAME MESSAGE Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-cvm-1-6-mstr-ctl-skew/zones/us-central1-a/instances/nodes-us-central1-a-t911 machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-cvm-1-6-mstr-ctl-skew/zones/us-central1-a/instances/nodes-us-central1-a-t911" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-cvm-1-6-mstr-ctl-skew/zones/us-central1-c/instances/control-plane-us-central1-c-wt5g machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-cvm-1-6-mstr-ctl-skew/zones/us-central1-c/instances/control-plane-us-central1-c-wt5g" has not yet joined cluster Node control-plane-us-central1-a-srq4 node "control-plane-us-central1-a-srq4" of role "control-plane" is not ready Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Validation Failed W0202 07:57:41.536989 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 07:57:51.984107 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 12 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-cvm-1-6-mstr-ctl-skew/zones/us-central1-a/instances/nodes-us-central1-a-t911 machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-cvm-1-6-mstr-ctl-skew/zones/us-central1-a/instances/nodes-us-central1-a-t911" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-cvm-1-6-mstr-ctl-skew/zones/us-central1-c/instances/control-plane-us-central1-c-wt5g machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-cvm-1-6-mstr-ctl-skew/zones/us-central1-c/instances/control-plane-us-central1-c-wt5g" has not yet joined cluster Node control-plane-us-central1-a-srq4 node "control-plane-us-central1-a-srq4" of role "control-plane" is not ready Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-a-srq4 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-srq4" is not ready (kube-controller-manager) Validation Failed W0202 07:57:52.872293 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 07:58:03.253457 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 13 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-cvm-1-6-mstr-ctl-skew/zones/us-central1-c/instances/control-plane-us-central1-c-wt5g machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-cvm-1-6-mstr-ctl-skew/zones/us-central1-c/instances/control-plane-us-central1-c-wt5g" has not yet joined cluster Node control-plane-us-central1-a-srq4 node "control-plane-us-central1-a-srq4" of role "control-plane" is not ready Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Pod kube-system/etcd-manager-main-control-plane-us-central1-a-srq4 system-cluster-critical pod "etcd-manager-main-control-plane-us-central1-a-srq4" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-a-srq4 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-srq4" is not ready (kube-controller-manager) Validation Failed W0202 07:58:04.144033 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 07:58:14.490849 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 13 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-cvm-1-6-mstr-ctl-skew/zones/us-central1-a/instances/nodes-us-central1-a-t911 machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-cvm-1-6-mstr-ctl-skew/zones/us-central1-a/instances/nodes-us-central1-a-t911" has not yet joined cluster Node control-plane-us-central1-a-srq4 node "control-plane-us-central1-a-srq4" of role "control-plane" is not ready Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-a-srq4 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-srq4" is not ready (kube-controller-manager) Validation Failed W0202 07:58:15.378694 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 07:58:25.918423 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 24 lines ... Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Pod kube-system/etcd-manager-events-control-plane-us-central1-b-1p0h system-cluster-critical pod "etcd-manager-events-control-plane-us-central1-b-1p0h" is pending Pod kube-system/kops-controller-bt6hd system-cluster-critical pod "kops-controller-bt6hd" is pending Pod kube-system/kops-controller-crmqp system-cluster-critical pod "kops-controller-crmqp" is pending Pod kube-system/kube-scheduler-control-plane-us-central1-a-srq4 system-cluster-critical pod "kube-scheduler-control-plane-us-central1-a-srq4" is pending Validation Failed W0202 07:58:26.778217 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 07:58:37.185231 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 20 lines ... Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Pod kube-system/kube-apiserver-control-plane-us-central1-b-1p0h system-cluster-critical pod "kube-apiserver-control-plane-us-central1-b-1p0h" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-c-wt5g system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-wt5g" is pending Validation Failed W0202 07:58:38.099623 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 07:58:48.483963 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 20 lines ... Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-c-wt5g system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-wt5g" is not ready (kube-controller-manager) Pod kube-system/kube-scheduler-control-plane-us-central1-c-wt5g system-cluster-critical pod "kube-scheduler-control-plane-us-central1-c-wt5g" is pending Validation Failed W0202 07:58:49.303499 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 07:58:59.649939 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 18 lines ... Pod kube-system/cilium-g7sww system-node-critical pod "cilium-g7sww" is not ready (cilium-agent) Pod kube-system/cilium-vbf5g system-node-critical pod "cilium-vbf5g" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 07:59:00.517257 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 07:59:10.820696 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/cilium-g7sww system-node-critical pod "cilium-g7sww" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 07:59:11.656140 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 07:59:22.071701 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-1p0h system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-1p0h" is pending Validation Failed W0202 07:59:23.007285 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 07:59:33.318928 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 07:59:34.262229 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 07:59:44.554187 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 07:59:45.397101 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 07:59:55.804258 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 07:59:56.743084 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:00:07.085139 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:00:07.889434 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:00:18.308671 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:00:19.213478 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:00:29.507181 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:00:30.309801 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:00:40.638642 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:00:41.469189 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:00:43.619250 5752 boskos.go:86] Sending heartbeat to Boskos I0202 08:00:51.862867 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:00:52.699470 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:01:03.077236 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:01:03.938599 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:01:14.279918 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:01:15.212484 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:01:25.634568 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:01:26.532399 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:01:36.900017 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:01:37.754343 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:01:48.064768 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:01:48.929768 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:01:59.268824 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:02:00.114204 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:02:10.466877 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:02:11.365327 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:02:21.676775 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:02:22.546595 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:02:32.875747 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:02:33.788604 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:02:44.127915 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:02:44.956276 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:02:55.368742 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:02:56.220943 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:03:06.565613 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:03:07.437697 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:03:17.767549 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:03:18.624138 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:03:28.923326 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:03:29.763746 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:03:40.152078 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:03:40.996212 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:03:51.425425 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:03:52.236166 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:04:02.656527 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:04:03.524082 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:04:13.893328 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:04:14.669392 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:04:25.030988 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:04:25.833813 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:04:36.167982 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:04:37.036791 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:04:47.443261 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:04:48.357623 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:04:58.712069 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:04:59.652813 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:05:10.072699 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:05:10.914480 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:05:21.297854 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:05:22.100092 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:05:32.422258 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:05:33.223214 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:05:43.572667 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] I0202 08:05:43.629255 5752 boskos.go:86] Sending heartbeat to Boskos INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:05:44.333204 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:05:54.688694 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:05:55.477766 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:06:05.854158 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:06:06.734022 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:06:17.061051 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:06:17.879882 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:06:28.269798 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:06:29.179261 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:06:39.573238 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:06:40.506951 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:06:50.874165 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:06:51.763488 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:07:02.124851 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:07:03.060430 6114 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 08:07:13.424255 6114 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-1p0h node "control-plane-us-central1-b-1p0h" of role "control-plane" is not ready Node control-plane-us-central1-c-wt5g node "control-plane-us-central1-c-wt5g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-zn4kd system-cluster-critical pod "coredns-5d479c4f64-zn4kd" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-mm9jr system-cluster-critical pod "coredns-autoscaler-557ccb4c66-mm9jr" is pending Pod kube-system/dns-controller-6f69f47785-4w8mn system-cluster-critical pod "dns-controller-6f69f47785-4w8mn" is pending Validation Failed W0202 08:07:14.270144 6114 validate_cluster.go:232] (will retry): cluster not yet healthy Error: validation failed: wait time exceeded during validation I0202 08:07:24.276867 5752 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/08b7df1f-a2ce-11ed-8c0a-1250e2f4dc61/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh3114457135/key --ssh-user prow I0202 08:07:24.276906 5752 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/08b7df1f-a2ce-11ed-8c0a-1250e2f4dc61/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh3114457135/key --ssh-user prow I0202 08:07:24.764231 6124 gce.go:99] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] 2023/02/02 08:07:29 Dumping node control-plane-us-central1-a-srq4 2023/02/02 08:07:33 error dumping node control-plane-us-central1-a-srq4: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/02/02 08:07:33 error dumping node control-plane-us-central1-a-srq4: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/02/02 08:07:33 Dumping node control-plane-us-central1-b-1p0h 2023/02/02 08:07:38 error dumping node control-plane-us-central1-b-1p0h: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/02/02 08:07:38 error dumping node control-plane-us-central1-b-1p0h: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/02/02 08:07:38 Dumping node control-plane-us-central1-c-wt5g 2023/02/02 08:07:42 error dumping node control-plane-us-central1-c-wt5g: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/02/02 08:07:42 error dumping node control-plane-us-central1-c-wt5g: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/02/02 08:07:42 dumping node not registered in kubernetes: 35.226.118.71 2023/02/02 08:07:42 Dumping node 35.226.118.71 I0202 08:07:44.344392 5752 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/08b7df1f-a2ce-11ed-8c0a-1250e2f4dc61/kops get cluster --name ha-migration.k8s.local -o yaml I0202 08:07:44.344444 5752 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/08b7df1f-a2ce-11ed-8c0a-1250e2f4dc61/kops get cluster --name ha-migration.k8s.local -o yaml I0202 08:07:44.507835 5752 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/08b7df1f-a2ce-11ed-8c0a-1250e2f4dc61/kops get instancegroups --name ha-migration.k8s.local -o yaml I0202 08:07:44.507869 5752 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/08b7df1f-a2ce-11ed-8c0a-1250e2f4dc61/kops get instancegroups --name ha-migration.k8s.local -o yaml ... skipping 167 lines ... Deleted cluster: "ha-migration.k8s.local" I0202 08:10:07.370403 5752 gcs.go:88] gsutil -u k8s-gce-cvm-1-6-mstr-ctl-skew rm -r gs://k8s-gce-cvm-1-6-mstr-ctl-skew-state-08 I0202 08:10:07.370473 5752 local.go:42] ⚙️ gsutil -u k8s-gce-cvm-1-6-mstr-ctl-skew rm -r gs://k8s-gce-cvm-1-6-mstr-ctl-skew-state-08 Removing gs://k8s-gce-cvm-1-6-mstr-ctl-skew-state-08/... I0202 08:10:10.496948 5752 down.go:62] releasing boskos project I0202 08:10:10.504778 5752 boskos.go:83] Boskos heartbeat func received signal to close Error: exit status 1 + EXIT_VALUE=1 + set +o xtrace