e2e-kops-gce-leader-migration #1620826474284060672
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 1 failed / 1 succeeded |
| Started | |
| Elapsed | 20m29s |
| Revision | master |
exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
kubetest2 Down
... skipping 156 lines ... .........................................Updated [https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-master-slow]. ..done. WARNING: No host aliases were added to your SSH configs because you do not have any running instances. Try running this command again after running some instances. I0201 16:50:36.625005 5759 up.go:44] Cleaning up any leaked resources from previous cluster I0201 16:50:36.625163 5759 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/47545d87-a250-11ed-9efc-5e7820dba16b/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh666739224/key --ssh-user prow I0201 16:50:36.625183 5759 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/47545d87-a250-11ed-9efc-5e7820dba16b/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh666739224/key --ssh-user prow Error: Cluster.kops.k8s.io "ha-migration.k8s.local" not found W0201 16:50:36.870794 5759 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1 I0201 16:50:36.870849 5759 down.go:48] /home/prow/go/src/k8s.io/kops/_rundir/47545d87-a250-11ed-9efc-5e7820dba16b/kops delete cluster --name ha-migration.k8s.local --yes I0201 16:50:36.870860 5759 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/47545d87-a250-11ed-9efc-5e7820dba16b/kops delete cluster --name ha-migration.k8s.local --yes Error: error reading cluster configuration: Cluster.kops.k8s.io "ha-migration.k8s.local" not found I0201 16:50:36.997149 5759 gcs.go:51] gsutil ls -b -p e2e-gce-gci-ci-master-slow gs://e2e-gce-gci-ci-master-slow-state-47 I0201 16:50:36.997180 5759 local.go:42] ⚙️ gsutil ls -b -p e2e-gce-gci-ci-master-slow gs://e2e-gce-gci-ci-master-slow-state-47 I0201 16:50:38.962504 5759 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip 2023/02/01 16:50:38 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404 I0201 16:50:38.979131 5759 http.go:37] curl https://ip.jsb.workers.dev I0201 16:50:39.039771 5759 up.go:167] /home/prow/go/src/k8s.io/kops/_rundir/47545d87-a250-11ed-9efc-5e7820dba16b/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh666739224/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 34.70.192.226/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project e2e-gce-gci-ci-master-slow I0201 16:50:39.039809 5759 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/47545d87-a250-11ed-9efc-5e7820dba16b/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh666739224/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 34.70.192.226/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project e2e-gce-gci-ci-master-slow I0201 16:50:39.086026 5945 create_cluster.go:882] Using SSH public key: /tmp/kops-ssh666739224/key.pub I0201 16:50:39.218743 5945 new_cluster.go:573] VMs will be configured to use specified Service Account: default I0201 16:50:39.218872 5945 new_cluster.go:1339] Cloud Provider ID: "gce" ... skipping 527 lines ... I0201 16:50:47.385529 5966 keypair.go:226] Issuing new certificate: "etcd-peers-ca-main" I0201 16:50:47.402728 5966 address.go:139] GCE creating address: "api-ha-migration-k8s-local" W0201 16:50:47.405265 5966 vfs_keystorereader.go:143] CA private key was not found I0201 16:50:47.439690 5966 keypair.go:226] Issuing new certificate: "service-account" I0201 16:50:47.497436 5966 keypair.go:226] Issuing new certificate: "kubernetes-ca" I0201 16:51:00.242645 5966 executor.go:111] Tasks: 50 done / 91 total; 23 can run W0201 16:51:10.083494 5966 executor.go:139] error running task "ForwardingRule/api-ha-migration-k8s-local" (9m50s remaining to succeed): error creating ForwardingRule "api-ha-migration-k8s-local": googleapi: Error 400: The resource 'projects/e2e-gce-gci-ci-master-slow/regions/us-central1/targetPools/api-ha-migration-k8s-local' is not ready, resourceNotReady I0201 16:51:10.083574 5966 executor.go:111] Tasks: 72 done / 91 total; 13 can run I0201 16:51:23.174150 5966 executor.go:111] Tasks: 85 done / 91 total; 6 can run I0201 16:51:37.046332 5966 executor.go:111] Tasks: 91 done / 91 total; 0 can run I0201 16:51:37.115892 5966 update_cluster.go:323] Exporting kubeconfig for cluster kOps has set your kubectl context to ha-migration.k8s.local ... skipping 7 lines ... * read about installing addons at: https://kops.sigs.k8s.io/addons. I0201 16:51:47.437240 5759 up.go:251] /home/prow/go/src/k8s.io/kops/_rundir/47545d87-a250-11ed-9efc-5e7820dba16b/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s I0201 16:51:47.437304 5759 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/47545d87-a250-11ed-9efc-5e7820dba16b/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s Validating cluster ha-migration.k8s.local W0201 16:52:18.186264 5986 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.173.154.156/api/v1/nodes": dial tcp 34.173.154.156:443: i/o timeout W0201 16:52:43.675739 5986 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.173.154.156/api/v1/nodes": dial tcp 34.173.154.156:443: connect: connection refused W0201 16:52:53.682196 5986 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.173.154.156/api/v1/nodes": dial tcp 34.173.154.156:443: connect: connection refused W0201 16:53:03.685357 5986 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.173.154.156/api/v1/nodes": dial tcp 34.173.154.156:443: connect: connection refused W0201 16:53:13.690687 5986 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.173.154.156/api/v1/nodes": dial tcp 34.173.154.156:443: connect: connection refused W0201 16:53:23.695192 5986 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.173.154.156/api/v1/nodes": dial tcp 34.173.154.156:443: connect: connection refused W0201 16:53:33.703800 5986 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.173.154.156/api/v1/nodes": dial tcp 34.173.154.156:443: connect: connection refused W0201 16:53:43.711204 5986 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.173.154.156/api/v1/nodes": dial tcp 34.173.154.156:443: connect: connection refused W0201 16:53:53.715389 5986 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.173.154.156/api/v1/nodes": dial tcp 34.173.154.156:443: connect: connection refused W0201 16:54:03.718782 5986 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.173.154.156/api/v1/nodes": dial tcp 34.173.154.156:443: connect: connection refused W0201 16:54:13.728157 5986 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.173.154.156/api/v1/nodes": dial tcp 34.173.154.156:443: connect: connection refused W0201 16:54:33.738018 5986 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.173.154.156/api/v1/nodes": net/http: TLS handshake timeout W0201 16:54:43.747106 5986 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.173.154.156/api/v1/nodes": dial tcp 34.173.154.156:443: connect: connection refused W0201 16:54:53.755840 5986 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.173.154.156/api/v1/nodes": dial tcp 34.173.154.156:443: connect: connection refused W0201 16:55:03.760110 5986 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.173.154.156/api/v1/nodes": dial tcp 34.173.154.156:443: connect: connection refused W0201 16:55:23.766785 5986 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.173.154.156/api/v1/nodes": net/http: TLS handshake timeout I0201 16:55:24.604748 5759 boskos.go:86] Sending heartbeat to Boskos W0201 16:55:33.774966 5986 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.173.154.156/api/v1/nodes": dial tcp 34.173.154.156:443: connect: connection refused W0201 16:55:43.784237 5986 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.173.154.156/api/v1/nodes": dial tcp 34.173.154.156:443: connect: connection refused W0201 16:55:58.724150 5986 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.173.154.156/api/v1/nodes": dial tcp 34.173.154.156:443: connect: connection refused - error from a previous attempt: read tcp 10.60.172.117:37586->34.173.154.156:443: read: connection reset by peer W0201 16:56:18.729382 5986 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.173.154.156/api/v1/nodes": net/http: TLS handshake timeout W0201 16:56:42.738452 5986 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.173.154.156/api/v1/nodes": net/http: TLS handshake timeout - error from a previous attempt: read tcp 10.60.172.117:38942->34.173.154.156:443: read: connection reset by peer W0201 16:56:52.741713 5986 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.173.154.156/api/v1/nodes": dial tcp 34.173.154.156:443: connect: connection refused W0201 16:57:02.749532 5986 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.173.154.156/api/v1/nodes": dial tcp 34.173.154.156:443: connect: connection refused W0201 16:57:22.757687 5986 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.173.154.156/api/v1/nodes": net/http: TLS handshake timeout I0201 16:57:33.211395 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-c ControlPlane e2-standard-2 1 1 us-central1 ... skipping 11 lines ... Machine https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-master-slow/zones/us-central1-a/instances/nodes-us-central1-a-937k machine "https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-master-slow/zones/us-central1-a/instances/nodes-us-central1-a-937k" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-master-slow/zones/us-central1-c/instances/control-plane-us-central1-c-g8f0 machine "https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-master-slow/zones/us-central1-c/instances/control-plane-us-central1-c-g8f0" has not yet joined cluster Node control-plane-us-central1-a-wbhv node "control-plane-us-central1-a-wbhv" of role "control-plane" is not ready Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-b-7v75 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-7v75" is pending Validation Failed W0201 16:57:34.164921 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 16:57:44.522781 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 14 lines ... Node control-plane-us-central1-a-wbhv node "control-plane-us-central1-a-wbhv" of role "control-plane" is not ready Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-a-wbhv system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-wbhv" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-7v75 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-7v75" is not ready (kube-controller-manager) Pod kube-system/kube-scheduler-control-plane-us-central1-a-wbhv system-cluster-critical pod "kube-scheduler-control-plane-us-central1-a-wbhv" is pending Validation Failed W0201 16:57:45.386577 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 16:57:55.792512 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 13 lines ... Machine https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-master-slow/zones/us-central1-c/instances/control-plane-us-central1-c-g8f0 machine "https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-master-slow/zones/us-central1-c/instances/control-plane-us-central1-c-g8f0" has not yet joined cluster Node control-plane-us-central1-a-wbhv node "control-plane-us-central1-a-wbhv" of role "control-plane" is not ready Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-a-wbhv system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-wbhv" is not ready (kube-controller-manager) Pod kube-system/kube-controller-manager-control-plane-us-central1-b-7v75 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-7v75" is not ready (kube-controller-manager) Validation Failed W0201 16:57:56.693190 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 16:58:07.004318 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 13 lines ... Machine https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-master-slow/zones/us-central1-c/instances/control-plane-us-central1-c-g8f0 machine "https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-master-slow/zones/us-central1-c/instances/control-plane-us-central1-c-g8f0" has not yet joined cluster Node control-plane-us-central1-a-wbhv node "control-plane-us-central1-a-wbhv" of role "control-plane" is not ready Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-a-wbhv system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-wbhv" is not ready (kube-controller-manager) Pod kube-system/kube-controller-manager-control-plane-us-central1-b-7v75 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-7v75" is not ready (kube-controller-manager) Validation Failed W0201 16:58:07.900374 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 16:58:18.228059 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/etcd-manager-events-control-plane-us-central1-a-wbhv system-cluster-critical pod "etcd-manager-events-control-plane-us-central1-a-wbhv" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-a-wbhv system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-wbhv" is not ready (kube-controller-manager) Pod kube-system/kube-controller-manager-control-plane-us-central1-b-7v75 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-7v75" is not ready (kube-controller-manager) Validation Failed W0201 16:58:19.130226 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 16:58:29.477461 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 14 lines ... Node control-plane-us-central1-a-wbhv node "control-plane-us-central1-a-wbhv" of role "control-plane" is not ready Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-a-wbhv system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-wbhv" is not ready (kube-controller-manager) Pod kube-system/kube-controller-manager-control-plane-us-central1-b-7v75 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-7v75" is not ready (kube-controller-manager) Validation Failed W0201 16:58:30.310557 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 16:58:40.687580 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 14 lines ... Node control-plane-us-central1-a-wbhv node "control-plane-us-central1-a-wbhv" of role "control-plane" is not ready Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-a-wbhv system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-wbhv" is not ready (kube-controller-manager) Pod kube-system/kube-controller-manager-control-plane-us-central1-b-7v75 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-7v75" is not ready (kube-controller-manager) Validation Failed W0201 16:58:41.566541 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 16:58:51.853027 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 13 lines ... Machine https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-master-slow/zones/us-central1-a/instances/nodes-us-central1-a-937k machine "https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-master-slow/zones/us-central1-a/instances/nodes-us-central1-a-937k" has not yet joined cluster Node control-plane-us-central1-a-wbhv node "control-plane-us-central1-a-wbhv" of role "control-plane" is not ready Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-b-7v75 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-7v75" is not ready (kube-controller-manager) Validation Failed W0201 16:58:52.748539 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 16:59:03.121281 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/etcd-manager-events-control-plane-us-central1-c-g8f0 system-cluster-critical pod "etcd-manager-events-control-plane-us-central1-c-g8f0" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-7v75 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-7v75" is not ready (kube-controller-manager) Pod kube-system/kube-controller-manager-control-plane-us-central1-c-g8f0 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-g8f0" is not ready (kube-controller-manager) Validation Failed W0201 16:59:03.896185 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 16:59:14.211111 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 21 lines ... Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-7v75 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-7v75" is not ready (kube-controller-manager) Pod kube-system/kube-controller-manager-control-plane-us-central1-c-g8f0 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-g8f0" is not ready (kube-controller-manager) Validation Failed W0201 16:59:15.074278 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 16:59:25.429645 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 22 lines ... Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Pod kube-system/kube-apiserver-control-plane-us-central1-c-g8f0 system-cluster-critical pod "kube-apiserver-control-plane-us-central1-c-g8f0" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-7v75 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-7v75" is not ready (kube-controller-manager) Pod kube-system/kube-controller-manager-control-plane-us-central1-c-g8f0 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-g8f0" is not ready (kube-controller-manager) Validation Failed W0201 16:59:26.349765 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 16:59:36.726601 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 20 lines ... Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-7v75 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-7v75" is not ready (kube-controller-manager) Pod kube-system/kube-controller-manager-control-plane-us-central1-c-g8f0 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-g8f0" is not ready (kube-controller-manager) Validation Failed W0201 16:59:37.557995 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 16:59:47.893893 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 18 lines ... Pod kube-system/cilium-frqwn system-node-critical pod "cilium-frqwn" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-7v75 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-7v75" is not ready (kube-controller-manager) Validation Failed W0201 16:59:48.809339 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 16:59:59.168945 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 17 lines ... Pod kube-system/cilium-6z7sh system-node-critical pod "cilium-6z7sh" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-7v75 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-7v75" is not ready (kube-controller-manager) Validation Failed W0201 17:00:00.066998 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:00:10.389390 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:00:11.219771 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:00:21.566050 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:00:22.413345 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:00:24.616079 5759 boskos.go:86] Sending heartbeat to Boskos I0201 17:00:32.755809 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:00:33.579326 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:00:43.928963 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:00:44.820864 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:00:55.130101 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:00:55.975312 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:01:06.266996 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:01:07.115362 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:01:17.555936 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:01:18.500833 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:01:28.837600 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:01:29.709771 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:01:40.029937 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:01:40.876762 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:01:51.283304 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:01:52.132911 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:02:02.609271 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:02:03.466386 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:02:13.813231 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:02:14.646312 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:02:24.957500 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:02:25.818174 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:02:36.131772 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:02:37.064826 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:02:47.406231 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:02:48.270418 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:02:58.704555 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:02:59.468098 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:03:09.787125 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:03:10.682710 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:03:21.023780 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:03:21.903851 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:03:32.209986 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:03:33.018465 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:03:43.351403 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:03:44.170291 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:03:54.471169 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:03:55.277604 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:04:05.667488 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:04:06.438073 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:04:16.890309 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:04:17.696574 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:04:28.121599 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:04:28.925820 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:04:39.285089 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:04:40.164903 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:04:50.635260 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:04:51.528741 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:05:01.876293 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:05:02.709070 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:05:13.162233 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:05:13.998633 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:05:24.330412 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] I0201 17:05:24.629286 5759 boskos.go:86] Sending heartbeat to Boskos INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:05:25.141163 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:05:35.614532 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:05:36.418553 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:05:46.808611 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:05:47.672273 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:05:58.080707 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:05:58.956843 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:06:09.381519 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:06:10.157700 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:06:20.499414 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:06:21.380179 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:06:31.714137 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:06:32.576362 5986 validate_cluster.go:232] (will retry): cluster not yet healthy I0201 17:06:42.962070 5986 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-7v75 node "control-plane-us-central1-b-7v75" of role "control-plane" is not ready Node control-plane-us-central1-c-g8f0 node "control-plane-us-central1-c-g8f0" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-mhxjc system-cluster-critical pod "coredns-5d479c4f64-mhxjc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-m5m9s system-cluster-critical pod "coredns-autoscaler-557ccb4c66-m5m9s" is pending Pod kube-system/dns-controller-6f69f47785-hghd4 system-cluster-critical pod "dns-controller-6f69f47785-hghd4" is pending Validation Failed W0201 17:06:43.867278 5986 validate_cluster.go:232] (will retry): cluster not yet healthy Error: validation failed: wait time exceeded during validation I0201 17:06:53.882760 5759 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/47545d87-a250-11ed-9efc-5e7820dba16b/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh666739224/key --ssh-user prow I0201 17:06:53.882803 5759 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/47545d87-a250-11ed-9efc-5e7820dba16b/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh666739224/key --ssh-user prow I0201 17:06:54.351456 5997 gce.go:99] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] 2023/02/01 17:06:58 Dumping node control-plane-us-central1-a-wbhv 2023/02/01 17:07:03 error dumping node control-plane-us-central1-a-wbhv: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/02/01 17:07:03 error dumping node control-plane-us-central1-a-wbhv: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/02/01 17:07:03 Dumping node control-plane-us-central1-b-7v75 2023/02/01 17:07:07 error dumping node control-plane-us-central1-b-7v75: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/02/01 17:07:07 error dumping node control-plane-us-central1-b-7v75: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/02/01 17:07:07 Dumping node control-plane-us-central1-c-g8f0 2023/02/01 17:07:10 error dumping node control-plane-us-central1-c-g8f0: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/02/01 17:07:10 error dumping node control-plane-us-central1-c-g8f0: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/02/01 17:07:10 dumping node not registered in kubernetes: 34.136.135.97 2023/02/01 17:07:10 Dumping node 34.136.135.97 I0201 17:07:12.471710 5759 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/47545d87-a250-11ed-9efc-5e7820dba16b/kops get cluster --name ha-migration.k8s.local -o yaml I0201 17:07:12.471753 5759 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/47545d87-a250-11ed-9efc-5e7820dba16b/kops get cluster --name ha-migration.k8s.local -o yaml I0201 17:07:12.670691 5759 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/47545d87-a250-11ed-9efc-5e7820dba16b/kops get instancegroups --name ha-migration.k8s.local -o yaml I0201 17:07:12.670751 5759 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/47545d87-a250-11ed-9efc-5e7820dba16b/kops get instancegroups --name ha-migration.k8s.local -o yaml ... skipping 233 lines ... Operation completed over 53 objects. Removing gs://e2e-gce-gci-ci-master-slow-state-47/... I0201 17:09:51.746295 5759 down.go:62] releasing boskos project I0201 17:09:51.756526 5759 boskos.go:83] Boskos heartbeat func received signal to close Error: exit status 1 + EXIT_VALUE=1 + set +o xtrace