e2e-kops-gce-leader-migration #1621188912401616896
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 1 failed / 1 succeeded |
| Started | |
| Elapsed | 20m9s |
| Revision | master |
exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
kubetest2 Down
... skipping 156 lines ... ...................Updated [https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-01]. .done. WARNING: No host aliases were added to your SSH configs because you do not have any running instances. Try running this command again after running some instances. I0202 16:50:45.921405 5743 up.go:44] Cleaning up any leaked resources from previous cluster I0202 16:50:45.921534 5743 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/78e24aea-a319-11ed-8c0a-1250e2f4dc61/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh3453864241/key --ssh-user prow I0202 16:50:45.921551 5743 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/78e24aea-a319-11ed-8c0a-1250e2f4dc61/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh3453864241/key --ssh-user prow Error: Cluster.kops.k8s.io "ha-migration.k8s.local" not found W0202 16:50:46.237633 5743 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1 I0202 16:50:46.237709 5743 down.go:48] /home/prow/go/src/k8s.io/kops/_rundir/78e24aea-a319-11ed-8c0a-1250e2f4dc61/kops delete cluster --name ha-migration.k8s.local --yes I0202 16:50:46.237722 5743 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/78e24aea-a319-11ed-8c0a-1250e2f4dc61/kops delete cluster --name ha-migration.k8s.local --yes Error: error reading cluster configuration: Cluster.kops.k8s.io "ha-migration.k8s.local" not found I0202 16:50:46.425285 5743 gcs.go:51] gsutil ls -b -p k8s-boskos-gce-project-01 gs://k8s-boskos-gce-project-01-state-78 I0202 16:50:46.425336 5743 local.go:42] ⚙️ gsutil ls -b -p k8s-boskos-gce-project-01 gs://k8s-boskos-gce-project-01-state-78 I0202 16:50:48.500694 5743 gcs.go:70] gsutil mb -p k8s-boskos-gce-project-01 gs://k8s-boskos-gce-project-01-state-78 I0202 16:50:48.500742 5743 local.go:42] ⚙️ gsutil mb -p k8s-boskos-gce-project-01 gs://k8s-boskos-gce-project-01-state-78 Creating gs://k8s-boskos-gce-project-01-state-78/... I0202 16:50:51.145769 5743 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip 2023/02/02 16:50:51 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404 I0202 16:50:51.159224 5743 http.go:37] curl https://ip.jsb.workers.dev I0202 16:50:51.256589 5743 up.go:167] /home/prow/go/src/k8s.io/kops/_rundir/78e24aea-a319-11ed-8c0a-1250e2f4dc61/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh3453864241/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 34.132.147.186/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project k8s-boskos-gce-project-01 I0202 16:50:51.256625 5743 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/78e24aea-a319-11ed-8c0a-1250e2f4dc61/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh3453864241/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 34.132.147.186/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project k8s-boskos-gce-project-01 I0202 16:50:51.306838 6063 create_cluster.go:882] Using SSH public key: /tmp/kops-ssh3453864241/key.pub I0202 16:50:51.525473 6063 new_cluster.go:573] VMs will be configured to use specified Service Account: default I0202 16:50:51.525751 6063 new_cluster.go:1339] Cloud Provider ID: "gce" ... skipping 527 lines ... I0202 16:51:03.686408 6083 keypair.go:226] Issuing new certificate: "etcd-peers-ca-events" I0202 16:51:03.687924 6083 keypair.go:226] Issuing new certificate: "apiserver-aggregator-ca" W0202 16:51:03.867581 6083 vfs_keystorereader.go:143] CA private key was not found I0202 16:51:03.981342 6083 keypair.go:226] Issuing new certificate: "service-account" I0202 16:51:03.983862 6083 keypair.go:226] Issuing new certificate: "kubernetes-ca" I0202 16:51:19.337772 6083 executor.go:111] Tasks: 50 done / 91 total; 23 can run W0202 16:51:32.064288 6083 executor.go:139] error running task "ForwardingRule/api-ha-migration-k8s-local" (9m47s remaining to succeed): error creating ForwardingRule "api-ha-migration-k8s-local": googleapi: Error 400: The resource 'projects/k8s-boskos-gce-project-01/regions/us-central1/targetPools/api-ha-migration-k8s-local' is not ready, resourceNotReady I0202 16:51:32.064380 6083 executor.go:111] Tasks: 72 done / 91 total; 13 can run I0202 16:51:38.980344 6083 executor.go:111] Tasks: 85 done / 91 total; 6 can run I0202 16:51:51.855467 6083 executor.go:111] Tasks: 91 done / 91 total; 0 can run I0202 16:51:51.924342 6083 update_cluster.go:323] Exporting kubeconfig for cluster kOps has set your kubectl context to ha-migration.k8s.local ... skipping 7 lines ... * read about installing addons at: https://kops.sigs.k8s.io/addons. I0202 16:52:02.358690 5743 up.go:251] /home/prow/go/src/k8s.io/kops/_rundir/78e24aea-a319-11ed-8c0a-1250e2f4dc61/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s I0202 16:52:02.358745 5743 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/78e24aea-a319-11ed-8c0a-1250e2f4dc61/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s Validating cluster ha-migration.k8s.local W0202 16:52:32.862574 6102 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.106.87/api/v1/nodes": dial tcp 35.193.106.87:443: i/o timeout W0202 16:52:58.324060 6102 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.106.87/api/v1/nodes": dial tcp 35.193.106.87:443: connect: connection refused W0202 16:53:08.327315 6102 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.106.87/api/v1/nodes": dial tcp 35.193.106.87:443: connect: connection refused W0202 16:53:18.330238 6102 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.106.87/api/v1/nodes": dial tcp 35.193.106.87:443: connect: connection refused W0202 16:53:28.339973 6102 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.106.87/api/v1/nodes": dial tcp 35.193.106.87:443: connect: connection refused W0202 16:53:38.343624 6102 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.106.87/api/v1/nodes": dial tcp 35.193.106.87:443: connect: connection refused W0202 16:53:48.351885 6102 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.106.87/api/v1/nodes": dial tcp 35.193.106.87:443: connect: connection refused W0202 16:53:58.360578 6102 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.106.87/api/v1/nodes": dial tcp 35.193.106.87:443: connect: connection refused W0202 16:54:08.368342 6102 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.106.87/api/v1/nodes": dial tcp 35.193.106.87:443: connect: connection refused W0202 16:54:18.371816 6102 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.106.87/api/v1/nodes": dial tcp 35.193.106.87:443: connect: connection refused W0202 16:54:38.380459 6102 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.106.87/api/v1/nodes": net/http: TLS handshake timeout W0202 16:54:56.561688 6102 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.106.87/api/v1/nodes": dial tcp 35.193.106.87:443: connect: connection refused - error from a previous attempt: read tcp 10.60.122.66:57944->35.193.106.87:443: read: connection reset by peer W0202 16:55:19.037398 6102 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.106.87/api/v1/nodes": dial tcp 35.193.106.87:443: connect: connection refused - error from a previous attempt: read tcp 10.60.122.66:48808->35.193.106.87:443: read: connection reset by peer I0202 16:55:38.789112 5743 boskos.go:86] Sending heartbeat to Boskos W0202 16:55:39.044448 6102 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.106.87/api/v1/nodes": net/http: TLS handshake timeout W0202 16:55:49.052663 6102 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.106.87/api/v1/nodes": dial tcp 35.193.106.87:443: connect: connection refused W0202 16:55:59.056276 6102 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.106.87/api/v1/nodes": dial tcp 35.193.106.87:443: connect: connection refused W0202 16:56:09.060487 6102 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.106.87/api/v1/nodes": dial tcp 35.193.106.87:443: connect: connection refused W0202 16:56:36.818093 6102 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.193.106.87/api/v1/nodes": dial tcp 35.193.106.87:443: connect: connection refused - error from a previous attempt: read tcp 10.60.122.66:49002->35.193.106.87:443: read: connection reset by peer I0202 16:56:56.015095 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-c ControlPlane e2-standard-2 1 1 us-central1 ... skipping 8 lines ... KIND NAME MESSAGE Machine https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-01/zones/us-central1-a/instances/control-plane-us-central1-a-bwz4 machine "https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-01/zones/us-central1-a/instances/control-plane-us-central1-a-bwz4" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-01/zones/us-central1-a/instances/nodes-us-central1-a-k372 machine "https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-01/zones/us-central1-a/instances/nodes-us-central1-a-k372" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-01/zones/us-central1-b/instances/control-plane-us-central1-b-3m8d machine "https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-01/zones/us-central1-b/instances/control-plane-us-central1-b-3m8d" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-01/zones/us-central1-c/instances/control-plane-us-central1-c-vpld machine "https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-01/zones/us-central1-c/instances/control-plane-us-central1-c-vpld" has not yet joined cluster Validation Failed W0202 16:56:56.935132 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 16:57:07.240467 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 10 lines ... KIND NAME MESSAGE Machine https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-01/zones/us-central1-a/instances/control-plane-us-central1-a-bwz4 machine "https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-01/zones/us-central1-a/instances/control-plane-us-central1-a-bwz4" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-01/zones/us-central1-a/instances/nodes-us-central1-a-k372 machine "https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-01/zones/us-central1-a/instances/nodes-us-central1-a-k372" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-01/zones/us-central1-c/instances/control-plane-us-central1-c-vpld machine "https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-01/zones/us-central1-c/instances/control-plane-us-central1-c-vpld" has not yet joined cluster Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Validation Failed W0202 16:57:08.150552 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 16:57:18.464756 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 10 lines ... KIND NAME MESSAGE Machine https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-01/zones/us-central1-a/instances/control-plane-us-central1-a-bwz4 machine "https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-01/zones/us-central1-a/instances/control-plane-us-central1-a-bwz4" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-01/zones/us-central1-a/instances/nodes-us-central1-a-k372 machine "https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-01/zones/us-central1-a/instances/nodes-us-central1-a-k372" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-01/zones/us-central1-c/instances/control-plane-us-central1-c-vpld machine "https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-01/zones/us-central1-c/instances/control-plane-us-central1-c-vpld" has not yet joined cluster Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Validation Failed W0202 16:57:19.293422 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 16:57:29.637468 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/etcd-manager-main-control-plane-us-central1-b-3m8d system-cluster-critical pod "etcd-manager-main-control-plane-us-central1-b-3m8d" is pending Pod kube-system/kube-apiserver-control-plane-us-central1-b-3m8d system-cluster-critical pod "kube-apiserver-control-plane-us-central1-b-3m8d" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-3m8d system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-3m8d" is pending Validation Failed W0202 16:57:30.468139 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 16:57:40.879953 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 13 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-01/zones/us-central1-a/instances/nodes-us-central1-a-k372 machine "https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-01/zones/us-central1-a/instances/nodes-us-central1-a-k372" has not yet joined cluster Node control-plane-us-central1-a-bwz4 node "control-plane-us-central1-a-bwz4" of role "control-plane" is not ready Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-b-3m8d system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-3m8d" is not ready (kube-controller-manager) Validation Failed W0202 16:57:41.775170 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 16:57:52.112688 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 13 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-01/zones/us-central1-a/instances/nodes-us-central1-a-k372 machine "https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-01/zones/us-central1-a/instances/nodes-us-central1-a-k372" has not yet joined cluster Node control-plane-us-central1-a-bwz4 node "control-plane-us-central1-a-bwz4" of role "control-plane" is not ready Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-c-vpld system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-vpld" is pending Validation Failed W0202 16:57:52.973122 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 16:58:03.312264 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 21 lines ... Pod kube-system/cilium-s7q4s system-node-critical pod "cilium-s7q4s" is pending Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-c-vpld system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-vpld" is not ready (kube-controller-manager) Validation Failed W0202 16:58:04.160552 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 16:58:14.509996 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 19 lines ... Pod kube-system/cilium-pv6w6 system-node-critical pod "cilium-pv6w6" is pending Pod kube-system/cilium-s7q4s system-node-critical pod "cilium-s7q4s" is pending Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 16:58:15.324930 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 16:58:25.677916 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 18 lines ... Pod kube-system/cilium-pv6w6 system-node-critical pod "cilium-pv6w6" is pending Pod kube-system/cilium-s7q4s system-node-critical pod "cilium-s7q4s" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 16:58:26.492422 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 16:58:36.788556 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 17 lines ... Pod kube-system/cilium-pv6w6 system-node-critical pod "cilium-pv6w6" is not ready (cilium-agent) Pod kube-system/cilium-s7q4s system-node-critical pod "cilium-s7q4s" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 16:58:37.610957 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 16:58:47.979273 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 16:58:49.002542 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 16:58:59.315206 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-a-bwz4 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-bwz4" is pending Validation Failed W0202 16:59:00.124047 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 16:59:10.446394 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 16:59:11.240652 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 16:59:21.653333 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 16:59:22.468025 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 16:59:32.888608 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 16:59:33.706567 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 16:59:44.063826 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 16:59:44.907991 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 16:59:55.201546 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 16:59:56.078070 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:00:06.394938 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:00:07.292617 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:00:17.746662 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:00:18.652665 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:00:29.010785 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:00:29.906436 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:00:38.800559 5743 boskos.go:86] Sending heartbeat to Boskos I0202 17:00:40.288985 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:00:41.215370 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:00:51.666444 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:00:52.469887 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:01:02.887576 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:01:03.736450 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:01:14.043969 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:01:14.894785 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:01:25.243001 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:01:26.113857 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:01:36.402851 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:01:37.183871 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:01:47.515332 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:01:48.355611 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:01:58.647870 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:01:59.512793 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:02:09.779577 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:02:10.668816 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:02:21.080279 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:02:21.966070 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:02:32.273061 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:02:33.113476 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:02:43.427101 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:02:44.267996 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:02:54.612202 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:02:55.449567 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:03:05.792660 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:03:06.664420 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:03:17.081664 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:03:17.873387 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:03:28.173948 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:03:29.073249 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:03:39.506156 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:03:40.350812 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:03:50.729140 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:03:51.581427 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:04:01.951173 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:04:02.765334 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:04:13.110553 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:04:13.981149 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:04:24.282667 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:04:25.084915 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:04:35.421966 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:04:36.247581 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:04:46.624875 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:04:47.482483 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:04:57.766471 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:04:58.588369 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:05:08.960382 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:05:09.791520 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:05:20.115373 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:05:20.905400 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:05:31.246150 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:05:32.075059 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:05:38.812198 5743 boskos.go:86] Sending heartbeat to Boskos I0202 17:05:42.404616 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:05:43.203654 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:05:53.530977 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:05:54.346638 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:06:04.615788 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:06:05.450558 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:06:15.906357 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:06:16.773439 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:06:27.055670 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:06:27.879078 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:06:38.328025 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:06:39.163160 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:06:49.552308 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:06:50.395838 6102 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 17:07:00.773126 6102 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-3m8d node "control-plane-us-central1-b-3m8d" of role "control-plane" is not ready Node control-plane-us-central1-c-vpld node "control-plane-us-central1-c-vpld" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-bgkr7 system-cluster-critical pod "coredns-5d479c4f64-bgkr7" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-v8b26 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-v8b26" is pending Pod kube-system/dns-controller-6f69f47785-rd78c system-cluster-critical pod "dns-controller-6f69f47785-rd78c" is pending Validation Failed W0202 17:07:01.611072 6102 validate_cluster.go:232] (will retry): cluster not yet healthy Error: validation failed: wait time exceeded during validation I0202 17:07:11.630057 5743 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/78e24aea-a319-11ed-8c0a-1250e2f4dc61/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh3453864241/key --ssh-user prow I0202 17:07:11.630103 5743 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/78e24aea-a319-11ed-8c0a-1250e2f4dc61/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh3453864241/key --ssh-user prow I0202 17:07:12.038412 6113 gce.go:99] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] 2023/02/02 17:07:16 Dumping node control-plane-us-central1-a-bwz4 2023/02/02 17:07:21 error dumping node control-plane-us-central1-a-bwz4: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/02/02 17:07:21 error dumping node control-plane-us-central1-a-bwz4: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/02/02 17:07:21 Dumping node control-plane-us-central1-b-3m8d 2023/02/02 17:07:25 error dumping node control-plane-us-central1-b-3m8d: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/02/02 17:07:25 error dumping node control-plane-us-central1-b-3m8d: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/02/02 17:07:25 Dumping node control-plane-us-central1-c-vpld 2023/02/02 17:07:28 error dumping node control-plane-us-central1-c-vpld: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/02/02 17:07:28 error dumping node control-plane-us-central1-c-vpld: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/02/02 17:07:28 dumping node not registered in kubernetes: 34.134.114.21 2023/02/02 17:07:28 Dumping node 34.134.114.21 I0202 17:07:30.595011 5743 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/78e24aea-a319-11ed-8c0a-1250e2f4dc61/kops get cluster --name ha-migration.k8s.local -o yaml I0202 17:07:30.595047 5743 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/78e24aea-a319-11ed-8c0a-1250e2f4dc61/kops get cluster --name ha-migration.k8s.local -o yaml I0202 17:07:30.744253 5743 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/78e24aea-a319-11ed-8c0a-1250e2f4dc61/kops get instancegroups --name ha-migration.k8s.local -o yaml I0202 17:07:30.744300 5743 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/78e24aea-a319-11ed-8c0a-1250e2f4dc61/kops get instancegroups --name ha-migration.k8s.local -o yaml ... skipping 166 lines ... Deleted cluster: "ha-migration.k8s.local" I0202 17:09:42.172312 5743 gcs.go:88] gsutil -u k8s-boskos-gce-project-01 rm -r gs://k8s-boskos-gce-project-01-state-78 I0202 17:09:42.172375 5743 local.go:42] ⚙️ gsutil -u k8s-boskos-gce-project-01 rm -r gs://k8s-boskos-gce-project-01-state-78 Removing gs://k8s-boskos-gce-project-01-state-78/... I0202 17:09:44.734788 5743 down.go:62] releasing boskos project I0202 17:09:44.743807 5743 boskos.go:83] Boskos heartbeat func received signal to close Error: exit status 1 + EXIT_VALUE=1 + set +o xtrace