e2e-kops-gce-leader-migration #1620554590170648576
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 1 failed / 1 succeeded |
| Started | |
| Elapsed | 20m12s |
| Revision | master |
exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
kubetest2 Down
... skipping 156 lines ... ...............Updated [https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-08]. ..done. WARNING: No host aliases were added to your SSH configs because you do not have any running instances. Try running this command again after running some instances. I0131 22:50:32.517634 5734 up.go:44] Cleaning up any leaked resources from previous cluster I0131 22:50:32.517758 5734 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/5a45e80d-a1b9-11ed-9994-daecb65d57ab/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh2478300607/key --ssh-user prow I0131 22:50:32.517773 5734 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/5a45e80d-a1b9-11ed-9994-daecb65d57ab/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh2478300607/key --ssh-user prow Error: Cluster.kops.k8s.io "ha-migration.k8s.local" not found W0131 22:50:32.770150 5734 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1 I0131 22:50:32.770197 5734 down.go:48] /home/prow/go/src/k8s.io/kops/_rundir/5a45e80d-a1b9-11ed-9994-daecb65d57ab/kops delete cluster --name ha-migration.k8s.local --yes I0131 22:50:32.770214 5734 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/5a45e80d-a1b9-11ed-9994-daecb65d57ab/kops delete cluster --name ha-migration.k8s.local --yes Error: error reading cluster configuration: Cluster.kops.k8s.io "ha-migration.k8s.local" not found I0131 22:50:32.976937 5734 gcs.go:51] gsutil ls -b -p k8s-boskos-gce-project-08 gs://k8s-boskos-gce-project-08-state-5a I0131 22:50:32.976989 5734 local.go:42] ⚙️ gsutil ls -b -p k8s-boskos-gce-project-08 gs://k8s-boskos-gce-project-08-state-5a I0131 22:50:34.952659 5734 gcs.go:70] gsutil mb -p k8s-boskos-gce-project-08 gs://k8s-boskos-gce-project-08-state-5a I0131 22:50:34.952708 5734 local.go:42] ⚙️ gsutil mb -p k8s-boskos-gce-project-08 gs://k8s-boskos-gce-project-08-state-5a Creating gs://k8s-boskos-gce-project-08-state-5a/... I0131 22:50:37.471391 5734 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip 2023/01/31 22:50:37 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404 I0131 22:50:37.486946 5734 http.go:37] curl https://ip.jsb.workers.dev I0131 22:50:37.600978 5734 up.go:167] /home/prow/go/src/k8s.io/kops/_rundir/5a45e80d-a1b9-11ed-9994-daecb65d57ab/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh2478300607/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 104.154.31.37/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project k8s-boskos-gce-project-08 I0131 22:50:37.601022 5734 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/5a45e80d-a1b9-11ed-9994-daecb65d57ab/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh2478300607/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 104.154.31.37/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project k8s-boskos-gce-project-08 I0131 22:50:37.654765 6056 create_cluster.go:882] Using SSH public key: /tmp/kops-ssh2478300607/key.pub I0131 22:50:37.936815 6056 new_cluster.go:573] VMs will be configured to use specified Service Account: default I0131 22:50:37.936962 6056 new_cluster.go:1339] Cloud Provider ID: "gce" ... skipping 527 lines ... I0131 22:50:49.781404 6076 keypair.go:226] Issuing new certificate: "etcd-peers-ca-main" I0131 22:50:49.787450 6076 keypair.go:226] Issuing new certificate: "etcd-peers-ca-events" W0131 22:50:49.885455 6076 vfs_keystorereader.go:143] CA private key was not found I0131 22:50:50.075715 6076 keypair.go:226] Issuing new certificate: "kubernetes-ca" I0131 22:50:50.179294 6076 keypair.go:226] Issuing new certificate: "service-account" I0131 22:51:00.928938 6076 executor.go:111] Tasks: 50 done / 91 total; 23 can run W0131 22:51:13.694801 6076 executor.go:139] error running task "ForwardingRule/api-ha-migration-k8s-local" (9m47s remaining to succeed): error creating ForwardingRule "api-ha-migration-k8s-local": googleapi: Error 400: The resource 'projects/k8s-boskos-gce-project-08/regions/us-central1/targetPools/api-ha-migration-k8s-local' is not ready, resourceNotReady I0131 22:51:13.694882 6076 executor.go:111] Tasks: 72 done / 91 total; 13 can run I0131 22:51:23.558098 6076 executor.go:111] Tasks: 85 done / 91 total; 6 can run I0131 22:51:37.718877 6076 executor.go:111] Tasks: 91 done / 91 total; 0 can run I0131 22:51:37.792145 6076 update_cluster.go:323] Exporting kubeconfig for cluster kOps has set your kubectl context to ha-migration.k8s.local ... skipping 7 lines ... * read about installing addons at: https://kops.sigs.k8s.io/addons. I0131 22:51:48.245769 5734 up.go:251] /home/prow/go/src/k8s.io/kops/_rundir/5a45e80d-a1b9-11ed-9994-daecb65d57ab/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s I0131 22:51:48.245823 5734 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/5a45e80d-a1b9-11ed-9994-daecb65d57ab/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s Validating cluster ha-migration.k8s.local W0131 22:52:18.739496 6096 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://173.255.117.246/api/v1/nodes": dial tcp 173.255.117.246:443: i/o timeout W0131 22:52:35.902301 6096 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://173.255.117.246/api/v1/nodes": dial tcp 173.255.117.246:443: connect: connection refused W0131 22:52:45.912170 6096 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://173.255.117.246/api/v1/nodes": dial tcp 173.255.117.246:443: connect: connection refused W0131 22:52:55.915156 6096 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://173.255.117.246/api/v1/nodes": dial tcp 173.255.117.246:443: connect: connection refused W0131 22:53:05.919073 6096 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://173.255.117.246/api/v1/nodes": dial tcp 173.255.117.246:443: connect: connection refused W0131 22:53:15.922029 6096 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://173.255.117.246/api/v1/nodes": dial tcp 173.255.117.246:443: connect: connection refused W0131 22:53:25.931799 6096 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://173.255.117.246/api/v1/nodes": dial tcp 173.255.117.246:443: connect: connection refused W0131 22:53:35.941384 6096 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://173.255.117.246/api/v1/nodes": dial tcp 173.255.117.246:443: connect: connection refused W0131 22:53:45.951539 6096 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://173.255.117.246/api/v1/nodes": dial tcp 173.255.117.246:443: connect: connection refused W0131 22:53:55.956229 6096 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://173.255.117.246/api/v1/nodes": dial tcp 173.255.117.246:443: connect: connection refused W0131 22:54:15.973230 6096 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://173.255.117.246/api/v1/nodes": net/http: TLS handshake timeout W0131 22:54:35.983936 6096 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://173.255.117.246/api/v1/nodes": net/http: TLS handshake timeout W0131 22:55:02.120578 6096 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://173.255.117.246/api/v1/nodes": net/http: TLS handshake timeout - error from a previous attempt: read tcp 10.60.21.37:42922->173.255.117.246:443: read: connection reset by peer I0131 22:55:25.677286 5734 boskos.go:86] Sending heartbeat to Boskos W0131 22:55:27.247489 6096 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://173.255.117.246/api/v1/nodes": dial tcp 173.255.117.246:443: connect: connection refused - error from a previous attempt: read tcp 10.60.21.37:56784->173.255.117.246:443: read: connection reset by peer W0131 22:55:37.260470 6096 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://173.255.117.246/api/v1/nodes": dial tcp 173.255.117.246:443: connect: connection refused W0131 22:55:57.272633 6096 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://173.255.117.246/api/v1/nodes": net/http: TLS handshake timeout W0131 22:56:07.283910 6096 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://173.255.117.246/api/v1/nodes": dial tcp 173.255.117.246:443: connect: connection refused W0131 22:56:17.291021 6096 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://173.255.117.246/api/v1/nodes": dial tcp 173.255.117.246:443: connect: connection refused I0131 22:56:32.372126 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-c ControlPlane e2-standard-2 1 1 us-central1 ... skipping 9 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-08/zones/us-central1-a/instances/control-plane-us-central1-a-lxg6 machine "https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-08/zones/us-central1-a/instances/control-plane-us-central1-a-lxg6" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-08/zones/us-central1-a/instances/nodes-us-central1-a-95zg machine "https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-08/zones/us-central1-a/instances/nodes-us-central1-a-95zg" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-08/zones/us-central1-b/instances/control-plane-us-central1-b-4x3r machine "https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-08/zones/us-central1-b/instances/control-plane-us-central1-b-4x3r" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-08/zones/us-central1-c/instances/control-plane-us-central1-c-49pl machine "https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-08/zones/us-central1-c/instances/control-plane-us-central1-c-49pl" has not yet joined cluster Pod kube-system/kube-controller-manager-control-plane-us-central1-b-4x3r system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-4x3r" is pending Validation Failed W0131 22:56:33.309536 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 22:56:43.783742 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 11 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-08/zones/us-central1-a/instances/control-plane-us-central1-a-lxg6 machine "https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-08/zones/us-central1-a/instances/control-plane-us-central1-a-lxg6" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-08/zones/us-central1-a/instances/nodes-us-central1-a-95zg machine "https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-08/zones/us-central1-a/instances/nodes-us-central1-a-95zg" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-08/zones/us-central1-c/instances/control-plane-us-central1-c-49pl machine "https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-08/zones/us-central1-c/instances/control-plane-us-central1-c-49pl" has not yet joined cluster Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-b-4x3r system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-4x3r" is not ready (kube-controller-manager) Validation Failed W0131 22:56:44.658886 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 22:56:54.965754 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 13 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-08/zones/us-central1-a/instances/nodes-us-central1-a-95zg machine "https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-08/zones/us-central1-a/instances/nodes-us-central1-a-95zg" has not yet joined cluster Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-b-4x3r system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-4x3r" is not ready (kube-controller-manager) Pod kube-system/kube-scheduler-control-plane-us-central1-b-4x3r system-cluster-critical pod "kube-scheduler-control-plane-us-central1-b-4x3r" is pending Validation Failed W0131 22:56:55.843225 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 22:57:06.264995 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 13 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-08/zones/us-central1-a/instances/nodes-us-central1-a-95zg machine "https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-08/zones/us-central1-a/instances/nodes-us-central1-a-95zg" has not yet joined cluster Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/etcd-manager-events-control-plane-us-central1-b-4x3r system-cluster-critical pod "etcd-manager-events-control-plane-us-central1-b-4x3r" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-4x3r system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-4x3r" is not ready (kube-controller-manager) Validation Failed W0131 22:57:07.196981 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 22:57:17.519950 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 13 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-08/zones/us-central1-a/instances/nodes-us-central1-a-95zg machine "https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-08/zones/us-central1-a/instances/nodes-us-central1-a-95zg" has not yet joined cluster Node control-plane-us-central1-a-lxg6 node "control-plane-us-central1-a-lxg6" of role "control-plane" is not ready Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-b-4x3r system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-4x3r" is not ready (kube-controller-manager) Validation Failed W0131 22:57:18.372601 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 22:57:28.734934 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 13 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-08/zones/us-central1-a/instances/nodes-us-central1-a-95zg machine "https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-08/zones/us-central1-a/instances/nodes-us-central1-a-95zg" has not yet joined cluster Node control-plane-us-central1-a-lxg6 node "control-plane-us-central1-a-lxg6" of role "control-plane" is not ready Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-b-4x3r system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-4x3r" is not ready (kube-controller-manager) Validation Failed W0131 22:57:29.572893 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 22:57:39.950035 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 13 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-08/zones/us-central1-a/instances/nodes-us-central1-a-95zg machine "https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-08/zones/us-central1-a/instances/nodes-us-central1-a-95zg" has not yet joined cluster Node control-plane-us-central1-a-lxg6 node "control-plane-us-central1-a-lxg6" of role "control-plane" is not ready Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/kube-apiserver-control-plane-us-central1-b-4x3r system-cluster-critical pod "kube-apiserver-control-plane-us-central1-b-4x3r" is pending Validation Failed W0131 22:57:40.822898 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 22:57:51.119978 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 18 lines ... Pod kube-system/cilium-kd6dt system-node-critical pod "cilium-kd6dt" is pending Pod kube-system/cilium-m4x82 system-node-critical pod "cilium-m4x82" is pending Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 22:57:52.013900 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 22:58:02.382900 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 21 lines ... Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Pod kube-system/etcd-manager-events-control-plane-us-central1-c-49pl system-cluster-critical pod "etcd-manager-events-control-plane-us-central1-c-49pl" is pending Pod kube-system/kube-apiserver-control-plane-us-central1-c-49pl system-cluster-critical pod "kube-apiserver-control-plane-us-central1-c-49pl" is pending Pod kube-system/kube-scheduler-control-plane-us-central1-a-lxg6 system-cluster-critical pod "kube-scheduler-control-plane-us-central1-a-lxg6" is pending Validation Failed W0131 22:58:03.283457 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 22:58:13.611102 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 18 lines ... Pod kube-system/cilium-kd6dt system-node-critical pod "cilium-kd6dt" is not ready (cilium-agent) Pod kube-system/cilium-m4x82 system-node-critical pod "cilium-m4x82" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 22:58:14.427766 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 22:58:24.811340 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/cilium-kd6dt system-node-critical pod "cilium-kd6dt" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 22:58:25.626123 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 22:58:36.020820 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 22:58:36.917626 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 22:58:47.280214 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 22:58:48.105613 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 22:58:58.510235 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 22:58:59.401906 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 22:59:09.723072 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 22:59:10.563810 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 22:59:20.922550 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 22:59:21.777376 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 22:59:32.191878 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 22:59:33.023518 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 22:59:43.393482 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 22:59:44.246342 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 22:59:54.642126 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 22:59:55.527673 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:00:05.882090 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:00:06.695834 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:00:17.209421 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:00:18.075439 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:00:25.686586 5734 boskos.go:86] Sending heartbeat to Boskos I0131 23:00:28.537582 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:00:29.369792 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:00:39.703111 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:00:40.599545 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:00:51.048127 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:00:51.872016 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:01:02.183810 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:01:03.018243 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:01:13.363422 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:01:14.194825 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:01:24.494726 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:01:25.337029 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:01:35.738940 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:01:36.627585 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:01:46.953239 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:01:47.816725 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:01:58.138509 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:01:58.944184 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:02:09.283225 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:02:10.107331 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:02:20.440187 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:02:21.335284 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:02:31.707832 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:02:32.618931 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:02:43.046006 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:02:43.937424 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:02:54.359882 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:02:55.128328 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:03:05.451210 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:03:06.337676 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:03:16.643204 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:03:17.583774 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:03:27.912338 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:03:28.752893 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:03:39.074729 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:03:39.893345 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:03:50.279647 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:03:51.186931 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:04:01.547836 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:04:02.370061 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:04:12.725745 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:04:13.615770 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:04:23.991103 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:04:24.840527 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:04:35.193417 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:04:35.986014 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:04:46.329093 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:04:47.139305 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:04:57.466375 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:04:58.303282 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:05:08.635621 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:05:09.465467 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:05:19.940154 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:05:20.780005 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:05:25.698077 5734 boskos.go:86] Sending heartbeat to Boskos I0131 23:05:31.131953 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:05:31.954435 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:05:42.269744 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:05:43.101448 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:05:53.510087 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:05:54.414784 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:06:04.748901 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:06:05.561773 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:06:16.000485 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:06:16.768504 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:06:27.161289 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:06:27.979379 6096 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 23:06:38.356245 6096 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-4x3r node "control-plane-us-central1-b-4x3r" of role "control-plane" is not ready Node control-plane-us-central1-c-49pl node "control-plane-us-central1-c-49pl" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-kfh6l system-cluster-critical pod "coredns-5d479c4f64-kfh6l" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-clf7m system-cluster-critical pod "coredns-autoscaler-557ccb4c66-clf7m" is pending Pod kube-system/dns-controller-6f69f47785-pqcmw system-cluster-critical pod "dns-controller-6f69f47785-pqcmw" is pending Validation Failed W0131 23:06:39.143004 6096 validate_cluster.go:232] (will retry): cluster not yet healthy Error: validation failed: wait time exceeded during validation I0131 23:06:49.154910 5734 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/5a45e80d-a1b9-11ed-9994-daecb65d57ab/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh2478300607/key --ssh-user prow I0131 23:06:49.154968 5734 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/5a45e80d-a1b9-11ed-9994-daecb65d57ab/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh2478300607/key --ssh-user prow I0131 23:06:49.640439 6106 gce.go:99] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] 2023/01/31 23:06:53 Dumping node control-plane-us-central1-a-lxg6 2023/01/31 23:06:57 error dumping node control-plane-us-central1-a-lxg6: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/31 23:06:57 error dumping node control-plane-us-central1-a-lxg6: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/31 23:06:57 Dumping node control-plane-us-central1-b-4x3r 2023/01/31 23:07:00 error dumping node control-plane-us-central1-b-4x3r: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/31 23:07:00 error dumping node control-plane-us-central1-b-4x3r: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/31 23:07:00 Dumping node control-plane-us-central1-c-49pl 2023/01/31 23:07:03 error dumping node control-plane-us-central1-c-49pl: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/31 23:07:03 error dumping node control-plane-us-central1-c-49pl: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/31 23:07:03 dumping node not registered in kubernetes: 35.239.228.146 2023/01/31 23:07:03 Dumping node 35.239.228.146 I0131 23:07:05.248361 5734 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/5a45e80d-a1b9-11ed-9994-daecb65d57ab/kops get cluster --name ha-migration.k8s.local -o yaml I0131 23:07:05.248398 5734 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/5a45e80d-a1b9-11ed-9994-daecb65d57ab/kops get cluster --name ha-migration.k8s.local -o yaml I0131 23:07:05.418602 5734 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/5a45e80d-a1b9-11ed-9994-daecb65d57ab/kops get instancegroups --name ha-migration.k8s.local -o yaml I0131 23:07:05.418716 5734 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/5a45e80d-a1b9-11ed-9994-daecb65d57ab/kops get instancegroups --name ha-migration.k8s.local -o yaml ... skipping 166 lines ... Deleted cluster: "ha-migration.k8s.local" I0131 23:09:16.285621 5734 gcs.go:88] gsutil -u k8s-boskos-gce-project-08 rm -r gs://k8s-boskos-gce-project-08-state-5a I0131 23:09:16.285671 5734 local.go:42] ⚙️ gsutil -u k8s-boskos-gce-project-08 rm -r gs://k8s-boskos-gce-project-08-state-5a Removing gs://k8s-boskos-gce-project-08-state-5a/... I0131 23:09:18.958003 5734 down.go:62] releasing boskos project I0131 23:09:18.968446 5734 boskos.go:83] Boskos heartbeat func received signal to close Error: exit status 1 + EXIT_VALUE=1 + set +o xtrace