e2e-kops-gce-leader-migration #1620011030794997760
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 1 failed / 1 succeeded |
| Started | |
| Elapsed | 20m13s |
| Revision | master |
exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
kubetest2 Down
... skipping 156 lines ... ..............................Updated [https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-19]. ..done. WARNING: No host aliases were added to your SSH configs because you do not have any running instances. Try running this command again after running some instances. I0130 10:50:21.111083 5766 up.go:44] Cleaning up any leaked resources from previous cluster I0130 10:50:21.111230 5766 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/9dd6a4e7-a08b-11ed-9a0c-f25a29267a91/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh1804452069/key --ssh-user prow I0130 10:50:21.111249 5766 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/9dd6a4e7-a08b-11ed-9a0c-f25a29267a91/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh1804452069/key --ssh-user prow Error: Cluster.kops.k8s.io "ha-migration.k8s.local" not found W0130 10:50:21.363583 5766 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1 I0130 10:50:21.363628 5766 down.go:48] /home/prow/go/src/k8s.io/kops/_rundir/9dd6a4e7-a08b-11ed-9a0c-f25a29267a91/kops delete cluster --name ha-migration.k8s.local --yes I0130 10:50:21.363642 5766 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/9dd6a4e7-a08b-11ed-9a0c-f25a29267a91/kops delete cluster --name ha-migration.k8s.local --yes Error: error reading cluster configuration: Cluster.kops.k8s.io "ha-migration.k8s.local" not found I0130 10:50:21.528027 5766 gcs.go:51] gsutil ls -b -p k8s-boskos-gce-project-19 gs://k8s-boskos-gce-project-19-state-9d I0130 10:50:21.528065 5766 local.go:42] ⚙️ gsutil ls -b -p k8s-boskos-gce-project-19 gs://k8s-boskos-gce-project-19-state-9d I0130 10:50:23.600240 5766 gcs.go:70] gsutil mb -p k8s-boskos-gce-project-19 gs://k8s-boskos-gce-project-19-state-9d I0130 10:50:23.600278 5766 local.go:42] ⚙️ gsutil mb -p k8s-boskos-gce-project-19 gs://k8s-boskos-gce-project-19-state-9d Creating gs://k8s-boskos-gce-project-19-state-9d/... I0130 10:50:26.249398 5766 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip 2023/01/30 10:50:26 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404 I0130 10:50:26.264874 5766 http.go:37] curl https://ip.jsb.workers.dev I0130 10:50:26.358470 5766 up.go:167] /home/prow/go/src/k8s.io/kops/_rundir/9dd6a4e7-a08b-11ed-9a0c-f25a29267a91/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh1804452069/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 34.121.26.144/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project k8s-boskos-gce-project-19 I0130 10:50:26.358502 5766 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/9dd6a4e7-a08b-11ed-9a0c-f25a29267a91/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh1804452069/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 34.121.26.144/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project k8s-boskos-gce-project-19 I0130 10:50:26.408576 6086 create_cluster.go:882] Using SSH public key: /tmp/kops-ssh1804452069/key.pub I0130 10:50:26.642667 6086 new_cluster.go:573] VMs will be configured to use specified Service Account: default I0130 10:50:26.642809 6086 new_cluster.go:1338] Cloud Provider ID: "gce" ... skipping 527 lines ... I0130 10:50:38.993131 6109 keypair.go:226] Issuing new certificate: "etcd-manager-ca-events" I0130 10:50:38.993543 6109 keypair.go:226] Issuing new certificate: "etcd-clients-ca" W0130 10:50:39.179037 6109 vfs_keystorereader.go:143] CA private key was not found I0130 10:50:39.371611 6109 keypair.go:226] Issuing new certificate: "service-account" I0130 10:50:39.476772 6109 keypair.go:226] Issuing new certificate: "kubernetes-ca" I0130 10:50:51.152283 6109 executor.go:111] Tasks: 50 done / 91 total; 23 can run W0130 10:51:01.207920 6109 executor.go:139] error running task "ForwardingRule/api-ha-migration-k8s-local" (9m49s remaining to succeed): error creating ForwardingRule "api-ha-migration-k8s-local": googleapi: Error 400: The resource 'projects/k8s-boskos-gce-project-19/regions/us-central1/targetPools/api-ha-migration-k8s-local' is not ready, resourceNotReady I0130 10:51:01.207995 6109 executor.go:111] Tasks: 72 done / 91 total; 13 can run I0130 10:51:08.074979 6109 executor.go:111] Tasks: 85 done / 91 total; 6 can run I0130 10:51:22.071717 6109 executor.go:111] Tasks: 91 done / 91 total; 0 can run I0130 10:51:22.142115 6109 update_cluster.go:323] Exporting kubeconfig for cluster kOps has set your kubectl context to ha-migration.k8s.local ... skipping 7 lines ... * read about installing addons at: https://kops.sigs.k8s.io/addons. I0130 10:51:32.443912 5766 up.go:251] /home/prow/go/src/k8s.io/kops/_rundir/9dd6a4e7-a08b-11ed-9a0c-f25a29267a91/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s I0130 10:51:32.443982 5766 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/9dd6a4e7-a08b-11ed-9a0c-f25a29267a91/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s Validating cluster ha-migration.k8s.local W0130 10:52:03.019763 6129 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.123.198.34/api/v1/nodes": dial tcp 34.123.198.34:443: i/o timeout W0130 10:52:13.024875 6129 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.123.198.34/api/v1/nodes": dial tcp 34.123.198.34:443: connect: connection refused W0130 10:52:23.029135 6129 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.123.198.34/api/v1/nodes": dial tcp 34.123.198.34:443: connect: connection refused W0130 10:52:33.033555 6129 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.123.198.34/api/v1/nodes": dial tcp 34.123.198.34:443: connect: connection refused W0130 10:52:43.038755 6129 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.123.198.34/api/v1/nodes": dial tcp 34.123.198.34:443: connect: connection refused W0130 10:52:53.041680 6129 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.123.198.34/api/v1/nodes": dial tcp 34.123.198.34:443: connect: connection refused W0130 10:53:03.044923 6129 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.123.198.34/api/v1/nodes": dial tcp 34.123.198.34:443: connect: connection refused W0130 10:53:13.048770 6129 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.123.198.34/api/v1/nodes": dial tcp 34.123.198.34:443: connect: connection refused W0130 10:53:23.055479 6129 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.123.198.34/api/v1/nodes": dial tcp 34.123.198.34:443: connect: connection refused W0130 10:53:43.061537 6129 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.123.198.34/api/v1/nodes": net/http: TLS handshake timeout W0130 10:54:03.067644 6129 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.123.198.34/api/v1/nodes": net/http: TLS handshake timeout W0130 10:54:13.073341 6129 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.123.198.34/api/v1/nodes": dial tcp 34.123.198.34:443: connect: connection refused W0130 10:54:33.077835 6129 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.123.198.34/api/v1/nodes": net/http: TLS handshake timeout W0130 10:54:43.080978 6129 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.123.198.34/api/v1/nodes": dial tcp 34.123.198.34:443: connect: connection refused W0130 10:54:53.084844 6129 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.123.198.34/api/v1/nodes": dial tcp 34.123.198.34:443: connect: connection refused I0130 10:55:11.400371 5766 boskos.go:86] Sending heartbeat to Boskos W0130 10:55:13.088931 6129 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.123.198.34/api/v1/nodes": net/http: TLS handshake timeout W0130 10:55:23.091513 6129 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.123.198.34/api/v1/nodes": dial tcp 34.123.198.34:443: connect: connection refused W0130 10:55:36.728787 6129 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.123.198.34/api/v1/nodes": dial tcp 34.123.198.34:443: connect: connection refused - error from a previous attempt: read tcp 10.60.23.145:55024->34.123.198.34:443: read: connection reset by peer W0130 10:55:46.736477 6129 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.123.198.34/api/v1/nodes": dial tcp 34.123.198.34:443: connect: connection refused W0130 10:55:56.743126 6129 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.123.198.34/api/v1/nodes": dial tcp 34.123.198.34:443: connect: connection refused W0130 10:56:16.750770 6129 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.123.198.34/api/v1/nodes": net/http: TLS handshake timeout I0130 10:56:27.218822 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-c ControlPlane e2-standard-2 1 1 us-central1 ... skipping 11 lines ... KIND NAME MESSAGE Machine https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-19/zones/us-central1-a/instances/nodes-us-central1-a-xtq2 machine "https://www.googleapis.com/compute/v1/projects/k8s-boskos-gce-project-19/zones/us-central1-a/instances/nodes-us-central1-a-xtq2" has not yet joined cluster Node control-plane-us-central1-a-c0lz node "control-plane-us-central1-a-c0lz" of role "control-plane" is not ready Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Validation Failed W0130 10:56:28.210236 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 10:56:38.712427 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-a-c0lz system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-c0lz" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-c-9x4g system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-9x4g" is not ready (kube-controller-manager) Pod kube-system/kube-scheduler-control-plane-us-central1-c-9x4g system-cluster-critical pod "kube-scheduler-control-plane-us-central1-c-9x4g" is pending Validation Failed W0130 10:56:39.513597 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 10:56:49.965994 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 14 lines ... Node control-plane-us-central1-a-c0lz node "control-plane-us-central1-a-c0lz" of role "control-plane" is not ready Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/etcd-manager-main-control-plane-us-central1-c-9x4g system-cluster-critical pod "etcd-manager-main-control-plane-us-central1-c-9x4g" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-c-9x4g system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-9x4g" is not ready (kube-controller-manager) Validation Failed W0130 10:56:50.810881 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 10:57:01.318751 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 24 lines ... Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Pod kube-system/kops-controller-5qmwm system-cluster-critical pod "kops-controller-5qmwm" is pending Pod kube-system/kops-controller-782lt system-cluster-critical pod "kops-controller-782lt" is pending Pod kube-system/kops-controller-x6hl5 system-cluster-critical pod "kops-controller-x6hl5" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-c-9x4g system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-9x4g" is not ready (kube-controller-manager) Validation Failed W0130 10:57:02.104595 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 10:57:12.490599 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 24 lines ... Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Pod kube-system/etcd-manager-events-control-plane-us-central1-a-c0lz system-cluster-critical pod "etcd-manager-events-control-plane-us-central1-a-c0lz" is pending Pod kube-system/kops-controller-x6hl5 system-cluster-critical pod "kops-controller-x6hl5" is pending Pod kube-system/kube-apiserver-control-plane-us-central1-c-9x4g system-cluster-critical pod "kube-apiserver-control-plane-us-central1-c-9x4g" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-c-9x4g system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-9x4g" is not ready (kube-controller-manager) Validation Failed W0130 10:57:13.353570 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 10:57:23.852370 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 21 lines ... Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-ksj3 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-ksj3" is not ready (kube-controller-manager) Pod kube-system/kube-scheduler-control-plane-us-central1-a-c0lz system-cluster-critical pod "kube-scheduler-control-plane-us-central1-a-c0lz" is pending Validation Failed W0130 10:57:24.755203 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 10:57:35.226443 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 20 lines ... Pod kube-system/cilium-xk92m system-node-critical pod "cilium-xk92m" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-ksj3 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-ksj3" is not ready (kube-controller-manager) Validation Failed W0130 10:57:36.094469 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 10:57:46.497826 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 17 lines ... Pod kube-system/cilium-mwwgz system-node-critical pod "cilium-mwwgz" is not ready (cilium-agent) Pod kube-system/cilium-stbxq system-node-critical pod "cilium-stbxq" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 10:57:47.412784 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 10:57:57.827709 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/cilium-mwwgz system-node-critical pod "cilium-mwwgz" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 10:57:58.654211 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 10:58:09.108263 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 10:58:09.932523 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 10:58:20.344419 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 10:58:21.142566 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 10:58:31.579371 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 10:58:32.391271 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 10:58:42.809215 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 10:58:43.678585 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 10:58:54.071367 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 10:58:54.967212 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 10:59:05.380529 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 10:59:06.178939 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 10:59:16.593654 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 10:59:17.529461 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 10:59:27.967251 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 10:59:28.801771 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 10:59:39.255108 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 10:59:40.100373 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 10:59:50.523784 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 10:59:51.334743 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:00:01.765174 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:00:02.652510 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:00:11.412044 5766 boskos.go:86] Sending heartbeat to Boskos I0130 11:00:13.116743 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:00:14.004048 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:00:24.432559 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:00:25.346107 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:00:35.822589 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:00:36.746216 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:00:47.173098 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:00:47.994432 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:00:58.436881 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:00:59.210598 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:01:09.692335 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:01:10.514942 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:01:20.956852 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:01:21.766432 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:01:32.222201 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:01:33.046596 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:01:43.474512 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:01:44.337649 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:01:54.792867 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:01:55.591500 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:02:06.058098 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:02:06.916863 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:02:17.361847 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:02:18.188263 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:02:28.611962 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:02:29.580687 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:02:40.026989 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:02:40.847542 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:02:51.277207 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:02:52.188583 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:03:02.599128 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:03:03.385472 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:03:13.858992 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:03:14.652175 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:03:25.069309 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:03:25.942622 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:03:36.345696 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:03:37.163434 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:03:47.628346 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:03:48.645768 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:03:59.136779 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:03:59.941775 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:04:10.418046 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:04:11.296876 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:04:21.819936 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:04:22.680817 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:04:33.179780 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:04:34.180677 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:04:44.656342 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:04:45.531625 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:04:55.970848 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:04:56.833479 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:05:07.246755 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:05:08.121096 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:05:11.422746 5766 boskos.go:86] Sending heartbeat to Boskos I0130 11:05:18.605979 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:05:19.428674 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:05:29.912070 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:05:30.808883 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:05:41.294127 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:05:42.101277 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:05:52.527200 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:05:53.387693 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:06:03.825007 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:06:04.611577 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:06:15.043387 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:06:15.861041 6129 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 11:06:26.319735 6129 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-ksj3 node "control-plane-us-central1-b-ksj3" of role "control-plane" is not ready Node control-plane-us-central1-c-9x4g node "control-plane-us-central1-c-9x4g" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-dxtbc system-cluster-critical pod "coredns-5d479c4f64-dxtbc" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-g7jbc system-cluster-critical pod "coredns-autoscaler-557ccb4c66-g7jbc" is pending Pod kube-system/dns-controller-6f69f47785-7vf6m system-cluster-critical pod "dns-controller-6f69f47785-7vf6m" is pending Validation Failed W0130 11:06:27.196514 6129 validate_cluster.go:232] (will retry): cluster not yet healthy Error: validation failed: wait time exceeded during validation I0130 11:06:37.206949 5766 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/9dd6a4e7-a08b-11ed-9a0c-f25a29267a91/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh1804452069/key --ssh-user prow I0130 11:06:37.207003 5766 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/9dd6a4e7-a08b-11ed-9a0c-f25a29267a91/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh1804452069/key --ssh-user prow I0130 11:06:37.644448 6139 gce.go:99] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] 2023/01/30 11:06:42 Dumping node control-plane-us-central1-a-c0lz 2023/01/30 11:06:45 error dumping node control-plane-us-central1-a-c0lz: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/30 11:06:45 error dumping node control-plane-us-central1-a-c0lz: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/30 11:06:45 Dumping node control-plane-us-central1-b-ksj3 2023/01/30 11:06:49 error dumping node control-plane-us-central1-b-ksj3: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/30 11:06:49 error dumping node control-plane-us-central1-b-ksj3: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/30 11:06:49 Dumping node control-plane-us-central1-c-9x4g 2023/01/30 11:06:53 error dumping node control-plane-us-central1-c-9x4g: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/30 11:06:53 error dumping node control-plane-us-central1-c-9x4g: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/30 11:06:53 dumping node not registered in kubernetes: 34.71.180.248 2023/01/30 11:06:53 Dumping node 34.71.180.248 I0130 11:06:54.635457 5766 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/9dd6a4e7-a08b-11ed-9a0c-f25a29267a91/kops get cluster --name ha-migration.k8s.local -o yaml I0130 11:06:54.635503 5766 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/9dd6a4e7-a08b-11ed-9a0c-f25a29267a91/kops get cluster --name ha-migration.k8s.local -o yaml I0130 11:06:54.804985 5766 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/9dd6a4e7-a08b-11ed-9a0c-f25a29267a91/kops get instancegroups --name ha-migration.k8s.local -o yaml I0130 11:06:54.805020 5766 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/9dd6a4e7-a08b-11ed-9a0c-f25a29267a91/kops get instancegroups --name ha-migration.k8s.local -o yaml ... skipping 167 lines ... Deleted cluster: "ha-migration.k8s.local" I0130 11:09:17.721747 5766 gcs.go:88] gsutil -u k8s-boskos-gce-project-19 rm -r gs://k8s-boskos-gce-project-19-state-9d I0130 11:09:17.722375 5766 local.go:42] ⚙️ gsutil -u k8s-boskos-gce-project-19 rm -r gs://k8s-boskos-gce-project-19-state-9d Removing gs://k8s-boskos-gce-project-19-state-9d/... I0130 11:09:20.745419 5766 down.go:62] releasing boskos project I0130 11:09:20.754432 5766 boskos.go:83] Boskos heartbeat func received signal to close Error: exit status 1 + EXIT_VALUE=1 + set +o xtrace