e2e-kops-gce-leader-migration #1620237498028396544
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 1 failed / 1 succeeded |
| Started | |
| Elapsed | 20m35s |
| Revision | master |
exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
kubetest2 Down
... skipping 156 lines ... ...................................Updated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce]. .done. WARNING: No host aliases were added to your SSH configs because you do not have any running instances. Try running this command again after running some instances. I0131 01:50:26.739487 5781 up.go:44] Cleaning up any leaked resources from previous cluster I0131 01:50:26.739627 5781 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/54c4ab8f-a109-11ed-9994-daecb65d57ab/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh95036056/key --ssh-user prow I0131 01:50:26.739640 5781 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/54c4ab8f-a109-11ed-9994-daecb65d57ab/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh95036056/key --ssh-user prow Error: Cluster.kops.k8s.io "ha-migration.k8s.local" not found W0131 01:50:26.998727 5781 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1 I0131 01:50:26.998773 5781 down.go:48] /home/prow/go/src/k8s.io/kops/_rundir/54c4ab8f-a109-11ed-9994-daecb65d57ab/kops delete cluster --name ha-migration.k8s.local --yes I0131 01:50:26.998785 5781 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/54c4ab8f-a109-11ed-9994-daecb65d57ab/kops delete cluster --name ha-migration.k8s.local --yes Error: error reading cluster configuration: Cluster.kops.k8s.io "ha-migration.k8s.local" not found I0131 01:50:27.170630 5781 gcs.go:51] gsutil ls -b -p k8s-jkns-e2e-gce gs://k8s-jkns-e2e-gce-state-54 I0131 01:50:27.170675 5781 local.go:42] ⚙️ gsutil ls -b -p k8s-jkns-e2e-gce gs://k8s-jkns-e2e-gce-state-54 I0131 01:50:29.436486 5781 gcs.go:70] gsutil mb -p k8s-jkns-e2e-gce gs://k8s-jkns-e2e-gce-state-54 I0131 01:50:29.436539 5781 local.go:42] ⚙️ gsutil mb -p k8s-jkns-e2e-gce gs://k8s-jkns-e2e-gce-state-54 Creating gs://k8s-jkns-e2e-gce-state-54/... I0131 01:50:32.303413 5781 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip 2023/01/31 01:50:32 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404 I0131 01:50:32.318072 5781 http.go:37] curl https://ip.jsb.workers.dev I0131 01:50:32.476098 5781 up.go:167] /home/prow/go/src/k8s.io/kops/_rundir/54c4ab8f-a109-11ed-9994-daecb65d57ab/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh95036056/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 35.188.115.87/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project k8s-jkns-e2e-gce I0131 01:50:32.476129 5781 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/54c4ab8f-a109-11ed-9994-daecb65d57ab/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh95036056/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 35.188.115.87/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project k8s-jkns-e2e-gce I0131 01:50:32.537706 6102 create_cluster.go:882] Using SSH public key: /tmp/kops-ssh95036056/key.pub I0131 01:50:32.841221 6102 new_cluster.go:573] VMs will be configured to use specified Service Account: default I0131 01:50:32.841362 6102 new_cluster.go:1338] Cloud Provider ID: "gce" ... skipping 527 lines ... I0131 01:50:45.684265 6121 keypair.go:226] Issuing new certificate: "etcd-manager-ca-main" I0131 01:50:45.686034 6121 keypair.go:226] Issuing new certificate: "etcd-manager-ca-events" W0131 01:50:45.875731 6121 vfs_keystorereader.go:143] CA private key was not found I0131 01:50:45.979659 6121 keypair.go:226] Issuing new certificate: "kubernetes-ca" I0131 01:50:45.980116 6121 keypair.go:226] Issuing new certificate: "service-account" I0131 01:50:58.325285 6121 executor.go:111] Tasks: 50 done / 91 total; 23 can run W0131 01:51:11.043211 6121 executor.go:139] error running task "ForwardingRule/api-ha-migration-k8s-local" (9m47s remaining to succeed): error creating ForwardingRule "api-ha-migration-k8s-local": googleapi: Error 400: The resource 'projects/k8s-jkns-e2e-gce/regions/us-central1/targetPools/api-ha-migration-k8s-local' is not ready, resourceNotReady I0131 01:51:11.043450 6121 executor.go:111] Tasks: 72 done / 91 total; 13 can run I0131 01:51:17.761438 6121 executor.go:111] Tasks: 85 done / 91 total; 6 can run I0131 01:51:34.817279 6121 executor.go:111] Tasks: 91 done / 91 total; 0 can run I0131 01:51:35.287649 6121 update_cluster.go:323] Exporting kubeconfig for cluster kOps has set your kubectl context to ha-migration.k8s.local ... skipping 7 lines ... * read about installing addons at: https://kops.sigs.k8s.io/addons. I0131 01:51:45.580856 5781 up.go:251] /home/prow/go/src/k8s.io/kops/_rundir/54c4ab8f-a109-11ed-9994-daecb65d57ab/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s I0131 01:51:45.580926 5781 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/54c4ab8f-a109-11ed-9994-daecb65d57ab/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s Validating cluster ha-migration.k8s.local W0131 01:52:16.119452 6141 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.68.17.77/api/v1/nodes": dial tcp 34.68.17.77:443: i/o timeout W0131 01:52:26.124330 6141 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.68.17.77/api/v1/nodes": dial tcp 34.68.17.77:443: connect: connection refused W0131 01:52:36.128268 6141 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.68.17.77/api/v1/nodes": dial tcp 34.68.17.77:443: connect: connection refused W0131 01:52:46.131869 6141 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.68.17.77/api/v1/nodes": dial tcp 34.68.17.77:443: connect: connection refused W0131 01:52:56.135518 6141 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.68.17.77/api/v1/nodes": dial tcp 34.68.17.77:443: connect: connection refused W0131 01:53:06.139070 6141 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.68.17.77/api/v1/nodes": dial tcp 34.68.17.77:443: connect: connection refused W0131 01:53:16.142808 6141 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.68.17.77/api/v1/nodes": dial tcp 34.68.17.77:443: connect: connection refused W0131 01:53:26.146219 6141 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.68.17.77/api/v1/nodes": dial tcp 34.68.17.77:443: connect: connection refused W0131 01:53:36.149584 6141 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.68.17.77/api/v1/nodes": dial tcp 34.68.17.77:443: connect: connection refused W0131 01:53:46.154105 6141 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.68.17.77/api/v1/nodes": dial tcp 34.68.17.77:443: connect: connection refused W0131 01:54:06.158384 6141 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.68.17.77/api/v1/nodes": net/http: TLS handshake timeout W0131 01:54:26.162149 6141 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.68.17.77/api/v1/nodes": net/http: TLS handshake timeout W0131 01:54:36.165033 6141 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.68.17.77/api/v1/nodes": dial tcp 34.68.17.77:443: connect: connection refused W0131 01:54:46.167790 6141 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.68.17.77/api/v1/nodes": dial tcp 34.68.17.77:443: connect: connection refused W0131 01:55:05.302773 6141 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.68.17.77/api/v1/nodes": dial tcp 34.68.17.77:443: connect: connection refused - error from a previous attempt: read tcp 10.60.197.179:34636->34.68.17.77:443: read: connection reset by peer I0131 01:55:15.455221 5781 boskos.go:86] Sending heartbeat to Boskos W0131 01:55:25.324466 6141 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.68.17.77/api/v1/nodes": net/http: TLS handshake timeout W0131 01:55:45.328515 6141 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.68.17.77/api/v1/nodes": net/http: TLS handshake timeout W0131 01:55:55.332724 6141 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.68.17.77/api/v1/nodes": dial tcp 34.68.17.77:443: connect: connection refused W0131 01:56:05.344252 6141 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.68.17.77/api/v1/nodes": dial tcp 34.68.17.77:443: connect: connection refused I0131 01:56:15.809191 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-c ControlPlane e2-standard-2 1 1 us-central1 ... skipping 9 lines ... KIND NAME MESSAGE Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce/zones/us-central1-a/instances/control-plane-us-central1-a-spn2 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce/zones/us-central1-a/instances/control-plane-us-central1-a-spn2" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce/zones/us-central1-a/instances/nodes-us-central1-a-vf83 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce/zones/us-central1-a/instances/nodes-us-central1-a-vf83" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce/zones/us-central1-b/instances/control-plane-us-central1-b-5ntn machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce/zones/us-central1-b/instances/control-plane-us-central1-b-5ntn" has not yet joined cluster Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Validation Failed W0131 01:56:16.802182 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 01:56:27.327278 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 18 lines ... Pod kube-system/cilium-twh52 system-node-critical pod "cilium-twh52" is pending Pod kube-system/cilium-x89gn system-node-critical pod "cilium-x89gn" is pending Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 01:56:28.267670 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 01:56:38.582609 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 21 lines ... Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Pod kube-system/etcd-manager-events-control-plane-us-central1-c-6m1x system-cluster-critical pod "etcd-manager-events-control-plane-us-central1-c-6m1x" is pending Pod kube-system/kops-controller-592vj system-cluster-critical pod "kops-controller-592vj" is pending Pod kube-system/kops-controller-rhg2c system-cluster-critical pod "kops-controller-rhg2c" is pending Validation Failed W0131 01:56:39.434001 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 01:56:49.883584 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 22 lines ... Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Pod kube-system/kops-controller-592vj system-cluster-critical pod "kops-controller-592vj" is pending Pod kube-system/kops-controller-rhg2c system-cluster-critical pod "kops-controller-rhg2c" is pending Validation Failed W0131 01:56:50.809204 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 01:57:01.192432 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 25 lines ... Pod kube-system/etcd-manager-events-control-plane-us-central1-a-spn2 system-cluster-critical pod "etcd-manager-events-control-plane-us-central1-a-spn2" is pending Pod kube-system/etcd-manager-main-control-plane-us-central1-a-spn2 system-cluster-critical pod "etcd-manager-main-control-plane-us-central1-a-spn2" is pending Pod kube-system/kops-controller-592vj system-cluster-critical pod "kops-controller-592vj" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-a-spn2 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-spn2" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-5ntn system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-5ntn" is pending Validation Failed W0131 01:57:02.121800 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 01:57:12.434461 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 21 lines ... Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-a-spn2 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-spn2" is not ready (kube-controller-manager) Pod kube-system/kube-controller-manager-control-plane-us-central1-b-5ntn system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-5ntn" is not ready (kube-controller-manager) Validation Failed W0131 01:57:13.415704 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 01:57:23.766770 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 19 lines ... Pod kube-system/cilium-x89gn system-node-critical pod "cilium-x89gn" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-5ntn system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-5ntn" is not ready (kube-controller-manager) Validation Failed W0131 01:57:24.663400 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 01:57:35.001643 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 18 lines ... Pod kube-system/cilium-x89gn system-node-critical pod "cilium-x89gn" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-5ntn system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-5ntn" is not ready (kube-controller-manager) Validation Failed W0131 01:57:35.955950 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 01:57:46.387324 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 17 lines ... Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-5ntn system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-5ntn" is not ready (kube-controller-manager) Pod kube-system/kube-scheduler-control-plane-us-central1-a-spn2 system-cluster-critical pod "kube-scheduler-control-plane-us-central1-a-spn2" is pending Validation Failed W0131 01:57:47.240258 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 01:57:57.610369 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-5ntn system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-5ntn" is not ready (kube-controller-manager) Validation Failed W0131 01:57:58.502007 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 01:58:08.861908 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 01:58:09.652867 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 01:58:20.146334 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 01:58:21.066162 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 01:58:31.409865 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 01:58:32.259113 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 01:58:42.573200 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 01:58:43.408555 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 01:58:53.763024 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 01:58:54.600310 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 01:59:04.962613 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 01:59:05.749380 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 01:59:16.046908 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 01:59:16.886210 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 01:59:27.215336 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 01:59:28.066447 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 01:59:38.461309 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 01:59:39.337242 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 01:59:49.781729 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 01:59:50.722659 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:00:01.079208 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:00:01.981353 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:00:12.405839 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:00:13.284856 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:00:15.466947 5781 boskos.go:86] Sending heartbeat to Boskos I0131 02:00:23.608865 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:00:24.471729 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:00:34.791381 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:00:35.696671 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:00:46.127482 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:00:47.020512 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:00:57.454203 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:00:58.311045 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:01:08.730865 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:01:09.585917 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:01:19.967380 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:01:20.882239 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:01:31.291584 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:01:32.254463 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:01:42.580644 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:01:43.443308 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:01:53.743684 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:01:54.606337 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:02:04.986228 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:02:05.884760 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:02:16.220041 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:02:17.154667 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:02:27.583604 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:02:28.509976 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:02:38.849346 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:02:39.746401 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:02:50.126493 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:02:51.042967 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:03:01.363574 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:03:02.216126 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:03:12.529027 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:03:13.327921 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:03:23.637955 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:03:24.446798 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:03:34.820432 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:03:35.679291 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:03:46.063764 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:03:46.926763 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:03:57.349066 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:03:58.229713 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:04:08.631212 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:04:09.516550 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:04:19.987122 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:04:20.809297 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:04:31.247381 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:04:32.152645 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:04:42.551100 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:04:43.403399 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:04:53.763009 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:04:54.597834 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:05:04.977609 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:05:05.876640 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:05:15.478699 5781 boskos.go:86] Sending heartbeat to Boskos I0131 02:05:16.299368 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:05:17.149745 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:05:27.555783 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:05:28.472783 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:05:38.828397 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:05:39.743276 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:05:50.160578 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:05:50.987315 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:06:01.436684 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:06:02.321987 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:06:12.727799 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:06:13.590086 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:06:23.884255 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:06:24.786374 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:06:35.266221 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:06:36.100731 6141 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 02:06:46.424825 6141 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5ntn node "control-plane-us-central1-b-5ntn" of role "control-plane" is not ready Node control-plane-us-central1-c-6m1x node "control-plane-us-central1-c-6m1x" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-q5rrg system-cluster-critical pod "coredns-5d479c4f64-q5rrg" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-brzq6 system-cluster-critical pod "coredns-autoscaler-557ccb4c66-brzq6" is pending Pod kube-system/dns-controller-6f69f47785-c5j82 system-cluster-critical pod "dns-controller-6f69f47785-c5j82" is pending Validation Failed W0131 02:06:47.317524 6141 validate_cluster.go:232] (will retry): cluster not yet healthy Error: validation failed: wait time exceeded during validation I0131 02:06:57.324607 5781 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/54c4ab8f-a109-11ed-9994-daecb65d57ab/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh95036056/key --ssh-user prow I0131 02:06:57.324659 5781 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/54c4ab8f-a109-11ed-9994-daecb65d57ab/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh95036056/key --ssh-user prow I0131 02:06:57.883934 6152 gce.go:99] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] 2023/01/31 02:07:02 Dumping node control-plane-us-central1-a-spn2 2023/01/31 02:07:06 error dumping node control-plane-us-central1-a-spn2: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/31 02:07:06 error dumping node control-plane-us-central1-a-spn2: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/31 02:07:06 Dumping node control-plane-us-central1-b-5ntn 2023/01/31 02:07:11 error dumping node control-plane-us-central1-b-5ntn: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/31 02:07:11 error dumping node control-plane-us-central1-b-5ntn: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/31 02:07:11 Dumping node control-plane-us-central1-c-6m1x 2023/01/31 02:07:14 error dumping node control-plane-us-central1-c-6m1x: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/31 02:07:14 error dumping node control-plane-us-central1-c-6m1x: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/31 02:07:14 dumping node not registered in kubernetes: 34.133.210.94 2023/01/31 02:07:14 Dumping node 34.133.210.94 I0131 02:07:16.122766 5781 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/54c4ab8f-a109-11ed-9994-daecb65d57ab/kops get cluster --name ha-migration.k8s.local -o yaml I0131 02:07:16.122811 5781 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/54c4ab8f-a109-11ed-9994-daecb65d57ab/kops get cluster --name ha-migration.k8s.local -o yaml I0131 02:07:16.284146 5781 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/54c4ab8f-a109-11ed-9994-daecb65d57ab/kops get instancegroups --name ha-migration.k8s.local -o yaml I0131 02:07:16.284291 5781 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/54c4ab8f-a109-11ed-9994-daecb65d57ab/kops get instancegroups --name ha-migration.k8s.local -o yaml ... skipping 166 lines ... Deleted cluster: "ha-migration.k8s.local" I0131 02:09:36.371273 5781 gcs.go:88] gsutil -u k8s-jkns-e2e-gce rm -r gs://k8s-jkns-e2e-gce-state-54 I0131 02:09:36.371334 5781 local.go:42] ⚙️ gsutil -u k8s-jkns-e2e-gce rm -r gs://k8s-jkns-e2e-gce-state-54 Removing gs://k8s-jkns-e2e-gce-state-54/... I0131 02:09:39.691335 5781 down.go:62] releasing boskos project I0131 02:09:39.701034 5781 boskos.go:83] Boskos heartbeat func received signal to close Error: exit status 1 + EXIT_VALUE=1 + set +o xtrace