e2e-kops-gce-leader-migration #1620373394606264320
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 1 failed / 1 succeeded |
| Started | |
| Elapsed | 20m18s |
| Revision | master |
exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
kubetest2 Down
... skipping 156 lines ... ......................................Updated [https://www.googleapis.com/compute/v1/projects/kubernetes-petset]. .done. WARNING: No host aliases were added to your SSH configs because you do not have any running instances. Try running this command again after running some instances. I0131 10:50:19.128843 5744 up.go:44] Cleaning up any leaked resources from previous cluster I0131 10:50:19.128969 5744 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/c4d15d4d-a154-11ed-9994-daecb65d57ab/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh784733497/key --ssh-user prow I0131 10:50:19.128994 5744 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/c4d15d4d-a154-11ed-9994-daecb65d57ab/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh784733497/key --ssh-user prow Error: Cluster.kops.k8s.io "ha-migration.k8s.local" not found W0131 10:50:19.442431 5744 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1 I0131 10:50:19.442504 5744 down.go:48] /home/prow/go/src/k8s.io/kops/_rundir/c4d15d4d-a154-11ed-9994-daecb65d57ab/kops delete cluster --name ha-migration.k8s.local --yes I0131 10:50:19.442516 5744 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/c4d15d4d-a154-11ed-9994-daecb65d57ab/kops delete cluster --name ha-migration.k8s.local --yes Error: error reading cluster configuration: Cluster.kops.k8s.io "ha-migration.k8s.local" not found I0131 10:50:19.702008 5744 gcs.go:51] gsutil ls -b -p kubernetes-petset gs://kubernetes-petset-state-c4 I0131 10:50:19.702045 5744 local.go:42] ⚙️ gsutil ls -b -p kubernetes-petset gs://kubernetes-petset-state-c4 I0131 10:50:21.763019 5744 gcs.go:70] gsutil mb -p kubernetes-petset gs://kubernetes-petset-state-c4 I0131 10:50:21.763059 5744 local.go:42] ⚙️ gsutil mb -p kubernetes-petset gs://kubernetes-petset-state-c4 Creating gs://kubernetes-petset-state-c4/... I0131 10:50:24.476212 5744 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip 2023/01/31 10:50:24 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404 I0131 10:50:24.490994 5744 http.go:37] curl https://ip.jsb.workers.dev I0131 10:50:24.591924 5744 up.go:167] /home/prow/go/src/k8s.io/kops/_rundir/c4d15d4d-a154-11ed-9994-daecb65d57ab/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh784733497/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 34.170.210.157/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project kubernetes-petset I0131 10:50:24.591958 5744 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/c4d15d4d-a154-11ed-9994-daecb65d57ab/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh784733497/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 34.170.210.157/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project kubernetes-petset I0131 10:50:24.642618 6065 create_cluster.go:882] Using SSH public key: /tmp/kops-ssh784733497/key.pub I0131 10:50:24.938017 6065 new_cluster.go:573] VMs will be configured to use specified Service Account: default I0131 10:50:24.938149 6065 new_cluster.go:1339] Cloud Provider ID: "gce" ... skipping 527 lines ... I0131 10:50:37.480828 6086 keypair.go:226] Issuing new certificate: "etcd-manager-ca-events" I0131 10:50:37.481308 6086 keypair.go:226] Issuing new certificate: "etcd-manager-ca-main" W0131 10:50:37.677916 6086 vfs_keystorereader.go:143] CA private key was not found I0131 10:50:37.781769 6086 keypair.go:226] Issuing new certificate: "kubernetes-ca" I0131 10:50:37.879348 6086 keypair.go:226] Issuing new certificate: "service-account" I0131 10:50:50.097890 6086 executor.go:111] Tasks: 50 done / 91 total; 23 can run W0131 10:51:02.835488 6086 executor.go:139] error running task "ForwardingRule/api-ha-migration-k8s-local" (9m47s remaining to succeed): error creating ForwardingRule "api-ha-migration-k8s-local": googleapi: Error 400: The resource 'projects/kubernetes-petset/regions/us-central1/targetPools/api-ha-migration-k8s-local' is not ready, resourceNotReady I0131 10:51:02.835761 6086 executor.go:111] Tasks: 72 done / 91 total; 13 can run I0131 10:51:09.621604 6086 executor.go:111] Tasks: 85 done / 91 total; 6 can run I0131 10:51:23.608282 6086 executor.go:111] Tasks: 91 done / 91 total; 0 can run I0131 10:51:23.673010 6086 update_cluster.go:323] Exporting kubeconfig for cluster kOps has set your kubectl context to ha-migration.k8s.local ... skipping 7 lines ... * read about installing addons at: https://kops.sigs.k8s.io/addons. I0131 10:51:34.228752 5744 up.go:251] /home/prow/go/src/k8s.io/kops/_rundir/c4d15d4d-a154-11ed-9994-daecb65d57ab/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s I0131 10:51:34.228808 5744 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/c4d15d4d-a154-11ed-9994-daecb65d57ab/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s Validating cluster ha-migration.k8s.local W0131 10:52:04.767908 6104 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.238.81.17/api/v1/nodes": dial tcp 35.238.81.17:443: i/o timeout W0131 10:52:44.769582 6104 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.238.81.17/api/v1/nodes": dial tcp 35.238.81.17:443: i/o timeout W0131 10:52:54.773108 6104 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.238.81.17/api/v1/nodes": dial tcp 35.238.81.17:443: connect: connection refused W0131 10:53:04.775794 6104 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.238.81.17/api/v1/nodes": dial tcp 35.238.81.17:443: connect: connection refused W0131 10:53:14.778986 6104 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.238.81.17/api/v1/nodes": dial tcp 35.238.81.17:443: connect: connection refused W0131 10:53:24.782030 6104 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.238.81.17/api/v1/nodes": dial tcp 35.238.81.17:443: connect: connection refused W0131 10:53:34.785243 6104 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.238.81.17/api/v1/nodes": dial tcp 35.238.81.17:443: connect: connection refused W0131 10:53:44.789230 6104 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.238.81.17/api/v1/nodes": dial tcp 35.238.81.17:443: connect: connection refused W0131 10:54:04.793380 6104 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.238.81.17/api/v1/nodes": net/http: TLS handshake timeout W0131 10:54:20.675332 6104 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.238.81.17/api/v1/nodes": dial tcp 35.238.81.17:443: connect: connection refused - error from a previous attempt: read tcp 10.60.64.169:39812->35.238.81.17:443: read: connection reset by peer W0131 10:54:38.217620 6104 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.238.81.17/api/v1/nodes": dial tcp 35.238.81.17:443: connect: connection refused - error from a previous attempt: read tcp 10.60.64.169:48902->35.238.81.17:443: read: connection reset by peer W0131 10:54:48.224434 6104 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.238.81.17/api/v1/nodes": dial tcp 35.238.81.17:443: connect: connection refused W0131 10:54:58.228300 6104 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.238.81.17/api/v1/nodes": dial tcp 35.238.81.17:443: connect: connection refused I0131 10:55:07.413191 5744 boskos.go:86] Sending heartbeat to Boskos W0131 10:55:19.499954 6104 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.238.81.17/api/v1/nodes": net/http: TLS handshake timeout - error from a previous attempt: read tcp 10.60.64.169:47094->35.238.81.17:443: read: connection reset by peer W0131 10:55:29.502775 6104 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.238.81.17/api/v1/nodes": dial tcp 35.238.81.17:443: connect: connection refused W0131 10:55:49.510709 6104 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.238.81.17/api/v1/nodes": net/http: TLS handshake timeout W0131 10:56:09.523899 6104 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.238.81.17/api/v1/nodes": net/http: TLS handshake timeout W0131 10:56:19.531847 6104 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.238.81.17/api/v1/nodes": dial tcp 35.238.81.17:443: connect: connection refused W0131 10:56:29.539421 6104 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.238.81.17/api/v1/nodes": dial tcp 35.238.81.17:443: connect: connection refused I0131 10:56:39.925269 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-c ControlPlane e2-standard-2 1 1 us-central1 ... skipping 9 lines ... KIND NAME MESSAGE Machine https://www.googleapis.com/compute/v1/projects/kubernetes-petset/zones/us-central1-a/instances/nodes-us-central1-a-xwr4 machine "https://www.googleapis.com/compute/v1/projects/kubernetes-petset/zones/us-central1-a/instances/nodes-us-central1-a-xwr4" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/kubernetes-petset/zones/us-central1-b/instances/control-plane-us-central1-b-trwg machine "https://www.googleapis.com/compute/v1/projects/kubernetes-petset/zones/us-central1-b/instances/control-plane-us-central1-b-trwg" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/kubernetes-petset/zones/us-central1-c/instances/control-plane-us-central1-c-8c4h machine "https://www.googleapis.com/compute/v1/projects/kubernetes-petset/zones/us-central1-c/instances/control-plane-us-central1-c-8c4h" has not yet joined cluster Node control-plane-us-central1-a-smcc node "control-plane-us-central1-a-smcc" of role "control-plane" is not ready Validation Failed W0131 10:56:40.926988 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 10:56:51.244459 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 10 lines ... KIND NAME MESSAGE Machine https://www.googleapis.com/compute/v1/projects/kubernetes-petset/zones/us-central1-a/instances/nodes-us-central1-a-xwr4 machine "https://www.googleapis.com/compute/v1/projects/kubernetes-petset/zones/us-central1-a/instances/nodes-us-central1-a-xwr4" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/kubernetes-petset/zones/us-central1-b/instances/control-plane-us-central1-b-trwg machine "https://www.googleapis.com/compute/v1/projects/kubernetes-petset/zones/us-central1-b/instances/control-plane-us-central1-b-trwg" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/kubernetes-petset/zones/us-central1-c/instances/control-plane-us-central1-c-8c4h machine "https://www.googleapis.com/compute/v1/projects/kubernetes-petset/zones/us-central1-c/instances/control-plane-us-central1-c-8c4h" has not yet joined cluster Node control-plane-us-central1-a-smcc node "control-plane-us-central1-a-smcc" of role "control-plane" is not ready Validation Failed W0131 10:56:52.176984 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 10:57:02.470204 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 11 lines ... Machine https://www.googleapis.com/compute/v1/projects/kubernetes-petset/zones/us-central1-a/instances/nodes-us-central1-a-xwr4 machine "https://www.googleapis.com/compute/v1/projects/kubernetes-petset/zones/us-central1-a/instances/nodes-us-central1-a-xwr4" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/kubernetes-petset/zones/us-central1-b/instances/control-plane-us-central1-b-trwg machine "https://www.googleapis.com/compute/v1/projects/kubernetes-petset/zones/us-central1-b/instances/control-plane-us-central1-b-trwg" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/kubernetes-petset/zones/us-central1-c/instances/control-plane-us-central1-c-8c4h machine "https://www.googleapis.com/compute/v1/projects/kubernetes-petset/zones/us-central1-c/instances/control-plane-us-central1-c-8c4h" has not yet joined cluster Node control-plane-us-central1-a-smcc node "control-plane-us-central1-a-smcc" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-a-smcc system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-smcc" is not ready (kube-controller-manager) Validation Failed W0131 10:57:03.279532 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 10:57:13.630925 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 13 lines ... Machine https://www.googleapis.com/compute/v1/projects/kubernetes-petset/zones/us-central1-a/instances/nodes-us-central1-a-xwr4 machine "https://www.googleapis.com/compute/v1/projects/kubernetes-petset/zones/us-central1-a/instances/nodes-us-central1-a-xwr4" has not yet joined cluster Node control-plane-us-central1-a-smcc node "control-plane-us-central1-a-smcc" of role "control-plane" is not ready Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-a-smcc system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-smcc" is not ready (kube-controller-manager) Validation Failed W0131 10:57:14.554682 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 10:57:24.940785 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 12 lines ... KIND NAME MESSAGE Machine https://www.googleapis.com/compute/v1/projects/kubernetes-petset/zones/us-central1-a/instances/nodes-us-central1-a-xwr4 machine "https://www.googleapis.com/compute/v1/projects/kubernetes-petset/zones/us-central1-a/instances/nodes-us-central1-a-xwr4" has not yet joined cluster Node control-plane-us-central1-a-smcc node "control-plane-us-central1-a-smcc" of role "control-plane" is not ready Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Validation Failed W0131 10:57:25.850701 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 10:57:36.134179 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 22 lines ... Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Pod kube-system/etcd-manager-events-control-plane-us-central1-a-smcc system-cluster-critical pod "etcd-manager-events-control-plane-us-central1-a-smcc" is pending Pod kube-system/kops-controller-9t9l8 system-cluster-critical pod "kops-controller-9t9l8" is pending Validation Failed W0131 10:57:37.144208 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 10:57:47.498486 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 21 lines ... Pod kube-system/cilium-operator-b4b4c5b48-wzvrt system-cluster-critical pod "cilium-operator-b4b4c5b48-wzvrt" is pending Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Pod kube-system/kops-controller-9t9l8 system-cluster-critical pod "kops-controller-9t9l8" is pending Validation Failed W0131 10:57:48.404586 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 10:57:58.715425 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 21 lines ... Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Pod kube-system/etcd-manager-events-control-plane-us-central1-c-8c4h system-cluster-critical pod "etcd-manager-events-control-plane-us-central1-c-8c4h" is pending Pod kube-system/kube-scheduler-control-plane-us-central1-c-8c4h system-cluster-critical pod "kube-scheduler-control-plane-us-central1-c-8c4h" is pending Validation Failed W0131 10:57:59.684476 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 10:58:10.046624 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 22 lines ... Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Pod kube-system/etcd-manager-main-control-plane-us-central1-a-smcc system-cluster-critical pod "etcd-manager-main-control-plane-us-central1-a-smcc" is pending Pod kube-system/kops-controller-gmk45 system-cluster-critical pod "kops-controller-gmk45" is pending Pod kube-system/kube-apiserver-control-plane-us-central1-a-smcc system-cluster-critical pod "kube-apiserver-control-plane-us-central1-a-smcc" is pending Validation Failed W0131 10:58:10.864813 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 10:58:21.250520 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 17 lines ... Pod kube-system/cilium-9p5fs system-node-critical pod "cilium-9p5fs" is not ready (cilium-agent) Pod kube-system/cilium-ns6vt system-node-critical pod "cilium-ns6vt" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 10:58:22.200167 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 10:58:32.528177 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 17 lines ... Pod kube-system/cilium-9p5fs system-node-critical pod "cilium-9p5fs" is not ready (cilium-agent) Pod kube-system/cilium-ns6vt system-node-critical pod "cilium-ns6vt" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 10:58:33.384471 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 10:58:43.744328 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 10:58:44.615608 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 10:58:55.061563 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-c-8c4h system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-8c4h" is pending Validation Failed W0131 10:58:55.942912 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 10:59:06.308889 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Pod kube-system/etcd-manager-main-control-plane-us-central1-c-8c4h system-cluster-critical pod "etcd-manager-main-control-plane-us-central1-c-8c4h" is pending Validation Failed W0131 10:59:07.160226 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 10:59:17.515547 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 10:59:18.353396 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 10:59:28.748695 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 10:59:29.600139 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 10:59:39.908341 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 10:59:40.734034 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 10:59:51.058158 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 10:59:51.911702 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:00:02.281213 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:00:03.109016 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:00:07.423153 5744 boskos.go:86] Sending heartbeat to Boskos I0131 11:00:13.438158 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:00:14.326385 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:00:24.662460 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:00:25.524354 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:00:35.883119 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:00:36.755373 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:00:47.103151 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:00:48.063663 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:00:58.380933 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:00:59.277585 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:01:09.615241 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:01:10.501015 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:01:20.855138 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:01:21.717943 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:01:32.034044 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:01:32.897033 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:01:43.233560 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:01:44.080753 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:01:54.462646 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:01:55.361205 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:02:05.685402 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:02:06.489951 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:02:16.831576 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:02:17.728845 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:02:28.171111 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:02:29.074472 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:02:39.474318 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:02:40.423812 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:02:50.787053 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:02:51.611760 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:03:01.944568 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:03:02.831071 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:03:13.235439 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:03:13.984814 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:03:24.309003 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:03:25.208199 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:03:35.515348 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:03:36.457487 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:03:46.722086 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:03:47.613411 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:03:57.923638 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:03:58.806979 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:04:09.142662 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:04:10.026417 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:04:20.641888 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:04:21.553145 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:04:31.941675 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:04:32.860074 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:04:43.147947 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:04:44.033886 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:04:54.415532 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:04:55.256108 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:05:05.563811 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:05:06.414779 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:05:07.434426 5744 boskos.go:86] Sending heartbeat to Boskos I0131 11:05:16.795319 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:05:17.670732 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:05:27.933099 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:05:28.854183 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:05:39.268753 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:05:40.155460 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:05:50.572012 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:05:51.473803 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:06:01.823269 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:06:02.768246 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:06:13.052972 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:06:13.888734 6104 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 11:06:24.251490 6104 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-trwg node "control-plane-us-central1-b-trwg" of role "control-plane" is not ready Node control-plane-us-central1-c-8c4h node "control-plane-us-central1-c-8c4h" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-n6qvw system-cluster-critical pod "coredns-5d479c4f64-n6qvw" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8qq5x system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8qq5x" is pending Pod kube-system/dns-controller-6f69f47785-htzqq system-cluster-critical pod "dns-controller-6f69f47785-htzqq" is pending Validation Failed W0131 11:06:25.104842 6104 validate_cluster.go:232] (will retry): cluster not yet healthy Error: validation failed: wait time exceeded during validation I0131 11:06:35.114097 5744 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/c4d15d4d-a154-11ed-9994-daecb65d57ab/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh784733497/key --ssh-user prow I0131 11:06:35.114146 5744 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/c4d15d4d-a154-11ed-9994-daecb65d57ab/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh784733497/key --ssh-user prow I0131 11:06:35.667897 6114 gce.go:99] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] 2023/01/31 11:06:40 Dumping node control-plane-us-central1-a-smcc 2023/01/31 11:06:44 error dumping node control-plane-us-central1-a-smcc: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/31 11:06:44 error dumping node control-plane-us-central1-a-smcc: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/31 11:06:44 Dumping node control-plane-us-central1-b-trwg 2023/01/31 11:06:49 error dumping node control-plane-us-central1-b-trwg: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/31 11:06:49 error dumping node control-plane-us-central1-b-trwg: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/31 11:06:49 Dumping node control-plane-us-central1-c-8c4h 2023/01/31 11:06:52 error dumping node control-plane-us-central1-c-8c4h: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/31 11:06:52 error dumping node control-plane-us-central1-c-8c4h: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/31 11:06:52 dumping node not registered in kubernetes: 34.134.165.137 2023/01/31 11:06:52 Dumping node 34.134.165.137 I0131 11:06:54.734427 5744 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/c4d15d4d-a154-11ed-9994-daecb65d57ab/kops get cluster --name ha-migration.k8s.local -o yaml I0131 11:06:54.734487 5744 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/c4d15d4d-a154-11ed-9994-daecb65d57ab/kops get cluster --name ha-migration.k8s.local -o yaml I0131 11:06:54.885536 5744 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/c4d15d4d-a154-11ed-9994-daecb65d57ab/kops get instancegroups --name ha-migration.k8s.local -o yaml I0131 11:06:54.885566 5744 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/c4d15d4d-a154-11ed-9994-daecb65d57ab/kops get instancegroups --name ha-migration.k8s.local -o yaml ... skipping 166 lines ... Deleted cluster: "ha-migration.k8s.local" I0131 11:09:14.974147 5744 gcs.go:88] gsutil -u kubernetes-petset rm -r gs://kubernetes-petset-state-c4 I0131 11:09:14.974199 5744 local.go:42] ⚙️ gsutil -u kubernetes-petset rm -r gs://kubernetes-petset-state-c4 Removing gs://kubernetes-petset-state-c4/... I0131 11:09:17.535810 5744 down.go:62] releasing boskos project I0131 11:09:17.547429 5744 boskos.go:83] Boskos heartbeat func received signal to close Error: exit status 1 + EXIT_VALUE=1 + set +o xtrace