e2e-kops-gce-leader-migration #1621098314000764928
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 1 failed / 1 succeeded |
| Started | |
| Elapsed | 20m6s |
| Revision | master |
exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
kubetest2 Down
... skipping 156 lines ... ..................................Updated [https://www.googleapis.com/compute/v1/projects/gce-cvm-upg-1-3-1-4-ctl-skew]. .done. WARNING: No host aliases were added to your SSH configs because you do not have any running instances. Try running this command again after running some instances. I0202 10:50:50.065129 5760 up.go:44] Cleaning up any leaked resources from previous cluster I0202 10:50:50.065368 5760 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/2e138f46-a2e7-11ed-8c0a-1250e2f4dc61/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh1320855839/key --ssh-user prow I0202 10:50:50.065405 5760 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/2e138f46-a2e7-11ed-8c0a-1250e2f4dc61/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh1320855839/key --ssh-user prow Error: Cluster.kops.k8s.io "ha-migration.k8s.local" not found W0202 10:50:50.292201 5760 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1 I0202 10:50:50.292251 5760 down.go:48] /home/prow/go/src/k8s.io/kops/_rundir/2e138f46-a2e7-11ed-8c0a-1250e2f4dc61/kops delete cluster --name ha-migration.k8s.local --yes I0202 10:50:50.292263 5760 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/2e138f46-a2e7-11ed-8c0a-1250e2f4dc61/kops delete cluster --name ha-migration.k8s.local --yes Error: error reading cluster configuration: Cluster.kops.k8s.io "ha-migration.k8s.local" not found I0202 10:50:50.424575 5760 gcs.go:51] gsutil ls -b -p gce-cvm-upg-1-3-1-4-ctl-skew gs://gce-cvm-upg-1-3-1-4-ctl-skew-state-2e I0202 10:50:50.424619 5760 local.go:42] ⚙️ gsutil ls -b -p gce-cvm-upg-1-3-1-4-ctl-skew gs://gce-cvm-upg-1-3-1-4-ctl-skew-state-2e I0202 10:50:52.337985 5760 gcs.go:70] gsutil mb -p gce-cvm-upg-1-3-1-4-ctl-skew gs://gce-cvm-upg-1-3-1-4-ctl-skew-state-2e I0202 10:50:52.338026 5760 local.go:42] ⚙️ gsutil mb -p gce-cvm-upg-1-3-1-4-ctl-skew gs://gce-cvm-upg-1-3-1-4-ctl-skew-state-2e Creating gs://gce-cvm-upg-1-3-1-4-ctl-skew-state-2e/... I0202 10:50:54.813451 5760 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip 2023/02/02 10:50:54 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404 I0202 10:50:54.827634 5760 http.go:37] curl https://ip.jsb.workers.dev I0202 10:50:54.918864 5760 up.go:167] /home/prow/go/src/k8s.io/kops/_rundir/2e138f46-a2e7-11ed-8c0a-1250e2f4dc61/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh1320855839/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 35.239.218.55/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project gce-cvm-upg-1-3-1-4-ctl-skew I0202 10:50:54.918915 5760 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/2e138f46-a2e7-11ed-8c0a-1250e2f4dc61/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh1320855839/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 35.239.218.55/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project gce-cvm-upg-1-3-1-4-ctl-skew I0202 10:50:54.969990 6080 create_cluster.go:882] Using SSH public key: /tmp/kops-ssh1320855839/key.pub I0202 10:50:55.246476 6080 new_cluster.go:573] VMs will be configured to use specified Service Account: default I0202 10:50:55.246589 6080 new_cluster.go:1339] Cloud Provider ID: "gce" ... skipping 527 lines ... I0202 10:51:08.979557 6100 keypair.go:226] Issuing new certificate: "etcd-manager-ca-main" I0202 10:51:08.982869 6100 keypair.go:226] Issuing new certificate: "etcd-peers-ca-events" W0202 10:51:09.080670 6100 vfs_keystorereader.go:143] CA private key was not found I0202 10:51:09.285003 6100 keypair.go:226] Issuing new certificate: "service-account" I0202 10:51:09.286148 6100 keypair.go:226] Issuing new certificate: "kubernetes-ca" I0202 10:51:21.355030 6100 executor.go:111] Tasks: 50 done / 91 total; 23 can run W0202 10:51:31.205313 6100 executor.go:139] error running task "ForwardingRule/api-ha-migration-k8s-local" (9m50s remaining to succeed): error creating ForwardingRule "api-ha-migration-k8s-local": googleapi: Error 400: The resource 'projects/gce-cvm-upg-1-3-1-4-ctl-skew/regions/us-central1/targetPools/api-ha-migration-k8s-local' is not ready, resourceNotReady I0202 10:51:31.205384 6100 executor.go:111] Tasks: 72 done / 91 total; 13 can run I0202 10:51:37.978716 6100 executor.go:111] Tasks: 85 done / 91 total; 6 can run I0202 10:51:51.899803 6100 executor.go:111] Tasks: 91 done / 91 total; 0 can run I0202 10:51:51.978984 6100 update_cluster.go:323] Exporting kubeconfig for cluster kOps has set your kubectl context to ha-migration.k8s.local ... skipping 7 lines ... * read about installing addons at: https://kops.sigs.k8s.io/addons. I0202 10:52:02.273523 5760 up.go:251] /home/prow/go/src/k8s.io/kops/_rundir/2e138f46-a2e7-11ed-8c0a-1250e2f4dc61/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s I0202 10:52:02.273582 5760 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/2e138f46-a2e7-11ed-8c0a-1250e2f4dc61/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s Validating cluster ha-migration.k8s.local W0202 10:52:33.139128 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.72.1.207/api/v1/nodes": dial tcp 34.72.1.207:443: i/o timeout W0202 10:52:58.538144 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.72.1.207/api/v1/nodes": dial tcp 34.72.1.207:443: connect: connection refused W0202 10:53:08.544853 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.72.1.207/api/v1/nodes": dial tcp 34.72.1.207:443: connect: connection refused W0202 10:53:18.547856 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.72.1.207/api/v1/nodes": dial tcp 34.72.1.207:443: connect: connection refused W0202 10:53:28.557918 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.72.1.207/api/v1/nodes": dial tcp 34.72.1.207:443: connect: connection refused W0202 10:53:38.565543 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.72.1.207/api/v1/nodes": dial tcp 34.72.1.207:443: connect: connection refused W0202 10:53:48.568931 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.72.1.207/api/v1/nodes": dial tcp 34.72.1.207:443: connect: connection refused W0202 10:53:58.579047 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.72.1.207/api/v1/nodes": dial tcp 34.72.1.207:443: connect: connection refused W0202 10:54:08.585935 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.72.1.207/api/v1/nodes": dial tcp 34.72.1.207:443: connect: connection refused W0202 10:54:18.589096 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.72.1.207/api/v1/nodes": dial tcp 34.72.1.207:443: connect: connection refused W0202 10:54:28.597805 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.72.1.207/api/v1/nodes": dial tcp 34.72.1.207:443: connect: connection refused W0202 10:54:38.600504 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.72.1.207/api/v1/nodes": dial tcp 34.72.1.207:443: connect: connection refused W0202 10:54:53.702174 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.72.1.207/api/v1/nodes": dial tcp 34.72.1.207:443: connect: connection refused - error from a previous attempt: read tcp 10.60.108.217:34772->34.72.1.207:443: read: connection reset by peer W0202 10:55:13.705463 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.72.1.207/api/v1/nodes": net/http: TLS handshake timeout W0202 10:55:23.709139 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.72.1.207/api/v1/nodes": dial tcp 34.72.1.207:443: connect: connection refused W0202 10:55:33.713594 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.72.1.207/api/v1/nodes": dial tcp 34.72.1.207:443: connect: connection refused I0202 10:55:38.794787 5760 boskos.go:86] Sending heartbeat to Boskos W0202 10:55:43.717293 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.72.1.207/api/v1/nodes": dial tcp 34.72.1.207:443: connect: connection refused W0202 10:56:03.721766 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.72.1.207/api/v1/nodes": net/http: TLS handshake timeout W0202 10:56:13.725407 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.72.1.207/api/v1/nodes": dial tcp 34.72.1.207:443: connect: connection refused W0202 10:56:33.728674 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.72.1.207/api/v1/nodes": net/http: TLS handshake timeout W0202 10:56:43.733219 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.72.1.207/api/v1/nodes": dial tcp 34.72.1.207:443: connect: connection refused W0202 10:56:53.736998 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.72.1.207/api/v1/nodes": dial tcp 34.72.1.207:443: connect: connection refused W0202 10:57:03.740868 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.72.1.207/api/v1/nodes": dial tcp 34.72.1.207:443: connect: connection refused W0202 10:57:23.745560 6121 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.72.1.207/api/v1/nodes": net/http: TLS handshake timeout I0202 10:57:34.058198 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-c ControlPlane e2-standard-2 1 1 us-central1 ... skipping 11 lines ... KIND NAME MESSAGE Machine https://www.googleapis.com/compute/v1/projects/gce-cvm-upg-1-3-1-4-ctl-skew/zones/us-central1-a/instances/nodes-us-central1-a-925z machine "https://www.googleapis.com/compute/v1/projects/gce-cvm-upg-1-3-1-4-ctl-skew/zones/us-central1-a/instances/nodes-us-central1-a-925z" has not yet joined cluster Node control-plane-us-central1-a-vwcg node "control-plane-us-central1-a-vwcg" of role "control-plane" is not ready Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Validation Failed W0202 10:57:35.022283 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 10:57:45.321073 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 14 lines ... Node control-plane-us-central1-a-vwcg node "control-plane-us-central1-a-vwcg" of role "control-plane" is not ready Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-b-k4x0 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-k4x0" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-c-3qmw system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-3qmw" is not ready (kube-controller-manager) Validation Failed W0202 10:57:46.138097 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 10:57:56.470532 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 25 lines ... Pod kube-system/kops-controller-8lch6 system-cluster-critical pod "kops-controller-8lch6" is pending Pod kube-system/kops-controller-jq2v6 system-cluster-critical pod "kops-controller-jq2v6" is pending Pod kube-system/kops-controller-qxxbb system-cluster-critical pod "kops-controller-qxxbb" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-k4x0 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-k4x0" is not ready (kube-controller-manager) Pod kube-system/kube-controller-manager-control-plane-us-central1-c-3qmw system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-3qmw" is not ready (kube-controller-manager) Validation Failed W0202 10:57:57.375193 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 10:58:07.817869 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 23 lines ... Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Pod kube-system/kops-controller-qxxbb system-cluster-critical pod "kops-controller-qxxbb" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-c-3qmw system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-3qmw" is not ready (kube-controller-manager) Pod kube-system/kube-scheduler-control-plane-us-central1-c-3qmw system-cluster-critical pod "kube-scheduler-control-plane-us-central1-c-3qmw" is pending Validation Failed W0202 10:58:08.650583 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 10:58:18.990410 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 24 lines ... Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Pod kube-system/etcd-manager-events-control-plane-us-central1-c-3qmw system-cluster-critical pod "etcd-manager-events-control-plane-us-central1-c-3qmw" is pending Pod kube-system/kube-apiserver-control-plane-us-central1-a-vwcg system-cluster-critical pod "kube-apiserver-control-plane-us-central1-a-vwcg" is pending Pod kube-system/kube-apiserver-control-plane-us-central1-c-3qmw system-cluster-critical pod "kube-apiserver-control-plane-us-central1-c-3qmw" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-c-3qmw system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-3qmw" is not ready (kube-controller-manager) Validation Failed W0202 10:58:19.847194 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 10:58:30.142556 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 19 lines ... Pod kube-system/cilium-tv5ch system-node-critical pod "cilium-tv5ch" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-c-3qmw system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-3qmw" is not ready (kube-controller-manager) Validation Failed W0202 10:58:30.985519 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 10:58:41.412933 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 17 lines ... Pod kube-system/cilium-tv5ch system-node-critical pod "cilium-tv5ch" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-a-vwcg system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-vwcg" is pending Validation Failed W0202 10:58:42.370714 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 10:58:52.759221 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 17 lines ... Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Pod kube-system/etcd-manager-main-control-plane-us-central1-b-k4x0 system-cluster-critical pod "etcd-manager-main-control-plane-us-central1-b-k4x0" is pending Pod kube-system/kube-apiserver-control-plane-us-central1-b-k4x0 system-cluster-critical pod "kube-apiserver-control-plane-us-central1-b-k4x0" is pending Validation Failed W0202 10:58:53.624280 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 10:59:04.034899 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 10:59:04.874222 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 10:59:15.185654 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 10:59:16.079592 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 10:59:26.461013 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 10:59:27.315365 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 10:59:37.639153 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 10:59:38.515312 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 10:59:48.828857 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 10:59:49.677649 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:00:00.045494 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:00:00.929117 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:00:11.288906 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:00:12.193766 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:00:22.512941 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:00:23.463651 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:00:33.875646 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:00:34.761396 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:00:38.806075 5760 boskos.go:86] Sending heartbeat to Boskos I0202 11:00:45.139655 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:00:46.007627 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:00:56.317319 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:00:57.200054 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:01:07.558412 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:01:08.455600 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:01:18.847137 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:01:19.749094 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:01:30.205032 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:01:31.093960 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:01:41.428613 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:01:42.299111 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:01:52.601372 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:01:53.449886 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:02:03.814656 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:02:04.707610 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:02:15.019151 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:02:15.884270 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:02:26.228750 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:02:27.002090 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:02:37.397270 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:02:38.243909 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:02:48.575683 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:02:49.475295 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:02:59.835176 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:03:00.708176 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:03:11.053063 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:03:11.912649 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:03:22.214651 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:03:23.037310 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:03:33.339470 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:03:34.151283 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:03:44.541693 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:03:45.422847 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:03:55.743798 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:03:56.534745 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:04:06.831955 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:04:07.730377 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:04:18.050766 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:04:18.879390 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:04:29.182184 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:04:30.009465 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:04:40.407106 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:04:41.282535 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:04:51.621320 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:04:52.464326 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:05:02.820877 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:05:03.707855 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:05:14.098665 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:05:15.026428 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:05:25.341263 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:05:26.293125 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:05:36.683102 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:05:37.541329 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:05:38.818835 5760 boskos.go:86] Sending heartbeat to Boskos I0202 11:05:47.889891 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:05:48.735240 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:05:59.191563 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:06:00.051915 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:06:10.420968 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:06:11.255232 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:06:21.555211 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:06:22.345876 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:06:32.804524 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:06:33.640266 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:06:43.943434 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:06:44.871668 6121 validate_cluster.go:232] (will retry): cluster not yet healthy I0202 11:06:55.223428 6121 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-k4x0 node "control-plane-us-central1-b-k4x0" of role "control-plane" is not ready Node control-plane-us-central1-c-3qmw node "control-plane-us-central1-c-3qmw" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-khrc9 system-cluster-critical pod "coredns-5d479c4f64-khrc9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-jjgcq system-cluster-critical pod "coredns-autoscaler-557ccb4c66-jjgcq" is pending Pod kube-system/dns-controller-6f69f47785-jk72f system-cluster-critical pod "dns-controller-6f69f47785-jk72f" is pending Validation Failed W0202 11:06:56.096003 6121 validate_cluster.go:232] (will retry): cluster not yet healthy Error: validation failed: wait time exceeded during validation I0202 11:07:06.106098 5760 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/2e138f46-a2e7-11ed-8c0a-1250e2f4dc61/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh1320855839/key --ssh-user prow I0202 11:07:06.106146 5760 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/2e138f46-a2e7-11ed-8c0a-1250e2f4dc61/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh1320855839/key --ssh-user prow I0202 11:07:06.520120 6131 gce.go:99] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] 2023/02/02 11:07:11 Dumping node control-plane-us-central1-a-vwcg 2023/02/02 11:07:15 error dumping node control-plane-us-central1-a-vwcg: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/02/02 11:07:15 error dumping node control-plane-us-central1-a-vwcg: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/02/02 11:07:15 Dumping node control-plane-us-central1-b-k4x0 2023/02/02 11:07:19 error dumping node control-plane-us-central1-b-k4x0: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/02/02 11:07:19 error dumping node control-plane-us-central1-b-k4x0: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/02/02 11:07:19 Dumping node control-plane-us-central1-c-3qmw 2023/02/02 11:07:23 error dumping node control-plane-us-central1-c-3qmw: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/02/02 11:07:23 error dumping node control-plane-us-central1-c-3qmw: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/02/02 11:07:23 dumping node not registered in kubernetes: 34.135.158.159 2023/02/02 11:07:23 Dumping node 34.135.158.159 I0202 11:07:25.346612 5760 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/2e138f46-a2e7-11ed-8c0a-1250e2f4dc61/kops get cluster --name ha-migration.k8s.local -o yaml I0202 11:07:25.346649 5760 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/2e138f46-a2e7-11ed-8c0a-1250e2f4dc61/kops get cluster --name ha-migration.k8s.local -o yaml I0202 11:07:25.552330 5760 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/2e138f46-a2e7-11ed-8c0a-1250e2f4dc61/kops get instancegroups --name ha-migration.k8s.local -o yaml I0202 11:07:25.552368 5760 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/2e138f46-a2e7-11ed-8c0a-1250e2f4dc61/kops get instancegroups --name ha-migration.k8s.local -o yaml ... skipping 167 lines ... Deleted cluster: "ha-migration.k8s.local" I0202 11:09:39.124893 5760 gcs.go:88] gsutil -u gce-cvm-upg-1-3-1-4-ctl-skew rm -r gs://gce-cvm-upg-1-3-1-4-ctl-skew-state-2e I0202 11:09:39.124958 5760 local.go:42] ⚙️ gsutil -u gce-cvm-upg-1-3-1-4-ctl-skew rm -r gs://gce-cvm-upg-1-3-1-4-ctl-skew-state-2e Removing gs://gce-cvm-upg-1-3-1-4-ctl-skew-state-2e/... I0202 11:09:41.645820 5760 down.go:62] releasing boskos project I0202 11:09:41.654782 5760 boskos.go:83] Boskos heartbeat func received signal to close Error: exit status 1 + EXIT_VALUE=1 + set +o xtrace