e2e-kops-gce-leader-migration #1619920432981348352
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 1 failed / 1 succeeded |
| Started | |
| Elapsed | 20m23s |
| Revision | master |
exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
kubetest2 Down
... skipping 156 lines ... ......................................Updated [https://www.googleapis.com/compute/v1/projects/k8s-kubeadm-1-6-on-1-7]. ..done. WARNING: No host aliases were added to your SSH configs because you do not have any running instances. Try running this command again after running some instances. I0130 04:50:28.732044 5717 up.go:44] Cleaning up any leaked resources from previous cluster I0130 04:50:28.732192 5717 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/531d711b-a059-11ed-9a0c-f25a29267a91/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh2974755992/key --ssh-user prow I0130 04:50:28.732207 5717 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/531d711b-a059-11ed-9a0c-f25a29267a91/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh2974755992/key --ssh-user prow Error: Cluster.kops.k8s.io "ha-migration.k8s.local" not found W0130 04:50:29.045692 5717 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1 I0130 04:50:29.045865 5717 down.go:48] /home/prow/go/src/k8s.io/kops/_rundir/531d711b-a059-11ed-9a0c-f25a29267a91/kops delete cluster --name ha-migration.k8s.local --yes I0130 04:50:29.045876 5717 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/531d711b-a059-11ed-9a0c-f25a29267a91/kops delete cluster --name ha-migration.k8s.local --yes Error: error reading cluster configuration: Cluster.kops.k8s.io "ha-migration.k8s.local" not found I0130 04:50:29.262589 5717 gcs.go:51] gsutil ls -b -p k8s-kubeadm-1-6-on-1-7 gs://k8s-kubeadm-1-6-on-1-7-state-53 I0130 04:50:29.262623 5717 local.go:42] ⚙️ gsutil ls -b -p k8s-kubeadm-1-6-on-1-7 gs://k8s-kubeadm-1-6-on-1-7-state-53 I0130 04:50:31.359565 5717 gcs.go:70] gsutil mb -p k8s-kubeadm-1-6-on-1-7 gs://k8s-kubeadm-1-6-on-1-7-state-53 I0130 04:50:31.359603 5717 local.go:42] ⚙️ gsutil mb -p k8s-kubeadm-1-6-on-1-7 gs://k8s-kubeadm-1-6-on-1-7-state-53 Creating gs://k8s-kubeadm-1-6-on-1-7-state-53/... I0130 04:50:33.984362 5717 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip 2023/01/30 04:50:33 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404 I0130 04:50:33.999981 5717 http.go:37] curl https://ip.jsb.workers.dev I0130 04:50:34.091741 5717 up.go:167] /home/prow/go/src/k8s.io/kops/_rundir/531d711b-a059-11ed-9a0c-f25a29267a91/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh2974755992/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 34.123.87.11/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project k8s-kubeadm-1-6-on-1-7 I0130 04:50:34.091784 5717 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/531d711b-a059-11ed-9a0c-f25a29267a91/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh2974755992/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 34.123.87.11/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project k8s-kubeadm-1-6-on-1-7 I0130 04:50:34.146128 6038 create_cluster.go:882] Using SSH public key: /tmp/kops-ssh2974755992/key.pub I0130 04:50:34.426843 6038 new_cluster.go:573] VMs will be configured to use specified Service Account: default I0130 04:50:34.426976 6038 new_cluster.go:1338] Cloud Provider ID: "gce" ... skipping 527 lines ... I0130 04:50:46.184542 6058 keypair.go:226] Issuing new certificate: "etcd-clients-ca" I0130 04:50:46.184936 6058 keypair.go:226] Issuing new certificate: "apiserver-aggregator-ca" W0130 04:50:46.375964 6058 vfs_keystorereader.go:143] CA private key was not found I0130 04:50:46.476015 6058 keypair.go:226] Issuing new certificate: "service-account" I0130 04:50:46.530309 6058 keypair.go:226] Issuing new certificate: "kubernetes-ca" I0130 04:50:58.752875 6058 executor.go:111] Tasks: 50 done / 91 total; 23 can run W0130 04:51:08.662590 6058 executor.go:139] error running task "ForwardingRule/api-ha-migration-k8s-local" (9m50s remaining to succeed): error creating ForwardingRule "api-ha-migration-k8s-local": googleapi: Error 400: The resource 'projects/k8s-kubeadm-1-6-on-1-7/regions/us-central1/targetPools/api-ha-migration-k8s-local' is not ready, resourceNotReady I0130 04:51:08.662697 6058 executor.go:111] Tasks: 72 done / 91 total; 13 can run I0130 04:51:15.429813 6058 executor.go:111] Tasks: 85 done / 91 total; 6 can run I0130 04:51:29.508950 6058 executor.go:111] Tasks: 91 done / 91 total; 0 can run I0130 04:51:29.578857 6058 update_cluster.go:323] Exporting kubeconfig for cluster kOps has set your kubectl context to ha-migration.k8s.local ... skipping 7 lines ... * read about installing addons at: https://kops.sigs.k8s.io/addons. I0130 04:51:39.997054 5717 up.go:251] /home/prow/go/src/k8s.io/kops/_rundir/531d711b-a059-11ed-9a0c-f25a29267a91/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s I0130 04:51:39.997107 5717 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/531d711b-a059-11ed-9a0c-f25a29267a91/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s Validating cluster ha-migration.k8s.local W0130 04:52:10.659346 6079 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.170.190.83/api/v1/nodes": dial tcp 34.170.190.83:443: i/o timeout W0130 04:52:27.841131 6079 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.170.190.83/api/v1/nodes": dial tcp 34.170.190.83:443: connect: connection refused W0130 04:52:37.844715 6079 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.170.190.83/api/v1/nodes": dial tcp 34.170.190.83:443: connect: connection refused W0130 04:52:47.852122 6079 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.170.190.83/api/v1/nodes": dial tcp 34.170.190.83:443: connect: connection refused W0130 04:52:57.854865 6079 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.170.190.83/api/v1/nodes": dial tcp 34.170.190.83:443: connect: connection refused W0130 04:53:07.858960 6079 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.170.190.83/api/v1/nodes": dial tcp 34.170.190.83:443: connect: connection refused W0130 04:53:17.861644 6079 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.170.190.83/api/v1/nodes": dial tcp 34.170.190.83:443: connect: connection refused W0130 04:53:27.872408 6079 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.170.190.83/api/v1/nodes": dial tcp 34.170.190.83:443: connect: connection refused W0130 04:53:37.880028 6079 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.170.190.83/api/v1/nodes": dial tcp 34.170.190.83:443: connect: connection refused W0130 04:53:47.884223 6079 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.170.190.83/api/v1/nodes": dial tcp 34.170.190.83:443: connect: connection refused W0130 04:54:12.762444 6079 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.170.190.83/api/v1/nodes": net/http: TLS handshake timeout - error from a previous attempt: read tcp 10.60.56.59:59880->34.170.190.83:443: read: connection reset by peer W0130 04:54:22.765221 6079 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.170.190.83/api/v1/nodes": dial tcp 34.170.190.83:443: connect: connection refused W0130 04:54:32.770173 6079 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.170.190.83/api/v1/nodes": dial tcp 34.170.190.83:443: connect: connection refused W0130 04:54:52.775512 6079 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.170.190.83/api/v1/nodes": net/http: TLS handshake timeout W0130 04:55:02.781515 6079 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.170.190.83/api/v1/nodes": dial tcp 34.170.190.83:443: connect: connection refused W0130 04:55:12.785333 6079 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.170.190.83/api/v1/nodes": dial tcp 34.170.190.83:443: connect: connection refused I0130 04:55:17.236933 5717 boskos.go:86] Sending heartbeat to Boskos W0130 04:55:22.789303 6079 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.170.190.83/api/v1/nodes": dial tcp 34.170.190.83:443: connect: connection refused I0130 04:55:35.843025 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-c ControlPlane e2-standard-2 1 1 us-central1 ... skipping 10 lines ... KIND NAME MESSAGE Machine https://www.googleapis.com/compute/v1/projects/k8s-kubeadm-1-6-on-1-7/zones/us-central1-a/instances/nodes-us-central1-a-r7h4 machine "https://www.googleapis.com/compute/v1/projects/k8s-kubeadm-1-6-on-1-7/zones/us-central1-a/instances/nodes-us-central1-a-r7h4" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-kubeadm-1-6-on-1-7/zones/us-central1-c/instances/control-plane-us-central1-c-2r0p machine "https://www.googleapis.com/compute/v1/projects/k8s-kubeadm-1-6-on-1-7/zones/us-central1-c/instances/control-plane-us-central1-c-2r0p" has not yet joined cluster Node control-plane-us-central1-a-d27f node "control-plane-us-central1-a-d27f" of role "control-plane" is not ready Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Validation Failed W0130 04:55:36.814180 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 04:55:47.273367 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 12 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-kubeadm-1-6-on-1-7/zones/us-central1-a/instances/nodes-us-central1-a-r7h4 machine "https://www.googleapis.com/compute/v1/projects/k8s-kubeadm-1-6-on-1-7/zones/us-central1-a/instances/nodes-us-central1-a-r7h4" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-kubeadm-1-6-on-1-7/zones/us-central1-c/instances/control-plane-us-central1-c-2r0p machine "https://www.googleapis.com/compute/v1/projects/k8s-kubeadm-1-6-on-1-7/zones/us-central1-c/instances/control-plane-us-central1-c-2r0p" has not yet joined cluster Node control-plane-us-central1-a-d27f node "control-plane-us-central1-a-d27f" of role "control-plane" is not ready Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Pod kube-system/etcd-manager-events-control-plane-us-central1-b-50g5 system-cluster-critical pod "etcd-manager-events-control-plane-us-central1-b-50g5" is pending Validation Failed W0130 04:55:48.323280 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 04:55:58.750507 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 21 lines ... Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Pod kube-system/etcd-manager-main-control-plane-us-central1-b-50g5 system-cluster-critical pod "etcd-manager-main-control-plane-us-central1-b-50g5" is pending Pod kube-system/kops-controller-hrlhh system-cluster-critical pod "kops-controller-hrlhh" is pending Pod kube-system/kops-controller-w6lk4 system-cluster-critical pod "kops-controller-w6lk4" is pending Validation Failed W0130 04:55:59.634272 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 04:56:10.004982 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 24 lines ... Pod kube-system/kops-controller-hrlhh system-cluster-critical pod "kops-controller-hrlhh" is pending Pod kube-system/kops-controller-w6lk4 system-cluster-critical pod "kops-controller-w6lk4" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-a-d27f system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-d27f" is not ready (kube-controller-manager) Pod kube-system/kube-scheduler-control-plane-us-central1-a-d27f system-cluster-critical pod "kube-scheduler-control-plane-us-central1-a-d27f" is pending Pod kube-system/kube-scheduler-control-plane-us-central1-b-50g5 system-cluster-critical pod "kube-scheduler-control-plane-us-central1-b-50g5" is pending Validation Failed W0130 04:56:10.915011 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 04:56:21.335265 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 22 lines ... Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Pod kube-system/kops-controller-hcslj system-cluster-critical pod "kops-controller-hcslj" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-a-d27f system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-d27f" is not ready (kube-controller-manager) Validation Failed W0130 04:56:22.241260 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 04:56:32.680721 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 20 lines ... Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Pod kube-system/kops-controller-hcslj system-cluster-critical pod "kops-controller-hcslj" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-a-d27f system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-d27f" is not ready (kube-controller-manager) Validation Failed W0130 04:56:33.543336 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 04:56:43.965211 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 18 lines ... Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Pod kube-system/kops-controller-hcslj system-cluster-critical pod "kops-controller-hcslj" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-a-d27f system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-d27f" is not ready (kube-controller-manager) Validation Failed W0130 04:56:44.795932 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 04:56:55.148413 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 19 lines ... Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Pod kube-system/kube-apiserver-control-plane-us-central1-a-d27f system-cluster-critical pod "kube-apiserver-control-plane-us-central1-a-d27f" is pending Pod kube-system/kube-apiserver-control-plane-us-central1-b-50g5 system-cluster-critical pod "kube-apiserver-control-plane-us-central1-b-50g5" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-a-d27f system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-d27f" is not ready (kube-controller-manager) Validation Failed W0130 04:56:55.991951 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 04:57:06.392819 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 17 lines ... Pod kube-system/cilium-dfrzv system-node-critical pod "cilium-dfrzv" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-c-2r0p system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-c-2r0p" is not ready (kube-controller-manager) Validation Failed W0130 04:57:07.305907 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 04:57:17.700273 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/cilium-dfrzv system-node-critical pod "cilium-dfrzv" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 04:57:18.502992 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 04:57:28.924900 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Pod kube-system/kube-apiserver-control-plane-us-central1-c-2r0p system-cluster-critical pod "kube-apiserver-control-plane-us-central1-c-2r0p" is pending Validation Failed W0130 04:57:29.841476 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 04:57:40.290980 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 04:57:41.225362 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 04:57:51.605066 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 04:57:52.523435 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 04:58:02.929042 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 04:58:03.743706 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 04:58:14.131645 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Pod kube-system/etcd-manager-main-control-plane-us-central1-c-2r0p system-cluster-critical pod "etcd-manager-main-control-plane-us-central1-c-2r0p" is pending Validation Failed W0130 04:58:14.941696 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 04:58:25.390498 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 04:58:26.250896 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 04:58:36.643408 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 04:58:37.508361 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 04:58:47.950861 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 04:58:48.747687 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 04:58:59.126429 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 04:59:00.025999 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 04:59:10.382933 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 04:59:11.203767 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 04:59:21.642769 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 04:59:22.523003 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 04:59:32.968507 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 04:59:33.780300 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 04:59:44.240064 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 04:59:45.164428 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 04:59:55.527019 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 04:59:56.337713 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:00:06.757362 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:00:07.576693 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:00:17.248732 5717 boskos.go:86] Sending heartbeat to Boskos I0130 05:00:17.917247 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:00:18.892385 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:00:29.287438 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:00:30.098612 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:00:40.505532 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:00:41.356478 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:00:51.836767 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:00:52.636620 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:01:03.116309 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:01:03.938671 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:01:14.355279 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:01:15.171603 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:01:25.615233 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:01:26.482851 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:01:36.905221 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:01:37.839920 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:01:48.226023 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:01:49.078128 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:01:59.448454 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:02:00.300816 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:02:10.713387 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:02:11.531226 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:02:21.930048 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:02:22.797409 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:02:33.159348 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:02:34.047496 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:02:44.506484 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:02:45.314147 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:02:55.750815 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:02:56.514457 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:03:06.944275 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:03:07.831753 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:03:18.276625 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:03:19.095718 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:03:29.487841 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:03:30.331858 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:03:40.716072 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:03:41.591616 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:03:51.961376 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:03:52.763130 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:04:03.167554 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:04:04.047247 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:04:14.443026 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:04:15.290754 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:04:25.732046 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:04:26.499326 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:04:36.938265 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:04:37.712834 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:04:48.136007 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:04:49.042379 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:04:59.472557 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:05:00.311261 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:05:10.677919 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:05:11.544901 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:05:17.260724 5717 boskos.go:86] Sending heartbeat to Boskos I0130 05:05:21.927965 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:05:22.745296 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:05:33.149714 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:05:33.915543 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:05:44.389093 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:05:45.158471 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:05:55.507972 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:05:56.322673 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:06:06.792432 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:06:07.639896 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:06:18.020923 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:06:18.809243 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:06:29.241645 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:06:30.123076 6079 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 05:06:40.564707 6079 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-50g5 node "control-plane-us-central1-b-50g5" of role "control-plane" is not ready Node control-plane-us-central1-c-2r0p node "control-plane-us-central1-c-2r0p" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-fp4wz system-cluster-critical pod "coredns-5d479c4f64-fp4wz" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-8c6qh system-cluster-critical pod "coredns-autoscaler-557ccb4c66-8c6qh" is pending Pod kube-system/dns-controller-6f69f47785-r975c system-cluster-critical pod "dns-controller-6f69f47785-r975c" is pending Validation Failed W0130 05:06:41.379613 6079 validate_cluster.go:232] (will retry): cluster not yet healthy Error: validation failed: wait time exceeded during validation I0130 05:06:51.394738 5717 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/531d711b-a059-11ed-9a0c-f25a29267a91/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh2974755992/key --ssh-user prow I0130 05:06:51.394840 5717 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/531d711b-a059-11ed-9a0c-f25a29267a91/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh2974755992/key --ssh-user prow I0130 05:06:51.885447 6089 gce.go:99] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] 2023/01/30 05:06:56 Dumping node control-plane-us-central1-a-d27f 2023/01/30 05:06:59 error dumping node control-plane-us-central1-a-d27f: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/30 05:06:59 error dumping node control-plane-us-central1-a-d27f: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/30 05:06:59 Dumping node control-plane-us-central1-b-50g5 2023/01/30 05:07:03 error dumping node control-plane-us-central1-b-50g5: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/30 05:07:03 error dumping node control-plane-us-central1-b-50g5: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/30 05:07:03 Dumping node control-plane-us-central1-c-2r0p 2023/01/30 05:07:07 error dumping node control-plane-us-central1-c-2r0p: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/30 05:07:07 error dumping node control-plane-us-central1-c-2r0p: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/30 05:07:07 dumping node not registered in kubernetes: 34.171.5.19 2023/01/30 05:07:07 Dumping node 34.171.5.19 I0130 05:07:09.038803 5717 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/531d711b-a059-11ed-9a0c-f25a29267a91/kops get cluster --name ha-migration.k8s.local -o yaml I0130 05:07:09.038842 5717 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/531d711b-a059-11ed-9a0c-f25a29267a91/kops get cluster --name ha-migration.k8s.local -o yaml I0130 05:07:09.201231 5717 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/531d711b-a059-11ed-9a0c-f25a29267a91/kops get instancegroups --name ha-migration.k8s.local -o yaml I0130 05:07:09.201289 5717 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/531d711b-a059-11ed-9a0c-f25a29267a91/kops get instancegroups --name ha-migration.k8s.local -o yaml ... skipping 166 lines ... Deleted cluster: "ha-migration.k8s.local" I0130 05:09:27.317665 5717 gcs.go:88] gsutil -u k8s-kubeadm-1-6-on-1-7 rm -r gs://k8s-kubeadm-1-6-on-1-7-state-53 I0130 05:09:27.317712 5717 local.go:42] ⚙️ gsutil -u k8s-kubeadm-1-6-on-1-7 rm -r gs://k8s-kubeadm-1-6-on-1-7-state-53 Removing gs://k8s-kubeadm-1-6-on-1-7-state-53/... I0130 05:09:30.300006 5717 down.go:62] releasing boskos project I0130 05:09:30.310356 5717 boskos.go:83] Boskos heartbeat func received signal to close Error: exit status 1 + EXIT_VALUE=1 + set +o xtrace