e2e-kops-gce-leader-migration #1620192198895079424
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 1 failed / 1 succeeded |
| Started | |
| Elapsed | 20m44s |
| Revision | master |
exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
kubetest2 Down
... skipping 156 lines ... .....................................Updated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci-serial]. ..done. WARNING: No host aliases were added to your SSH configs because you do not have any running instances. Try running this command again after running some instances. I0130 22:50:33.628155 5816 up.go:44] Cleaning up any leaked resources from previous cluster I0130 22:50:33.628328 5816 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/2f5fea9c-a0f0-11ed-9994-daecb65d57ab/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh58337312/key --ssh-user prow I0130 22:50:33.628357 5816 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/2f5fea9c-a0f0-11ed-9994-daecb65d57ab/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh58337312/key --ssh-user prow Error: Cluster.kops.k8s.io "ha-migration.k8s.local" not found W0130 22:50:33.917801 5816 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1 I0130 22:50:33.917856 5816 down.go:48] /home/prow/go/src/k8s.io/kops/_rundir/2f5fea9c-a0f0-11ed-9994-daecb65d57ab/kops delete cluster --name ha-migration.k8s.local --yes I0130 22:50:33.917880 5816 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/2f5fea9c-a0f0-11ed-9994-daecb65d57ab/kops delete cluster --name ha-migration.k8s.local --yes Error: error reading cluster configuration: Cluster.kops.k8s.io "ha-migration.k8s.local" not found I0130 22:50:34.077020 5816 gcs.go:51] gsutil ls -b -p k8s-jkns-e2e-gce-gci-serial gs://k8s-jkns-e2e-gce-gci-serial-state-2f I0130 22:50:34.077064 5816 local.go:42] ⚙️ gsutil ls -b -p k8s-jkns-e2e-gce-gci-serial gs://k8s-jkns-e2e-gce-gci-serial-state-2f I0130 22:50:36.706358 5816 gcs.go:70] gsutil mb -p k8s-jkns-e2e-gce-gci-serial gs://k8s-jkns-e2e-gce-gci-serial-state-2f I0130 22:50:36.706480 5816 local.go:42] ⚙️ gsutil mb -p k8s-jkns-e2e-gce-gci-serial gs://k8s-jkns-e2e-gce-gci-serial-state-2f Creating gs://k8s-jkns-e2e-gce-gci-serial-state-2f/... I0130 22:50:39.463763 5816 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip 2023/01/30 22:50:39 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404 I0130 22:50:39.477824 5816 http.go:37] curl https://ip.jsb.workers.dev I0130 22:50:39.575416 5816 up.go:167] /home/prow/go/src/k8s.io/kops/_rundir/2f5fea9c-a0f0-11ed-9994-daecb65d57ab/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh58337312/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 35.224.73.140/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project k8s-jkns-e2e-gce-gci-serial I0130 22:50:39.575457 5816 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/2f5fea9c-a0f0-11ed-9994-daecb65d57ab/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh58337312/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 35.224.73.140/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project k8s-jkns-e2e-gce-gci-serial I0130 22:50:39.625263 6138 create_cluster.go:882] Using SSH public key: /tmp/kops-ssh58337312/key.pub I0130 22:50:39.849425 6138 new_cluster.go:573] VMs will be configured to use specified Service Account: default I0130 22:50:39.849731 6138 new_cluster.go:1338] Cloud Provider ID: "gce" ... skipping 527 lines ... I0130 22:50:52.284785 6158 keypair.go:226] Issuing new certificate: "etcd-peers-ca-events" I0130 22:50:52.297445 6158 keypair.go:226] Issuing new certificate: "etcd-manager-ca-main" W0130 22:50:52.479288 6158 vfs_keystorereader.go:143] CA private key was not found I0130 22:50:52.679320 6158 keypair.go:226] Issuing new certificate: "kubernetes-ca" I0130 22:50:52.682042 6158 keypair.go:226] Issuing new certificate: "service-account" I0130 22:51:10.893343 6158 executor.go:111] Tasks: 50 done / 91 total; 23 can run W0130 22:51:20.818891 6158 executor.go:139] error running task "ForwardingRule/api-ha-migration-k8s-local" (9m50s remaining to succeed): error creating ForwardingRule "api-ha-migration-k8s-local": googleapi: Error 400: The resource 'projects/k8s-jkns-e2e-gce-gci-serial/regions/us-central1/targetPools/api-ha-migration-k8s-local' is not ready, resourceNotReady I0130 22:51:20.818956 6158 executor.go:111] Tasks: 72 done / 91 total; 13 can run I0130 22:51:27.576470 6158 executor.go:111] Tasks: 85 done / 91 total; 6 can run I0130 22:51:41.651444 6158 executor.go:111] Tasks: 91 done / 91 total; 0 can run I0130 22:51:42.161749 6158 update_cluster.go:323] Exporting kubeconfig for cluster kOps has set your kubectl context to ha-migration.k8s.local ... skipping 7 lines ... * read about installing addons at: https://kops.sigs.k8s.io/addons. I0130 22:51:52.532066 5816 up.go:251] /home/prow/go/src/k8s.io/kops/_rundir/2f5fea9c-a0f0-11ed-9994-daecb65d57ab/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s I0130 22:51:52.532129 5816 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/2f5fea9c-a0f0-11ed-9994-daecb65d57ab/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s Validating cluster ha-migration.k8s.local W0130 22:52:23.049561 6177 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.28.59.142/api/v1/nodes": dial tcp 34.28.59.142:443: i/o timeout W0130 22:53:03.050496 6177 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.28.59.142/api/v1/nodes": dial tcp 34.28.59.142:443: i/o timeout W0130 22:53:13.053936 6177 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.28.59.142/api/v1/nodes": dial tcp 34.28.59.142:443: connect: connection refused W0130 22:53:23.057513 6177 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.28.59.142/api/v1/nodes": dial tcp 34.28.59.142:443: connect: connection refused W0130 22:53:33.061796 6177 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.28.59.142/api/v1/nodes": dial tcp 34.28.59.142:443: connect: connection refused W0130 22:53:43.065436 6177 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.28.59.142/api/v1/nodes": dial tcp 34.28.59.142:443: connect: connection refused W0130 22:53:53.070070 6177 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.28.59.142/api/v1/nodes": dial tcp 34.28.59.142:443: connect: connection refused W0130 22:54:03.075008 6177 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.28.59.142/api/v1/nodes": dial tcp 34.28.59.142:443: connect: connection refused W0130 22:54:13.078252 6177 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.28.59.142/api/v1/nodes": dial tcp 34.28.59.142:443: connect: connection refused W0130 22:54:23.082090 6177 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.28.59.142/api/v1/nodes": dial tcp 34.28.59.142:443: connect: connection refused W0130 22:54:33.086289 6177 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.28.59.142/api/v1/nodes": dial tcp 34.28.59.142:443: connect: connection refused W0130 22:54:55.163328 6177 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.28.59.142/api/v1/nodes": dial tcp 34.28.59.142:443: connect: connection refused - error from a previous attempt: read tcp 10.60.165.131:38692->34.28.59.142:443: read: connection reset by peer W0130 22:55:15.167088 6177 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.28.59.142/api/v1/nodes": net/http: TLS handshake timeout I0130 22:55:20.800326 5816 boskos.go:86] Sending heartbeat to Boskos W0130 22:55:33.052477 6177 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.28.59.142/api/v1/nodes": dial tcp 34.28.59.142:443: connect: connection refused - error from a previous attempt: read tcp 10.60.165.131:59462->34.28.59.142:443: read: connection reset by peer W0130 22:55:53.056263 6177 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.28.59.142/api/v1/nodes": net/http: TLS handshake timeout W0130 22:56:03.059695 6177 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.28.59.142/api/v1/nodes": dial tcp 34.28.59.142:443: connect: connection refused W0130 22:56:13.063268 6177 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.28.59.142/api/v1/nodes": dial tcp 34.28.59.142:443: connect: connection refused W0130 22:56:33.067498 6177 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.28.59.142/api/v1/nodes": net/http: TLS handshake timeout W0130 22:56:43.070103 6177 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.28.59.142/api/v1/nodes": dial tcp 34.28.59.142:443: connect: connection refused I0130 22:56:53.532063 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-c ControlPlane e2-standard-2 1 1 us-central1 ... skipping 9 lines ... KIND NAME MESSAGE Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci-serial/zones/us-central1-a/instances/nodes-us-central1-a-lmc0 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci-serial/zones/us-central1-a/instances/nodes-us-central1-a-lmc0" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci-serial/zones/us-central1-b/instances/control-plane-us-central1-b-vgh7 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci-serial/zones/us-central1-b/instances/control-plane-us-central1-b-vgh7" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci-serial/zones/us-central1-c/instances/control-plane-us-central1-c-mbw8 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci-serial/zones/us-central1-c/instances/control-plane-us-central1-c-mbw8" has not yet joined cluster Node control-plane-us-central1-a-fc33 node "control-plane-us-central1-a-fc33" of role "control-plane" is not ready Validation Failed W0130 22:56:54.473005 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 22:57:04.875302 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 10 lines ... KIND NAME MESSAGE Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci-serial/zones/us-central1-a/instances/nodes-us-central1-a-lmc0 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci-serial/zones/us-central1-a/instances/nodes-us-central1-a-lmc0" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci-serial/zones/us-central1-b/instances/control-plane-us-central1-b-vgh7 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci-serial/zones/us-central1-b/instances/control-plane-us-central1-b-vgh7" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci-serial/zones/us-central1-c/instances/control-plane-us-central1-c-mbw8 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci-serial/zones/us-central1-c/instances/control-plane-us-central1-c-mbw8" has not yet joined cluster Node control-plane-us-central1-a-fc33 node "control-plane-us-central1-a-fc33" of role "control-plane" is not ready Validation Failed W0130 22:57:05.853740 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 22:57:16.328707 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 11 lines ... KIND NAME MESSAGE Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci-serial/zones/us-central1-a/instances/nodes-us-central1-a-lmc0 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci-serial/zones/us-central1-a/instances/nodes-us-central1-a-lmc0" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci-serial/zones/us-central1-b/instances/control-plane-us-central1-b-vgh7 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci-serial/zones/us-central1-b/instances/control-plane-us-central1-b-vgh7" has not yet joined cluster Node control-plane-us-central1-a-fc33 node "control-plane-us-central1-a-fc33" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Validation Failed W0130 22:57:17.212476 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 22:57:27.642265 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 11 lines ... KIND NAME MESSAGE Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci-serial/zones/us-central1-a/instances/nodes-us-central1-a-lmc0 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci-serial/zones/us-central1-a/instances/nodes-us-central1-a-lmc0" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci-serial/zones/us-central1-b/instances/control-plane-us-central1-b-vgh7 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci-serial/zones/us-central1-b/instances/control-plane-us-central1-b-vgh7" has not yet joined cluster Node control-plane-us-central1-a-fc33 node "control-plane-us-central1-a-fc33" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Validation Failed W0130 22:57:28.509143 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 22:57:38.950261 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 12 lines ... KIND NAME MESSAGE Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci-serial/zones/us-central1-a/instances/nodes-us-central1-a-lmc0 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci-serial/zones/us-central1-a/instances/nodes-us-central1-a-lmc0" has not yet joined cluster Node control-plane-us-central1-a-fc33 node "control-plane-us-central1-a-fc33" of role "control-plane" is not ready Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Validation Failed W0130 22:57:39.752698 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 22:57:50.222247 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 13 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci-serial/zones/us-central1-a/instances/nodes-us-central1-a-lmc0 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci-serial/zones/us-central1-a/instances/nodes-us-central1-a-lmc0" has not yet joined cluster Node control-plane-us-central1-a-fc33 node "control-plane-us-central1-a-fc33" of role "control-plane" is not ready Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-a-fc33 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-fc33" is not ready (kube-controller-manager) Validation Failed W0130 22:57:51.083920 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 22:58:01.510867 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 24 lines ... Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Pod kube-system/kops-controller-9jszk system-cluster-critical pod "kops-controller-9jszk" is pending Pod kube-system/kops-controller-ftfhz system-cluster-critical pod "kops-controller-ftfhz" is pending Pod kube-system/kube-apiserver-control-plane-us-central1-a-fc33 system-cluster-critical pod "kube-apiserver-control-plane-us-central1-a-fc33" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-a-fc33 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-fc33" is not ready (kube-controller-manager) Validation Failed W0130 22:58:02.348183 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 22:58:12.778947 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 26 lines ... Pod kube-system/etcd-manager-main-control-plane-us-central1-b-vgh7 system-cluster-critical pod "etcd-manager-main-control-plane-us-central1-b-vgh7" is pending Pod kube-system/kops-controller-ftfhz system-cluster-critical pod "kops-controller-ftfhz" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-a-fc33 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-fc33" is not ready (kube-controller-manager) Pod kube-system/kube-scheduler-control-plane-us-central1-b-vgh7 system-cluster-critical pod "kube-scheduler-control-plane-us-central1-b-vgh7" is pending Pod kube-system/kube-scheduler-control-plane-us-central1-c-mbw8 system-cluster-critical pod "kube-scheduler-control-plane-us-central1-c-mbw8" is pending Validation Failed W0130 22:58:13.630842 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 22:58:24.034164 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 20 lines ... Pod kube-system/cilium-xd2b5 system-node-critical pod "cilium-xd2b5" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Pod kube-system/kube-apiserver-control-plane-us-central1-c-mbw8 system-cluster-critical pod "kube-apiserver-control-plane-us-central1-c-mbw8" is pending Validation Failed W0130 22:58:24.986845 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 22:58:35.375123 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 19 lines ... Pod kube-system/cilium-xd2b5 system-node-critical pod "cilium-xd2b5" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Pod kube-system/etcd-manager-main-control-plane-us-central1-c-mbw8 system-cluster-critical pod "etcd-manager-main-control-plane-us-central1-c-mbw8" is pending Validation Failed W0130 22:58:36.265910 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 22:58:46.659855 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/cilium-kb9h7 system-node-critical pod "cilium-kb9h7" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 22:58:47.584576 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 22:58:57.978644 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 22:58:58.789117 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 22:59:09.183346 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 22:59:10.047788 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 22:59:20.518564 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 22:59:21.475325 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 22:59:31.957034 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 22:59:32.779628 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 22:59:43.219889 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 22:59:44.107278 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 22:59:54.550793 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 22:59:55.411368 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:00:05.899504 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:00:06.751882 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:00:17.206985 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:00:18.109925 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:00:20.812086 5816 boskos.go:86] Sending heartbeat to Boskos I0130 23:00:28.512458 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:00:29.366702 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:00:39.859897 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:00:40.821579 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:00:51.299487 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:00:52.129682 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:01:02.621982 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:01:03.437816 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:01:13.906799 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:01:14.752658 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:01:25.243725 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:01:26.108286 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:01:36.504882 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:01:37.382709 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:01:47.788693 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:01:48.691262 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:01:59.074040 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:01:59.986603 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:02:10.473428 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:02:11.342505 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:02:21.769732 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:02:22.685132 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:02:33.175089 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:02:34.104125 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:02:44.490755 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:02:45.381904 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:02:55.791440 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:02:56.613531 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:03:07.004714 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:03:07.844589 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:03:18.349243 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:03:19.201834 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:03:29.719024 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:03:30.604144 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:03:41.002226 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:03:41.890529 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:03:52.282071 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:03:53.121297 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:04:03.591102 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:04:04.480228 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:04:14.961315 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:04:15.797001 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:04:26.326659 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:04:27.228346 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:04:37.658832 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:04:38.543030 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:04:49.023325 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:04:49.911758 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:05:00.303963 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:05:01.185752 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:05:11.561776 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:05:12.423078 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:05:20.823652 5816 boskos.go:86] Sending heartbeat to Boskos I0130 23:05:22.792547 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:05:23.689843 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:05:34.068885 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:05:34.931713 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:05:45.336677 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:05:46.200682 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:05:56.582121 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:05:57.488513 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:06:07.874368 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:06:08.809068 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:06:19.167154 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:06:20.041196 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:06:30.478721 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:06:31.335186 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:06:41.739603 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:06:42.575022 6177 validate_cluster.go:232] (will retry): cluster not yet healthy I0130 23:06:53.019290 6177 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-vgh7 node "control-plane-us-central1-b-vgh7" of role "control-plane" is not ready Node control-plane-us-central1-c-mbw8 node "control-plane-us-central1-c-mbw8" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-68bz9 system-cluster-critical pod "coredns-5d479c4f64-68bz9" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-9fhmv system-cluster-critical pod "coredns-autoscaler-557ccb4c66-9fhmv" is pending Pod kube-system/dns-controller-6f69f47785-2xs92 system-cluster-critical pod "dns-controller-6f69f47785-2xs92" is pending Validation Failed W0130 23:06:53.983182 6177 validate_cluster.go:232] (will retry): cluster not yet healthy Error: validation failed: wait time exceeded during validation I0130 23:07:03.989750 5816 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/2f5fea9c-a0f0-11ed-9994-daecb65d57ab/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh58337312/key --ssh-user prow I0130 23:07:03.989853 5816 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/2f5fea9c-a0f0-11ed-9994-daecb65d57ab/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh58337312/key --ssh-user prow I0130 23:07:04.499923 6187 gce.go:99] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] 2023/01/30 23:07:09 Dumping node control-plane-us-central1-a-fc33 2023/01/30 23:07:13 error dumping node control-plane-us-central1-a-fc33: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/30 23:07:13 error dumping node control-plane-us-central1-a-fc33: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/30 23:07:13 Dumping node control-plane-us-central1-b-vgh7 2023/01/30 23:07:18 error dumping node control-plane-us-central1-b-vgh7: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/30 23:07:18 error dumping node control-plane-us-central1-b-vgh7: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/30 23:07:18 Dumping node control-plane-us-central1-c-mbw8 2023/01/30 23:07:22 error dumping node control-plane-us-central1-c-mbw8: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/30 23:07:22 error dumping node control-plane-us-central1-c-mbw8: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/30 23:07:22 dumping node not registered in kubernetes: 35.232.100.108 2023/01/30 23:07:22 Dumping node 35.232.100.108 I0130 23:07:24.832396 5816 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/2f5fea9c-a0f0-11ed-9994-daecb65d57ab/kops get cluster --name ha-migration.k8s.local -o yaml I0130 23:07:24.832826 5816 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/2f5fea9c-a0f0-11ed-9994-daecb65d57ab/kops get cluster --name ha-migration.k8s.local -o yaml I0130 23:07:25.048078 5816 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/2f5fea9c-a0f0-11ed-9994-daecb65d57ab/kops get instancegroups --name ha-migration.k8s.local -o yaml I0130 23:07:25.048116 5816 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/2f5fea9c-a0f0-11ed-9994-daecb65d57ab/kops get instancegroups --name ha-migration.k8s.local -o yaml ... skipping 166 lines ... Deleted cluster: "ha-migration.k8s.local" I0130 23:09:47.445215 5816 gcs.go:88] gsutil -u k8s-jkns-e2e-gce-gci-serial rm -r gs://k8s-jkns-e2e-gce-gci-serial-state-2f I0130 23:09:47.445274 5816 local.go:42] ⚙️ gsutil -u k8s-jkns-e2e-gce-gci-serial rm -r gs://k8s-jkns-e2e-gce-gci-serial-state-2f Removing gs://k8s-jkns-e2e-gce-gci-serial-state-2f/... I0130 23:09:50.597785 5816 down.go:62] releasing boskos project I0130 23:09:50.610623 5816 boskos.go:83] Boskos heartbeat func received signal to close Error: exit status 1 + EXIT_VALUE=1 + set +o xtrace