e2e-kops-gce-leader-migration #1620418693349511168
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 1 failed / 1 succeeded |
| Started | |
| Elapsed | 20m15s |
| Revision | master |
exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
kubetest2 Down
... skipping 156 lines ... ..............................................Updated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-3]. .done. WARNING: No host aliases were added to your SSH configs because you do not have any running instances. Try running this command again after running some instances. I0131 13:50:31.095075 5763 up.go:44] Cleaning up any leaked resources from previous cluster I0131 13:50:31.095214 5763 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/ea2bf030-a16d-11ed-9994-daecb65d57ab/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh2303278509/key --ssh-user prow I0131 13:50:31.095231 5763 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/ea2bf030-a16d-11ed-9994-daecb65d57ab/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh2303278509/key --ssh-user prow Error: Cluster.kops.k8s.io "ha-migration.k8s.local" not found W0131 13:50:31.345337 5763 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1 I0131 13:50:31.345396 5763 down.go:48] /home/prow/go/src/k8s.io/kops/_rundir/ea2bf030-a16d-11ed-9994-daecb65d57ab/kops delete cluster --name ha-migration.k8s.local --yes I0131 13:50:31.345408 5763 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/ea2bf030-a16d-11ed-9994-daecb65d57ab/kops delete cluster --name ha-migration.k8s.local --yes Error: error reading cluster configuration: Cluster.kops.k8s.io "ha-migration.k8s.local" not found I0131 13:50:31.490061 5763 gcs.go:51] gsutil ls -b -p k8s-jkns-gce-1-3 gs://k8s-jkns-gce-1-3-state-ea I0131 13:50:31.490100 5763 local.go:42] ⚙️ gsutil ls -b -p k8s-jkns-gce-1-3 gs://k8s-jkns-gce-1-3-state-ea I0131 13:50:33.530147 5763 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip 2023/01/31 13:50:33 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404 I0131 13:50:33.545441 5763 http.go:37] curl https://ip.jsb.workers.dev I0131 13:50:33.642961 5763 up.go:167] /home/prow/go/src/k8s.io/kops/_rundir/ea2bf030-a16d-11ed-9994-daecb65d57ab/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh2303278509/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 35.226.241.93/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project k8s-jkns-gce-1-3 I0131 13:50:33.643000 5763 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/ea2bf030-a16d-11ed-9994-daecb65d57ab/kops create cluster --name ha-migration.k8s.local --cloud gce --kubernetes-version v1.23.16 --ssh-public-key /tmp/kops-ssh2303278509/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --node-count=1 --master-count=3 --zones=us-central1-a,us-central1-b,us-central1-c --master-zones=us-central1-a,us-central1-b,us-central1-c --gce-service-account=default --admin-access 35.226.241.93/32 --master-volume-size 48 --node-volume-size 48 --master-size e2-standard-2 --project k8s-jkns-gce-1-3 I0131 13:50:33.694805 5947 create_cluster.go:882] Using SSH public key: /tmp/kops-ssh2303278509/key.pub I0131 13:50:33.833734 5947 new_cluster.go:573] VMs will be configured to use specified Service Account: default I0131 13:50:33.833899 5947 new_cluster.go:1339] Cloud Provider ID: "gce" ... skipping 527 lines ... I0131 13:50:42.081731 5967 keypair.go:226] Issuing new certificate: "etcd-clients-ca" I0131 13:50:42.085347 5967 address.go:139] GCE creating address: "api-ha-migration-k8s-local" W0131 13:50:42.119042 5967 vfs_keystorereader.go:143] CA private key was not found I0131 13:50:42.148577 5967 keypair.go:226] Issuing new certificate: "service-account" I0131 13:50:42.152084 5967 keypair.go:226] Issuing new certificate: "kubernetes-ca" I0131 13:50:52.037184 5967 executor.go:111] Tasks: 50 done / 91 total; 23 can run W0131 13:51:01.766396 5967 executor.go:139] error running task "ForwardingRule/api-ha-migration-k8s-local" (9m50s remaining to succeed): error creating ForwardingRule "api-ha-migration-k8s-local": googleapi: Error 400: The resource 'projects/k8s-jkns-gce-1-3/regions/us-central1/targetPools/api-ha-migration-k8s-local' is not ready, resourceNotReady I0131 13:51:01.766475 5967 executor.go:111] Tasks: 72 done / 91 total; 13 can run I0131 13:51:23.604260 5967 executor.go:111] Tasks: 85 done / 91 total; 6 can run I0131 13:51:37.681231 5967 executor.go:111] Tasks: 91 done / 91 total; 0 can run I0131 13:51:37.762612 5967 update_cluster.go:323] Exporting kubeconfig for cluster kOps has set your kubectl context to ha-migration.k8s.local ... skipping 7 lines ... * read about installing addons at: https://kops.sigs.k8s.io/addons. I0131 13:51:48.153074 5763 up.go:251] /home/prow/go/src/k8s.io/kops/_rundir/ea2bf030-a16d-11ed-9994-daecb65d57ab/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s I0131 13:51:48.153132 5763 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/ea2bf030-a16d-11ed-9994-daecb65d57ab/kops validate cluster --name ha-migration.k8s.local --count 10 --wait 15m0s Validating cluster ha-migration.k8s.local W0131 13:52:18.742958 5988 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.219.234/api/v1/nodes": dial tcp 34.132.219.234:443: i/o timeout W0131 13:52:44.186844 5988 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.219.234/api/v1/nodes": dial tcp 34.132.219.234:443: connect: connection refused W0131 13:52:54.193145 5988 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.219.234/api/v1/nodes": dial tcp 34.132.219.234:443: connect: connection refused W0131 13:53:04.202292 5988 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.219.234/api/v1/nodes": dial tcp 34.132.219.234:443: connect: connection refused W0131 13:53:14.209406 5988 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.219.234/api/v1/nodes": dial tcp 34.132.219.234:443: connect: connection refused W0131 13:53:24.213889 5988 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.219.234/api/v1/nodes": dial tcp 34.132.219.234:443: connect: connection refused W0131 13:53:34.216225 5988 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.219.234/api/v1/nodes": dial tcp 34.132.219.234:443: connect: connection refused W0131 13:53:44.218728 5988 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.219.234/api/v1/nodes": dial tcp 34.132.219.234:443: connect: connection refused W0131 13:53:54.222222 5988 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.219.234/api/v1/nodes": dial tcp 34.132.219.234:443: connect: connection refused W0131 13:54:14.231138 5988 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.219.234/api/v1/nodes": net/http: TLS handshake timeout W0131 13:54:34.238815 5988 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.219.234/api/v1/nodes": net/http: TLS handshake timeout W0131 13:54:44.246537 5988 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.219.234/api/v1/nodes": dial tcp 34.132.219.234:443: connect: connection refused W0131 13:55:04.256347 5988 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.219.234/api/v1/nodes": net/http: TLS handshake timeout W0131 13:55:14.258973 5988 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.219.234/api/v1/nodes": dial tcp 34.132.219.234:443: connect: connection refused I0131 13:55:18.434187 5763 boskos.go:86] Sending heartbeat to Boskos W0131 13:55:24.269981 5988 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.219.234/api/v1/nodes": dial tcp 34.132.219.234:443: connect: connection refused W0131 13:55:34.273681 5988 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.219.234/api/v1/nodes": dial tcp 34.132.219.234:443: connect: connection refused W0131 13:55:44.286272 5988 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.132.219.234/api/v1/nodes": dial tcp 34.132.219.234:443: connect: connection refused I0131 13:56:00.279314 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-c ControlPlane e2-standard-2 1 1 us-central1 ... skipping 8 lines ... KIND NAME MESSAGE Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-3/zones/us-central1-a/instances/control-plane-us-central1-a-tlk6 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-3/zones/us-central1-a/instances/control-plane-us-central1-a-tlk6" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-3/zones/us-central1-a/instances/nodes-us-central1-a-z19v machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-3/zones/us-central1-a/instances/nodes-us-central1-a-z19v" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-3/zones/us-central1-b/instances/control-plane-us-central1-b-5x6h machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-3/zones/us-central1-b/instances/control-plane-us-central1-b-5x6h" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-3/zones/us-central1-c/instances/control-plane-us-central1-c-80kh machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-3/zones/us-central1-c/instances/control-plane-us-central1-c-80kh" has not yet joined cluster Validation Failed W0131 13:56:01.281289 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 13:56:11.713874 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 12 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-3/zones/us-central1-a/instances/nodes-us-central1-a-z19v machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-3/zones/us-central1-a/instances/nodes-us-central1-a-z19v" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-3/zones/us-central1-c/instances/control-plane-us-central1-c-80kh machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-3/zones/us-central1-c/instances/control-plane-us-central1-c-80kh" has not yet joined cluster Node control-plane-us-central1-a-tlk6 node "control-plane-us-central1-a-tlk6" of role "control-plane" is not ready Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-b-5x6h system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-5x6h" is not ready (kube-controller-manager) Validation Failed W0131 13:56:12.653422 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 13:56:23.029290 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 12 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-3/zones/us-central1-a/instances/nodes-us-central1-a-z19v machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-3/zones/us-central1-a/instances/nodes-us-central1-a-z19v" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-3/zones/us-central1-c/instances/control-plane-us-central1-c-80kh machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-3/zones/us-central1-c/instances/control-plane-us-central1-c-80kh" has not yet joined cluster Node control-plane-us-central1-a-tlk6 node "control-plane-us-central1-a-tlk6" of role "control-plane" is not ready Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-b-5x6h system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-5x6h" is not ready (kube-controller-manager) Validation Failed W0131 13:56:23.958255 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 13:56:34.337629 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 13 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-3/zones/us-central1-c/instances/control-plane-us-central1-c-80kh machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-3/zones/us-central1-c/instances/control-plane-us-central1-c-80kh" has not yet joined cluster Node control-plane-us-central1-a-tlk6 node "control-plane-us-central1-a-tlk6" of role "control-plane" is not ready Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Pod kube-system/etcd-manager-events-control-plane-us-central1-b-5x6h system-cluster-critical pod "etcd-manager-events-control-plane-us-central1-b-5x6h" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-5x6h system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-5x6h" is not ready (kube-controller-manager) Validation Failed W0131 13:56:35.152226 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 13:56:45.623994 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 12 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-3/zones/us-central1-a/instances/nodes-us-central1-a-z19v machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-3/zones/us-central1-a/instances/nodes-us-central1-a-z19v" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-3/zones/us-central1-c/instances/control-plane-us-central1-c-80kh machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-3/zones/us-central1-c/instances/control-plane-us-central1-c-80kh" has not yet joined cluster Node control-plane-us-central1-a-tlk6 node "control-plane-us-central1-a-tlk6" of role "control-plane" is not ready Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-b-5x6h system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-5x6h" is not ready (kube-controller-manager) Validation Failed W0131 13:56:46.521073 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 13:56:56.845050 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 13 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-3/zones/us-central1-c/instances/control-plane-us-central1-c-80kh machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-3/zones/us-central1-c/instances/control-plane-us-central1-c-80kh" has not yet joined cluster Node control-plane-us-central1-a-tlk6 node "control-plane-us-central1-a-tlk6" of role "control-plane" is not ready Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-a-tlk6 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-tlk6" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-b-5x6h system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-5x6h" is not ready (kube-controller-manager) Validation Failed W0131 13:56:57.736195 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 13:57:08.119248 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 14 lines ... Node control-plane-us-central1-a-tlk6 node "control-plane-us-central1-a-tlk6" of role "control-plane" is not ready Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Pod kube-system/kube-apiserver-control-plane-us-central1-a-tlk6 system-cluster-critical pod "kube-apiserver-control-plane-us-central1-a-tlk6" is pending Pod kube-system/kube-controller-manager-control-plane-us-central1-a-tlk6 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-tlk6" is not ready (kube-controller-manager) Pod kube-system/kube-controller-manager-control-plane-us-central1-b-5x6h system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-5x6h" is not ready (kube-controller-manager) Validation Failed W0131 13:57:09.004129 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 13:57:19.369472 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 14 lines ... Node control-plane-us-central1-a-tlk6 node "control-plane-us-central1-a-tlk6" of role "control-plane" is not ready Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Pod kube-system/kube-controller-manager-control-plane-us-central1-a-tlk6 system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-a-tlk6" is not ready (kube-controller-manager) Pod kube-system/kube-controller-manager-control-plane-us-central1-b-5x6h system-cluster-critical pod "kube-controller-manager-control-plane-us-central1-b-5x6h" is not ready (kube-controller-manager) Pod kube-system/kube-scheduler-control-plane-us-central1-b-5x6h system-cluster-critical pod "kube-scheduler-control-plane-us-central1-b-5x6h" is pending Validation Failed W0131 13:57:20.244546 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 13:57:30.677675 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 12 lines ... KIND NAME MESSAGE Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-3/zones/us-central1-a/instances/nodes-us-central1-a-z19v machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-3/zones/us-central1-a/instances/nodes-us-central1-a-z19v" has not yet joined cluster Node control-plane-us-central1-a-tlk6 node "control-plane-us-central1-a-tlk6" of role "control-plane" is not ready Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Validation Failed W0131 13:57:31.622906 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 13:57:41.910379 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 22 lines ... Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Pod kube-system/kops-controller-qff5g system-cluster-critical pod "kops-controller-qff5g" is pending Pod kube-system/kops-controller-s8f54 system-cluster-critical pod "kops-controller-s8f54" is pending Validation Failed W0131 13:57:42.799869 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 13:57:53.114796 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 20 lines ... Pod kube-system/cilium-operator-b4b4c5b48-6vzm6 system-cluster-critical pod "cilium-operator-b4b4c5b48-6vzm6" is pending Pod kube-system/cilium-rqkbq system-node-critical pod "cilium-rqkbq" is pending Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 13:57:53.912210 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 13:58:04.259133 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 19 lines ... Pod kube-system/cilium-operator-b4b4c5b48-6vzm6 system-cluster-critical pod "cilium-operator-b4b4c5b48-6vzm6" is pending Pod kube-system/cilium-rqkbq system-node-critical pod "cilium-rqkbq" is pending Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 13:58:05.244679 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 13:58:15.564019 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 17 lines ... Pod kube-system/cilium-4sccd system-node-critical pod "cilium-4sccd" is not ready (cilium-agent) Pod kube-system/cilium-rqkbq system-node-critical pod "cilium-rqkbq" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 13:58:16.754980 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 13:58:27.182765 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 17 lines ... Pod kube-system/cilium-rqkbq system-node-critical pod "cilium-rqkbq" is not ready (cilium-agent) Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Pod kube-system/kops-controller-lnxrk system-cluster-critical pod "kops-controller-lnxrk" is pending Validation Failed W0131 13:58:28.003652 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 13:58:38.312567 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Pod kube-system/etcd-manager-main-control-plane-us-central1-c-80kh system-cluster-critical pod "etcd-manager-main-control-plane-us-central1-c-80kh" is pending Validation Failed W0131 13:58:39.193641 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 13:58:49.574317 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Pod kube-system/kube-apiserver-control-plane-us-central1-c-80kh system-cluster-critical pod "kube-apiserver-control-plane-us-central1-c-80kh" is pending Validation Failed W0131 13:58:50.456776 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 13:59:00.778148 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 13:59:01.621248 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 13:59:11.932596 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 13:59:12.761367 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 13:59:23.289943 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 13:59:24.157896 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 13:59:34.486701 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 13:59:35.273228 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 13:59:45.674256 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 13:59:46.523862 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 13:59:56.930846 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 13:59:57.807265 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:00:08.188458 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:00:09.049277 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:00:18.444495 5763 boskos.go:86] Sending heartbeat to Boskos I0131 14:00:19.413612 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:00:20.241917 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:00:30.497515 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:00:31.342526 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:00:41.747018 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:00:42.624056 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:00:52.942610 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:00:53.814267 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:01:04.206788 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:01:05.036176 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:01:15.394640 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:01:16.281944 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:01:26.623046 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:01:27.512191 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:01:37.890376 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:01:38.774017 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:01:49.190841 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:01:50.048835 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:02:00.290121 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:02:01.116644 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:02:11.482965 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:02:12.326251 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:02:22.597249 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:02:23.443346 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:02:33.738472 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:02:34.552318 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:02:44.860719 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:02:45.649922 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:02:56.058656 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:02:56.963755 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:03:07.345899 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:03:08.188142 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:03:18.582897 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:03:19.379314 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:03:29.836332 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:03:30.696886 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:03:41.099015 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:03:41.957641 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:03:52.215102 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:03:53.073203 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:04:03.375682 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:04:04.206566 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:04:14.535217 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:04:15.358987 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:04:25.708500 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:04:26.591385 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:04:36.945313 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:04:37.814855 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:04:48.255642 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:04:49.051069 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:04:59.399737 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:05:00.231080 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:05:10.580948 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:05:11.454583 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:05:18.454573 5763 boskos.go:86] Sending heartbeat to Boskos I0131 14:05:21.764308 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 16 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:05:22.646907 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:05:33.094829 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:05:33.954270 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:05:44.280131 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:05:45.105202 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:05:55.486953 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:05:56.436740 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:06:06.856554 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:06:07.877789 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:06:18.219128 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:06:19.068519 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:06:29.466073 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:06:30.262514 5988 validate_cluster.go:232] (will retry): cluster not yet healthy I0131 14:06:40.610213 5988 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 control-plane-us-central1-b ControlPlane e2-standard-2 1 1 us-central1 ... skipping 15 lines ... Node control-plane-us-central1-b-5x6h node "control-plane-us-central1-b-5x6h" of role "control-plane" is not ready Node control-plane-us-central1-c-80kh node "control-plane-us-central1-c-80kh" of role "control-plane" is not ready Pod kube-system/coredns-5d479c4f64-4m72c system-cluster-critical pod "coredns-5d479c4f64-4m72c" is pending Pod kube-system/coredns-autoscaler-557ccb4c66-r5xwb system-cluster-critical pod "coredns-autoscaler-557ccb4c66-r5xwb" is pending Pod kube-system/dns-controller-6f69f47785-4l7ln system-cluster-critical pod "dns-controller-6f69f47785-4l7ln" is pending Validation Failed W0131 14:06:41.445157 5988 validate_cluster.go:232] (will retry): cluster not yet healthy Error: validation failed: wait time exceeded during validation I0131 14:06:51.460851 5763 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/ea2bf030-a16d-11ed-9994-daecb65d57ab/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh2303278509/key --ssh-user prow I0131 14:06:51.460903 5763 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/ea2bf030-a16d-11ed-9994-daecb65d57ab/kops toolbox dump --name ha-migration.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh2303278509/key --ssh-user prow I0131 14:06:51.817162 5998 gce.go:99] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] 2023/01/31 14:06:56 Dumping node control-plane-us-central1-a-tlk6 2023/01/31 14:06:59 error dumping node control-plane-us-central1-a-tlk6: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/31 14:06:59 error dumping node control-plane-us-central1-a-tlk6: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/31 14:06:59 Dumping node control-plane-us-central1-b-5x6h 2023/01/31 14:07:03 error dumping node control-plane-us-central1-b-5x6h: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/31 14:07:03 error dumping node control-plane-us-central1-b-5x6h: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/31 14:07:03 Dumping node control-plane-us-central1-c-80kh 2023/01/31 14:07:08 error dumping node control-plane-us-central1-c-80kh: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/31 14:07:08 error dumping node control-plane-us-central1-c-80kh: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/31 14:07:08 dumping node not registered in kubernetes: 34.136.23.99 2023/01/31 14:07:08 Dumping node 34.136.23.99 I0131 14:07:09.906277 5763 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/ea2bf030-a16d-11ed-9994-daecb65d57ab/kops get cluster --name ha-migration.k8s.local -o yaml I0131 14:07:09.906317 5763 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/ea2bf030-a16d-11ed-9994-daecb65d57ab/kops get cluster --name ha-migration.k8s.local -o yaml I0131 14:07:10.058847 5763 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/ea2bf030-a16d-11ed-9994-daecb65d57ab/kops get instancegroups --name ha-migration.k8s.local -o yaml I0131 14:07:10.058889 5763 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/ea2bf030-a16d-11ed-9994-daecb65d57ab/kops get instancegroups --name ha-migration.k8s.local -o yaml ... skipping 166 lines ... Deleted cluster: "ha-migration.k8s.local" I0131 14:09:25.351615 5763 gcs.go:88] gsutil -u k8s-jkns-gce-1-3 rm -r gs://k8s-jkns-gce-1-3-state-ea I0131 14:09:25.351892 5763 local.go:42] ⚙️ gsutil -u k8s-jkns-gce-1-3 rm -r gs://k8s-jkns-gce-1-3-state-ea Removing gs://k8s-jkns-gce-1-3-state-ea/... I0131 14:09:27.932992 5763 down.go:62] releasing boskos project I0131 14:09:27.941790 5763 boskos.go:83] Boskos heartbeat func received signal to close Error: exit status 1 + EXIT_VALUE=1 + set +o xtrace