e2e-kops-grid-gce-calico-u2004-k26 #1618193905742778368
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 1 failed / 1 succeeded |
| Started | |
| Elapsed | 20m27s |
| Revision | master |
exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
kubetest2 Down
... skipping 163 lines ... .......................................Updated [https://www.googleapis.com/compute/v1/projects/kubernetes-ingress]. .done. WARNING: No host aliases were added to your SSH configs because you do not have any running instances. Try running this command again after running some instances. I0125 10:29:50.020673 5495 up.go:44] Cleaning up any leaked resources from previous cluster I0125 10:29:50.020791 5495 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/e8d5fd17-9c9a-11ed-9276-ea2a76983d84/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh1981023726/key --ssh-user prow I0125 10:29:50.020849 5495 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/e8d5fd17-9c9a-11ed-9276-ea2a76983d84/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh1981023726/key --ssh-user prow Error: Cluster.kops.k8s.io "e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local" not found W0125 10:29:50.252916 5495 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1 I0125 10:29:50.252975 5495 down.go:48] /home/prow/go/src/k8s.io/kops/_rundir/e8d5fd17-9c9a-11ed-9276-ea2a76983d84/kops delete cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --yes I0125 10:29:50.252991 5495 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/e8d5fd17-9c9a-11ed-9276-ea2a76983d84/kops delete cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --yes Error: error reading cluster configuration: Cluster.kops.k8s.io "e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local" not found I0125 10:29:50.423558 5495 gcs.go:51] gsutil ls -b -p kubernetes-ingress gs://kubernetes-ingress-state-e8 I0125 10:29:50.423665 5495 local.go:42] ⚙️ gsutil ls -b -p kubernetes-ingress gs://kubernetes-ingress-state-e8 I0125 10:29:52.539698 5495 gcs.go:70] gsutil mb -p kubernetes-ingress gs://kubernetes-ingress-state-e8 I0125 10:29:52.539750 5495 local.go:42] ⚙️ gsutil mb -p kubernetes-ingress gs://kubernetes-ingress-state-e8 Creating gs://kubernetes-ingress-state-e8/... I0125 10:29:55.119027 5495 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip 2023/01/25 10:29:55 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404 I0125 10:29:55.134165 5495 http.go:37] curl https://ip.jsb.workers.dev I0125 10:29:55.224280 5495 up.go:167] /home/prow/go/src/k8s.io/kops/_rundir/e8d5fd17-9c9a-11ed-9276-ea2a76983d84/kops create cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --cloud gce --kubernetes-version https://storage.googleapis.com/kubernetes-release/release/v1.26.1 --ssh-public-key /tmp/kops-ssh1981023726/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --networking=calico --container-runtime=containerd --gce-service-account=default --admin-access 34.136.131.203/32 --master-count 1 --master-volume-size 48 --node-count 4 --node-volume-size 48 --zones us-central1-a --master-size e2-standard-2 --project kubernetes-ingress I0125 10:29:55.224323 5495 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/e8d5fd17-9c9a-11ed-9276-ea2a76983d84/kops create cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --cloud gce --kubernetes-version https://storage.googleapis.com/kubernetes-release/release/v1.26.1 --ssh-public-key /tmp/kops-ssh1981023726/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --networking=calico --container-runtime=containerd --gce-service-account=default --admin-access 34.136.131.203/32 --master-count 1 --master-volume-size 48 --node-count 4 --node-volume-size 48 --zones us-central1-a --master-size e2-standard-2 --project kubernetes-ingress I0125 10:29:55.274406 5817 create_cluster.go:882] Using SSH public key: /tmp/kops-ssh1981023726/key.pub I0125 10:29:55.538127 5817 new_cluster.go:573] VMs will be configured to use specified Service Account: default I0125 10:29:55.538259 5817 new_cluster.go:1338] Cloud Provider ID: "gce" ... skipping 349 lines ... I0125 10:30:04.182485 5838 keypair.go:226] Issuing new certificate: "etcd-manager-ca-events" I0125 10:30:04.184726 5838 keypair.go:226] Issuing new certificate: "etcd-peers-ca-main" W0125 10:30:04.387490 5838 vfs_keystorereader.go:143] CA private key was not found I0125 10:30:04.579680 5838 keypair.go:226] Issuing new certificate: "kubernetes-ca" I0125 10:30:04.582547 5838 keypair.go:226] Issuing new certificate: "service-account" I0125 10:30:31.812783 5838 executor.go:111] Tasks: 42 done / 67 total; 19 can run W0125 10:30:44.655095 5838 executor.go:139] error running task "ForwardingRule/api-e2e-e2e-kops-grid-gce-calico-u2004-k26-k8s-local" (9m47s remaining to succeed): error creating ForwardingRule "api-e2e-e2e-kops-grid-gce-calico-u2004-k26-k8s-local": googleapi: Error 400: The resource 'projects/kubernetes-ingress/regions/us-central1/targetPools/api-e2e-e2e-kops-grid-gce-calico-u2004-k26-k8s-local' is not ready, resourceNotReady I0125 10:30:44.655156 5838 executor.go:111] Tasks: 60 done / 67 total; 5 can run I0125 10:30:51.652648 5838 executor.go:111] Tasks: 65 done / 67 total; 2 can run I0125 10:31:04.725908 5838 executor.go:111] Tasks: 67 done / 67 total; 0 can run I0125 10:31:04.793157 5838 update_cluster.go:323] Exporting kubeconfig for cluster kOps has set your kubectl context to e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local ... skipping 7 lines ... * read about installing addons at: https://kops.sigs.k8s.io/addons. I0125 10:31:15.055710 5495 up.go:251] /home/prow/go/src/k8s.io/kops/_rundir/e8d5fd17-9c9a-11ed-9276-ea2a76983d84/kops validate cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --count 10 --wait 15m0s I0125 10:31:15.055766 5495 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/e8d5fd17-9c9a-11ed-9276-ea2a76983d84/kops validate cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --count 10 --wait 15m0s Validating cluster e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local W0125 10:31:45.423994 5857 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.136.126.98/api/v1/nodes": dial tcp 34.136.126.98:443: i/o timeout W0125 10:32:02.601189 5857 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.136.126.98/api/v1/nodes": dial tcp 34.136.126.98:443: connect: connection refused W0125 10:32:12.612842 5857 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.136.126.98/api/v1/nodes": dial tcp 34.136.126.98:443: connect: connection refused W0125 10:32:22.622142 5857 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.136.126.98/api/v1/nodes": dial tcp 34.136.126.98:443: connect: connection refused W0125 10:32:32.629782 5857 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.136.126.98/api/v1/nodes": dial tcp 34.136.126.98:443: connect: connection refused W0125 10:32:42.638155 5857 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.136.126.98/api/v1/nodes": dial tcp 34.136.126.98:443: connect: connection refused W0125 10:32:52.649162 5857 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.136.126.98/api/v1/nodes": dial tcp 34.136.126.98:443: connect: connection refused W0125 10:33:02.660996 5857 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.136.126.98/api/v1/nodes": dial tcp 34.136.126.98:443: connect: connection refused W0125 10:33:22.671289 5857 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.136.126.98/api/v1/nodes": net/http: TLS handshake timeout W0125 10:33:32.680901 5857 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.136.126.98/api/v1/nodes": dial tcp 34.136.126.98:443: connect: connection refused W0125 10:33:52.699521 5857 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.136.126.98/api/v1/nodes": net/http: TLS handshake timeout W0125 10:34:02.704183 5857 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.136.126.98/api/v1/nodes": dial tcp 34.136.126.98:443: connect: connection refused W0125 10:34:12.715062 5857 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.136.126.98/api/v1/nodes": dial tcp 34.136.126.98:443: connect: connection refused W0125 10:34:32.726481 5857 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.136.126.98/api/v1/nodes": net/http: TLS handshake timeout I0125 10:34:37.679579 5495 boskos.go:86] Sending heartbeat to Boskos W0125 10:34:42.733886 5857 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.136.126.98/api/v1/nodes": dial tcp 34.136.126.98:443: connect: connection refused W0125 10:34:52.739372 5857 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.136.126.98/api/v1/nodes": dial tcp 34.136.126.98:443: connect: connection refused I0125 10:35:03.237196 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 5 lines ... Machine https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/control-plane-us-central1-a-37d5 machine "https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/control-plane-us-central1-a-37d5" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/nodes-us-central1-a-4426 machine "https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/nodes-us-central1-a-4426" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/nodes-us-central1-a-5s1z machine "https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/nodes-us-central1-a-5s1z" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/nodes-us-central1-a-n8p1 machine "https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/nodes-us-central1-a-n8p1" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/nodes-us-central1-a-t2q9 machine "https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/nodes-us-central1-a-t2q9" has not yet joined cluster Validation Failed W0125 10:35:03.909999 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:35:14.415069 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 6 lines ... Machine https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/control-plane-us-central1-a-37d5 machine "https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/control-plane-us-central1-a-37d5" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/nodes-us-central1-a-4426 machine "https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/nodes-us-central1-a-4426" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/nodes-us-central1-a-5s1z machine "https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/nodes-us-central1-a-5s1z" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/nodes-us-central1-a-n8p1 machine "https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/nodes-us-central1-a-n8p1" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/nodes-us-central1-a-t2q9 machine "https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/nodes-us-central1-a-t2q9" has not yet joined cluster Validation Failed W0125 10:35:15.035815 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:35:25.543657 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 6 lines ... Machine https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/control-plane-us-central1-a-37d5 machine "https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/control-plane-us-central1-a-37d5" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/nodes-us-central1-a-4426 machine "https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/nodes-us-central1-a-4426" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/nodes-us-central1-a-5s1z machine "https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/nodes-us-central1-a-5s1z" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/nodes-us-central1-a-n8p1 machine "https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/nodes-us-central1-a-n8p1" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/nodes-us-central1-a-t2q9 machine "https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/nodes-us-central1-a-t2q9" has not yet joined cluster Validation Failed W0125 10:35:26.175825 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:35:36.613487 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 11 lines ... Pod kube-system/calico-kube-controllers-55f488656-bf5ql system-cluster-critical pod "calico-kube-controllers-55f488656-bf5ql" is pending Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is pending Pod kube-system/coredns-7bc44848df-h6vnv system-cluster-critical pod "coredns-7bc44848df-h6vnv" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-rm69g system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-rm69g" is pending Pod kube-system/dns-controller-6d5f4bf5d6-fq78f system-cluster-critical pod "dns-controller-6d5f4bf5d6-fq78f" is pending Validation Failed W0125 10:35:37.198932 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:35:47.654640 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 11 lines ... Pod kube-system/calico-kube-controllers-55f488656-bf5ql system-cluster-critical pod "calico-kube-controllers-55f488656-bf5ql" is pending Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is pending Pod kube-system/cloud-controller-manager-cvjpf system-cluster-critical pod "cloud-controller-manager-cvjpf" is pending Pod kube-system/coredns-7bc44848df-h6vnv system-cluster-critical pod "coredns-7bc44848df-h6vnv" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-rm69g system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-rm69g" is pending Validation Failed W0125 10:35:48.328404 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:35:58.734977 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 10 lines ... Machine https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/nodes-us-central1-a-t2q9 machine "https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/nodes-us-central1-a-t2q9" has not yet joined cluster Pod kube-system/calico-kube-controllers-55f488656-bf5ql system-cluster-critical pod "calico-kube-controllers-55f488656-bf5ql" is pending Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is pending Pod kube-system/coredns-7bc44848df-h6vnv system-cluster-critical pod "coredns-7bc44848df-h6vnv" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-rm69g system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-rm69g" is pending Validation Failed W0125 10:35:59.309361 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:36:09.729829 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 11 lines ... Node control-plane-us-central1-a-37d5 node "control-plane-us-central1-a-37d5" of role "control-plane" is not ready Pod kube-system/calico-kube-controllers-55f488656-bf5ql system-cluster-critical pod "calico-kube-controllers-55f488656-bf5ql" is pending Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is pending Pod kube-system/coredns-7bc44848df-h6vnv system-cluster-critical pod "coredns-7bc44848df-h6vnv" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-rm69g system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-rm69g" is pending Validation Failed W0125 10:36:10.322270 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:36:20.731110 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 10 lines ... Machine https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/nodes-us-central1-a-t2q9 machine "https://www.googleapis.com/compute/v1/projects/kubernetes-ingress/zones/us-central1-a/instances/nodes-us-central1-a-t2q9" has not yet joined cluster Node control-plane-us-central1-a-37d5 control-plane node "control-plane-us-central1-a-37d5" is missing kube-apiserver pod Pod kube-system/coredns-7bc44848df-h6vnv system-cluster-critical pod "coredns-7bc44848df-h6vnv" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-rm69g system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-rm69g" is pending Pod kube-system/kube-apiserver-control-plane-us-central1-a-37d5 system-cluster-critical pod "kube-apiserver-control-plane-us-central1-a-37d5" is pending Validation Failed W0125 10:36:21.272895 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:36:31.680524 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 15 lines ... Pod kube-system/calico-node-7b4mt system-node-critical pod "calico-node-7b4mt" is pending Pod kube-system/calico-node-94sk6 system-node-critical pod "calico-node-94sk6" is pending Pod kube-system/calico-node-dhngv system-node-critical pod "calico-node-dhngv" is pending Pod kube-system/coredns-7bc44848df-h6vnv system-cluster-critical pod "coredns-7bc44848df-h6vnv" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-rm69g system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-rm69g" is pending Validation Failed W0125 10:36:32.205541 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:36:42.672689 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 14 lines ... Pod kube-system/calico-node-7b4mt system-node-critical pod "calico-node-7b4mt" is pending Pod kube-system/calico-node-94sk6 system-node-critical pod "calico-node-94sk6" is pending Pod kube-system/calico-node-dhngv system-node-critical pod "calico-node-dhngv" is pending Pod kube-system/coredns-7bc44848df-h6vnv system-cluster-critical pod "coredns-7bc44848df-h6vnv" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-rm69g system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-rm69g" is pending Validation Failed W0125 10:36:43.210068 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:36:53.634892 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 12 lines ... Pod kube-system/calico-node-7b4mt system-node-critical pod "calico-node-7b4mt" is pending Pod kube-system/calico-node-94sk6 system-node-critical pod "calico-node-94sk6" is not ready (calico-node) Pod kube-system/calico-node-dhngv system-node-critical pod "calico-node-dhngv" is not ready (calico-node) Pod kube-system/coredns-7bc44848df-h6vnv system-cluster-critical pod "coredns-7bc44848df-h6vnv" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-rm69g system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-rm69g" is pending Validation Failed W0125 10:36:54.205585 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:37:04.653598 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 10 lines ... KIND NAME MESSAGE Pod kube-system/calico-node-5hqr7 system-node-critical pod "calico-node-5hqr7" is not ready (calico-node) Pod kube-system/calico-node-7b4mt system-node-critical pod "calico-node-7b4mt" is not ready (calico-node) Pod kube-system/calico-node-94sk6 system-node-critical pod "calico-node-94sk6" is not ready (calico-node) Pod kube-system/calico-node-dhngv system-node-critical pod "calico-node-dhngv" is not ready (calico-node) Validation Failed W0125 10:37:05.223383 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:37:15.691504 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 11 lines ... Pod kube-system/calico-node-5hqr7 system-node-critical pod "calico-node-5hqr7" is not ready (calico-node) Pod kube-system/calico-node-7b4mt system-node-critical pod "calico-node-7b4mt" is not ready (calico-node) Pod kube-system/calico-node-94sk6 system-node-critical pod "calico-node-94sk6" is not ready (calico-node) Pod kube-system/calico-node-dhngv system-node-critical pod "calico-node-dhngv" is not ready (calico-node) Pod kube-system/kube-proxy-nodes-us-central1-a-t2q9 system-node-critical pod "kube-proxy-nodes-us-central1-a-t2q9" is pending Validation Failed W0125 10:37:16.227551 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:37:26.619347 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 11 lines ... Pod kube-system/calico-node-5hqr7 system-node-critical pod "calico-node-5hqr7" is not ready (calico-node) Pod kube-system/calico-node-7b4mt system-node-critical pod "calico-node-7b4mt" is not ready (calico-node) Pod kube-system/calico-node-dhngv system-node-critical pod "calico-node-dhngv" is not ready (calico-node) Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Pod kube-system/kube-proxy-nodes-us-central1-a-4426 system-node-critical pod "kube-proxy-nodes-us-central1-a-4426" is pending Validation Failed W0125 10:37:27.169070 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:37:37.661829 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:37:38.254482 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:37:48.692917 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:37:49.296840 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:37:59.768565 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:38:00.312983 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:38:10.669938 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:38:11.325153 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:38:21.794475 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:38:22.319923 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:38:32.781936 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:38:33.349377 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:38:43.797442 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:38:44.341983 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:38:54.790122 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:38:55.360395 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:39:05.775157 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:39:06.351773 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:39:16.827362 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:39:17.421735 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:39:27.834507 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:39:28.371748 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:39:37.690251 5495 boskos.go:86] Sending heartbeat to Boskos I0125 10:39:38.810936 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 8 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:39:39.299007 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:39:49.679070 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:39:50.256045 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:40:00.681658 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:40:01.258970 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:40:11.669252 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:40:12.208624 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:40:22.618601 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:40:23.129854 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:40:33.545738 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:40:34.074565 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:40:44.514108 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:40:45.081925 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:40:55.574882 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:40:56.142482 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:41:06.590264 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:41:07.178880 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:41:17.613317 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:41:18.169229 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:41:28.624820 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:41:29.151735 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:41:39.572868 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:41:40.100902 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:41:50.548023 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:41:51.118847 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:42:01.451725 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:42:01.964174 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:42:12.392852 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:42:12.990404 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:42:23.373829 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:42:23.931803 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:42:34.412320 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:42:34.991116 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:42:45.384759 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:42:45.950285 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:42:56.377716 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:42:56.922907 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:43:07.313621 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:43:07.840893 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:43:18.293283 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:43:18.840212 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:43:29.251205 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:43:29.810761 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:43:40.347394 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:43:40.904157 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:43:51.344025 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:43:51.868815 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:44:02.362421 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:44:02.954901 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:44:13.356754 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:44:13.931455 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:44:24.399815 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:44:24.917286 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:44:35.321720 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:44:35.843650 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:44:37.700853 5495 boskos.go:86] Sending heartbeat to Boskos I0125 10:44:46.225499 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 8 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:44:46.771095 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:44:57.174690 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:44:57.740621 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:45:08.122940 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:45:08.765538 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:45:19.209983 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:45:19.792433 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:45:30.231807 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:45:30.806884 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:45:41.219462 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:45:41.776909 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:45:52.184387 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:45:52.763937 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:46:03.303171 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:46:03.878953 5857 validate_cluster.go:232] (will retry): cluster not yet healthy I0125 10:46:14.372512 5857 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-t2q9 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-kq7lf system-node-critical pod "calico-node-kq7lf" is not ready (calico-node) Validation Failed W0125 10:46:14.892726 5857 validate_cluster.go:232] (will retry): cluster not yet healthy Error: validation failed: wait time exceeded during validation I0125 10:46:24.905109 5495 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/e8d5fd17-9c9a-11ed-9276-ea2a76983d84/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh1981023726/key --ssh-user prow I0125 10:46:24.905186 5495 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/e8d5fd17-9c9a-11ed-9276-ea2a76983d84/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh1981023726/key --ssh-user prow I0125 10:46:25.382628 5867 gce.go:99] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] 2023/01/25 10:46:29 Dumping node control-plane-us-central1-a-37d5 2023/01/25 10:46:32 error dumping node control-plane-us-central1-a-37d5: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/25 10:46:32 error dumping node control-plane-us-central1-a-37d5: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/25 10:46:32 Dumping node nodes-us-central1-a-4426 2023/01/25 10:46:34 Dumping node nodes-us-central1-a-5s1z 2023/01/25 10:46:36 Dumping node nodes-us-central1-a-n8p1 2023/01/25 10:46:37 Dumping node nodes-us-central1-a-t2q9 I0125 10:46:39.200189 5495 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/e8d5fd17-9c9a-11ed-9276-ea2a76983d84/kops get cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local -o yaml I0125 10:46:39.200230 5495 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/e8d5fd17-9c9a-11ed-9276-ea2a76983d84/kops get cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local -o yaml ... skipping 155 lines ... Deleted cluster: "e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local" I0125 10:48:56.734907 5495 gcs.go:88] gsutil -u kubernetes-ingress rm -r gs://kubernetes-ingress-state-e8 I0125 10:48:56.735003 5495 local.go:42] ⚙️ gsutil -u kubernetes-ingress rm -r gs://kubernetes-ingress-state-e8 Removing gs://kubernetes-ingress-state-e8/... I0125 10:48:59.535843 5495 down.go:62] releasing boskos project I0125 10:48:59.552407 5495 boskos.go:83] Boskos heartbeat func received signal to close Error: exit status 1 + EXIT_VALUE=1 + set +o xtrace