e2e-kops-grid-gce-calico-u2004-k26 #1618556306719772672
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 1 failed / 1 succeeded |
| Started | |
| Elapsed | 20m15s |
| Revision | master |
exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
kubetest2 Down
... skipping 163 lines ... ............................Updated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-alpha]. ..done. WARNING: No host aliases were added to your SSH configs because you do not have any running instances. Try running this command again after running some instances. I0126 10:29:56.222866 5539 up.go:44] Cleaning up any leaked resources from previous cluster I0126 10:29:56.223114 5539 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/151d7577-9d64-11ed-b1bb-1299ca1e1805/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh2822732964/key --ssh-user prow I0126 10:29:56.223151 5539 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/151d7577-9d64-11ed-b1bb-1299ca1e1805/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh2822732964/key --ssh-user prow Error: Cluster.kops.k8s.io "e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local" not found W0126 10:29:56.554489 5539 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1 I0126 10:29:56.554602 5539 down.go:48] /home/prow/go/src/k8s.io/kops/_rundir/151d7577-9d64-11ed-b1bb-1299ca1e1805/kops delete cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --yes I0126 10:29:56.554616 5539 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/151d7577-9d64-11ed-b1bb-1299ca1e1805/kops delete cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --yes Error: error reading cluster configuration: Cluster.kops.k8s.io "e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local" not found I0126 10:29:56.833657 5539 gcs.go:51] gsutil ls -b -p k8s-jkns-gci-gce-alpha gs://k8s-jkns-gci-gce-alpha-state-15 I0126 10:29:56.833701 5539 local.go:42] ⚙️ gsutil ls -b -p k8s-jkns-gci-gce-alpha gs://k8s-jkns-gci-gce-alpha-state-15 I0126 10:29:59.208253 5539 gcs.go:70] gsutil mb -p k8s-jkns-gci-gce-alpha gs://k8s-jkns-gci-gce-alpha-state-15 I0126 10:29:59.208299 5539 local.go:42] ⚙️ gsutil mb -p k8s-jkns-gci-gce-alpha gs://k8s-jkns-gci-gce-alpha-state-15 Creating gs://k8s-jkns-gci-gce-alpha-state-15/... I0126 10:30:02.160075 5539 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip 2023/01/26 10:30:02 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404 I0126 10:30:02.175475 5539 http.go:37] curl https://ip.jsb.workers.dev I0126 10:30:02.274134 5539 up.go:167] /home/prow/go/src/k8s.io/kops/_rundir/151d7577-9d64-11ed-b1bb-1299ca1e1805/kops create cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --cloud gce --kubernetes-version https://storage.googleapis.com/kubernetes-release/release/v1.26.1 --ssh-public-key /tmp/kops-ssh2822732964/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --networking=calico --container-runtime=containerd --gce-service-account=default --admin-access 34.123.218.112/32 --master-count 1 --master-volume-size 48 --node-count 4 --node-volume-size 48 --zones us-west3-a --master-size e2-standard-2 --project k8s-jkns-gci-gce-alpha I0126 10:30:02.274183 5539 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/151d7577-9d64-11ed-b1bb-1299ca1e1805/kops create cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --cloud gce --kubernetes-version https://storage.googleapis.com/kubernetes-release/release/v1.26.1 --ssh-public-key /tmp/kops-ssh2822732964/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --networking=calico --container-runtime=containerd --gce-service-account=default --admin-access 34.123.218.112/32 --master-count 1 --master-volume-size 48 --node-count 4 --node-volume-size 48 --zones us-west3-a --master-size e2-standard-2 --project k8s-jkns-gci-gce-alpha I0126 10:30:02.331899 5860 create_cluster.go:882] Using SSH public key: /tmp/kops-ssh2822732964/key.pub I0126 10:30:02.542672 5860 new_cluster.go:573] VMs will be configured to use specified Service Account: default I0126 10:30:02.543083 5860 new_cluster.go:1338] Cloud Provider ID: "gce" ... skipping 349 lines ... I0126 10:30:10.885862 5880 keypair.go:226] Issuing new certificate: "etcd-clients-ca" I0126 10:30:10.887799 5880 keypair.go:226] Issuing new certificate: "etcd-manager-ca-events" W0126 10:30:10.979724 5880 vfs_keystorereader.go:143] CA private key was not found I0126 10:30:11.080902 5880 keypair.go:226] Issuing new certificate: "kubernetes-ca" I0126 10:30:11.126812 5880 keypair.go:226] Issuing new certificate: "service-account" I0126 10:30:23.185495 5880 executor.go:111] Tasks: 42 done / 67 total; 19 can run W0126 10:30:36.647673 5880 executor.go:139] error running task "ForwardingRule/api-e2e-e2e-kops-grid-gce-calico-u2004-k26-k8s-local" (9m46s remaining to succeed): error creating ForwardingRule "api-e2e-e2e-kops-grid-gce-calico-u2004-k26-k8s-local": googleapi: Error 400: The resource 'projects/k8s-jkns-gci-gce-alpha/regions/us-west3/targetPools/api-e2e-e2e-kops-grid-gce-calico-u2004-k26-k8s-local' is not ready, resourceNotReady I0126 10:30:36.647767 5880 executor.go:111] Tasks: 60 done / 67 total; 5 can run I0126 10:30:43.911983 5880 executor.go:111] Tasks: 65 done / 67 total; 2 can run I0126 10:30:57.864439 5880 executor.go:111] Tasks: 67 done / 67 total; 0 can run I0126 10:30:57.937726 5880 update_cluster.go:323] Exporting kubeconfig for cluster kOps has set your kubectl context to e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local ... skipping 7 lines ... * read about installing addons at: https://kops.sigs.k8s.io/addons. I0126 10:31:08.296563 5539 up.go:251] /home/prow/go/src/k8s.io/kops/_rundir/151d7577-9d64-11ed-b1bb-1299ca1e1805/kops validate cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --count 10 --wait 15m0s I0126 10:31:08.296641 5539 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/151d7577-9d64-11ed-b1bb-1299ca1e1805/kops validate cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --count 10 --wait 15m0s Validating cluster e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local W0126 10:31:38.707533 5898 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.176.171/api/v1/nodes": dial tcp 34.106.176.171:443: i/o timeout W0126 10:31:48.731785 5898 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.176.171/api/v1/nodes": dial tcp 34.106.176.171:443: connect: connection refused W0126 10:31:58.755693 5898 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.176.171/api/v1/nodes": dial tcp 34.106.176.171:443: connect: connection refused W0126 10:32:08.779079 5898 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.176.171/api/v1/nodes": dial tcp 34.106.176.171:443: connect: connection refused W0126 10:32:18.802479 5898 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.176.171/api/v1/nodes": dial tcp 34.106.176.171:443: connect: connection refused W0126 10:32:28.825856 5898 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.176.171/api/v1/nodes": dial tcp 34.106.176.171:443: connect: connection refused W0126 10:32:38.850330 5898 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.176.171/api/v1/nodes": dial tcp 34.106.176.171:443: connect: connection refused W0126 10:32:48.873132 5898 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.176.171/api/v1/nodes": dial tcp 34.106.176.171:443: connect: connection refused W0126 10:32:58.897497 5898 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.176.171/api/v1/nodes": dial tcp 34.106.176.171:443: connect: connection refused W0126 10:33:08.924055 5898 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.176.171/api/v1/nodes": dial tcp 34.106.176.171:443: connect: connection refused W0126 10:33:18.947938 5898 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.176.171/api/v1/nodes": dial tcp 34.106.176.171:443: connect: connection refused W0126 10:33:28.971603 5898 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.176.171/api/v1/nodes": dial tcp 34.106.176.171:443: connect: connection refused W0126 10:33:48.997031 5898 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.176.171/api/v1/nodes": net/http: TLS handshake timeout W0126 10:34:09.020348 5898 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.176.171/api/v1/nodes": net/http: TLS handshake timeout W0126 10:34:19.042126 5898 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.176.171/api/v1/nodes": dial tcp 34.106.176.171:443: connect: connection refused W0126 10:34:29.064365 5898 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.176.171/api/v1/nodes": dial tcp 34.106.176.171:443: connect: connection refused W0126 10:34:39.087129 5898 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.176.171/api/v1/nodes": dial tcp 34.106.176.171:443: connect: connection refused I0126 10:34:45.695514 5539 boskos.go:86] Sending heartbeat to Boskos W0126 10:34:59.112902 5898 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.176.171/api/v1/nodes": net/http: TLS handshake timeout W0126 10:35:09.136464 5898 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.176.171/api/v1/nodes": dial tcp 34.106.176.171:443: connect: connection refused W0126 10:35:19.159979 5898 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.176.171/api/v1/nodes": dial tcp 34.106.176.171:443: connect: connection refused I0126 10:35:35.143309 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 5 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-alpha/zones/us-west3-a/instances/control-plane-us-west3-a-4j9x machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-alpha/zones/us-west3-a/instances/control-plane-us-west3-a-4j9x" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-alpha/zones/us-west3-a/instances/nodes-us-west3-a-0fls machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-alpha/zones/us-west3-a/instances/nodes-us-west3-a-0fls" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-alpha/zones/us-west3-a/instances/nodes-us-west3-a-gjg6 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-alpha/zones/us-west3-a/instances/nodes-us-west3-a-gjg6" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-alpha/zones/us-west3-a/instances/nodes-us-west3-a-q9x9 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-alpha/zones/us-west3-a/instances/nodes-us-west3-a-q9x9" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-alpha/zones/us-west3-a/instances/nodes-us-west3-a-sqtb machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-alpha/zones/us-west3-a/instances/nodes-us-west3-a-sqtb" has not yet joined cluster Validation Failed W0126 10:35:35.748384 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:35:46.065991 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 6 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-alpha/zones/us-west3-a/instances/control-plane-us-west3-a-4j9x machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-alpha/zones/us-west3-a/instances/control-plane-us-west3-a-4j9x" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-alpha/zones/us-west3-a/instances/nodes-us-west3-a-0fls machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-alpha/zones/us-west3-a/instances/nodes-us-west3-a-0fls" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-alpha/zones/us-west3-a/instances/nodes-us-west3-a-gjg6 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-alpha/zones/us-west3-a/instances/nodes-us-west3-a-gjg6" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-alpha/zones/us-west3-a/instances/nodes-us-west3-a-q9x9 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-alpha/zones/us-west3-a/instances/nodes-us-west3-a-q9x9" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-alpha/zones/us-west3-a/instances/nodes-us-west3-a-sqtb machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-alpha/zones/us-west3-a/instances/nodes-us-west3-a-sqtb" has not yet joined cluster Validation Failed W0126 10:35:46.689535 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:35:57.160195 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 8 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-alpha/zones/us-west3-a/instances/nodes-us-west3-a-gjg6 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-alpha/zones/us-west3-a/instances/nodes-us-west3-a-gjg6" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-alpha/zones/us-west3-a/instances/nodes-us-west3-a-q9x9 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-alpha/zones/us-west3-a/instances/nodes-us-west3-a-q9x9" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-alpha/zones/us-west3-a/instances/nodes-us-west3-a-sqtb machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-alpha/zones/us-west3-a/instances/nodes-us-west3-a-sqtb" has not yet joined cluster Pod kube-system/calico-kube-controllers-55f488656-879ng system-cluster-critical pod "calico-kube-controllers-55f488656-879ng" is pending Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is pending Validation Failed W0126 10:35:57.910631 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:36:08.349260 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 10 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-alpha/zones/us-west3-a/instances/nodes-us-west3-a-sqtb machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-alpha/zones/us-west3-a/instances/nodes-us-west3-a-sqtb" has not yet joined cluster Pod kube-system/calico-kube-controllers-55f488656-879ng system-cluster-critical pod "calico-kube-controllers-55f488656-879ng" is pending Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is pending Pod kube-system/coredns-7bc44848df-wcvxl system-cluster-critical pod "coredns-7bc44848df-wcvxl" is pending Pod kube-system/dns-controller-6d5f4bf5d6-4k9qq system-cluster-critical pod "dns-controller-6d5f4bf5d6-4k9qq" is pending Validation Failed W0126 10:36:09.059381 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:36:19.396516 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 14 lines ... Pod kube-system/coredns-7bc44848df-wcvxl system-cluster-critical pod "coredns-7bc44848df-wcvxl" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-vxr2f system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-vxr2f" is pending Pod kube-system/dns-controller-6d5f4bf5d6-4k9qq system-cluster-critical pod "dns-controller-6d5f4bf5d6-4k9qq" is pending Pod kube-system/etcd-manager-main-control-plane-us-west3-a-4j9x system-cluster-critical pod "etcd-manager-main-control-plane-us-west3-a-4j9x" is pending Pod kube-system/kops-controller-bxnc2 system-cluster-critical pod "kops-controller-bxnc2" is pending Validation Failed W0126 10:36:20.136158 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:36:30.446495 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 15 lines ... Pod kube-system/coredns-autoscaler-7cb5c5b969-vxr2f system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-vxr2f" is pending Pod kube-system/dns-controller-6d5f4bf5d6-4k9qq system-cluster-critical pod "dns-controller-6d5f4bf5d6-4k9qq" is pending Pod kube-system/etcd-manager-main-control-plane-us-west3-a-4j9x system-cluster-critical pod "etcd-manager-main-control-plane-us-west3-a-4j9x" is pending Pod kube-system/kops-controller-bxnc2 system-cluster-critical pod "kops-controller-bxnc2" is pending Pod kube-system/kube-proxy-control-plane-us-west3-a-4j9x system-node-critical pod "kube-proxy-control-plane-us-west3-a-4j9x" is pending Validation Failed W0126 10:36:30.955691 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:36:41.267806 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 11 lines ... Pod kube-system/calico-kube-controllers-55f488656-879ng system-cluster-critical pod "calico-kube-controllers-55f488656-879ng" is pending Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is pending Pod kube-system/coredns-7bc44848df-wcvxl system-cluster-critical pod "coredns-7bc44848df-wcvxl" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-vxr2f system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-vxr2f" is pending Pod kube-system/kube-apiserver-control-plane-us-west3-a-4j9x system-cluster-critical pod "kube-apiserver-control-plane-us-west3-a-4j9x" is pending Validation Failed W0126 10:36:41.830713 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:36:52.160341 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 19 lines ... Pod kube-system/calico-node-drb59 system-node-critical pod "calico-node-drb59" is pending Pod kube-system/calico-node-twl7w system-node-critical pod "calico-node-twl7w" is pending Pod kube-system/calico-node-vd24n system-node-critical pod "calico-node-vd24n" is pending Pod kube-system/coredns-7bc44848df-wcvxl system-cluster-critical pod "coredns-7bc44848df-wcvxl" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-vxr2f system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-vxr2f" is pending Validation Failed W0126 10:36:52.758713 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:37:03.075013 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 17 lines ... Pod kube-system/calico-node-twl7w system-node-critical pod "calico-node-twl7w" is pending Pod kube-system/calico-node-vd24n system-node-critical pod "calico-node-vd24n" is pending Pod kube-system/coredns-7bc44848df-wcvxl system-cluster-critical pod "coredns-7bc44848df-wcvxl" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-vxr2f system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-vxr2f" is pending Pod kube-system/kube-controller-manager-control-plane-us-west3-a-4j9x system-cluster-critical pod "kube-controller-manager-control-plane-us-west3-a-4j9x" is pending Validation Failed W0126 10:37:03.730933 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:37:14.046525 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 13 lines ... Pod kube-system/calico-node-drb59 system-node-critical pod "calico-node-drb59" is pending Pod kube-system/calico-node-twl7w system-node-critical pod "calico-node-twl7w" is pending Pod kube-system/calico-node-vd24n system-node-critical pod "calico-node-vd24n" is pending Pod kube-system/coredns-7bc44848df-wcvxl system-cluster-critical pod "coredns-7bc44848df-wcvxl" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-vxr2f system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-vxr2f" is pending Validation Failed W0126 10:37:14.627714 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:37:24.955003 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 10 lines ... KIND NAME MESSAGE Pod kube-system/calico-node-99zmn system-node-critical pod "calico-node-99zmn" is not ready (calico-node) Pod kube-system/calico-node-drb59 system-node-critical pod "calico-node-drb59" is not ready (calico-node) Pod kube-system/calico-node-twl7w system-node-critical pod "calico-node-twl7w" is not ready (calico-node) Pod kube-system/calico-node-vd24n system-node-critical pod "calico-node-vd24n" is not ready (calico-node) Validation Failed W0126 10:37:25.714149 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:37:36.068840 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 10 lines ... KIND NAME MESSAGE Pod kube-system/calico-node-99zmn system-node-critical pod "calico-node-99zmn" is not ready (calico-node) Pod kube-system/calico-node-drb59 system-node-critical pod "calico-node-drb59" is not ready (calico-node) Pod kube-system/calico-node-twl7w system-node-critical pod "calico-node-twl7w" is not ready (calico-node) Pod kube-system/calico-node-vd24n system-node-critical pod "calico-node-vd24n" is not ready (calico-node) Validation Failed W0126 10:37:36.668053 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:37:47.016323 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 10 lines ... KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Pod kube-system/calico-node-drb59 system-node-critical pod "calico-node-drb59" is not ready (calico-node) Pod kube-system/calico-node-twl7w system-node-critical pod "calico-node-twl7w" is not ready (calico-node) Pod kube-system/calico-node-vd24n system-node-critical pod "calico-node-vd24n" is not ready (calico-node) Validation Failed W0126 10:37:47.514150 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:37:57.859613 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:37:58.300469 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:38:08.693547 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:38:09.165668 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:38:19.452918 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:38:19.943435 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:38:30.273167 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:38:30.754377 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:38:41.240201 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:38:41.903447 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:38:52.289154 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:38:52.840458 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:39:03.175787 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:39:03.741044 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:39:14.044253 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:39:14.668532 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:39:25.025288 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:39:25.472415 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:39:35.767868 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:39:36.323632 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:39:45.707047 5539 boskos.go:86] Sending heartbeat to Boskos I0126 10:39:46.636746 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 ... skipping 8 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:39:47.083005 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:39:57.533361 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:39:58.132056 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:40:08.545211 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:40:08.992346 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:40:19.368024 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:40:19.902029 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:40:30.250763 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:40:30.710886 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:40:41.078603 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:40:41.536200 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:40:51.908533 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:40:52.319013 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:41:02.686705 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:41:03.158410 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:41:13.491028 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:41:13.997665 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:41:24.303478 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:41:24.725823 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:41:35.101332 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:41:35.796944 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:41:46.199844 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:41:46.770141 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:41:57.103588 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:41:57.501770 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:42:07.822381 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:42:08.254249 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:42:18.574294 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:42:19.131931 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:42:29.465164 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:42:29.999714 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:42:40.402892 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:42:40.823502 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:42:51.112412 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:42:51.582253 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:43:01.856537 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:43:02.352104 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:43:12.676750 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:43:13.254545 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:43:23.727131 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:43:24.231248 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:43:34.582760 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:43:35.069006 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:43:45.382141 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:43:45.780417 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:43:56.112200 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:43:56.530191 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:44:06.829699 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:44:07.264094 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:44:17.604662 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:44:18.104309 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:44:28.450364 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:44:28.956546 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:44:39.272284 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:44:39.769084 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:44:45.717860 5539 boskos.go:86] Sending heartbeat to Boskos I0126 10:44:50.093260 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 ... skipping 8 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:44:50.679510 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:45:01.049099 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:45:01.507249 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:45:11.861118 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:45:12.291981 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:45:22.585976 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:45:22.984674 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:45:33.320692 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:45:33.763735 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:45:44.114594 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:45:44.638870 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:45:55.101484 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:45:55.543011 5898 validate_cluster.go:232] (will retry): cluster not yet healthy I0126 10:46:05.892730 5898 gce_cloud.go:301] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node e2-medium 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-sqtb node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-5krzb system-node-critical pod "calico-node-5krzb" is not ready (calico-node) Validation Failed W0126 10:46:06.412538 5898 validate_cluster.go:232] (will retry): cluster not yet healthy Error: validation failed: wait time exceeded during validation I0126 10:46:16.431622 5539 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/151d7577-9d64-11ed-b1bb-1299ca1e1805/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh2822732964/key --ssh-user prow I0126 10:46:16.431681 5539 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/151d7577-9d64-11ed-b1bb-1299ca1e1805/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh2822732964/key --ssh-user prow I0126 10:46:16.869159 5909 gce.go:99] Scanning zones: [us-west3-a us-west3-b us-west3-c] 2023/01/26 10:46:21 Dumping node control-plane-us-west3-a-4j9x 2023/01/26 10:46:26 error dumping node control-plane-us-west3-a-4j9x: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/26 10:46:26 error dumping node control-plane-us-west3-a-4j9x: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/26 10:46:26 Dumping node nodes-us-west3-a-0fls 2023/01/26 10:46:28 Dumping node nodes-us-west3-a-gjg6 2023/01/26 10:46:31 Dumping node nodes-us-west3-a-q9x9 2023/01/26 10:46:34 Dumping node nodes-us-west3-a-sqtb I0126 10:46:37.092760 5539 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/151d7577-9d64-11ed-b1bb-1299ca1e1805/kops get cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local -o yaml I0126 10:46:37.092796 5539 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/151d7577-9d64-11ed-b1bb-1299ca1e1805/kops get cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local -o yaml ... skipping 154 lines ... Deleted cluster: "e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local" I0126 10:48:49.809196 5539 gcs.go:88] gsutil -u k8s-jkns-gci-gce-alpha rm -r gs://k8s-jkns-gci-gce-alpha-state-15 I0126 10:48:49.809263 5539 local.go:42] ⚙️ gsutil -u k8s-jkns-gci-gce-alpha rm -r gs://k8s-jkns-gci-gce-alpha-state-15 Removing gs://k8s-jkns-gci-gce-alpha-state-15/... I0126 10:48:52.591390 5539 down.go:62] releasing boskos project I0126 10:48:52.599759 5539 boskos.go:83] Boskos heartbeat func received signal to close Error: exit status 1 + EXIT_VALUE=1 + set +o xtrace