e2e-kops-grid-gce-calico-u2004-k26 #1615415429050667008
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 1 failed / 1 succeeded |
| Started | |
| Elapsed | 20m32s |
| Revision | master |
exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
kubetest2 Down
... skipping 163 lines ... .................................Updated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-ubuntu-gce-1-6]. .done. WARNING: No host aliases were added to your SSH configs because you do not have any running instances. Try running this command again after running some instances. I0117 18:29:22.010915 5535 up.go:44] Cleaning up any leaked resources from previous cluster I0117 18:29:22.011030 5535 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/8b8d66f6-9694-11ed-824d-f64c9135b4ea/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh4285681553/key --ssh-user prow I0117 18:29:22.011047 5535 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/8b8d66f6-9694-11ed-824d-f64c9135b4ea/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh4285681553/key --ssh-user prow Error: Cluster.kops.k8s.io "e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local" not found W0117 18:29:22.240992 5535 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1 I0117 18:29:22.241051 5535 down.go:48] /home/prow/go/src/k8s.io/kops/_rundir/8b8d66f6-9694-11ed-824d-f64c9135b4ea/kops delete cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --yes I0117 18:29:22.241066 5535 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/8b8d66f6-9694-11ed-824d-f64c9135b4ea/kops delete cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --yes Error: error reading cluster configuration: Cluster.kops.k8s.io "e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local" not found I0117 18:29:22.397145 5535 gcs.go:51] gsutil ls -b -p k8s-jkns-e2e-ubuntu-gce-1-6 gs://k8s-jkns-e2e-ubuntu-gce-1-6-state-8b I0117 18:29:22.397200 5535 local.go:42] ⚙️ gsutil ls -b -p k8s-jkns-e2e-ubuntu-gce-1-6 gs://k8s-jkns-e2e-ubuntu-gce-1-6-state-8b I0117 18:29:24.555203 5535 gcs.go:70] gsutil mb -p k8s-jkns-e2e-ubuntu-gce-1-6 gs://k8s-jkns-e2e-ubuntu-gce-1-6-state-8b I0117 18:29:24.555241 5535 local.go:42] ⚙️ gsutil mb -p k8s-jkns-e2e-ubuntu-gce-1-6 gs://k8s-jkns-e2e-ubuntu-gce-1-6-state-8b Creating gs://k8s-jkns-e2e-ubuntu-gce-1-6-state-8b/... I0117 18:29:27.060157 5535 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip 2023/01/17 18:29:27 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404 I0117 18:29:27.075839 5535 http.go:37] curl https://ip.jsb.workers.dev I0117 18:29:27.215058 5535 up.go:167] /home/prow/go/src/k8s.io/kops/_rundir/8b8d66f6-9694-11ed-824d-f64c9135b4ea/kops create cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --cloud gce --kubernetes-version https://storage.googleapis.com/kubernetes-release/release/v1.26.0 --ssh-public-key /tmp/kops-ssh4285681553/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --networking=calico --container-runtime=containerd --gce-service-account=default --admin-access 34.136.212.21/32 --master-count 1 --master-volume-size 48 --node-count 4 --node-volume-size 48 --zones us-west1-a --master-size e2-standard-2 --project k8s-jkns-e2e-ubuntu-gce-1-6 I0117 18:29:27.215104 5535 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/8b8d66f6-9694-11ed-824d-f64c9135b4ea/kops create cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --cloud gce --kubernetes-version https://storage.googleapis.com/kubernetes-release/release/v1.26.0 --ssh-public-key /tmp/kops-ssh4285681553/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --networking=calico --container-runtime=containerd --gce-service-account=default --admin-access 34.136.212.21/32 --master-count 1 --master-volume-size 48 --node-count 4 --node-volume-size 48 --zones us-west1-a --master-size e2-standard-2 --project k8s-jkns-e2e-ubuntu-gce-1-6 I0117 18:29:27.268690 5857 create_cluster.go:882] Using SSH public key: /tmp/kops-ssh4285681553/key.pub I0117 18:29:27.539836 5857 new_cluster.go:573] VMs will be configured to use specified Service Account: default I0117 18:29:27.539987 5857 new_cluster.go:1338] Cloud Provider ID: "gce" ... skipping 349 lines ... I0117 18:29:35.985515 5877 keypair.go:226] Issuing new certificate: "etcd-clients-ca" I0117 18:29:35.987509 5877 keypair.go:226] Issuing new certificate: "etcd-peers-ca-main" W0117 18:29:36.177469 5877 vfs_keystorereader.go:143] CA private key was not found I0117 18:29:36.281930 5877 keypair.go:226] Issuing new certificate: "kubernetes-ca" I0117 18:29:36.288484 5877 keypair.go:226] Issuing new certificate: "service-account" I0117 18:29:48.563460 5877 executor.go:111] Tasks: 42 done / 67 total; 19 can run W0117 18:30:03.511476 5877 executor.go:139] error running task "ForwardingRule/api-e2e-e2e-kops-grid-gce-calico-u2004-k26-k8s-local" (9m45s remaining to succeed): error creating ForwardingRule "api-e2e-e2e-kops-grid-gce-calico-u2004-k26-k8s-local": googleapi: Error 400: The resource 'projects/k8s-jkns-e2e-ubuntu-gce-1-6/regions/us-west1/targetPools/api-e2e-e2e-kops-grid-gce-calico-u2004-k26-k8s-local' is not ready, resourceNotReady I0117 18:30:03.511560 5877 executor.go:111] Tasks: 60 done / 67 total; 5 can run I0117 18:30:10.535912 5877 executor.go:111] Tasks: 65 done / 67 total; 2 can run I0117 18:30:24.918915 5877 executor.go:111] Tasks: 67 done / 67 total; 0 can run I0117 18:30:24.985597 5877 update_cluster.go:323] Exporting kubeconfig for cluster kOps has set your kubectl context to e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local ... skipping 7 lines ... * read about installing addons at: https://kops.sigs.k8s.io/addons. I0117 18:30:35.514877 5535 up.go:251] /home/prow/go/src/k8s.io/kops/_rundir/8b8d66f6-9694-11ed-824d-f64c9135b4ea/kops validate cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --count 10 --wait 15m0s I0117 18:30:35.514924 5535 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/8b8d66f6-9694-11ed-824d-f64c9135b4ea/kops validate cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --count 10 --wait 15m0s Validating cluster e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local W0117 18:31:05.917006 5897 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.105.47.229/api/v1/nodes": dial tcp 34.105.47.229:443: i/o timeout W0117 18:31:15.959502 5897 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.105.47.229/api/v1/nodes": dial tcp 34.105.47.229:443: connect: connection refused W0117 18:31:26.001236 5897 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.105.47.229/api/v1/nodes": dial tcp 34.105.47.229:443: connect: connection refused W0117 18:31:36.043516 5897 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.105.47.229/api/v1/nodes": dial tcp 34.105.47.229:443: connect: connection refused W0117 18:31:46.085450 5897 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.105.47.229/api/v1/nodes": dial tcp 34.105.47.229:443: connect: connection refused W0117 18:31:56.127881 5897 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.105.47.229/api/v1/nodes": dial tcp 34.105.47.229:443: connect: connection refused W0117 18:32:06.169338 5897 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.105.47.229/api/v1/nodes": dial tcp 34.105.47.229:443: connect: connection refused W0117 18:32:16.211930 5897 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.105.47.229/api/v1/nodes": dial tcp 34.105.47.229:443: connect: connection refused W0117 18:32:26.253985 5897 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.105.47.229/api/v1/nodes": dial tcp 34.105.47.229:443: connect: connection refused W0117 18:32:36.299447 5897 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.105.47.229/api/v1/nodes": dial tcp 34.105.47.229:443: connect: connection refused W0117 18:32:46.340690 5897 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.105.47.229/api/v1/nodes": dial tcp 34.105.47.229:443: connect: connection refused W0117 18:32:56.382876 5897 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.105.47.229/api/v1/nodes": dial tcp 34.105.47.229:443: connect: connection refused W0117 18:33:16.427314 5897 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.105.47.229/api/v1/nodes": net/http: TLS handshake timeout W0117 18:33:36.471224 5897 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.105.47.229/api/v1/nodes": net/http: TLS handshake timeout I0117 18:33:47.049735 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 6 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-ubuntu-gce-1-6/zones/us-west1-a/instances/nodes-us-west1-a-2206 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-ubuntu-gce-1-6/zones/us-west1-a/instances/nodes-us-west1-a-2206" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-ubuntu-gce-1-6/zones/us-west1-a/instances/nodes-us-west1-a-fwfb machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-ubuntu-gce-1-6/zones/us-west1-a/instances/nodes-us-west1-a-fwfb" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-ubuntu-gce-1-6/zones/us-west1-a/instances/nodes-us-west1-a-plw4 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-ubuntu-gce-1-6/zones/us-west1-a/instances/nodes-us-west1-a-plw4" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-ubuntu-gce-1-6/zones/us-west1-a/instances/nodes-us-west1-a-w5nh machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-ubuntu-gce-1-6/zones/us-west1-a/instances/nodes-us-west1-a-w5nh" has not yet joined cluster Pod kube-system/kube-controller-manager-control-plane-us-west1-a-kfhm system-cluster-critical pod "kube-controller-manager-control-plane-us-west1-a-kfhm" is pending Validation Failed W0117 18:33:47.699920 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:33:58.037101 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-ubuntu-gce-1-6/zones/us-west1-a/instances/nodes-us-west1-a-2206 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-ubuntu-gce-1-6/zones/us-west1-a/instances/nodes-us-west1-a-2206" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-ubuntu-gce-1-6/zones/us-west1-a/instances/nodes-us-west1-a-fwfb machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-ubuntu-gce-1-6/zones/us-west1-a/instances/nodes-us-west1-a-fwfb" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-ubuntu-gce-1-6/zones/us-west1-a/instances/nodes-us-west1-a-plw4 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-ubuntu-gce-1-6/zones/us-west1-a/instances/nodes-us-west1-a-plw4" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-ubuntu-gce-1-6/zones/us-west1-a/instances/nodes-us-west1-a-w5nh machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-ubuntu-gce-1-6/zones/us-west1-a/instances/nodes-us-west1-a-w5nh" has not yet joined cluster Pod kube-system/kube-controller-manager-control-plane-us-west1-a-kfhm system-cluster-critical pod "kube-controller-manager-control-plane-us-west1-a-kfhm" is not ready (kube-controller-manager) Validation Failed W0117 18:33:58.834458 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:34:09.269961 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-ubuntu-gce-1-6/zones/us-west1-a/instances/nodes-us-west1-a-2206 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-ubuntu-gce-1-6/zones/us-west1-a/instances/nodes-us-west1-a-2206" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-ubuntu-gce-1-6/zones/us-west1-a/instances/nodes-us-west1-a-fwfb machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-ubuntu-gce-1-6/zones/us-west1-a/instances/nodes-us-west1-a-fwfb" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-ubuntu-gce-1-6/zones/us-west1-a/instances/nodes-us-west1-a-plw4 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-ubuntu-gce-1-6/zones/us-west1-a/instances/nodes-us-west1-a-plw4" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-ubuntu-gce-1-6/zones/us-west1-a/instances/nodes-us-west1-a-w5nh machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-ubuntu-gce-1-6/zones/us-west1-a/instances/nodes-us-west1-a-w5nh" has not yet joined cluster Pod kube-system/kube-controller-manager-control-plane-us-west1-a-kfhm system-cluster-critical pod "kube-controller-manager-control-plane-us-west1-a-kfhm" is not ready (kube-controller-manager) Validation Failed W0117 18:34:09.826130 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:34:11.777129 5535 boskos.go:86] Sending heartbeat to Boskos I0117 18:34:20.171820 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 ... skipping 8 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-ubuntu-gce-1-6/zones/us-west1-a/instances/nodes-us-west1-a-2206 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-ubuntu-gce-1-6/zones/us-west1-a/instances/nodes-us-west1-a-2206" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-ubuntu-gce-1-6/zones/us-west1-a/instances/nodes-us-west1-a-fwfb machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-ubuntu-gce-1-6/zones/us-west1-a/instances/nodes-us-west1-a-fwfb" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-ubuntu-gce-1-6/zones/us-west1-a/instances/nodes-us-west1-a-plw4 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-ubuntu-gce-1-6/zones/us-west1-a/instances/nodes-us-west1-a-plw4" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-ubuntu-gce-1-6/zones/us-west1-a/instances/nodes-us-west1-a-w5nh machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-ubuntu-gce-1-6/zones/us-west1-a/instances/nodes-us-west1-a-w5nh" has not yet joined cluster Pod kube-system/kube-scheduler-control-plane-us-west1-a-kfhm system-cluster-critical pod "kube-scheduler-control-plane-us-west1-a-kfhm" is pending Validation Failed W0117 18:34:20.772897 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:34:31.175210 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 13 lines ... Pod kube-system/cloud-controller-manager-j24bj system-cluster-critical pod "cloud-controller-manager-j24bj" is pending Pod kube-system/coredns-7bc44848df-vd7fk system-cluster-critical pod "coredns-7bc44848df-vd7fk" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-txmnw system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-txmnw" is pending Pod kube-system/dns-controller-6d5f4bf5d6-pvgd7 system-cluster-critical pod "dns-controller-6d5f4bf5d6-pvgd7" is pending Pod kube-system/kops-controller-545rp system-cluster-critical pod "kops-controller-545rp" is pending Validation Failed W0117 18:34:31.797988 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:34:42.261060 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 15 lines ... Pod kube-system/cloud-controller-manager-j24bj system-cluster-critical pod "cloud-controller-manager-j24bj" is pending Pod kube-system/coredns-7bc44848df-vd7fk system-cluster-critical pod "coredns-7bc44848df-vd7fk" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-txmnw system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-txmnw" is pending Pod kube-system/etcd-manager-main-control-plane-us-west1-a-kfhm system-cluster-critical pod "etcd-manager-main-control-plane-us-west1-a-kfhm" is pending Pod kube-system/kube-apiserver-control-plane-us-west1-a-kfhm system-cluster-critical pod "kube-apiserver-control-plane-us-west1-a-kfhm" is pending Validation Failed W0117 18:34:42.922306 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:34:53.308240 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 15 lines ... Pod kube-system/calico-node-hpmv9 system-node-critical pod "calico-node-hpmv9" is pending Pod kube-system/calico-node-tfjtj system-node-critical pod "calico-node-tfjtj" is pending Pod kube-system/coredns-7bc44848df-vd7fk system-cluster-critical pod "coredns-7bc44848df-vd7fk" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-txmnw system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-txmnw" is pending Pod kube-system/kube-proxy-nodes-us-west1-a-fwfb system-node-critical pod "kube-proxy-nodes-us-west1-a-fwfb" is pending Validation Failed W0117 18:34:54.056081 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:35:04.686388 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 14 lines ... Pod kube-system/calico-node-dzhlb system-node-critical pod "calico-node-dzhlb" is pending Pod kube-system/calico-node-hpmv9 system-node-critical pod "calico-node-hpmv9" is pending Pod kube-system/calico-node-tfjtj system-node-critical pod "calico-node-tfjtj" is pending Pod kube-system/coredns-7bc44848df-vd7fk system-cluster-critical pod "coredns-7bc44848df-vd7fk" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-txmnw system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-txmnw" is pending Validation Failed W0117 18:35:05.252629 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:35:15.612730 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 14 lines ... Pod kube-system/calico-node-dzhlb system-node-critical pod "calico-node-dzhlb" is pending Pod kube-system/calico-node-hpmv9 system-node-critical pod "calico-node-hpmv9" is not ready (calico-node) Pod kube-system/calico-node-tfjtj system-node-critical pod "calico-node-tfjtj" is not ready (calico-node) Pod kube-system/coredns-7bc44848df-vd7fk system-cluster-critical pod "coredns-7bc44848df-vd7fk" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-txmnw system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-txmnw" is pending Validation Failed W0117 18:35:16.187283 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:35:26.601982 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 12 lines ... Pod kube-system/calico-node-cswjf system-node-critical pod "calico-node-cswjf" is not ready (calico-node) Pod kube-system/calico-node-dzhlb system-node-critical pod "calico-node-dzhlb" is pending Pod kube-system/calico-node-hpmv9 system-node-critical pod "calico-node-hpmv9" is not ready (calico-node) Pod kube-system/calico-node-tfjtj system-node-critical pod "calico-node-tfjtj" is not ready (calico-node) Pod kube-system/coredns-7bc44848df-4wlq7 system-cluster-critical pod "coredns-7bc44848df-4wlq7" is pending Validation Failed W0117 18:35:27.342386 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:35:37.701051 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 11 lines ... Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Pod kube-system/calico-node-cswjf system-node-critical pod "calico-node-cswjf" is not ready (calico-node) Pod kube-system/calico-node-dzhlb system-node-critical pod "calico-node-dzhlb" is not ready (calico-node) Pod kube-system/calico-node-hpmv9 system-node-critical pod "calico-node-hpmv9" is not ready (calico-node) Pod kube-system/calico-node-tfjtj system-node-critical pod "calico-node-tfjtj" is not ready (calico-node) Validation Failed W0117 18:35:38.302773 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:35:48.612260 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 9 lines ... VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Pod kube-system/calico-node-cswjf system-node-critical pod "calico-node-cswjf" is not ready (calico-node) Pod kube-system/calico-node-dzhlb system-node-critical pod "calico-node-dzhlb" is not ready (calico-node) Validation Failed W0117 18:35:49.164197 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:35:59.521017 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 9 lines ... VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Pod kube-system/calico-node-cswjf system-node-critical pod "calico-node-cswjf" is not ready (calico-node) Pod kube-system/calico-node-dzhlb system-node-critical pod "calico-node-dzhlb" is not ready (calico-node) Validation Failed W0117 18:36:00.078653 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:36:10.487630 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:36:11.224959 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:36:21.551007 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:36:22.080708 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:36:32.450775 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:36:33.010324 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:36:43.470097 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:36:44.040844 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:36:54.413069 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:36:54.945977 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:37:05.393414 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:37:05.960565 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:37:16.367644 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:37:16.929746 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:37:27.280416 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:37:27.826816 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:37:38.205851 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:37:38.741956 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:37:49.103438 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:37:49.648353 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:38:00.021978 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:38:00.631839 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:38:11.078171 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:38:11.650301 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:38:22.010014 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:38:22.562375 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:38:32.919585 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:38:33.504506 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:38:43.900253 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:38:44.647497 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:38:55.007361 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:38:55.575463 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:39:05.886285 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:39:06.423020 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:39:11.790799 5535 boskos.go:86] Sending heartbeat to Boskos I0117 18:39:16.805732 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 ... skipping 8 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:39:17.347816 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:39:27.727431 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:39:28.321877 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:39:38.678244 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:39:39.236962 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:39:49.628835 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:39:50.176733 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:40:00.609509 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:40:01.242766 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:40:11.562913 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:40:12.145486 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:40:22.614767 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:40:23.156602 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:40:33.498772 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:40:34.155574 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:40:44.499346 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:40:45.106263 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:40:55.502175 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:40:56.072623 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:41:06.424692 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:41:06.965239 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:41:17.366659 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:41:17.911767 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:41:28.216098 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:41:28.848469 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:41:39.235719 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:41:39.780861 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:41:50.131940 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:41:50.730186 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:42:01.125946 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:42:01.681795 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:42:12.033727 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:42:12.623043 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:42:22.981843 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:42:23.532171 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:42:33.862957 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:42:34.441942 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:42:44.805752 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:42:45.389267 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:42:55.741995 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:42:56.289363 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:43:06.700753 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:43:07.274443 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:43:17.627245 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:43:18.156610 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:43:28.499702 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:43:29.051646 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:43:39.516392 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:43:40.190131 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:43:50.630582 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:43:51.163411 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:44:01.652697 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:44:02.225083 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:44:11.800490 5535 boskos.go:86] Sending heartbeat to Boskos I0117 18:44:12.582721 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 ... skipping 8 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:44:13.136668 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:44:23.480710 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:44:24.281318 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:44:34.649663 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:44:35.227470 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:44:45.604593 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:44:46.228384 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:44:56.697772 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:44:57.250789 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:45:07.773647 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:45:08.389353 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:45:18.795401 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:45:19.380497 5897 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 18:45:29.730378 5897 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-w5nh node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2nnx6 system-node-critical pod "calico-node-2nnx6" is not ready (calico-node) Validation Failed W0117 18:45:30.325139 5897 validate_cluster.go:232] (will retry): cluster not yet healthy Error: validation failed: wait time exceeded during validation I0117 18:45:40.344799 5535 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/8b8d66f6-9694-11ed-824d-f64c9135b4ea/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh4285681553/key --ssh-user prow I0117 18:45:40.344864 5535 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/8b8d66f6-9694-11ed-824d-f64c9135b4ea/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh4285681553/key --ssh-user prow I0117 18:45:40.833099 5908 gce.go:99] Scanning zones: [us-west1-b us-west1-c us-west1-a] 2023/01/17 18:45:45 Dumping node control-plane-us-west1-a-kfhm 2023/01/17 18:45:50 error dumping node control-plane-us-west1-a-kfhm: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/17 18:45:50 error dumping node control-plane-us-west1-a-kfhm: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/17 18:45:50 Dumping node nodes-us-west1-a-2206 2023/01/17 18:45:54 Dumping node nodes-us-west1-a-fwfb 2023/01/17 18:45:57 Dumping node nodes-us-west1-a-plw4 2023/01/17 18:46:01 Dumping node nodes-us-west1-a-w5nh I0117 18:46:04.826892 5535 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/8b8d66f6-9694-11ed-824d-f64c9135b4ea/kops get cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local -o yaml I0117 18:46:04.827002 5535 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/8b8d66f6-9694-11ed-824d-f64c9135b4ea/kops get cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local -o yaml ... skipping 154 lines ... Deleted cluster: "e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local" I0117 18:48:24.801966 5535 gcs.go:88] gsutil -u k8s-jkns-e2e-ubuntu-gce-1-6 rm -r gs://k8s-jkns-e2e-ubuntu-gce-1-6-state-8b I0117 18:48:24.802091 5535 local.go:42] ⚙️ gsutil -u k8s-jkns-e2e-ubuntu-gce-1-6 rm -r gs://k8s-jkns-e2e-ubuntu-gce-1-6-state-8b Removing gs://k8s-jkns-e2e-ubuntu-gce-1-6-state-8b/... I0117 18:48:27.749903 5535 down.go:62] releasing boskos project I0117 18:48:27.759137 5535 boskos.go:83] Boskos heartbeat func received signal to close Error: exit status 1 + EXIT_VALUE=1 + set +o xtrace