e2e-kops-grid-gce-calico-u2004-k26 #1617952316646756352
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 1 failed / 1 succeeded |
| Started | |
| Elapsed | 21m7s |
| Revision | master |
exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
kubetest2 Down
... skipping 163 lines ... .............................Updated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-slow-1-3]. ..done. WARNING: No host aliases were added to your SSH configs because you do not have any running instances. Try running this command again after running some instances. I0124 18:30:53.113962 5696 up.go:44] Cleaning up any leaked resources from previous cluster I0124 18:30:53.114333 5696 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/ccf6718b-9c14-11ed-b10d-8a774b882db2/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh3355924745/key --ssh-user prow I0124 18:30:53.114477 5696 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/ccf6718b-9c14-11ed-b10d-8a774b882db2/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh3355924745/key --ssh-user prow Error: Cluster.kops.k8s.io "e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local" not found W0124 18:30:53.523334 5696 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1 I0124 18:30:53.523372 5696 down.go:48] /home/prow/go/src/k8s.io/kops/_rundir/ccf6718b-9c14-11ed-b10d-8a774b882db2/kops delete cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --yes I0124 18:30:53.523383 5696 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/ccf6718b-9c14-11ed-b10d-8a774b882db2/kops delete cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --yes Error: error reading cluster configuration: Cluster.kops.k8s.io "e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local" not found I0124 18:30:53.858842 5696 gcs.go:51] gsutil ls -b -p k8s-jkns-gce-slow-1-3 gs://k8s-jkns-gce-slow-1-3-state-cc I0124 18:30:53.858909 5696 local.go:42] ⚙️ gsutil ls -b -p k8s-jkns-gce-slow-1-3 gs://k8s-jkns-gce-slow-1-3-state-cc I0124 18:30:58.095953 5696 gcs.go:70] gsutil mb -p k8s-jkns-gce-slow-1-3 gs://k8s-jkns-gce-slow-1-3-state-cc I0124 18:30:58.095987 5696 local.go:42] ⚙️ gsutil mb -p k8s-jkns-gce-slow-1-3 gs://k8s-jkns-gce-slow-1-3-state-cc Creating gs://k8s-jkns-gce-slow-1-3-state-cc/... I0124 18:31:02.715068 5696 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip 2023/01/24 18:31:02 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404 I0124 18:31:02.730512 5696 http.go:37] curl https://ip.jsb.workers.dev I0124 18:31:02.847622 5696 up.go:167] /home/prow/go/src/k8s.io/kops/_rundir/ccf6718b-9c14-11ed-b10d-8a774b882db2/kops create cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --cloud gce --kubernetes-version https://storage.googleapis.com/kubernetes-release/release/v1.26.1 --ssh-public-key /tmp/kops-ssh3355924745/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --networking=calico --container-runtime=containerd --gce-service-account=default --admin-access 35.239.116.242/32 --master-count 1 --master-volume-size 48 --node-count 4 --node-volume-size 48 --zones us-central1-a --master-size e2-standard-2 --project k8s-jkns-gce-slow-1-3 I0124 18:31:02.847719 5696 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/ccf6718b-9c14-11ed-b10d-8a774b882db2/kops create cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --cloud gce --kubernetes-version https://storage.googleapis.com/kubernetes-release/release/v1.26.1 --ssh-public-key /tmp/kops-ssh3355924745/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --networking=calico --container-runtime=containerd --gce-service-account=default --admin-access 35.239.116.242/32 --master-count 1 --master-volume-size 48 --node-count 4 --node-volume-size 48 --zones us-central1-a --master-size e2-standard-2 --project k8s-jkns-gce-slow-1-3 I0124 18:31:02.949611 6020 create_cluster.go:882] Using SSH public key: /tmp/kops-ssh3355924745/key.pub I0124 18:31:03.243031 6020 new_cluster.go:573] VMs will be configured to use specified Service Account: default I0124 18:31:03.243261 6020 new_cluster.go:1338] Cloud Provider ID: "gce" ... skipping 349 lines ... I0124 18:31:12.782184 6038 keypair.go:226] Issuing new certificate: "etcd-peers-ca-events" W0124 18:31:12.782904 6038 vfs_keystorereader.go:143] CA private key was not found I0124 18:31:12.783524 6038 keypair.go:226] Issuing new certificate: "etcd-manager-ca-main" I0124 18:31:12.965540 6038 keypair.go:226] Issuing new certificate: "kubernetes-ca" I0124 18:31:13.075818 6038 keypair.go:226] Issuing new certificate: "service-account" I0124 18:31:25.472807 6038 executor.go:111] Tasks: 42 done / 67 total; 19 can run W0124 18:31:38.355559 6038 executor.go:139] error running task "ForwardingRule/api-e2e-e2e-kops-grid-gce-calico-u2004-k26-k8s-local" (9m47s remaining to succeed): error creating ForwardingRule "api-e2e-e2e-kops-grid-gce-calico-u2004-k26-k8s-local": googleapi: Error 400: The resource 'projects/k8s-jkns-gce-slow-1-3/regions/us-central1/targetPools/api-e2e-e2e-kops-grid-gce-calico-u2004-k26-k8s-local' is not ready, resourceNotReady I0124 18:31:38.355689 6038 executor.go:111] Tasks: 60 done / 67 total; 5 can run I0124 18:31:45.256989 6038 executor.go:111] Tasks: 65 done / 67 total; 2 can run I0124 18:31:59.163141 6038 executor.go:111] Tasks: 67 done / 67 total; 0 can run I0124 18:31:59.294572 6038 update_cluster.go:323] Exporting kubeconfig for cluster kOps has set your kubectl context to e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local ... skipping 7 lines ... * read about installing addons at: https://kops.sigs.k8s.io/addons. I0124 18:32:09.674461 5696 up.go:251] /home/prow/go/src/k8s.io/kops/_rundir/ccf6718b-9c14-11ed-b10d-8a774b882db2/kops validate cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --count 10 --wait 15m0s I0124 18:32:09.674585 5696 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/ccf6718b-9c14-11ed-b10d-8a774b882db2/kops validate cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --count 10 --wait 15m0s Validating cluster e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local W0124 18:32:40.098242 6058 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.135.227.69/api/v1/nodes": dial tcp 34.135.227.69:443: i/o timeout W0124 18:32:53.143972 6058 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.135.227.69/api/v1/nodes": dial tcp 34.135.227.69:443: connect: connection refused W0124 18:33:03.150138 6058 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.135.227.69/api/v1/nodes": dial tcp 34.135.227.69:443: connect: connection refused W0124 18:33:13.153989 6058 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.135.227.69/api/v1/nodes": dial tcp 34.135.227.69:443: connect: connection refused W0124 18:33:23.159801 6058 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.135.227.69/api/v1/nodes": dial tcp 34.135.227.69:443: connect: connection refused W0124 18:33:33.166110 6058 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.135.227.69/api/v1/nodes": dial tcp 34.135.227.69:443: connect: connection refused W0124 18:33:43.171799 6058 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.135.227.69/api/v1/nodes": dial tcp 34.135.227.69:443: connect: connection refused W0124 18:33:53.177696 6058 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.135.227.69/api/v1/nodes": dial tcp 34.135.227.69:443: connect: connection refused W0124 18:34:03.183773 6058 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.135.227.69/api/v1/nodes": dial tcp 34.135.227.69:443: connect: connection refused W0124 18:34:13.188554 6058 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.135.227.69/api/v1/nodes": dial tcp 34.135.227.69:443: connect: connection refused W0124 18:34:23.192395 6058 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.135.227.69/api/v1/nodes": dial tcp 34.135.227.69:443: connect: connection refused W0124 18:34:33.198912 6058 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.135.227.69/api/v1/nodes": dial tcp 34.135.227.69:443: connect: connection refused W0124 18:34:53.209965 6058 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.135.227.69/api/v1/nodes": net/http: TLS handshake timeout W0124 18:35:13.218934 6058 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.135.227.69/api/v1/nodes": net/http: TLS handshake timeout W0124 18:35:23.223839 6058 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.135.227.69/api/v1/nodes": dial tcp 34.135.227.69:443: connect: connection refused W0124 18:35:33.227735 6058 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.135.227.69/api/v1/nodes": dial tcp 34.135.227.69:443: connect: connection refused I0124 18:35:41.665531 5696 boskos.go:86] Sending heartbeat to Boskos W0124 18:35:53.237606 6058 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.135.227.69/api/v1/nodes": net/http: TLS handshake timeout W0124 18:36:03.242721 6058 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.135.227.69/api/v1/nodes": dial tcp 34.135.227.69:443: connect: connection refused W0124 18:36:13.246160 6058 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.135.227.69/api/v1/nodes": dial tcp 34.135.227.69:443: connect: connection refused W0124 18:36:23.251484 6058 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.135.227.69/api/v1/nodes": dial tcp 34.135.227.69:443: connect: connection refused I0124 18:36:37.440033 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 5 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-slow-1-3/zones/us-central1-a/instances/control-plane-us-central1-a-dsrf machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-slow-1-3/zones/us-central1-a/instances/control-plane-us-central1-a-dsrf" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-slow-1-3/zones/us-central1-a/instances/nodes-us-central1-a-0hbg machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-slow-1-3/zones/us-central1-a/instances/nodes-us-central1-a-0hbg" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-slow-1-3/zones/us-central1-a/instances/nodes-us-central1-a-9qxk machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-slow-1-3/zones/us-central1-a/instances/nodes-us-central1-a-9qxk" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-slow-1-3/zones/us-central1-a/instances/nodes-us-central1-a-hzqh machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-slow-1-3/zones/us-central1-a/instances/nodes-us-central1-a-hzqh" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-slow-1-3/zones/us-central1-a/instances/nodes-us-central1-a-z4jf machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-slow-1-3/zones/us-central1-a/instances/nodes-us-central1-a-z4jf" has not yet joined cluster Validation Failed W0124 18:36:38.056158 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:36:48.516710 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 6 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-slow-1-3/zones/us-central1-a/instances/control-plane-us-central1-a-dsrf machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-slow-1-3/zones/us-central1-a/instances/control-plane-us-central1-a-dsrf" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-slow-1-3/zones/us-central1-a/instances/nodes-us-central1-a-0hbg machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-slow-1-3/zones/us-central1-a/instances/nodes-us-central1-a-0hbg" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-slow-1-3/zones/us-central1-a/instances/nodes-us-central1-a-9qxk machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-slow-1-3/zones/us-central1-a/instances/nodes-us-central1-a-9qxk" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-slow-1-3/zones/us-central1-a/instances/nodes-us-central1-a-hzqh machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-slow-1-3/zones/us-central1-a/instances/nodes-us-central1-a-hzqh" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-slow-1-3/zones/us-central1-a/instances/nodes-us-central1-a-z4jf machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-slow-1-3/zones/us-central1-a/instances/nodes-us-central1-a-z4jf" has not yet joined cluster Validation Failed W0124 18:36:49.157922 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:36:59.590825 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 6 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-slow-1-3/zones/us-central1-a/instances/control-plane-us-central1-a-dsrf machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-slow-1-3/zones/us-central1-a/instances/control-plane-us-central1-a-dsrf" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-slow-1-3/zones/us-central1-a/instances/nodes-us-central1-a-0hbg machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-slow-1-3/zones/us-central1-a/instances/nodes-us-central1-a-0hbg" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-slow-1-3/zones/us-central1-a/instances/nodes-us-central1-a-9qxk machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-slow-1-3/zones/us-central1-a/instances/nodes-us-central1-a-9qxk" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-slow-1-3/zones/us-central1-a/instances/nodes-us-central1-a-hzqh machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-slow-1-3/zones/us-central1-a/instances/nodes-us-central1-a-hzqh" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-slow-1-3/zones/us-central1-a/instances/nodes-us-central1-a-z4jf machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-slow-1-3/zones/us-central1-a/instances/nodes-us-central1-a-z4jf" has not yet joined cluster Validation Failed W0124 18:37:00.159320 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:37:10.565158 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 11 lines ... Pod kube-system/calico-kube-controllers-55f488656-cgrb4 system-cluster-critical pod "calico-kube-controllers-55f488656-cgrb4" is pending Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is pending Pod kube-system/coredns-7bc44848df-slc2m system-cluster-critical pod "coredns-7bc44848df-slc2m" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-xv5v9 system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-xv5v9" is pending Pod kube-system/dns-controller-6d5f4bf5d6-rk976 system-cluster-critical pod "dns-controller-6d5f4bf5d6-rk976" is pending Validation Failed W0124 18:37:11.129150 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:37:21.667997 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 14 lines ... Pod kube-system/coredns-7bc44848df-slc2m system-cluster-critical pod "coredns-7bc44848df-slc2m" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-xv5v9 system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-xv5v9" is pending Pod kube-system/dns-controller-6d5f4bf5d6-rk976 system-cluster-critical pod "dns-controller-6d5f4bf5d6-rk976" is pending Pod kube-system/etcd-manager-main-control-plane-us-central1-a-dsrf system-cluster-critical pod "etcd-manager-main-control-plane-us-central1-a-dsrf" is pending Pod kube-system/kops-controller-pdqbt system-cluster-critical pod "kops-controller-pdqbt" is pending Validation Failed W0124 18:37:22.188748 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:37:32.674272 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 15 lines ... Pod kube-system/coredns-autoscaler-7cb5c5b969-xv5v9 system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-xv5v9" is pending Pod kube-system/dns-controller-6d5f4bf5d6-rk976 system-cluster-critical pod "dns-controller-6d5f4bf5d6-rk976" is pending Pod kube-system/etcd-manager-events-control-plane-us-central1-a-dsrf system-cluster-critical pod "etcd-manager-events-control-plane-us-central1-a-dsrf" is pending Pod kube-system/kops-controller-pdqbt system-cluster-critical pod "kops-controller-pdqbt" is pending Pod kube-system/kube-proxy-control-plane-us-central1-a-dsrf system-node-critical pod "kube-proxy-control-plane-us-central1-a-dsrf" is pending Validation Failed W0124 18:37:33.300723 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:37:43.749164 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 11 lines ... Pod kube-system/calico-kube-controllers-55f488656-cgrb4 system-cluster-critical pod "calico-kube-controllers-55f488656-cgrb4" is pending Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is pending Pod kube-system/cloud-controller-manager-7bpfv system-cluster-critical pod "cloud-controller-manager-7bpfv" is pending Pod kube-system/coredns-7bc44848df-slc2m system-cluster-critical pod "coredns-7bc44848df-slc2m" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-xv5v9 system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-xv5v9" is pending Validation Failed W0124 18:37:44.286032 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:37:54.815344 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 12 lines ... Pod kube-system/calico-node-25pdl system-node-critical pod "calico-node-25pdl" is pending Pod kube-system/calico-node-2qg2r system-node-critical pod "calico-node-2qg2r" is pending Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is pending Pod kube-system/coredns-7bc44848df-slc2m system-cluster-critical pod "coredns-7bc44848df-slc2m" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-xv5v9 system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-xv5v9" is pending Validation Failed W0124 18:37:55.343623 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:38:05.806929 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 18 lines ... Pod kube-system/calico-node-5cp7t system-node-critical pod "calico-node-5cp7t" is pending Pod kube-system/calico-node-klzv5 system-node-critical pod "calico-node-klzv5" is pending Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Pod kube-system/coredns-7bc44848df-slc2m system-cluster-critical pod "coredns-7bc44848df-slc2m" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-xv5v9 system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-xv5v9" is pending Validation Failed W0124 18:38:06.420837 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:38:16.886543 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 12 lines ... Pod kube-system/calico-node-2qg2r system-node-critical pod "calico-node-2qg2r" is pending Pod kube-system/calico-node-5cp7t system-node-critical pod "calico-node-5cp7t" is pending Pod kube-system/calico-node-klzv5 system-node-critical pod "calico-node-klzv5" is pending Pod kube-system/coredns-7bc44848df-slc2m system-cluster-critical pod "coredns-7bc44848df-slc2m" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-xv5v9 system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-xv5v9" is pending Validation Failed W0124 18:38:17.440329 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:38:27.835622 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 11 lines ... Pod kube-system/calico-node-25pdl system-node-critical pod "calico-node-25pdl" is not ready (calico-node) Pod kube-system/calico-node-2qg2r system-node-critical pod "calico-node-2qg2r" is not ready (calico-node) Pod kube-system/calico-node-5cp7t system-node-critical pod "calico-node-5cp7t" is not ready (calico-node) Pod kube-system/calico-node-klzv5 system-node-critical pod "calico-node-klzv5" is not ready (calico-node) Pod kube-system/coredns-7bc44848df-9bc6n system-cluster-critical pod "coredns-7bc44848df-9bc6n" is pending Validation Failed W0124 18:38:28.382680 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:38:38.811518 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 10 lines ... KIND NAME MESSAGE Pod kube-system/calico-node-25pdl system-node-critical pod "calico-node-25pdl" is not ready (calico-node) Pod kube-system/calico-node-2qg2r system-node-critical pod "calico-node-2qg2r" is not ready (calico-node) Pod kube-system/calico-node-5cp7t system-node-critical pod "calico-node-5cp7t" is not ready (calico-node) Pod kube-system/calico-node-klzv5 system-node-critical pod "calico-node-klzv5" is not ready (calico-node) Validation Failed W0124 18:38:39.354017 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:38:49.856110 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 11 lines ... Pod kube-system/calico-node-25pdl system-node-critical pod "calico-node-25pdl" is not ready (calico-node) Pod kube-system/calico-node-2qg2r system-node-critical pod "calico-node-2qg2r" is not ready (calico-node) Pod kube-system/calico-node-5cp7t system-node-critical pod "calico-node-5cp7t" is not ready (calico-node) Pod kube-system/calico-node-klzv5 system-node-critical pod "calico-node-klzv5" is not ready (calico-node) Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:38:50.495265 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:39:00.902156 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 8 lines ... VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Pod kube-system/kube-proxy-nodes-us-central1-a-hzqh system-node-critical pod "kube-proxy-nodes-us-central1-a-hzqh" is pending Validation Failed W0124 18:39:01.414731 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:39:11.786712 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:39:12.300241 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:39:22.737456 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 8 lines ... VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Pod kube-system/kube-proxy-nodes-us-central1-a-z4jf system-node-critical pod "kube-proxy-nodes-us-central1-a-z4jf" is pending Validation Failed W0124 18:39:23.316725 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:39:33.753714 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:39:34.295555 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:39:44.743930 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:39:45.266433 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:39:55.673876 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:39:56.196911 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:40:06.601176 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:40:07.190658 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:40:17.648670 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:40:18.258976 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:40:28.784996 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:40:29.366833 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:40:39.765539 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:40:40.417343 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:40:41.678893 5696 boskos.go:86] Sending heartbeat to Boskos I0124 18:40:50.847391 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 8 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:40:51.485572 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:41:01.911319 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:41:02.448102 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:41:12.890377 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:41:13.429165 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:41:23.865754 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:41:24.673834 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:41:35.092186 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:41:35.651504 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:41:46.098580 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:41:46.695775 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:41:57.106926 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:41:57.633045 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:42:08.073174 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:42:08.629002 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:42:19.111351 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:42:19.717641 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:42:30.203390 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:42:30.745905 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:42:41.189162 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:42:41.788427 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:42:52.272466 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:42:52.813560 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:43:03.299756 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:43:03.881951 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:43:14.328211 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:43:14.932301 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:43:25.403213 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:43:25.922594 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:43:36.324265 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:43:36.915896 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:43:47.346651 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:43:47.865694 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:43:58.309516 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:43:58.853652 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:44:09.299602 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:44:09.858622 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:44:20.291247 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:44:20.864766 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:44:31.291024 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:44:31.834445 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:44:42.275453 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:44:42.807009 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:44:53.278560 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:44:53.842620 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:45:04.284778 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:45:04.826643 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:45:15.260254 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:45:15.847025 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:45:26.316313 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:45:26.847407 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:45:37.283564 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:45:37.862264 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:45:41.699033 5696 boskos.go:86] Sending heartbeat to Boskos I0124 18:45:48.269119 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 ... skipping 8 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:45:48.793561 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:45:59.269613 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:45:59.838379 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:46:10.253130 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:46:10.781571 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:46:21.174804 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:46:21.705038 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:46:32.129474 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:46:32.678819 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:46:43.187760 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:46:43.739951 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:46:54.151634 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:46:54.758310 6058 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 18:47:05.198154 6058 gce_cloud.go:301] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-central1-a ControlPlane e2-standard-2 1 1 us-central1 nodes-us-central1-a Node e2-medium 4 4 us-central1 ... skipping 7 lines ... nodes-us-central1-a-z4jf node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-zqdlh system-node-critical pod "calico-node-zqdlh" is not ready (calico-node) Validation Failed W0124 18:47:05.832659 6058 validate_cluster.go:232] (will retry): cluster not yet healthy Error: validation failed: wait time exceeded during validation I0124 18:47:15.840135 5696 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/ccf6718b-9c14-11ed-b10d-8a774b882db2/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh3355924745/key --ssh-user prow I0124 18:47:15.840184 5696 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/ccf6718b-9c14-11ed-b10d-8a774b882db2/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh3355924745/key --ssh-user prow I0124 18:47:16.274250 6069 gce.go:99] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b us-central1-d] 2023/01/24 18:47:19 Dumping node control-plane-us-central1-a-dsrf 2023/01/24 18:47:24 error dumping node control-plane-us-central1-a-dsrf: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/24 18:47:24 error dumping node control-plane-us-central1-a-dsrf: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/24 18:47:24 Dumping node nodes-us-central1-a-0hbg 2023/01/24 18:47:25 Dumping node nodes-us-central1-a-9qxk 2023/01/24 18:47:27 Dumping node nodes-us-central1-a-hzqh 2023/01/24 18:47:30 Dumping node nodes-us-central1-a-z4jf I0124 18:47:31.729706 5696 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/ccf6718b-9c14-11ed-b10d-8a774b882db2/kops get cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local -o yaml I0124 18:47:31.729754 5696 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/ccf6718b-9c14-11ed-b10d-8a774b882db2/kops get cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local -o yaml ... skipping 154 lines ... Deleted cluster: "e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local" I0124 18:49:36.847781 5696 gcs.go:88] gsutil -u k8s-jkns-gce-slow-1-3 rm -r gs://k8s-jkns-gce-slow-1-3-state-cc I0124 18:49:36.847841 5696 local.go:42] ⚙️ gsutil -u k8s-jkns-gce-slow-1-3 rm -r gs://k8s-jkns-gce-slow-1-3-state-cc Removing gs://k8s-jkns-gce-slow-1-3-state-cc/... I0124 18:49:39.845745 5696 down.go:62] releasing boskos project I0124 18:49:39.855350 5696 boskos.go:83] Boskos heartbeat func received signal to close Error: exit status 1 + EXIT_VALUE=1 + set +o xtrace