e2e-kops-grid-gce-calico-u2004-k23-containerd #1588785783286796288
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 1 failed / 1 succeeded |
| Started | |
| Elapsed | 19m46s |
| Revision | master |
kubetest2 Down
... skipping 195 lines ... ......................Updated [https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-serial]. ..done. WARNING: No host aliases were added to your SSH configs because you do not have any running instances. Try running this command again after running some instances. I1105 06:52:17.503079 6069 up.go:44] Cleaning up any leaked resources from previous cluster I1105 06:52:17.503231 6069 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/1f47b8d6-5cd6-11ed-8af1-9a8d20cfcfb2/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k23-containerd.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh282373056/key --ssh-user prow I1105 06:52:17.503251 6069 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/1f47b8d6-5cd6-11ed-8af1-9a8d20cfcfb2/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k23-containerd.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh282373056/key --ssh-user prow W1105 06:52:17.830071 6069 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1 I1105 06:52:17.830232 6069 down.go:48] /home/prow/go/src/k8s.io/kops/_rundir/1f47b8d6-5cd6-11ed-8af1-9a8d20cfcfb2/kops delete cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k23-containerd.k8s.local --yes I1105 06:52:17.830252 6069 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/1f47b8d6-5cd6-11ed-8af1-9a8d20cfcfb2/kops delete cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k23-containerd.k8s.local --yes I1105 06:52:17.864619 6114 featureflag.go:162] FeatureFlag "SpecOverrideFlag"=true Error: error reading cluster configuration: Cluster.kops.k8s.io "e2e-e2e-kops-grid-gce-calico-u2004-k23-containerd.k8s.local" not found I1105 06:52:18.080051 6069 gcs.go:51] gsutil ls -b -p e2e-gce-gci-ci-serial gs://e2e-gce-gci-ci-serial-state-1f I1105 06:52:18.080094 6069 local.go:42] ⚙️ gsutil ls -b -p e2e-gce-gci-ci-serial gs://e2e-gce-gci-ci-serial-state-1f I1105 06:52:20.386319 6069 gcs.go:70] gsutil mb -p e2e-gce-gci-ci-serial gs://e2e-gce-gci-ci-serial-state-1f I1105 06:52:20.386351 6069 local.go:42] ⚙️ gsutil mb -p e2e-gce-gci-ci-serial gs://e2e-gce-gci-ci-serial-state-1f Creating gs://e2e-gce-gci-ci-serial-state-1f/... I1105 06:52:23.069862 6069 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip 2022/11/05 06:52:23 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404 I1105 06:52:23.084994 6069 http.go:37] curl https://ip.jsb.workers.dev I1105 06:52:23.170751 6069 up.go:159] /home/prow/go/src/k8s.io/kops/_rundir/1f47b8d6-5cd6-11ed-8af1-9a8d20cfcfb2/kops create cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k23-containerd.k8s.local --cloud gce --kubernetes-version https://storage.googleapis.com/kubernetes-release/release/v1.23.13 --ssh-public-key /tmp/kops-ssh282373056/key.pub --override cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --networking=calico --container-runtime=containerd --gce-service-account=default --admin-access 34.136.112.132/32 --master-count 1 --master-volume-size 48 --node-count 4 --node-volume-size 48 --zones us-east4-a --master-size e2-standard-2 --project e2e-gce-gci-ci-serial I1105 06:52:23.170793 6069 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/1f47b8d6-5cd6-11ed-8af1-9a8d20cfcfb2/kops create cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k23-containerd.k8s.local --cloud gce --kubernetes-version https://storage.googleapis.com/kubernetes-release/release/v1.23.13 --ssh-public-key /tmp/kops-ssh282373056/key.pub --override cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --networking=calico --container-runtime=containerd --gce-service-account=default --admin-access 34.136.112.132/32 --master-count 1 --master-volume-size 48 --node-count 4 --node-volume-size 48 --zones us-east4-a --master-size e2-standard-2 --project e2e-gce-gci-ci-serial I1105 06:52:23.204494 6391 featureflag.go:162] FeatureFlag "SpecOverrideFlag"=true I1105 06:52:23.222645 6391 create_cluster.go:834] Using SSH public key: /tmp/kops-ssh282373056/key.pub I1105 06:52:23.433078 6391 new_cluster.go:530] VMs will be configured to use specified Service Account: default ... skipping 371 lines ... I1105 06:52:31.672939 6410 keypair.go:222] Issuing new certificate: "apiserver-aggregator-ca" I1105 06:52:31.679460 6410 keypair.go:222] Issuing new certificate: "etcd-manager-ca-main" W1105 06:52:31.706500 6410 vfs_castore.go:382] CA private key was not found I1105 06:52:31.874057 6410 keypair.go:222] Issuing new certificate: "kubernetes-ca" I1105 06:52:31.980715 6410 keypair.go:222] Issuing new certificate: "service-account" I1105 06:52:41.166212 6410 executor.go:111] Tasks: 42 done / 67 total; 19 can run W1105 06:52:54.484407 6410 executor.go:139] error running task "ForwardingRule/api-e2e-e2e-kops-grid-gce-calico-u2004-k23-containerd-k8s-local" (9m46s remaining to succeed): error creating ForwardingRule "api-e2e-e2e-kops-grid-gce-calico-u2004-k23-containerd-k8s-local": googleapi: Error 400: The resource 'projects/e2e-gce-gci-ci-serial/regions/us-east4/targetPools/api-e2e-e2e-kops-grid-gce-calico-u2004-k23-containerd-k8s-local' is not ready, resourceNotReady I1105 06:52:54.484479 6410 executor.go:111] Tasks: 60 done / 67 total; 5 can run I1105 06:53:01.413706 6410 executor.go:111] Tasks: 65 done / 67 total; 2 can run I1105 06:53:14.383784 6410 executor.go:111] Tasks: 67 done / 67 total; 0 can run I1105 06:53:14.445660 6410 update_cluster.go:326] Exporting kubeconfig for cluster kOps has set your kubectl context to e2e-e2e-kops-grid-gce-calico-u2004-k23-containerd.k8s.local ... skipping 8 lines ... I1105 06:53:24.940349 6069 up.go:243] /home/prow/go/src/k8s.io/kops/_rundir/1f47b8d6-5cd6-11ed-8af1-9a8d20cfcfb2/kops validate cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k23-containerd.k8s.local --count 10 --wait 15m0s I1105 06:53:24.940417 6069 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/1f47b8d6-5cd6-11ed-8af1-9a8d20cfcfb2/kops validate cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k23-containerd.k8s.local --count 10 --wait 15m0s I1105 06:53:24.974302 6429 featureflag.go:162] FeatureFlag "SpecOverrideFlag"=true Validating cluster e2e-e2e-kops-grid-gce-calico-u2004-k23-containerd.k8s.local W1105 06:53:55.286475 6429 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.247.204/api/v1/nodes": dial tcp 35.188.247.204:443: i/o timeout W1105 06:54:05.313471 6429 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.247.204/api/v1/nodes": dial tcp 35.188.247.204:443: connect: connection refused W1105 06:54:15.340680 6429 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.247.204/api/v1/nodes": dial tcp 35.188.247.204:443: connect: connection refused W1105 06:54:25.367875 6429 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.247.204/api/v1/nodes": dial tcp 35.188.247.204:443: connect: connection refused W1105 06:54:35.395139 6429 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.247.204/api/v1/nodes": dial tcp 35.188.247.204:443: connect: connection refused W1105 06:54:45.421877 6429 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.247.204/api/v1/nodes": dial tcp 35.188.247.204:443: connect: connection refused W1105 06:54:55.449759 6429 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.247.204/api/v1/nodes": dial tcp 35.188.247.204:443: connect: connection refused W1105 06:55:05.477322 6429 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.247.204/api/v1/nodes": dial tcp 35.188.247.204:443: connect: connection refused W1105 06:55:15.503868 6429 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.247.204/api/v1/nodes": dial tcp 35.188.247.204:443: connect: connection refused W1105 06:55:25.532007 6429 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.247.204/api/v1/nodes": dial tcp 35.188.247.204:443: connect: connection refused W1105 06:55:35.559937 6429 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.247.204/api/v1/nodes": dial tcp 35.188.247.204:443: connect: connection refused W1105 06:55:45.587171 6429 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.247.204/api/v1/nodes": dial tcp 35.188.247.204:443: connect: connection refused W1105 06:55:55.614710 6429 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.247.204/api/v1/nodes": dial tcp 35.188.247.204:443: connect: connection refused W1105 06:56:15.641273 6429 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://35.188.247.204/api/v1/nodes": net/http: TLS handshake timeout I1105 06:56:26.099058 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 6 lines ... Machine https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-serial/zones/us-east4-a/instances/nodes-us-east4-a-05r0 machine "https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-serial/zones/us-east4-a/instances/nodes-us-east4-a-05r0" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-serial/zones/us-east4-a/instances/nodes-us-east4-a-jr0n machine "https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-serial/zones/us-east4-a/instances/nodes-us-east4-a-jr0n" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-serial/zones/us-east4-a/instances/nodes-us-east4-a-l322 machine "https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-serial/zones/us-east4-a/instances/nodes-us-east4-a-l322" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-serial/zones/us-east4-a/instances/nodes-us-east4-a-xd4k machine "https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-serial/zones/us-east4-a/instances/nodes-us-east4-a-xd4k" has not yet joined cluster Node master-us-east4-a-7m31 node "master-us-east4-a-7m31" of role "master" is not ready Validation Failed W1105 06:56:26.820029 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 06:56:37.153456 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... Machine https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-serial/zones/us-east4-a/instances/nodes-us-east4-a-05r0 machine "https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-serial/zones/us-east4-a/instances/nodes-us-east4-a-05r0" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-serial/zones/us-east4-a/instances/nodes-us-east4-a-jr0n machine "https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-serial/zones/us-east4-a/instances/nodes-us-east4-a-jr0n" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-serial/zones/us-east4-a/instances/nodes-us-east4-a-l322 machine "https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-serial/zones/us-east4-a/instances/nodes-us-east4-a-l322" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-serial/zones/us-east4-a/instances/nodes-us-east4-a-xd4k machine "https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-serial/zones/us-east4-a/instances/nodes-us-east4-a-xd4k" has not yet joined cluster Node master-us-east4-a-7m31 node "master-us-east4-a-7m31" of role "master" is not ready Validation Failed W1105 06:56:38.001852 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 06:56:48.326713 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 10 lines ... Machine https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-serial/zones/us-east4-a/instances/nodes-us-east4-a-xd4k machine "https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-serial/zones/us-east4-a/instances/nodes-us-east4-a-xd4k" has not yet joined cluster Node master-us-east4-a-7m31 node "master-us-east4-a-7m31" of role "master" is not ready Pod kube-system/coredns-5dbfc5fddc-zcd2r system-cluster-critical pod "coredns-5dbfc5fddc-zcd2r" is pending Pod kube-system/coredns-autoscaler-6bc4c99775-kfdml system-cluster-critical pod "coredns-autoscaler-6bc4c99775-kfdml" is pending Pod kube-system/dns-controller-6b8c58c6cf-r96v5 system-cluster-critical pod "dns-controller-6b8c58c6cf-r96v5" is pending Validation Failed W1105 06:56:48.830831 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 06:56:59.136262 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 13 lines ... Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is pending Pod kube-system/coredns-5dbfc5fddc-zcd2r system-cluster-critical pod "coredns-5dbfc5fddc-zcd2r" is pending Pod kube-system/coredns-autoscaler-6bc4c99775-kfdml system-cluster-critical pod "coredns-autoscaler-6bc4c99775-kfdml" is pending Pod kube-system/dns-controller-6b8c58c6cf-r96v5 system-cluster-critical pod "dns-controller-6b8c58c6cf-r96v5" is pending Pod kube-system/etcd-manager-events-master-us-east4-a-7m31 system-cluster-critical pod "etcd-manager-events-master-us-east4-a-7m31" is pending Validation Failed W1105 06:56:59.628532 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 06:57:08.517704 6069 boskos.go:86] Sending heartbeat to Boskos I1105 06:57:09.996349 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 ... skipping 16 lines ... Pod kube-system/coredns-autoscaler-6bc4c99775-kfdml system-cluster-critical pod "coredns-autoscaler-6bc4c99775-kfdml" is pending Pod kube-system/dns-controller-6b8c58c6cf-r96v5 system-cluster-critical pod "dns-controller-6b8c58c6cf-r96v5" is pending Pod kube-system/etcd-manager-main-master-us-east4-a-7m31 system-cluster-critical pod "etcd-manager-main-master-us-east4-a-7m31" is pending Pod kube-system/kops-controller-26l9x system-cluster-critical pod "kops-controller-26l9x" is pending Pod kube-system/kube-proxy-master-us-east4-a-7m31 system-node-critical pod "kube-proxy-master-us-east4-a-7m31" is pending Validation Failed W1105 06:57:10.445489 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 06:57:20.760355 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 12 lines ... Pod kube-system/calico-kube-controllers-7f8977dffb-c9w79 system-cluster-critical pod "calico-kube-controllers-7f8977dffb-c9w79" is pending Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is pending Pod kube-system/coredns-5dbfc5fddc-zcd2r system-cluster-critical pod "coredns-5dbfc5fddc-zcd2r" is pending Pod kube-system/coredns-autoscaler-6bc4c99775-kfdml system-cluster-critical pod "coredns-autoscaler-6bc4c99775-kfdml" is pending Pod kube-system/dns-controller-6b8c58c6cf-r96v5 system-cluster-critical pod "dns-controller-6b8c58c6cf-r96v5" is pending Validation Failed W1105 06:57:21.267434 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 06:57:31.563922 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 12 lines ... Pod kube-system/calico-kube-controllers-7f8977dffb-c9w79 system-cluster-critical pod "calico-kube-controllers-7f8977dffb-c9w79" is pending Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is pending Pod kube-system/coredns-5dbfc5fddc-zcd2r system-cluster-critical pod "coredns-5dbfc5fddc-zcd2r" is pending Pod kube-system/coredns-autoscaler-6bc4c99775-kfdml system-cluster-critical pod "coredns-autoscaler-6bc4c99775-kfdml" is pending Pod kube-system/dns-controller-6b8c58c6cf-r96v5 system-cluster-critical pod "dns-controller-6b8c58c6cf-r96v5" is pending Validation Failed W1105 06:57:32.029699 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 06:57:42.339151 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 14 lines ... Pod kube-system/calico-kube-controllers-7f8977dffb-c9w79 system-cluster-critical pod "calico-kube-controllers-7f8977dffb-c9w79" is pending Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Pod kube-system/coredns-5dbfc5fddc-zcd2r system-cluster-critical pod "coredns-5dbfc5fddc-zcd2r" is pending Pod kube-system/coredns-autoscaler-6bc4c99775-kfdml system-cluster-critical pod "coredns-autoscaler-6bc4c99775-kfdml" is pending Pod kube-system/dns-controller-6b8c58c6cf-r96v5 system-cluster-critical pod "dns-controller-6b8c58c6cf-r96v5" is pending Validation Failed W1105 06:57:42.898825 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 06:57:53.221191 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 11 lines ... Node master-us-east4-a-7m31 master "master-us-east4-a-7m31" is missing kube-apiserver pod Node master-us-east4-a-7m31 master "master-us-east4-a-7m31" is missing kube-scheduler pod Pod kube-system/coredns-5dbfc5fddc-zcd2r system-cluster-critical pod "coredns-5dbfc5fddc-zcd2r" is pending Pod kube-system/coredns-autoscaler-6bc4c99775-kfdml system-cluster-critical pod "coredns-autoscaler-6bc4c99775-kfdml" is pending Pod kube-system/kube-apiserver-master-us-east4-a-7m31 system-cluster-critical pod "kube-apiserver-master-us-east4-a-7m31" is pending Validation Failed W1105 06:57:53.930506 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 06:58:04.230517 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 13 lines ... Pod kube-system/calico-node-dffbm system-node-critical pod "calico-node-dffbm" is pending Pod kube-system/calico-node-qp8dp system-node-critical pod "calico-node-qp8dp" is pending Pod kube-system/coredns-5dbfc5fddc-zcd2r system-cluster-critical pod "coredns-5dbfc5fddc-zcd2r" is pending Pod kube-system/coredns-autoscaler-6bc4c99775-kfdml system-cluster-critical pod "coredns-autoscaler-6bc4c99775-kfdml" is pending Pod kube-system/kube-proxy-nodes-us-east4-a-jr0n system-node-critical pod "kube-proxy-nodes-us-east4-a-jr0n" is pending Validation Failed W1105 06:58:04.743086 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 06:58:15.232405 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 18 lines ... Pod kube-system/calico-node-h4smd system-node-critical pod "calico-node-h4smd" is pending Pod kube-system/calico-node-qp8dp system-node-critical pod "calico-node-qp8dp" is pending Pod kube-system/coredns-5dbfc5fddc-zcd2r system-cluster-critical pod "coredns-5dbfc5fddc-zcd2r" is pending Pod kube-system/coredns-autoscaler-6bc4c99775-kfdml system-cluster-critical pod "coredns-autoscaler-6bc4c99775-kfdml" is pending Pod kube-system/kube-scheduler-master-us-east4-a-7m31 system-cluster-critical pod "kube-scheduler-master-us-east4-a-7m31" is pending Validation Failed W1105 06:58:15.712422 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 06:58:26.075423 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 16 lines ... Pod kube-system/calico-node-dffbm system-node-critical pod "calico-node-dffbm" is pending Pod kube-system/calico-node-h4smd system-node-critical pod "calico-node-h4smd" is pending Pod kube-system/calico-node-qp8dp system-node-critical pod "calico-node-qp8dp" is pending Pod kube-system/coredns-5dbfc5fddc-zcd2r system-cluster-critical pod "coredns-5dbfc5fddc-zcd2r" is pending Pod kube-system/coredns-autoscaler-6bc4c99775-kfdml system-cluster-critical pod "coredns-autoscaler-6bc4c99775-kfdml" is pending Validation Failed W1105 06:58:26.535074 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 06:58:36.891238 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 11 lines ... Pod kube-system/calico-node-2mw5s system-node-critical pod "calico-node-2mw5s" is not ready (calico-node) Pod kube-system/calico-node-dffbm system-node-critical pod "calico-node-dffbm" is not ready (calico-node) Pod kube-system/calico-node-h4smd system-node-critical pod "calico-node-h4smd" is not ready (calico-node) Pod kube-system/calico-node-qp8dp system-node-critical pod "calico-node-qp8dp" is not ready (calico-node) Pod kube-system/coredns-autoscaler-6bc4c99775-kfdml system-cluster-critical pod "coredns-autoscaler-6bc4c99775-kfdml" is pending Validation Failed W1105 06:58:37.354526 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 06:58:47.810588 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 10 lines ... KIND NAME MESSAGE Pod kube-system/calico-node-2mw5s system-node-critical pod "calico-node-2mw5s" is not ready (calico-node) Pod kube-system/calico-node-dffbm system-node-critical pod "calico-node-dffbm" is not ready (calico-node) Pod kube-system/calico-node-h4smd system-node-critical pod "calico-node-h4smd" is not ready (calico-node) Pod kube-system/calico-node-qp8dp system-node-critical pod "calico-node-qp8dp" is not ready (calico-node) Validation Failed W1105 06:58:48.242524 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 06:58:58.705278 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 10 lines ... KIND NAME MESSAGE Pod kube-system/calico-node-2mw5s system-node-critical pod "calico-node-2mw5s" is not ready (calico-node) Pod kube-system/calico-node-dffbm system-node-critical pod "calico-node-dffbm" is not ready (calico-node) Pod kube-system/calico-node-h4smd system-node-critical pod "calico-node-h4smd" is not ready (calico-node) Pod kube-system/calico-node-qp8dp system-node-critical pod "calico-node-qp8dp" is not ready (calico-node) Validation Failed W1105 06:58:59.174814 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 06:59:09.585820 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 8 lines ... VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-h4smd system-node-critical pod "calico-node-h4smd" is not ready (calico-node) Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 06:59:10.160445 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 06:59:20.507639 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 06:59:21.082949 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 06:59:31.390247 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 06:59:31.988209 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 06:59:42.345127 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 06:59:43.028214 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 06:59:53.475543 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 06:59:53.909809 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:00:04.328247 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:00:04.785705 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:00:15.163403 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:00:15.603562 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:00:25.922613 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:00:26.349687 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:00:36.707287 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:00:37.254564 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:00:47.629431 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:00:48.099168 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:00:58.459108 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:00:58.922661 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:01:09.212995 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:01:09.799574 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:01:20.134469 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:01:20.633259 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:01:31.008907 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:01:31.479058 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:01:41.808992 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:01:42.283683 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:01:52.768996 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:01:53.214409 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:02:03.551214 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:02:04.014835 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:02:08.529391 6069 boskos.go:86] Sending heartbeat to Boskos I1105 07:02:14.349464 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 ... skipping 8 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:02:14.813203 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:02:25.148833 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:02:25.613084 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:02:36.027168 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:02:36.485969 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:02:46.805549 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:02:47.267946 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:02:57.676420 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:02:58.260913 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:03:08.587567 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:03:09.054822 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:03:19.475258 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:03:20.044402 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:03:30.398184 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:03:30.902348 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:03:41.277354 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:03:41.770087 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:03:52.113019 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:03:52.588479 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:04:03.126400 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:04:03.800802 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:04:14.127617 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:04:14.613138 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:04:24.985151 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:04:25.441486 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:04:35.797016 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:04:36.320683 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:04:46.667439 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:04:47.080982 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:04:57.369006 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:04:57.818356 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:05:08.251883 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:05:08.707690 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:05:19.037670 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:05:19.477600 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:05:29.939539 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:05:30.399104 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:05:40.734802 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:05:41.175117 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:05:51.493243 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:05:51.943584 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:06:02.303894 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:06:02.751377 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:06:13.151305 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:06:13.642606 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:06:24.065814 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:06:24.490389 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:06:34.845779 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:06:35.287029 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:06:45.628621 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:06:46.091436 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:06:56.459991 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:06:57.020197 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:07:07.425859 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:07:07.889065 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:07:08.541258 6069 boskos.go:86] Sending heartbeat to Boskos I1105 07:07:18.232724 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 ... skipping 8 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:07:18.670252 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:07:29.067386 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:07:29.535164 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:07:39.844419 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:07:40.320662 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:07:50.726121 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:07:51.196082 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:08:01.559850 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:08:02.046703 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:08:12.385523 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:08:12.835373 6429 validate_cluster.go:232] (will retry): cluster not yet healthy I1105 07:08:23.138682 6429 gce_cloud.go:295] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS master-us-east4-a Master e2-standard-2 1 1 us-east4 nodes-us-east4-a Node n1-standard-2 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-xd4k node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-r98lv system-node-critical pod "calico-node-r98lv" is not ready (calico-node) Validation Failed W1105 07:08:23.611980 6429 validate_cluster.go:232] (will retry): cluster not yet healthy Error: Validation failed: wait time exceeded during validation I1105 07:08:33.626952 6069 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/1f47b8d6-5cd6-11ed-8af1-9a8d20cfcfb2/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k23-containerd.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh282373056/key --ssh-user prow I1105 07:08:33.627008 6069 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/1f47b8d6-5cd6-11ed-8af1-9a8d20cfcfb2/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k23-containerd.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh282373056/key --ssh-user prow I1105 07:08:54.060621 6069 dumplogs.go:78] /home/prow/go/src/k8s.io/kops/_rundir/1f47b8d6-5cd6-11ed-8af1-9a8d20cfcfb2/kops get cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k23-containerd.k8s.local -o yaml I1105 07:08:54.060799 6069 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/1f47b8d6-5cd6-11ed-8af1-9a8d20cfcfb2/kops get cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k23-containerd.k8s.local -o yaml I1105 07:08:54.233708 6069 dumplogs.go:78] /home/prow/go/src/k8s.io/kops/_rundir/1f47b8d6-5cd6-11ed-8af1-9a8d20cfcfb2/kops get instancegroups --name e2e-e2e-kops-grid-gce-calico-u2004-k23-containerd.k8s.local -o yaml I1105 07:08:54.233743 6069 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/1f47b8d6-5cd6-11ed-8af1-9a8d20cfcfb2/kops get instancegroups --name e2e-e2e-kops-grid-gce-calico-u2004-k23-containerd.k8s.local -o yaml ... skipping 134 lines ... Deleted cluster: "e2e-e2e-kops-grid-gce-calico-u2004-k23-containerd.k8s.local" I1105 07:10:48.661340 6069 gcs.go:88] gsutil -u e2e-gce-gci-ci-serial rm -r gs://e2e-gce-gci-ci-serial-state-1f I1105 07:10:48.661399 6069 local.go:42] ⚙️ gsutil -u e2e-gce-gci-ci-serial rm -r gs://e2e-gce-gci-ci-serial-state-1f Removing gs://e2e-gce-gci-ci-serial-state-1f/... I1105 07:10:51.426866 6069 down.go:62] releasing boskos project I1105 07:10:51.437742 6069 boskos.go:83] Boskos heartbeat func received signal to close Error: exit status 1 + EXIT_VALUE=1 + set +o xtrace