e2e-kops-grid-gce-calico-u2004-k25 #1598598143769841664
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 1 failed / 1 succeeded |
| Started | |
| Elapsed | 20m38s |
| Revision | master |
exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
kubetest2 Down
... skipping 163 lines ... ...............................................Updated [https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5]. ..done. WARNING: No host aliases were added to your SSH configs because you do not have any running instances. Try running this command again after running some instances. I1202 08:43:39.244665 5584 up.go:44] Cleaning up any leaked resources from previous cluster I1202 08:43:39.244777 5584 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/13932818-721d-11ed-88e2-f6fea4ddc280/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k25.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh3282435203/key --ssh-user prow I1202 08:43:39.244954 5584 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/13932818-721d-11ed-88e2-f6fea4ddc280/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k25.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh3282435203/key --ssh-user prow W1202 08:43:39.659644 5584 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1 I1202 08:43:39.659746 5584 down.go:48] /home/prow/go/src/k8s.io/kops/_rundir/13932818-721d-11ed-88e2-f6fea4ddc280/kops delete cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k25.k8s.local --yes I1202 08:43:39.659781 5584 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/13932818-721d-11ed-88e2-f6fea4ddc280/kops delete cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k25.k8s.local --yes I1202 08:43:39.726162 5631 featureflag.go:166] FeatureFlag "SpecOverrideFlag"=true Error: error reading cluster configuration: Cluster.kops.k8s.io "e2e-e2e-kops-grid-gce-calico-u2004-k25.k8s.local" not found I1202 08:43:40.000185 5584 gcs.go:51] gsutil ls -b -p k8s-gce-reboot-1-5 gs://k8s-gce-reboot-1-5-state-13 I1202 08:43:40.000284 5584 local.go:42] ⚙️ gsutil ls -b -p k8s-gce-reboot-1-5 gs://k8s-gce-reboot-1-5-state-13 I1202 08:43:43.585645 5584 gcs.go:70] gsutil mb -p k8s-gce-reboot-1-5 gs://k8s-gce-reboot-1-5-state-13 I1202 08:43:43.585691 5584 local.go:42] ⚙️ gsutil mb -p k8s-gce-reboot-1-5 gs://k8s-gce-reboot-1-5-state-13 Creating gs://k8s-gce-reboot-1-5-state-13/... I1202 08:43:47.707292 5584 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip 2022/12/02 08:43:47 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404 I1202 08:43:47.724580 5584 http.go:37] curl https://ip.jsb.workers.dev I1202 08:43:47.817894 5584 up.go:167] /home/prow/go/src/k8s.io/kops/_rundir/13932818-721d-11ed-88e2-f6fea4ddc280/kops create cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k25.k8s.local --cloud gce --kubernetes-version https://storage.googleapis.com/kubernetes-release/release/v1.25.4 --ssh-public-key /tmp/kops-ssh3282435203/key.pub --override cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --networking=calico --container-runtime=containerd --gce-service-account=default --admin-access 23.236.62.239/32 --master-count 1 --master-volume-size 48 --node-count 4 --node-volume-size 48 --zones us-west3-a --master-size e2-standard-2 --project k8s-gce-reboot-1-5 I1202 08:43:47.817998 5584 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/13932818-721d-11ed-88e2-f6fea4ddc280/kops create cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k25.k8s.local --cloud gce --kubernetes-version https://storage.googleapis.com/kubernetes-release/release/v1.25.4 --ssh-public-key /tmp/kops-ssh3282435203/key.pub --override cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --networking=calico --container-runtime=containerd --gce-service-account=default --admin-access 23.236.62.239/32 --master-count 1 --master-volume-size 48 --node-count 4 --node-volume-size 48 --zones us-west3-a --master-size e2-standard-2 --project k8s-gce-reboot-1-5 I1202 08:43:47.884314 5908 featureflag.go:166] FeatureFlag "SpecOverrideFlag"=true I1202 08:43:47.909654 5908 create_cluster.go:864] Using SSH public key: /tmp/kops-ssh3282435203/key.pub I1202 08:43:48.228608 5908 new_cluster.go:571] VMs will be configured to use specified Service Account: default ... skipping 394 lines ... I1202 08:44:55.584843 5584 up.go:251] /home/prow/go/src/k8s.io/kops/_rundir/13932818-721d-11ed-88e2-f6fea4ddc280/kops validate cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k25.k8s.local --count 10 --wait 15m0s I1202 08:44:55.584890 5584 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/13932818-721d-11ed-88e2-f6fea4ddc280/kops validate cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k25.k8s.local --count 10 --wait 15m0s I1202 08:44:55.663500 5947 featureflag.go:166] FeatureFlag "SpecOverrideFlag"=true Validating cluster e2e-e2e-kops-grid-gce-calico-u2004-k25.k8s.local W1202 08:45:26.019898 5947 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.161.30/api/v1/nodes": dial tcp 34.106.161.30:443: i/o timeout W1202 08:45:36.043524 5947 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.161.30/api/v1/nodes": dial tcp 34.106.161.30:443: connect: connection refused W1202 08:45:46.065705 5947 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.161.30/api/v1/nodes": dial tcp 34.106.161.30:443: connect: connection refused W1202 08:45:56.088195 5947 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.161.30/api/v1/nodes": dial tcp 34.106.161.30:443: connect: connection refused W1202 08:46:06.112172 5947 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.161.30/api/v1/nodes": dial tcp 34.106.161.30:443: connect: connection refused W1202 08:46:16.135324 5947 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.161.30/api/v1/nodes": dial tcp 34.106.161.30:443: connect: connection refused W1202 08:46:26.159641 5947 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.161.30/api/v1/nodes": dial tcp 34.106.161.30:443: connect: connection refused W1202 08:46:36.183900 5947 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.161.30/api/v1/nodes": dial tcp 34.106.161.30:443: connect: connection refused W1202 08:46:46.206616 5947 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.161.30/api/v1/nodes": dial tcp 34.106.161.30:443: connect: connection refused W1202 08:46:56.230494 5947 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.161.30/api/v1/nodes": dial tcp 34.106.161.30:443: connect: connection refused W1202 08:47:06.254832 5947 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.161.30/api/v1/nodes": dial tcp 34.106.161.30:443: connect: connection refused W1202 08:47:26.277903 5947 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.161.30/api/v1/nodes": net/http: TLS handshake timeout W1202 08:47:46.302285 5947 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.106.161.30/api/v1/nodes": net/http: TLS handshake timeout I1202 08:47:56.744985 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 5 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/control-plane-us-west3-a-2wzc machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/control-plane-us-west3-a-2wzc" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-59mp machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-59mp" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-6d02 machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-6d02" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-8hdj machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-8hdj" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-kdp1 machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-kdp1" has not yet joined cluster Validation Failed W1202 08:47:57.259211 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:48:07.605556 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 6 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/control-plane-us-west3-a-2wzc machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/control-plane-us-west3-a-2wzc" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-59mp machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-59mp" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-6d02 machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-6d02" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-8hdj machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-8hdj" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-kdp1 machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-kdp1" has not yet joined cluster Validation Failed W1202 08:48:08.243972 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:48:18.621346 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 10 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-kdp1 machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-kdp1" has not yet joined cluster Pod kube-system/coredns-677fff9cfb-7k2mx system-cluster-critical pod "coredns-677fff9cfb-7k2mx" is pending Pod kube-system/coredns-autoscaler-db7b97744-tskg6 system-cluster-critical pod "coredns-autoscaler-db7b97744-tskg6" is pending Pod kube-system/dns-controller-8946976bb-4l4vs system-cluster-critical pod "dns-controller-8946976bb-4l4vs" is pending Pod kube-system/kube-scheduler-control-plane-us-west3-a-2wzc system-cluster-critical pod "kube-scheduler-control-plane-us-west3-a-2wzc" is pending Validation Failed W1202 08:48:19.416043 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:48:24.629017 5584 boskos.go:86] Sending heartbeat to Boskos I1202 08:48:29.787212 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 ... skipping 11 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-kdp1 machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-kdp1" has not yet joined cluster Pod kube-system/coredns-677fff9cfb-7k2mx system-cluster-critical pod "coredns-677fff9cfb-7k2mx" is pending Pod kube-system/coredns-autoscaler-db7b97744-tskg6 system-cluster-critical pod "coredns-autoscaler-db7b97744-tskg6" is pending Pod kube-system/dns-controller-8946976bb-4l4vs system-cluster-critical pod "dns-controller-8946976bb-4l4vs" is pending Pod kube-system/kube-proxy-control-plane-us-west3-a-2wzc system-node-critical pod "kube-proxy-control-plane-us-west3-a-2wzc" is pending Validation Failed W1202 08:48:30.291107 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:48:40.714877 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 11 lines ... Pod kube-system/calico-kube-controllers-7bc879d8d6-p92hj system-cluster-critical pod "calico-kube-controllers-7bc879d8d6-p92hj" is pending Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is pending Pod kube-system/cloud-controller-manager-tdc54 system-cluster-critical pod "cloud-controller-manager-tdc54" is pending Pod kube-system/coredns-677fff9cfb-7k2mx system-cluster-critical pod "coredns-677fff9cfb-7k2mx" is pending Pod kube-system/coredns-autoscaler-db7b97744-tskg6 system-cluster-critical pod "coredns-autoscaler-db7b97744-tskg6" is pending Validation Failed W1202 08:48:41.146632 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:48:51.546066 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 12 lines ... Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is pending Pod kube-system/cloud-controller-manager-tdc54 system-cluster-critical pod "cloud-controller-manager-tdc54" is pending Pod kube-system/coredns-677fff9cfb-7k2mx system-cluster-critical pod "coredns-677fff9cfb-7k2mx" is pending Pod kube-system/coredns-autoscaler-db7b97744-tskg6 system-cluster-critical pod "coredns-autoscaler-db7b97744-tskg6" is pending Pod kube-system/etcd-manager-events-control-plane-us-west3-a-2wzc system-cluster-critical pod "etcd-manager-events-control-plane-us-west3-a-2wzc" is pending Validation Failed W1202 08:48:52.065663 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:49:02.416471 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 11 lines ... Pod kube-system/calico-kube-controllers-7bc879d8d6-p92hj system-cluster-critical pod "calico-kube-controllers-7bc879d8d6-p92hj" is pending Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is pending Pod kube-system/coredns-677fff9cfb-7k2mx system-cluster-critical pod "coredns-677fff9cfb-7k2mx" is pending Pod kube-system/coredns-autoscaler-db7b97744-tskg6 system-cluster-critical pod "coredns-autoscaler-db7b97744-tskg6" is pending Pod kube-system/etcd-manager-main-control-plane-us-west3-a-2wzc system-cluster-critical pod "etcd-manager-main-control-plane-us-west3-a-2wzc" is pending Validation Failed W1202 08:49:02.858450 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:49:13.257862 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 10 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-kdp1 machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-kdp1" has not yet joined cluster Pod kube-system/calico-kube-controllers-7bc879d8d6-p92hj system-cluster-critical pod "calico-kube-controllers-7bc879d8d6-p92hj" is pending Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Pod kube-system/coredns-677fff9cfb-7k2mx system-cluster-critical pod "coredns-677fff9cfb-7k2mx" is pending Pod kube-system/coredns-autoscaler-db7b97744-tskg6 system-cluster-critical pod "coredns-autoscaler-db7b97744-tskg6" is pending Validation Failed W1202 08:49:13.759382 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:49:24.164157 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 8 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-6d02 machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-6d02" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-8hdj machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-8hdj" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-kdp1 machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-kdp1" has not yet joined cluster Pod kube-system/coredns-677fff9cfb-7k2mx system-cluster-critical pod "coredns-677fff9cfb-7k2mx" is pending Pod kube-system/coredns-autoscaler-db7b97744-tskg6 system-cluster-critical pod "coredns-autoscaler-db7b97744-tskg6" is pending Validation Failed W1202 08:49:24.749000 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:49:35.165297 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 8 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-6d02 machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-6d02" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-8hdj machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-8hdj" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-kdp1 machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-kdp1" has not yet joined cluster Pod kube-system/coredns-677fff9cfb-7k2mx system-cluster-critical pod "coredns-677fff9cfb-7k2mx" is pending Pod kube-system/coredns-autoscaler-db7b97744-tskg6 system-cluster-critical pod "coredns-autoscaler-db7b97744-tskg6" is pending Validation Failed W1202 08:49:35.620500 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:49:45.991942 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 8 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-6d02 machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-6d02" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-8hdj machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-8hdj" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-kdp1 machine "https://www.googleapis.com/compute/v1/projects/k8s-gce-reboot-1-5/zones/us-west3-a/instances/nodes-us-west3-a-kdp1" has not yet joined cluster Pod kube-system/coredns-677fff9cfb-7k2mx system-cluster-critical pod "coredns-677fff9cfb-7k2mx" is pending Pod kube-system/coredns-autoscaler-db7b97744-tskg6 system-cluster-critical pod "coredns-autoscaler-db7b97744-tskg6" is pending Validation Failed W1202 08:49:46.409447 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:49:56.827361 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 13 lines ... Pod kube-system/calico-node-kk4kk system-node-critical pod "calico-node-kk4kk" is pending Pod kube-system/calico-node-tv6bm system-node-critical pod "calico-node-tv6bm" is pending Pod kube-system/coredns-677fff9cfb-7k2mx system-cluster-critical pod "coredns-677fff9cfb-7k2mx" is pending Pod kube-system/coredns-autoscaler-db7b97744-tskg6 system-cluster-critical pod "coredns-autoscaler-db7b97744-tskg6" is pending Pod kube-system/kube-proxy-nodes-us-west3-a-59mp system-node-critical pod "kube-proxy-nodes-us-west3-a-59mp" is pending Validation Failed W1202 08:49:57.339878 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:50:07.780348 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 12 lines ... Node nodes-us-west3-a-6d02 node "nodes-us-west3-a-6d02" of role "node" is not ready Pod kube-system/calico-node-kk4kk system-node-critical pod "calico-node-kk4kk" is pending Pod kube-system/calico-node-tv6bm system-node-critical pod "calico-node-tv6bm" is pending Pod kube-system/coredns-677fff9cfb-7k2mx system-cluster-critical pod "coredns-677fff9cfb-7k2mx" is pending Pod kube-system/coredns-autoscaler-db7b97744-tskg6 system-cluster-critical pod "coredns-autoscaler-db7b97744-tskg6" is pending Validation Failed W1202 08:50:08.297537 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:50:18.676421 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 11 lines ... Node nodes-us-west3-a-6d02 node "nodes-us-west3-a-6d02" of role "node" is not ready Pod kube-system/calico-node-kk4kk system-node-critical pod "calico-node-kk4kk" is pending Pod kube-system/calico-node-tv6bm system-node-critical pod "calico-node-tv6bm" is pending Pod kube-system/coredns-677fff9cfb-7k2mx system-cluster-critical pod "coredns-677fff9cfb-7k2mx" is pending Pod kube-system/coredns-autoscaler-db7b97744-tskg6 system-cluster-critical pod "coredns-autoscaler-db7b97744-tskg6" is pending Validation Failed W1202 08:50:19.187281 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:50:29.560693 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 14 lines ... Pod kube-system/calico-node-dc5cx system-node-critical pod "calico-node-dc5cx" is pending Pod kube-system/calico-node-kk4kk system-node-critical pod "calico-node-kk4kk" is not ready (calico-node) Pod kube-system/calico-node-tv6bm system-node-critical pod "calico-node-tv6bm" is not ready (calico-node) Pod kube-system/coredns-autoscaler-db7b97744-tskg6 system-cluster-critical pod "coredns-autoscaler-db7b97744-tskg6" is pending Pod kube-system/kube-proxy-nodes-us-west3-a-8hdj system-node-critical pod "kube-proxy-nodes-us-west3-a-8hdj" is pending Validation Failed W1202 08:50:29.960122 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:50:40.487704 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 12 lines ... Node nodes-us-west3-a-kdp1 node "nodes-us-west3-a-kdp1" of role "node" is not ready Pod kube-system/calico-node-2s95j system-node-critical pod "calico-node-2s95j" is pending Pod kube-system/calico-node-dc5cx system-node-critical pod "calico-node-dc5cx" is pending Pod kube-system/calico-node-kk4kk system-node-critical pod "calico-node-kk4kk" is not ready (calico-node) Pod kube-system/calico-node-tv6bm system-node-critical pod "calico-node-tv6bm" is not ready (calico-node) Validation Failed W1202 08:50:40.974091 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:50:51.391814 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 12 lines ... Pod kube-system/calico-node-2s95j system-node-critical pod "calico-node-2s95j" is pending Pod kube-system/calico-node-dc5cx system-node-critical pod "calico-node-dc5cx" is pending Pod kube-system/calico-node-kk4kk system-node-critical pod "calico-node-kk4kk" is not ready (calico-node) Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Pod kube-system/calico-node-tv6bm system-node-critical pod "calico-node-tv6bm" is not ready (calico-node) Validation Failed W1202 08:50:51.781513 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:51:02.155852 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 9 lines ... VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2s95j system-node-critical pod "calico-node-2s95j" is not ready (calico-node) Pod kube-system/calico-node-dc5cx system-node-critical pod "calico-node-dc5cx" is not ready (calico-node) Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:51:02.694410 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:51:13.054048 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 9 lines ... VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2s95j system-node-critical pod "calico-node-2s95j" is not ready (calico-node) Pod kube-system/calico-node-dc5cx system-node-critical pod "calico-node-dc5cx" is not ready (calico-node) Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:51:13.530607 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:51:23.938298 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 9 lines ... VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-2s95j system-node-critical pod "calico-node-2s95j" is not ready (calico-node) Pod kube-system/calico-node-dc5cx system-node-critical pod "calico-node-dc5cx" is not ready (calico-node) Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:51:24.349623 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:51:34.780261 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:51:35.311095 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:51:45.712678 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:51:46.260657 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:51:56.681815 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:51:57.124296 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:52:07.524290 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:52:07.973184 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:52:18.336650 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:52:18.768396 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:52:29.187123 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:52:29.645637 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:52:40.134818 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:52:40.754800 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:52:51.170488 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:52:51.610679 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:53:01.997733 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:53:02.436718 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:53:12.859294 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:53:13.283301 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:53:23.667152 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:53:24.105569 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:53:24.640628 5584 boskos.go:86] Sending heartbeat to Boskos I1202 08:53:34.516138 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 ... skipping 8 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:53:34.957896 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:53:45.356004 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:53:45.754038 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:53:56.136165 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:53:56.581703 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:54:06.982844 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:54:07.402549 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:54:17.799198 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:54:18.247966 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:54:28.625307 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:54:29.056351 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:54:39.471186 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:54:39.959182 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:54:50.327697 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:54:50.864303 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:55:01.238940 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:55:01.633299 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:55:12.055221 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:55:12.471860 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:55:22.820975 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:55:23.279308 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:55:33.722990 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:55:34.162960 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:55:44.594204 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:55:45.049647 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:55:55.631549 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:55:56.051555 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:56:06.437248 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:56:06.894965 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:56:17.328760 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:56:17.776359 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:56:28.179778 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:56:28.598905 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:56:38.970938 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:56:39.459463 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:56:49.857502 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:56:50.246174 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:57:00.637320 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:57:01.067512 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:57:11.494911 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:57:11.916320 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:57:22.324858 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:57:22.736303 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:57:33.174901 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:57:33.589795 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:57:44.012222 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:57:44.450221 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:57:54.812907 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:57:55.217519 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:58:05.619349 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:58:06.069984 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:58:16.415574 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:58:16.821185 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:58:24.649828 5584 boskos.go:86] Sending heartbeat to Boskos I1202 08:58:27.154692 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 ... skipping 8 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:58:27.576248 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:58:37.977717 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:58:38.446252 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:58:48.910891 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:58:49.369027 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:58:59.762231 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:59:00.203764 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:59:10.625247 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:59:11.026124 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:59:21.472562 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:59:21.982998 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:59:32.446650 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:59:32.823101 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:59:43.215674 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:59:43.633603 5947 validate_cluster.go:232] (will retry): cluster not yet healthy I1202 08:59:54.017206 5947 gce_cloud.go:295] Scanning zones: [us-west3-a us-west3-b us-west3-c] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west3-a ControlPlane e2-standard-2 1 1 us-west3 nodes-us-west3-a Node n1-standard-2 4 4 us-west3 ... skipping 7 lines ... nodes-us-west3-a-kdp1 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-qwlxx system-node-critical pod "calico-node-qwlxx" is not ready (calico-node) Validation Failed W1202 08:59:54.430633 5947 validate_cluster.go:232] (will retry): cluster not yet healthy Error: Validation failed: wait time exceeded during validation I1202 09:00:04.434195 5584 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/13932818-721d-11ed-88e2-f6fea4ddc280/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k25.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh3282435203/key --ssh-user prow I1202 09:00:04.434247 5584 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/13932818-721d-11ed-88e2-f6fea4ddc280/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k25.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh3282435203/key --ssh-user prow I1202 09:00:21.506734 5584 dumplogs.go:78] /home/prow/go/src/k8s.io/kops/_rundir/13932818-721d-11ed-88e2-f6fea4ddc280/kops get cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k25.k8s.local -o yaml I1202 09:00:21.506771 5584 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/13932818-721d-11ed-88e2-f6fea4ddc280/kops get cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k25.k8s.local -o yaml I1202 09:00:21.660178 5584 dumplogs.go:78] /home/prow/go/src/k8s.io/kops/_rundir/13932818-721d-11ed-88e2-f6fea4ddc280/kops get instancegroups --name e2e-e2e-kops-grid-gce-calico-u2004-k25.k8s.local -o yaml I1202 09:00:21.660242 5584 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/13932818-721d-11ed-88e2-f6fea4ddc280/kops get instancegroups --name e2e-e2e-kops-grid-gce-calico-u2004-k25.k8s.local -o yaml ... skipping 153 lines ... Deleted cluster: "e2e-e2e-kops-grid-gce-calico-u2004-k25.k8s.local" I1202 09:02:29.454224 5584 gcs.go:88] gsutil -u k8s-gce-reboot-1-5 rm -r gs://k8s-gce-reboot-1-5-state-13 I1202 09:02:29.454282 5584 local.go:42] ⚙️ gsutil -u k8s-gce-reboot-1-5 rm -r gs://k8s-gce-reboot-1-5-state-13 Removing gs://k8s-gce-reboot-1-5-state-13/... I1202 09:02:31.837322 5584 down.go:62] releasing boskos project I1202 09:02:31.846415 5584 boskos.go:83] Boskos heartbeat func received signal to close Error: exit status 1 + EXIT_VALUE=1 + set +o xtrace