e2e-kops-grid-gce-calico-u2004-k26 #1618918697869512704
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 1 failed / 1 succeeded |
| Started | |
| Elapsed | 20m7s |
| Revision | master |
exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
kubetest2 Down
... skipping 163 lines ... .....................Updated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-ingress-1-6]. ..done. WARNING: No host aliases were added to your SSH configs because you do not have any running instances. Try running this command again after running some instances. I0127 10:29:42.479706 5547 up.go:44] Cleaning up any leaked resources from previous cluster I0127 10:29:42.479878 5547 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/3ffdfc34-9e2d-11ed-b1bb-1299ca1e1805/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh157656249/key --ssh-user prow I0127 10:29:42.479911 5547 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/3ffdfc34-9e2d-11ed-b1bb-1299ca1e1805/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh157656249/key --ssh-user prow Error: Cluster.kops.k8s.io "e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local" not found W0127 10:29:42.778668 5547 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1 I0127 10:29:42.778718 5547 down.go:48] /home/prow/go/src/k8s.io/kops/_rundir/3ffdfc34-9e2d-11ed-b1bb-1299ca1e1805/kops delete cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --yes I0127 10:29:42.778729 5547 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/3ffdfc34-9e2d-11ed-b1bb-1299ca1e1805/kops delete cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --yes Error: error reading cluster configuration: Cluster.kops.k8s.io "e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local" not found I0127 10:29:43.007492 5547 gcs.go:51] gsutil ls -b -p k8s-jkns-gci-gce-ingress-1-6 gs://k8s-jkns-gci-gce-ingress-1-6-state-3f I0127 10:29:43.007534 5547 local.go:42] ⚙️ gsutil ls -b -p k8s-jkns-gci-gce-ingress-1-6 gs://k8s-jkns-gci-gce-ingress-1-6-state-3f I0127 10:29:44.978561 5547 gcs.go:70] gsutil mb -p k8s-jkns-gci-gce-ingress-1-6 gs://k8s-jkns-gci-gce-ingress-1-6-state-3f I0127 10:29:44.978608 5547 local.go:42] ⚙️ gsutil mb -p k8s-jkns-gci-gce-ingress-1-6 gs://k8s-jkns-gci-gce-ingress-1-6-state-3f Creating gs://k8s-jkns-gci-gce-ingress-1-6-state-3f/... I0127 10:29:47.679085 5547 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip 2023/01/27 10:29:47 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404 I0127 10:29:47.692091 5547 http.go:37] curl https://ip.jsb.workers.dev I0127 10:29:47.789173 5547 up.go:167] /home/prow/go/src/k8s.io/kops/_rundir/3ffdfc34-9e2d-11ed-b1bb-1299ca1e1805/kops create cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --cloud gce --kubernetes-version https://storage.googleapis.com/kubernetes-release/release/v1.26.1 --ssh-public-key /tmp/kops-ssh157656249/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --networking=calico --container-runtime=containerd --gce-service-account=default --admin-access 34.69.185.220/32 --master-count 1 --master-volume-size 48 --node-count 4 --node-volume-size 48 --zones us-east1-b --master-size e2-standard-2 --project k8s-jkns-gci-gce-ingress-1-6 I0127 10:29:47.789217 5547 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/3ffdfc34-9e2d-11ed-b1bb-1299ca1e1805/kops create cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --cloud gce --kubernetes-version https://storage.googleapis.com/kubernetes-release/release/v1.26.1 --ssh-public-key /tmp/kops-ssh157656249/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --networking=calico --container-runtime=containerd --gce-service-account=default --admin-access 34.69.185.220/32 --master-count 1 --master-volume-size 48 --node-count 4 --node-volume-size 48 --zones us-east1-b --master-size e2-standard-2 --project k8s-jkns-gci-gce-ingress-1-6 I0127 10:29:47.838641 5868 create_cluster.go:882] Using SSH public key: /tmp/kops-ssh157656249/key.pub I0127 10:29:48.222757 5868 new_cluster.go:573] VMs will be configured to use specified Service Account: default I0127 10:29:48.222882 5868 new_cluster.go:1338] Cloud Provider ID: "gce" ... skipping 349 lines ... I0127 10:29:56.679639 5888 keypair.go:226] Issuing new certificate: "etcd-manager-ca-main" I0127 10:29:56.694869 5888 keypair.go:226] Issuing new certificate: "etcd-peers-ca-main" W0127 10:29:56.781048 5888 vfs_keystorereader.go:143] CA private key was not found I0127 10:29:56.979291 5888 keypair.go:226] Issuing new certificate: "kubernetes-ca" I0127 10:29:56.980183 5888 keypair.go:226] Issuing new certificate: "service-account" I0127 10:30:09.071196 5888 executor.go:111] Tasks: 42 done / 67 total; 19 can run W0127 10:30:22.268867 5888 executor.go:139] error running task "ForwardingRule/api-e2e-e2e-kops-grid-gce-calico-u2004-k26-k8s-local" (9m46s remaining to succeed): error creating ForwardingRule "api-e2e-e2e-kops-grid-gce-calico-u2004-k26-k8s-local": googleapi: Error 400: The resource 'projects/k8s-jkns-gci-gce-ingress-1-6/regions/us-east1/targetPools/api-e2e-e2e-kops-grid-gce-calico-u2004-k26-k8s-local' is not ready, resourceNotReady I0127 10:30:22.269062 5888 executor.go:111] Tasks: 60 done / 67 total; 5 can run I0127 10:30:29.139292 5888 executor.go:111] Tasks: 65 done / 67 total; 2 can run I0127 10:30:40.178363 5888 executor.go:111] Tasks: 67 done / 67 total; 0 can run I0127 10:30:40.241082 5888 update_cluster.go:323] Exporting kubeconfig for cluster kOps has set your kubectl context to e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local ... skipping 7 lines ... * read about installing addons at: https://kops.sigs.k8s.io/addons. I0127 10:30:50.808811 5547 up.go:251] /home/prow/go/src/k8s.io/kops/_rundir/3ffdfc34-9e2d-11ed-b1bb-1299ca1e1805/kops validate cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --count 10 --wait 15m0s I0127 10:30:50.808876 5547 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/3ffdfc34-9e2d-11ed-b1bb-1299ca1e1805/kops validate cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --count 10 --wait 15m0s Validating cluster e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local W0127 10:31:21.102445 5908 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.139.181.182/api/v1/nodes": dial tcp 34.139.181.182:443: i/o timeout W0127 10:31:31.141659 5908 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.139.181.182/api/v1/nodes": dial tcp 34.139.181.182:443: connect: connection refused W0127 10:31:41.181384 5908 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.139.181.182/api/v1/nodes": dial tcp 34.139.181.182:443: connect: connection refused W0127 10:31:51.220244 5908 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.139.181.182/api/v1/nodes": dial tcp 34.139.181.182:443: connect: connection refused W0127 10:32:01.259671 5908 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.139.181.182/api/v1/nodes": dial tcp 34.139.181.182:443: connect: connection refused W0127 10:32:11.299025 5908 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.139.181.182/api/v1/nodes": dial tcp 34.139.181.182:443: connect: connection refused W0127 10:32:21.338434 5908 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.139.181.182/api/v1/nodes": dial tcp 34.139.181.182:443: connect: connection refused W0127 10:32:31.377487 5908 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.139.181.182/api/v1/nodes": dial tcp 34.139.181.182:443: connect: connection refused W0127 10:32:41.416485 5908 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.139.181.182/api/v1/nodes": dial tcp 34.139.181.182:443: connect: connection refused W0127 10:32:51.455737 5908 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.139.181.182/api/v1/nodes": dial tcp 34.139.181.182:443: connect: connection refused W0127 10:33:01.495757 5908 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.139.181.182/api/v1/nodes": dial tcp 34.139.181.182:443: connect: connection refused W0127 10:33:11.534954 5908 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.139.181.182/api/v1/nodes": dial tcp 34.139.181.182:443: connect: connection refused W0127 10:33:21.574427 5908 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.139.181.182/api/v1/nodes": dial tcp 34.139.181.182:443: connect: connection refused W0127 10:33:31.614979 5908 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.139.181.182/api/v1/nodes": dial tcp 34.139.181.182:443: connect: connection refused W0127 10:33:51.654030 5908 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.139.181.182/api/v1/nodes": net/http: TLS handshake timeout W0127 10:34:11.693412 5908 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.139.181.182/api/v1/nodes": net/http: TLS handshake timeout W0127 10:34:21.731383 5908 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.139.181.182/api/v1/nodes": dial tcp 34.139.181.182:443: connect: connection refused W0127 10:34:31.770110 5908 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.139.181.182/api/v1/nodes": dial tcp 34.139.181.182:443: connect: connection refused I0127 10:34:34.659946 5547 boskos.go:86] Sending heartbeat to Boskos W0127 10:34:51.809930 5908 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.139.181.182/api/v1/nodes": net/http: TLS handshake timeout W0127 10:35:01.849076 5908 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.139.181.182/api/v1/nodes": dial tcp 34.139.181.182:443: connect: connection refused W0127 10:35:11.888151 5908 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.139.181.182/api/v1/nodes": dial tcp 34.139.181.182:443: connect: connection refused W0127 10:35:21.927281 5908 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.139.181.182/api/v1/nodes": dial tcp 34.139.181.182:443: connect: connection refused I0127 10:35:33.987790 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 5 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-ingress-1-6/zones/us-east1-b/instances/control-plane-us-east1-b-djgn machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-ingress-1-6/zones/us-east1-b/instances/control-plane-us-east1-b-djgn" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-ingress-1-6/zones/us-east1-b/instances/nodes-us-east1-b-1vf4 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-ingress-1-6/zones/us-east1-b/instances/nodes-us-east1-b-1vf4" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-ingress-1-6/zones/us-east1-b/instances/nodes-us-east1-b-2rjg machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-ingress-1-6/zones/us-east1-b/instances/nodes-us-east1-b-2rjg" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-ingress-1-6/zones/us-east1-b/instances/nodes-us-east1-b-47pv machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-ingress-1-6/zones/us-east1-b/instances/nodes-us-east1-b-47pv" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-ingress-1-6/zones/us-east1-b/instances/nodes-us-east1-b-vj02 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-ingress-1-6/zones/us-east1-b/instances/nodes-us-east1-b-vj02" has not yet joined cluster Validation Failed W0127 10:35:35.247011 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:35:45.573098 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 6 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-ingress-1-6/zones/us-east1-b/instances/control-plane-us-east1-b-djgn machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-ingress-1-6/zones/us-east1-b/instances/control-plane-us-east1-b-djgn" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-ingress-1-6/zones/us-east1-b/instances/nodes-us-east1-b-1vf4 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-ingress-1-6/zones/us-east1-b/instances/nodes-us-east1-b-1vf4" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-ingress-1-6/zones/us-east1-b/instances/nodes-us-east1-b-2rjg machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-ingress-1-6/zones/us-east1-b/instances/nodes-us-east1-b-2rjg" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-ingress-1-6/zones/us-east1-b/instances/nodes-us-east1-b-47pv machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-ingress-1-6/zones/us-east1-b/instances/nodes-us-east1-b-47pv" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-ingress-1-6/zones/us-east1-b/instances/nodes-us-east1-b-vj02 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-ingress-1-6/zones/us-east1-b/instances/nodes-us-east1-b-vj02" has not yet joined cluster Validation Failed W0127 10:35:46.616632 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:35:57.007684 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-ingress-1-6/zones/us-east1-b/instances/nodes-us-east1-b-1vf4 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-ingress-1-6/zones/us-east1-b/instances/nodes-us-east1-b-1vf4" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-ingress-1-6/zones/us-east1-b/instances/nodes-us-east1-b-2rjg machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-ingress-1-6/zones/us-east1-b/instances/nodes-us-east1-b-2rjg" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-ingress-1-6/zones/us-east1-b/instances/nodes-us-east1-b-47pv machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-ingress-1-6/zones/us-east1-b/instances/nodes-us-east1-b-47pv" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-ingress-1-6/zones/us-east1-b/instances/nodes-us-east1-b-vj02 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-ingress-1-6/zones/us-east1-b/instances/nodes-us-east1-b-vj02" has not yet joined cluster Pod kube-system/dns-controller-6d5f4bf5d6-ntggn system-cluster-critical pod "dns-controller-6d5f4bf5d6-ntggn" is pending Validation Failed W0127 10:35:58.315975 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:36:08.680123 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 13 lines ... Pod kube-system/coredns-7bc44848df-hprr4 system-cluster-critical pod "coredns-7bc44848df-hprr4" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-xclv9 system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-xclv9" is pending Pod kube-system/dns-controller-6d5f4bf5d6-ntggn system-cluster-critical pod "dns-controller-6d5f4bf5d6-ntggn" is pending Pod kube-system/etcd-manager-main-control-plane-us-east1-b-djgn system-cluster-critical pod "etcd-manager-main-control-plane-us-east1-b-djgn" is pending Pod kube-system/kube-proxy-control-plane-us-east1-b-djgn system-node-critical pod "kube-proxy-control-plane-us-east1-b-djgn" is pending Validation Failed W0127 10:36:09.763703 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:36:20.096651 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 13 lines ... Pod kube-system/cloud-controller-manager-vbmfd system-cluster-critical pod "cloud-controller-manager-vbmfd" is pending Pod kube-system/coredns-7bc44848df-hprr4 system-cluster-critical pod "coredns-7bc44848df-hprr4" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-xclv9 system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-xclv9" is pending Pod kube-system/dns-controller-6d5f4bf5d6-ntggn system-cluster-critical pod "dns-controller-6d5f4bf5d6-ntggn" is pending Pod kube-system/kops-controller-jr9vc system-cluster-critical pod "kops-controller-jr9vc" is pending Validation Failed W0127 10:36:21.169849 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:36:31.537463 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 11 lines ... Pod kube-system/calico-kube-controllers-55f488656-7ms7v system-cluster-critical pod "calico-kube-controllers-55f488656-7ms7v" is pending Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is pending Pod kube-system/cloud-controller-manager-vbmfd system-cluster-critical pod "cloud-controller-manager-vbmfd" is pending Pod kube-system/coredns-7bc44848df-hprr4 system-cluster-critical pod "coredns-7bc44848df-hprr4" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-xclv9 system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-xclv9" is pending Validation Failed W0127 10:36:32.624442 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:36:42.995795 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 14 lines ... Pod kube-system/calico-node-xghkk system-node-critical pod "calico-node-xghkk" is pending Pod kube-system/coredns-7bc44848df-hprr4 system-cluster-critical pod "coredns-7bc44848df-hprr4" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-xclv9 system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-xclv9" is pending Pod kube-system/kube-apiserver-control-plane-us-east1-b-djgn system-cluster-critical pod "kube-apiserver-control-plane-us-east1-b-djgn" is pending Pod kube-system/kube-controller-manager-control-plane-us-east1-b-djgn system-cluster-critical pod "kube-controller-manager-control-plane-us-east1-b-djgn" is pending Validation Failed W0127 10:36:44.116754 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:36:54.495565 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 19 lines ... Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is pending Pod kube-system/calico-node-xghkk system-node-critical pod "calico-node-xghkk" is pending Pod kube-system/calico-node-zvjzb system-node-critical pod "calico-node-zvjzb" is pending Pod kube-system/coredns-7bc44848df-hprr4 system-cluster-critical pod "coredns-7bc44848df-hprr4" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-xclv9 system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-xclv9" is pending Validation Failed W0127 10:36:55.538819 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:37:05.894458 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 14 lines ... Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Pod kube-system/calico-node-xghkk system-node-critical pod "calico-node-xghkk" is pending Pod kube-system/calico-node-zvjzb system-node-critical pod "calico-node-zvjzb" is pending Pod kube-system/coredns-7bc44848df-hprr4 system-cluster-critical pod "coredns-7bc44848df-hprr4" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-xclv9 system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-xclv9" is pending Validation Failed W0127 10:37:06.732214 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:37:17.088147 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 12 lines ... Pod kube-system/calico-node-lcxjs system-node-critical pod "calico-node-lcxjs" is pending Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Pod kube-system/calico-node-xghkk system-node-critical pod "calico-node-xghkk" is not ready (calico-node) Pod kube-system/calico-node-zvjzb system-node-critical pod "calico-node-zvjzb" is not ready (calico-node) Pod kube-system/coredns-7bc44848df-vdg6g system-cluster-critical pod "coredns-7bc44848df-vdg6g" is pending Validation Failed W0127 10:37:18.084005 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:37:28.513655 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 11 lines ... Pod kube-system/calico-node-hc55l system-node-critical pod "calico-node-hc55l" is not ready (calico-node) Pod kube-system/calico-node-lcxjs system-node-critical pod "calico-node-lcxjs" is not ready (calico-node) Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Pod kube-system/calico-node-xghkk system-node-critical pod "calico-node-xghkk" is not ready (calico-node) Pod kube-system/calico-node-zvjzb system-node-critical pod "calico-node-zvjzb" is not ready (calico-node) Validation Failed W0127 10:37:29.183245 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:37:39.526497 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 11 lines ... Pod kube-system/calico-node-hc55l system-node-critical pod "calico-node-hc55l" is not ready (calico-node) Pod kube-system/calico-node-lcxjs system-node-critical pod "calico-node-lcxjs" is not ready (calico-node) Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Pod kube-system/calico-node-xghkk system-node-critical pod "calico-node-xghkk" is not ready (calico-node) Pod kube-system/calico-node-zvjzb system-node-critical pod "calico-node-zvjzb" is not ready (calico-node) Validation Failed W0127 10:37:40.570476 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:37:50.948245 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 8 lines ... VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-lcxjs system-node-critical pod "calico-node-lcxjs" is not ready (calico-node) Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:37:51.732627 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:38:02.106134 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:38:02.721576 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:38:13.055666 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:38:13.838225 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:38:24.208576 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:38:25.004900 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:38:35.393349 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:38:36.402036 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:38:46.761540 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:38:47.496344 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:38:57.980955 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:38:58.674002 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:39:09.011686 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:39:09.785714 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:39:20.190364 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:39:20.996908 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:39:31.486619 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:39:32.366212 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:39:34.669096 5547 boskos.go:86] Sending heartbeat to Boskos I0127 10:39:42.758477 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 ... skipping 8 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:39:43.465768 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:39:53.774973 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:39:54.562784 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:40:04.882967 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:40:05.702985 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:40:16.144758 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:40:16.791945 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:40:27.251626 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:40:28.124107 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:40:38.601567 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:40:39.427123 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:40:49.782947 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:40:50.437172 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:41:00.882586 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:41:01.578683 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:41:11.930375 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:41:12.547542 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:41:22.931634 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:41:24.159594 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:41:34.492200 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:41:35.086335 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:41:45.502239 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:41:46.113872 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:41:56.567205 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:41:57.375067 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:42:07.730950 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:42:08.762048 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:42:19.101428 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:42:20.121020 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:42:30.527446 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:42:31.147517 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:42:41.506702 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:42:42.178442 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:42:52.493793 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:42:53.103297 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:43:03.478310 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:43:04.273795 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:43:14.696242 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:43:15.329464 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:43:25.693608 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:43:26.510092 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:43:36.917020 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:43:37.502845 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:43:47.895404 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:43:48.711248 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:43:59.212609 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:44:00.046232 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:44:10.415632 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:44:11.129593 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:44:21.636419 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:44:22.252653 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:44:32.603276 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:44:33.440685 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:44:34.679318 5547 boskos.go:86] Sending heartbeat to Boskos I0127 10:44:43.790458 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 ... skipping 8 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:44:44.426858 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:44:54.776360 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:44:55.415614 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:45:05.926023 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:45:06.554298 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:45:17.066780 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:45:17.885754 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:45:28.354069 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:45:28.984765 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:45:39.351575 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:45:40.165068 5908 validate_cluster.go:232] (will retry): cluster not yet healthy I0127 10:45:50.519882 5908 gce_cloud.go:301] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east1-b ControlPlane e2-standard-2 1 1 us-east1 nodes-us-east1-b Node e2-medium 4 4 us-east1 ... skipping 7 lines ... nodes-us-east1-b-vj02 node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-svsrd system-node-critical pod "calico-node-svsrd" is not ready (calico-node) Validation Failed W0127 10:45:51.200893 5908 validate_cluster.go:232] (will retry): cluster not yet healthy Error: validation failed: wait time exceeded during validation I0127 10:46:01.211513 5547 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/3ffdfc34-9e2d-11ed-b1bb-1299ca1e1805/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh157656249/key --ssh-user prow I0127 10:46:01.211568 5547 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/3ffdfc34-9e2d-11ed-b1bb-1299ca1e1805/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh157656249/key --ssh-user prow I0127 10:46:01.609878 5918 gce.go:99] Scanning zones: [us-east1-b us-east1-c us-east1-d us-east1-a] 2023/01/27 10:46:06 Dumping node control-plane-us-east1-b-djgn 2023/01/27 10:46:13 error dumping node control-plane-us-east1-b-djgn: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/27 10:46:13 error dumping node control-plane-us-east1-b-djgn: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/27 10:46:13 Dumping node nodes-us-east1-b-1vf4 2023/01/27 10:46:17 Dumping node nodes-us-east1-b-2rjg 2023/01/27 10:46:20 Dumping node nodes-us-east1-b-47pv 2023/01/27 10:46:24 Dumping node nodes-us-east1-b-vj02 I0127 10:46:28.435620 5547 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/3ffdfc34-9e2d-11ed-b1bb-1299ca1e1805/kops get cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local -o yaml I0127 10:46:28.435681 5547 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/3ffdfc34-9e2d-11ed-b1bb-1299ca1e1805/kops get cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local -o yaml ... skipping 154 lines ... Deleted cluster: "e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local" I0127 10:48:38.726799 5547 gcs.go:88] gsutil -u k8s-jkns-gci-gce-ingress-1-6 rm -r gs://k8s-jkns-gci-gce-ingress-1-6-state-3f I0127 10:48:38.726856 5547 local.go:42] ⚙️ gsutil -u k8s-jkns-gci-gce-ingress-1-6 rm -r gs://k8s-jkns-gci-gce-ingress-1-6-state-3f Removing gs://k8s-jkns-gci-gce-ingress-1-6-state-3f/... I0127 10:48:41.324901 5547 down.go:62] releasing boskos project I0127 10:48:41.334022 5547 boskos.go:83] Boskos heartbeat func received signal to close Error: exit status 1 + EXIT_VALUE=1 + set +o xtrace