e2e-kops-grid-gce-calico-u2004-k26 #1615173833558331392
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 1 failed / 1 succeeded |
| Started | |
| Elapsed | 20m9s |
| Revision | master |
exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
kubetest2 Down
... skipping 163 lines ... ..............Updated [https://www.googleapis.com/compute/v1/projects/kube-gce-upg-lat-master]. ..done. WARNING: No host aliases were added to your SSH configs because you do not have any running instances. Try running this command again after running some instances. I0117 02:29:00.365687 5485 up.go:44] Cleaning up any leaked resources from previous cluster I0117 02:29:00.365817 5485 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/6ec3f129-960e-11ed-824d-f64c9135b4ea/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh3690236541/key --ssh-user prow I0117 02:29:00.365837 5485 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/6ec3f129-960e-11ed-824d-f64c9135b4ea/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh3690236541/key --ssh-user prow Error: Cluster.kops.k8s.io "e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local" not found W0117 02:29:00.574960 5485 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1 I0117 02:29:00.575018 5485 down.go:48] /home/prow/go/src/k8s.io/kops/_rundir/6ec3f129-960e-11ed-824d-f64c9135b4ea/kops delete cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --yes I0117 02:29:00.575070 5485 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/6ec3f129-960e-11ed-824d-f64c9135b4ea/kops delete cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --yes Error: error reading cluster configuration: Cluster.kops.k8s.io "e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local" not found I0117 02:29:00.697075 5485 gcs.go:51] gsutil ls -b -p kube-gce-upg-lat-master gs://kube-gce-upg-lat-master-state-6e I0117 02:29:00.697110 5485 local.go:42] ⚙️ gsutil ls -b -p kube-gce-upg-lat-master gs://kube-gce-upg-lat-master-state-6e I0117 02:29:02.742511 5485 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip 2023/01/17 02:29:02 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404 I0117 02:29:02.758191 5485 http.go:37] curl https://ip.jsb.workers.dev I0117 02:29:02.865042 5485 up.go:167] /home/prow/go/src/k8s.io/kops/_rundir/6ec3f129-960e-11ed-824d-f64c9135b4ea/kops create cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --cloud gce --kubernetes-version https://storage.googleapis.com/kubernetes-release/release/v1.26.0 --ssh-public-key /tmp/kops-ssh3690236541/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --networking=calico --container-runtime=containerd --gce-service-account=default --admin-access 35.222.21.177/32 --master-count 1 --master-volume-size 48 --node-count 4 --node-volume-size 48 --zones us-west1-a --master-size e2-standard-2 --project kube-gce-upg-lat-master I0117 02:29:02.865082 5485 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/6ec3f129-960e-11ed-824d-f64c9135b4ea/kops create cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --cloud gce --kubernetes-version https://storage.googleapis.com/kubernetes-release/release/v1.26.0 --ssh-public-key /tmp/kops-ssh3690236541/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --networking=calico --container-runtime=containerd --gce-service-account=default --admin-access 35.222.21.177/32 --master-count 1 --master-volume-size 48 --node-count 4 --node-volume-size 48 --zones us-west1-a --master-size e2-standard-2 --project kube-gce-upg-lat-master I0117 02:29:02.917362 5676 create_cluster.go:882] Using SSH public key: /tmp/kops-ssh3690236541/key.pub I0117 02:29:03.132671 5676 new_cluster.go:573] VMs will be configured to use specified Service Account: default I0117 02:29:03.132853 5676 new_cluster.go:1338] Cloud Provider ID: "gce" ... skipping 368 lines ... * read about installing addons at: https://kops.sigs.k8s.io/addons. I0117 02:30:05.070655 5485 up.go:251] /home/prow/go/src/k8s.io/kops/_rundir/6ec3f129-960e-11ed-824d-f64c9135b4ea/kops validate cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --count 10 --wait 15m0s I0117 02:30:05.070714 5485 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/6ec3f129-960e-11ed-824d-f64c9135b4ea/kops validate cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --count 10 --wait 15m0s Validating cluster e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local W0117 02:30:35.505855 5716 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.83.218.16/api/v1/nodes": dial tcp 34.83.218.16:443: i/o timeout W0117 02:30:45.547030 5716 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.83.218.16/api/v1/nodes": dial tcp 34.83.218.16:443: connect: connection refused W0117 02:30:55.588651 5716 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.83.218.16/api/v1/nodes": dial tcp 34.83.218.16:443: connect: connection refused W0117 02:31:05.631305 5716 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.83.218.16/api/v1/nodes": dial tcp 34.83.218.16:443: connect: connection refused W0117 02:31:15.672605 5716 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.83.218.16/api/v1/nodes": dial tcp 34.83.218.16:443: connect: connection refused W0117 02:31:25.714291 5716 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.83.218.16/api/v1/nodes": dial tcp 34.83.218.16:443: connect: connection refused W0117 02:31:35.755703 5716 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.83.218.16/api/v1/nodes": dial tcp 34.83.218.16:443: connect: connection refused W0117 02:31:45.797673 5716 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.83.218.16/api/v1/nodes": dial tcp 34.83.218.16:443: connect: connection refused W0117 02:31:55.839511 5716 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.83.218.16/api/v1/nodes": dial tcp 34.83.218.16:443: connect: connection refused W0117 02:32:05.881790 5716 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.83.218.16/api/v1/nodes": dial tcp 34.83.218.16:443: connect: connection refused W0117 02:32:25.924120 5716 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.83.218.16/api/v1/nodes": net/http: TLS handshake timeout W0117 02:32:48.421403 5716 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.83.218.16/api/v1/nodes": net/http: TLS handshake timeout - error from a previous attempt: read tcp 10.60.124.166:44088->34.83.218.16:443: read: connection reset by peer I0117 02:32:58.912740 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 5 lines ... Machine https://www.googleapis.com/compute/v1/projects/kube-gce-upg-lat-master/zones/us-west1-a/instances/control-plane-us-west1-a-j9wq machine "https://www.googleapis.com/compute/v1/projects/kube-gce-upg-lat-master/zones/us-west1-a/instances/control-plane-us-west1-a-j9wq" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/kube-gce-upg-lat-master/zones/us-west1-a/instances/nodes-us-west1-a-66x1 machine "https://www.googleapis.com/compute/v1/projects/kube-gce-upg-lat-master/zones/us-west1-a/instances/nodes-us-west1-a-66x1" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/kube-gce-upg-lat-master/zones/us-west1-a/instances/nodes-us-west1-a-6ncc machine "https://www.googleapis.com/compute/v1/projects/kube-gce-upg-lat-master/zones/us-west1-a/instances/nodes-us-west1-a-6ncc" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/kube-gce-upg-lat-master/zones/us-west1-a/instances/nodes-us-west1-a-89r1 machine "https://www.googleapis.com/compute/v1/projects/kube-gce-upg-lat-master/zones/us-west1-a/instances/nodes-us-west1-a-89r1" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/kube-gce-upg-lat-master/zones/us-west1-a/instances/nodes-us-west1-a-rhdg machine "https://www.googleapis.com/compute/v1/projects/kube-gce-upg-lat-master/zones/us-west1-a/instances/nodes-us-west1-a-rhdg" has not yet joined cluster Validation Failed W0117 02:32:59.779679 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:33:10.163012 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... Machine https://www.googleapis.com/compute/v1/projects/kube-gce-upg-lat-master/zones/us-west1-a/instances/nodes-us-west1-a-66x1 machine "https://www.googleapis.com/compute/v1/projects/kube-gce-upg-lat-master/zones/us-west1-a/instances/nodes-us-west1-a-66x1" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/kube-gce-upg-lat-master/zones/us-west1-a/instances/nodes-us-west1-a-6ncc machine "https://www.googleapis.com/compute/v1/projects/kube-gce-upg-lat-master/zones/us-west1-a/instances/nodes-us-west1-a-6ncc" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/kube-gce-upg-lat-master/zones/us-west1-a/instances/nodes-us-west1-a-89r1 machine "https://www.googleapis.com/compute/v1/projects/kube-gce-upg-lat-master/zones/us-west1-a/instances/nodes-us-west1-a-89r1" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/kube-gce-upg-lat-master/zones/us-west1-a/instances/nodes-us-west1-a-rhdg machine "https://www.googleapis.com/compute/v1/projects/kube-gce-upg-lat-master/zones/us-west1-a/instances/nodes-us-west1-a-rhdg" has not yet joined cluster Pod kube-system/kube-controller-manager-control-plane-us-west1-a-j9wq system-cluster-critical pod "kube-controller-manager-control-plane-us-west1-a-j9wq" is pending Validation Failed W0117 02:33:10.725049 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:33:21.159507 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 6 lines ... Machine https://www.googleapis.com/compute/v1/projects/kube-gce-upg-lat-master/zones/us-west1-a/instances/control-plane-us-west1-a-j9wq machine "https://www.googleapis.com/compute/v1/projects/kube-gce-upg-lat-master/zones/us-west1-a/instances/control-plane-us-west1-a-j9wq" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/kube-gce-upg-lat-master/zones/us-west1-a/instances/nodes-us-west1-a-66x1 machine "https://www.googleapis.com/compute/v1/projects/kube-gce-upg-lat-master/zones/us-west1-a/instances/nodes-us-west1-a-66x1" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/kube-gce-upg-lat-master/zones/us-west1-a/instances/nodes-us-west1-a-6ncc machine "https://www.googleapis.com/compute/v1/projects/kube-gce-upg-lat-master/zones/us-west1-a/instances/nodes-us-west1-a-6ncc" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/kube-gce-upg-lat-master/zones/us-west1-a/instances/nodes-us-west1-a-89r1 machine "https://www.googleapis.com/compute/v1/projects/kube-gce-upg-lat-master/zones/us-west1-a/instances/nodes-us-west1-a-89r1" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/kube-gce-upg-lat-master/zones/us-west1-a/instances/nodes-us-west1-a-rhdg machine "https://www.googleapis.com/compute/v1/projects/kube-gce-upg-lat-master/zones/us-west1-a/instances/nodes-us-west1-a-rhdg" has not yet joined cluster Validation Failed W0117 02:33:22.147959 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:33:32.523096 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 13 lines ... Pod kube-system/cloud-controller-manager-rbsc9 system-cluster-critical pod "cloud-controller-manager-rbsc9" is pending Pod kube-system/coredns-7bc44848df-2q4tm system-cluster-critical pod "coredns-7bc44848df-2q4tm" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-lrwb2 system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-lrwb2" is pending Pod kube-system/dns-controller-6d5f4bf5d6-smpf6 system-cluster-critical pod "dns-controller-6d5f4bf5d6-smpf6" is pending Pod kube-system/kops-controller-h96p8 system-cluster-critical pod "kops-controller-h96p8" is pending Validation Failed W0117 02:33:33.435703 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:33:43.875957 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 14 lines ... Pod kube-system/coredns-7bc44848df-2q4tm system-cluster-critical pod "coredns-7bc44848df-2q4tm" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-lrwb2 system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-lrwb2" is pending Pod kube-system/etcd-manager-events-control-plane-us-west1-a-j9wq system-cluster-critical pod "etcd-manager-events-control-plane-us-west1-a-j9wq" is pending Pod kube-system/etcd-manager-main-control-plane-us-west1-a-j9wq system-cluster-critical pod "etcd-manager-main-control-plane-us-west1-a-j9wq" is pending Pod kube-system/kube-apiserver-control-plane-us-west1-a-j9wq system-cluster-critical pod "kube-apiserver-control-plane-us-west1-a-j9wq" is pending Validation Failed W0117 02:33:44.431281 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:33:54.152985 5485 boskos.go:86] Sending heartbeat to Boskos I0117 02:33:54.772325 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 ... skipping 15 lines ... Pod kube-system/calico-node-dxwgv system-node-critical pod "calico-node-dxwgv" is pending Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is pending Pod kube-system/calico-node-qg55b system-node-critical pod "calico-node-qg55b" is pending Pod kube-system/coredns-7bc44848df-2q4tm system-cluster-critical pod "coredns-7bc44848df-2q4tm" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-lrwb2 system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-lrwb2" is pending Validation Failed W0117 02:33:55.398035 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:34:05.870333 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 18 lines ... Pod kube-system/calico-node-dxwgv system-node-critical pod "calico-node-dxwgv" is pending Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Pod kube-system/calico-node-qg55b system-node-critical pod "calico-node-qg55b" is pending Pod kube-system/coredns-7bc44848df-2q4tm system-cluster-critical pod "coredns-7bc44848df-2q4tm" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-lrwb2 system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-lrwb2" is pending Validation Failed W0117 02:34:06.446234 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:34:16.814856 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 12 lines ... Pod kube-system/calico-node-cffp8 system-node-critical pod "calico-node-cffp8" is pending Pod kube-system/calico-node-dxwgv system-node-critical pod "calico-node-dxwgv" is pending Pod kube-system/calico-node-qg55b system-node-critical pod "calico-node-qg55b" is pending Pod kube-system/coredns-7bc44848df-2q4tm system-cluster-critical pod "coredns-7bc44848df-2q4tm" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-lrwb2 system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-lrwb2" is pending Validation Failed W0117 02:34:17.424509 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:34:27.854338 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 12 lines ... Pod kube-system/calico-node-cffp8 system-node-critical pod "calico-node-cffp8" is not ready (calico-node) Pod kube-system/calico-node-dxwgv system-node-critical pod "calico-node-dxwgv" is not ready (calico-node) Pod kube-system/calico-node-qg55b system-node-critical pod "calico-node-qg55b" is not ready (calico-node) Pod kube-system/coredns-7bc44848df-2q4tm system-cluster-critical pod "coredns-7bc44848df-2q4tm" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-lrwb2 system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-lrwb2" is pending Validation Failed W0117 02:34:28.585979 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:34:38.969696 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 11 lines ... Pod kube-system/calico-node-5llmp system-node-critical pod "calico-node-5llmp" is not ready (calico-node) Pod kube-system/calico-node-cffp8 system-node-critical pod "calico-node-cffp8" is not ready (calico-node) Pod kube-system/calico-node-dxwgv system-node-critical pod "calico-node-dxwgv" is not ready (calico-node) Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Pod kube-system/calico-node-qg55b system-node-critical pod "calico-node-qg55b" is not ready (calico-node) Validation Failed W0117 02:34:39.511641 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:34:49.822659 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 10 lines ... KIND NAME MESSAGE Pod kube-system/calico-node-cffp8 system-node-critical pod "calico-node-cffp8" is not ready (calico-node) Pod kube-system/calico-node-dxwgv system-node-critical pod "calico-node-dxwgv" is not ready (calico-node) Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Pod kube-system/calico-node-qg55b system-node-critical pod "calico-node-qg55b" is not ready (calico-node) Validation Failed W0117 02:34:50.353754 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:35:00.684634 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:35:01.445221 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:35:11.783405 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:35:12.348936 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:35:22.758087 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:35:23.308707 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:35:33.667962 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:35:34.200566 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:35:44.631741 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:35:45.243633 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:35:55.630505 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:35:56.259814 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:36:06.566459 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:36:07.102824 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:36:17.509745 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:36:18.063533 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:36:28.482128 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:36:29.088838 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:36:39.476307 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:36:40.230264 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:36:50.591193 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:36:51.373116 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:37:01.756671 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:37:02.321365 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:37:12.694120 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:37:13.276572 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:37:23.735733 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:37:24.306692 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:37:34.667772 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:37:35.266151 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:37:45.651871 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:37:46.204540 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:37:56.553981 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:37:57.182094 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:38:07.486581 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:38:08.032437 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:38:18.341652 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:38:18.906581 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:38:29.281323 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:38:29.848400 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:38:40.185809 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:38:40.802148 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:38:51.221460 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:38:51.740002 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:38:54.164733 5485 boskos.go:86] Sending heartbeat to Boskos I0117 02:39:02.169688 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 ... skipping 8 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:39:02.917824 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:39:13.296845 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:39:13.870311 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:39:24.296868 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:39:24.835871 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:39:35.220797 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:39:35.988485 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:39:46.373396 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:39:46.922865 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:39:57.297786 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:39:57.896369 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:40:08.322063 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:40:08.914383 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:40:19.294888 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:40:19.849388 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:40:30.250819 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:40:30.809719 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:40:41.147588 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:40:41.693025 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:40:52.114527 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:40:52.705249 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:41:03.071126 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:41:03.630066 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:41:14.005508 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:41:14.605724 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:41:24.941184 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:41:25.529508 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:41:35.896741 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:41:36.447059 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:41:46.847831 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:41:47.441814 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:41:57.817779 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:41:58.418689 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:42:08.838571 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:42:09.357257 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:42:19.735248 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:42:20.257618 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:42:30.685854 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:42:31.254695 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:42:41.588930 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:42:42.198747 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:42:52.535213 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:42:53.131424 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:43:03.425829 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:43:03.966855 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:43:14.279273 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:43:14.808306 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:43:25.128058 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:43:25.709262 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:43:36.035224 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:43:36.607904 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:43:46.967172 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:43:47.514207 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:43:54.177044 5485 boskos.go:86] Sending heartbeat to Boskos I0117 02:43:57.872359 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 ... skipping 8 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:43:58.633947 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:44:08.945991 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:44:09.516544 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:44:19.904082 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:44:20.463341 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:44:30.808080 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:44:31.588203 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:44:41.969306 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:44:42.541232 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:44:52.872891 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:44:53.460932 5716 validate_cluster.go:232] (will retry): cluster not yet healthy I0117 02:45:03.948399 5716 gce_cloud.go:301] Scanning zones: [us-west1-b us-west1-c us-west1-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-west1-a ControlPlane e2-standard-2 1 1 us-west1 nodes-us-west1-a Node e2-medium 4 4 us-west1 ... skipping 7 lines ... nodes-us-west1-a-rhdg node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-l4xc4 system-node-critical pod "calico-node-l4xc4" is not ready (calico-node) Validation Failed W0117 02:45:04.517477 5716 validate_cluster.go:232] (will retry): cluster not yet healthy Error: validation failed: wait time exceeded during validation I0117 02:45:14.536920 5485 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/6ec3f129-960e-11ed-824d-f64c9135b4ea/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh3690236541/key --ssh-user prow I0117 02:45:14.536972 5485 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/6ec3f129-960e-11ed-824d-f64c9135b4ea/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh3690236541/key --ssh-user prow I0117 02:45:15.088187 5727 gce.go:99] Scanning zones: [us-west1-b us-west1-c us-west1-a] 2023/01/17 02:45:19 Dumping node control-plane-us-west1-a-j9wq 2023/01/17 02:45:24 error dumping node control-plane-us-west1-a-j9wq: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/17 02:45:24 error dumping node control-plane-us-west1-a-j9wq: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/17 02:45:24 Dumping node nodes-us-west1-a-66x1 2023/01/17 02:45:27 Dumping node nodes-us-west1-a-6ncc 2023/01/17 02:45:31 Dumping node nodes-us-west1-a-89r1 2023/01/17 02:45:35 Dumping node nodes-us-west1-a-rhdg I0117 02:45:38.403719 5485 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/6ec3f129-960e-11ed-824d-f64c9135b4ea/kops get cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local -o yaml I0117 02:45:38.403779 5485 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/6ec3f129-960e-11ed-824d-f64c9135b4ea/kops get cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local -o yaml ... skipping 221 lines ... Operation completed over 53 objects. Removing gs://kube-gce-upg-lat-master-state-6e/... I0117 02:47:59.832687 5485 down.go:62] releasing boskos project I0117 02:47:59.843948 5485 boskos.go:83] Boskos heartbeat func received signal to close Error: exit status 1 + EXIT_VALUE=1 + set +o xtrace