e2e-kops-grid-gce-calico-u2004-k26 #1617710721850675200
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 1 failed / 1 succeeded |
| Started | |
| Elapsed | 20m10s |
| Revision | master |
exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
kubetest2 Down
... skipping 163 lines ... .................................Updated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3]. ..done. WARNING: No host aliases were added to your SSH configs because you do not have any running instances. Try running this command again after running some instances. I0124 02:29:44.881239 5519 up.go:44] Cleaning up any leaked resources from previous cluster I0124 02:29:44.881379 5519 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/b0461ba1-9b8e-11ed-b10d-8a774b882db2/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh2429372263/key --ssh-user prow I0124 02:29:44.881404 5519 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/b0461ba1-9b8e-11ed-b10d-8a774b882db2/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh2429372263/key --ssh-user prow Error: Cluster.kops.k8s.io "e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local" not found W0124 02:29:45.102193 5519 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1 I0124 02:29:45.102233 5519 down.go:48] /home/prow/go/src/k8s.io/kops/_rundir/b0461ba1-9b8e-11ed-b10d-8a774b882db2/kops delete cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --yes I0124 02:29:45.102249 5519 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/b0461ba1-9b8e-11ed-b10d-8a774b882db2/kops delete cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --yes Error: error reading cluster configuration: Cluster.kops.k8s.io "e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local" not found I0124 02:29:45.246265 5519 gcs.go:51] gsutil ls -b -p k8s-jkns-gci-gce-serial-1-3 gs://k8s-jkns-gci-gce-serial-1-3-state-b0 I0124 02:29:45.246309 5519 local.go:42] ⚙️ gsutil ls -b -p k8s-jkns-gci-gce-serial-1-3 gs://k8s-jkns-gci-gce-serial-1-3-state-b0 I0124 02:29:47.335521 5519 gcs.go:70] gsutil mb -p k8s-jkns-gci-gce-serial-1-3 gs://k8s-jkns-gci-gce-serial-1-3-state-b0 I0124 02:29:47.335569 5519 local.go:42] ⚙️ gsutil mb -p k8s-jkns-gci-gce-serial-1-3 gs://k8s-jkns-gci-gce-serial-1-3-state-b0 Creating gs://k8s-jkns-gci-gce-serial-1-3-state-b0/... I0124 02:29:50.172141 5519 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip 2023/01/24 02:29:50 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404 I0124 02:29:50.185560 5519 http.go:37] curl https://ip.jsb.workers.dev I0124 02:29:50.296972 5519 up.go:167] /home/prow/go/src/k8s.io/kops/_rundir/b0461ba1-9b8e-11ed-b10d-8a774b882db2/kops create cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --cloud gce --kubernetes-version https://storage.googleapis.com/kubernetes-release/release/v1.26.1 --ssh-public-key /tmp/kops-ssh2429372263/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --networking=calico --container-runtime=containerd --gce-service-account=default --admin-access 130.211.216.66/32 --master-count 1 --master-volume-size 48 --node-count 4 --node-volume-size 48 --zones us-east4-a --master-size e2-standard-2 --project k8s-jkns-gci-gce-serial-1-3 I0124 02:29:50.297017 5519 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/b0461ba1-9b8e-11ed-b10d-8a774b882db2/kops create cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --cloud gce --kubernetes-version https://storage.googleapis.com/kubernetes-release/release/v1.26.1 --ssh-public-key /tmp/kops-ssh2429372263/key.pub --set cluster.spec.nodePortAccess=0.0.0.0/0 --channel=alpha --networking=calico --container-runtime=containerd --gce-service-account=default --admin-access 130.211.216.66/32 --master-count 1 --master-volume-size 48 --node-count 4 --node-volume-size 48 --zones us-east4-a --master-size e2-standard-2 --project k8s-jkns-gci-gce-serial-1-3 I0124 02:29:50.347982 5842 create_cluster.go:882] Using SSH public key: /tmp/kops-ssh2429372263/key.pub I0124 02:29:50.710470 5842 new_cluster.go:573] VMs will be configured to use specified Service Account: default I0124 02:29:50.710587 5842 new_cluster.go:1338] Cloud Provider ID: "gce" ... skipping 349 lines ... I0124 02:29:59.273492 5863 keypair.go:226] Issuing new certificate: "etcd-peers-ca-main" I0124 02:29:59.279593 5863 keypair.go:226] Issuing new certificate: "apiserver-aggregator-ca" I0124 02:29:59.372824 5863 keypair.go:226] Issuing new certificate: "service-account" W0124 02:29:59.480961 5863 vfs_keystorereader.go:143] CA private key was not found I0124 02:29:59.579276 5863 keypair.go:226] Issuing new certificate: "kubernetes-ca" I0124 02:30:09.829720 5863 executor.go:111] Tasks: 42 done / 67 total; 19 can run W0124 02:30:23.248933 5863 executor.go:139] error running task "ForwardingRule/api-e2e-e2e-kops-grid-gce-calico-u2004-k26-k8s-local" (9m46s remaining to succeed): error creating ForwardingRule "api-e2e-e2e-kops-grid-gce-calico-u2004-k26-k8s-local": googleapi: Error 400: The resource 'projects/k8s-jkns-gci-gce-serial-1-3/regions/us-east4/targetPools/api-e2e-e2e-kops-grid-gce-calico-u2004-k26-k8s-local' is not ready, resourceNotReady I0124 02:30:23.249003 5863 executor.go:111] Tasks: 60 done / 67 total; 5 can run I0124 02:30:30.149645 5863 executor.go:111] Tasks: 65 done / 67 total; 2 can run I0124 02:30:46.357367 5863 executor.go:111] Tasks: 67 done / 67 total; 0 can run I0124 02:30:46.425925 5863 update_cluster.go:323] Exporting kubeconfig for cluster kOps has set your kubectl context to e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local ... skipping 7 lines ... * read about installing addons at: https://kops.sigs.k8s.io/addons. I0124 02:30:56.859303 5519 up.go:251] /home/prow/go/src/k8s.io/kops/_rundir/b0461ba1-9b8e-11ed-b10d-8a774b882db2/kops validate cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --count 10 --wait 15m0s I0124 02:30:56.859375 5519 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/b0461ba1-9b8e-11ed-b10d-8a774b882db2/kops validate cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --count 10 --wait 15m0s Validating cluster e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local W0124 02:31:27.283953 5883 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.86.114.124/api/v1/nodes": dial tcp 34.86.114.124:443: i/o timeout W0124 02:31:37.310768 5883 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.86.114.124/api/v1/nodes": dial tcp 34.86.114.124:443: connect: connection refused W0124 02:31:47.337891 5883 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.86.114.124/api/v1/nodes": dial tcp 34.86.114.124:443: connect: connection refused W0124 02:31:57.365330 5883 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.86.114.124/api/v1/nodes": dial tcp 34.86.114.124:443: connect: connection refused W0124 02:32:07.392763 5883 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.86.114.124/api/v1/nodes": dial tcp 34.86.114.124:443: connect: connection refused W0124 02:32:17.419984 5883 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.86.114.124/api/v1/nodes": dial tcp 34.86.114.124:443: connect: connection refused W0124 02:32:27.447720 5883 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.86.114.124/api/v1/nodes": dial tcp 34.86.114.124:443: connect: connection refused W0124 02:32:37.474853 5883 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.86.114.124/api/v1/nodes": dial tcp 34.86.114.124:443: connect: connection refused W0124 02:32:47.502601 5883 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.86.114.124/api/v1/nodes": dial tcp 34.86.114.124:443: connect: connection refused W0124 02:32:57.531034 5883 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.86.114.124/api/v1/nodes": dial tcp 34.86.114.124:443: connect: connection refused W0124 02:33:07.558297 5883 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.86.114.124/api/v1/nodes": dial tcp 34.86.114.124:443: connect: connection refused W0124 02:33:17.585862 5883 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.86.114.124/api/v1/nodes": dial tcp 34.86.114.124:443: connect: connection refused W0124 02:33:37.614067 5883 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.86.114.124/api/v1/nodes": net/http: TLS handshake timeout W0124 02:33:57.642550 5883 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.86.114.124/api/v1/nodes": net/http: TLS handshake timeout W0124 02:34:08.789722 5883 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.86.114.124/api/v1/nodes": dial tcp 34.86.114.124:443: connect: connection refused - error from a previous attempt: read tcp 10.60.76.245:45288->34.86.114.124:443: read: connection reset by peer W0124 02:34:18.817679 5883 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.86.114.124/api/v1/nodes": dial tcp 34.86.114.124:443: connect: connection refused I0124 02:34:34.453225 5519 boskos.go:86] Sending heartbeat to Boskos W0124 02:34:38.845263 5883 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.86.114.124/api/v1/nodes": net/http: TLS handshake timeout W0124 02:34:50.805585 5883 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.86.114.124/api/v1/nodes": dial tcp 34.86.114.124:443: connect: connection refused - error from a previous attempt: read tcp 10.60.76.245:53586->34.86.114.124:443: read: connection reset by peer W0124 02:35:00.833388 5883 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.86.114.124/api/v1/nodes": dial tcp 34.86.114.124:443: connect: connection refused W0124 02:35:10.860374 5883 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://34.86.114.124/api/v1/nodes": dial tcp 34.86.114.124:443: connect: connection refused I0124 02:35:23.176788 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 5 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/control-plane-us-east4-a-x970 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/control-plane-us-east4-a-x970" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/nodes-us-east4-a-1zd2 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/nodes-us-east4-a-1zd2" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/nodes-us-east4-a-2sp9 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/nodes-us-east4-a-2sp9" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/nodes-us-east4-a-pz3f machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/nodes-us-east4-a-pz3f" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/nodes-us-east4-a-vm6v machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/nodes-us-east4-a-vm6v" has not yet joined cluster Validation Failed W0124 02:35:23.677428 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:35:34.147540 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 6 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/control-plane-us-east4-a-x970 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/control-plane-us-east4-a-x970" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/nodes-us-east4-a-1zd2 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/nodes-us-east4-a-1zd2" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/nodes-us-east4-a-2sp9 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/nodes-us-east4-a-2sp9" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/nodes-us-east4-a-pz3f machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/nodes-us-east4-a-pz3f" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/nodes-us-east4-a-vm6v machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/nodes-us-east4-a-vm6v" has not yet joined cluster Validation Failed W0124 02:35:34.761715 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:35:45.179653 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 6 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/control-plane-us-east4-a-x970 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/control-plane-us-east4-a-x970" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/nodes-us-east4-a-1zd2 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/nodes-us-east4-a-1zd2" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/nodes-us-east4-a-2sp9 machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/nodes-us-east4-a-2sp9" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/nodes-us-east4-a-pz3f machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/nodes-us-east4-a-pz3f" has not yet joined cluster Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/nodes-us-east4-a-vm6v machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/nodes-us-east4-a-vm6v" has not yet joined cluster Validation Failed W0124 02:35:45.765100 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:35:56.184930 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 11 lines ... Pod kube-system/calico-kube-controllers-55f488656-dnvzd system-cluster-critical pod "calico-kube-controllers-55f488656-dnvzd" is pending Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is pending Pod kube-system/coredns-7bc44848df-5mjnb system-cluster-critical pod "coredns-7bc44848df-5mjnb" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-cktdf system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-cktdf" is pending Pod kube-system/dns-controller-6d5f4bf5d6-wz22m system-cluster-critical pod "dns-controller-6d5f4bf5d6-wz22m" is pending Validation Failed W0124 02:35:56.783527 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:36:07.199451 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 16 lines ... Pod kube-system/dns-controller-6d5f4bf5d6-wz22m system-cluster-critical pod "dns-controller-6d5f4bf5d6-wz22m" is pending Pod kube-system/etcd-manager-events-control-plane-us-east4-a-x970 system-cluster-critical pod "etcd-manager-events-control-plane-us-east4-a-x970" is pending Pod kube-system/etcd-manager-main-control-plane-us-east4-a-x970 system-cluster-critical pod "etcd-manager-main-control-plane-us-east4-a-x970" is pending Pod kube-system/kops-controller-jb2pf system-cluster-critical pod "kops-controller-jb2pf" is pending Pod kube-system/kube-scheduler-control-plane-us-east4-a-x970 system-cluster-critical pod "kube-scheduler-control-plane-us-east4-a-x970" is pending Validation Failed W0124 02:36:07.751535 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:36:18.100394 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 11 lines ... Pod kube-system/calico-kube-controllers-55f488656-dnvzd system-cluster-critical pod "calico-kube-controllers-55f488656-dnvzd" is pending Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is pending Pod kube-system/cloud-controller-manager-qbznx system-cluster-critical pod "cloud-controller-manager-qbznx" is pending Pod kube-system/coredns-7bc44848df-5mjnb system-cluster-critical pod "coredns-7bc44848df-5mjnb" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-cktdf system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-cktdf" is pending Validation Failed W0124 02:36:18.518505 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:36:28.912992 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 10 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/nodes-us-east4-a-vm6v machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/nodes-us-east4-a-vm6v" has not yet joined cluster Pod kube-system/calico-kube-controllers-55f488656-dnvzd system-cluster-critical pod "calico-kube-controllers-55f488656-dnvzd" is pending Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is pending Pod kube-system/coredns-7bc44848df-5mjnb system-cluster-critical pod "coredns-7bc44848df-5mjnb" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-cktdf system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-cktdf" is pending Validation Failed W0124 02:36:29.406468 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:36:39.787804 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 12 lines ... Pod kube-system/calico-kube-controllers-55f488656-dnvzd system-cluster-critical pod "calico-kube-controllers-55f488656-dnvzd" is pending Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is pending Pod kube-system/coredns-7bc44848df-5mjnb system-cluster-critical pod "coredns-7bc44848df-5mjnb" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-cktdf system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-cktdf" is pending Pod kube-system/kube-controller-manager-control-plane-us-east4-a-x970 system-cluster-critical pod "kube-controller-manager-control-plane-us-east4-a-x970" is pending Validation Failed W0124 02:36:40.234861 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:36:50.668503 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 10 lines ... Machine https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/nodes-us-east4-a-vm6v machine "https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-east4-a/instances/nodes-us-east4-a-vm6v" has not yet joined cluster Pod kube-system/calico-kube-controllers-55f488656-dnvzd system-cluster-critical pod "calico-kube-controllers-55f488656-dnvzd" is pending Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Pod kube-system/coredns-7bc44848df-5mjnb system-cluster-critical pod "coredns-7bc44848df-5mjnb" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-cktdf system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-cktdf" is pending Validation Failed W0124 02:36:51.215201 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:37:01.569282 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 17 lines ... Pod kube-system/calico-node-jgxxr system-node-critical pod "calico-node-jgxxr" is pending Pod kube-system/calico-node-qvb5r system-node-critical pod "calico-node-qvb5r" is pending Pod kube-system/calico-node-rf887 system-node-critical pod "calico-node-rf887" is pending Pod kube-system/coredns-7bc44848df-5mjnb system-cluster-critical pod "coredns-7bc44848df-5mjnb" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-cktdf system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-cktdf" is pending Validation Failed W0124 02:37:02.031072 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:37:12.363681 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 15 lines ... Pod kube-system/calico-node-jgxxr system-node-critical pod "calico-node-jgxxr" is pending Pod kube-system/calico-node-qvb5r system-node-critical pod "calico-node-qvb5r" is pending Pod kube-system/calico-node-rf887 system-node-critical pod "calico-node-rf887" is pending Pod kube-system/coredns-7bc44848df-5mjnb system-cluster-critical pod "coredns-7bc44848df-5mjnb" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-cktdf system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-cktdf" is pending Validation Failed W0124 02:37:12.819781 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:37:23.154807 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 12 lines ... Pod kube-system/calico-node-jgxxr system-node-critical pod "calico-node-jgxxr" is pending Pod kube-system/calico-node-qvb5r system-node-critical pod "calico-node-qvb5r" is pending Pod kube-system/calico-node-rf887 system-node-critical pod "calico-node-rf887" is pending Pod kube-system/coredns-7bc44848df-5mjnb system-cluster-critical pod "coredns-7bc44848df-5mjnb" is pending Pod kube-system/coredns-autoscaler-7cb5c5b969-cktdf system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-cktdf" is pending Validation Failed W0124 02:37:23.662848 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:37:34.089730 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 11 lines ... Pod kube-system/calico-node-95tdc system-node-critical pod "calico-node-95tdc" is not ready (calico-node) Pod kube-system/calico-node-jgxxr system-node-critical pod "calico-node-jgxxr" is not ready (calico-node) Pod kube-system/calico-node-qvb5r system-node-critical pod "calico-node-qvb5r" is not ready (calico-node) Pod kube-system/calico-node-rf887 system-node-critical pod "calico-node-rf887" is not ready (calico-node) Pod kube-system/coredns-autoscaler-7cb5c5b969-cktdf system-cluster-critical pod "coredns-autoscaler-7cb5c5b969-cktdf" is pending Validation Failed W0124 02:37:34.766208 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:37:45.238635 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 12 lines ... Pod kube-system/calico-node-jgxxr system-node-critical pod "calico-node-jgxxr" is not ready (calico-node) Pod kube-system/calico-node-qvb5r system-node-critical pod "calico-node-qvb5r" is not ready (calico-node) Pod kube-system/calico-node-rf887 system-node-critical pod "calico-node-rf887" is not ready (calico-node) Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Pod kube-system/kube-proxy-nodes-us-east4-a-2sp9 system-node-critical pod "kube-proxy-nodes-us-east4-a-2sp9" is pending Validation Failed W0124 02:37:45.701016 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:37:56.150919 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 13 lines ... Pod kube-system/calico-node-qvb5r system-node-critical pod "calico-node-qvb5r" is not ready (calico-node) Pod kube-system/calico-node-rf887 system-node-critical pod "calico-node-rf887" is not ready (calico-node) Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Pod kube-system/kube-proxy-nodes-us-east4-a-pz3f system-node-critical pod "kube-proxy-nodes-us-east4-a-pz3f" is pending Pod kube-system/kube-proxy-nodes-us-east4-a-vm6v system-node-critical pod "kube-proxy-nodes-us-east4-a-vm6v" is pending Validation Failed W0124 02:37:56.642018 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:38:07.009647 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 8 lines ... VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-jgxxr system-node-critical pod "calico-node-jgxxr" is not ready (calico-node) Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:38:07.517673 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:38:17.847784 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:38:18.293340 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:38:28.636769 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:38:29.054608 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:38:39.402554 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:38:39.842003 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:38:50.337029 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:38:50.907318 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:39:01.327798 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:39:01.844918 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:39:12.219807 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:39:12.824936 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:39:23.203020 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:39:23.637468 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:39:33.995334 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] I0124 02:39:34.463691 5519 boskos.go:86] Sending heartbeat to Boskos INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 ... skipping 8 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:39:34.475783 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:39:44.907230 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:39:45.371837 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:39:55.804165 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:39:56.409519 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:40:06.766371 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:40:07.212877 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:40:17.665821 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:40:18.122972 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:40:28.454485 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:40:28.921255 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:40:39.294652 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:40:39.762437 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:40:50.209297 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:40:50.793249 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:41:01.249922 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:41:01.714314 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:41:12.111110 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:41:12.547761 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:41:23.035492 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:41:23.600619 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:41:33.948115 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:41:34.418615 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:41:44.912745 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:41:45.355462 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:41:55.820971 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:41:56.328833 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:42:06.717739 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:42:07.295339 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:42:17.734157 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:42:18.218586 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:42:28.603194 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:42:29.208416 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:42:39.567425 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:42:39.998359 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:42:50.473431 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:42:51.036468 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:43:01.499112 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:43:02.077510 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:43:12.430359 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:43:12.856721 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:43:23.286416 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:43:23.814240 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:43:34.262231 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:43:34.712718 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:43:45.126060 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:43:45.737624 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:43:56.130315 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:43:56.708109 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:44:07.054604 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:44:07.622324 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:44:18.055557 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:44:18.492623 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:44:28.891132 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:44:29.330632 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:44:34.474940 5519 boskos.go:86] Sending heartbeat to Boskos I0124 02:44:39.788524 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 ... skipping 8 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:44:40.318155 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:44:50.758343 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:44:51.338227 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:45:01.736330 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:45:02.175975 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:45:12.516982 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:45:13.000062 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:45:23.342954 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:45:23.893802 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:45:34.311414 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:45:34.786483 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:45:45.152519 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:45:45.633138 5883 validate_cluster.go:232] (will retry): cluster not yet healthy I0124 02:45:56.014429 5883 gce_cloud.go:301] Scanning zones: [us-east4-c us-east4-b us-east4-a] INSTANCE GROUPS NAME ROLE MACHINETYPE MIN MAX SUBNETS control-plane-us-east4-a ControlPlane e2-standard-2 1 1 us-east4 nodes-us-east4-a Node e2-medium 4 4 us-east4 ... skipping 7 lines ... nodes-us-east4-a-vm6v node True VALIDATION ERRORS KIND NAME MESSAGE Pod kube-system/calico-node-txnqp system-node-critical pod "calico-node-txnqp" is not ready (calico-node) Validation Failed W0124 02:45:56.432776 5883 validate_cluster.go:232] (will retry): cluster not yet healthy Error: validation failed: wait time exceeded during validation I0124 02:46:06.452734 5519 dumplogs.go:45] /home/prow/go/src/k8s.io/kops/_rundir/b0461ba1-9b8e-11ed-b10d-8a774b882db2/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh2429372263/key --ssh-user prow I0124 02:46:06.452783 5519 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/b0461ba1-9b8e-11ed-b10d-8a774b882db2/kops toolbox dump --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local --dir /logs/artifacts --private-key /tmp/kops-ssh2429372263/key --ssh-user prow I0124 02:46:06.872332 5894 gce.go:99] Scanning zones: [us-east4-c us-east4-b us-east4-a] 2023/01/24 02:46:11 Dumping node control-plane-us-east4-a-x970 2023/01/24 02:46:16 error dumping node control-plane-us-east4-a-x970: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=external-dns\"; fi": Process exited with status 1 2023/01/24 02:46:16 error dumping node control-plane-us-east4-a-x970: error executing command "if command -v kubectl &> /dev/null; then kubectl logs -n kube-system --all-containers -l \"k8s-app=dns-controller\"; fi": Process exited with status 1 2023/01/24 02:46:16 Dumping node nodes-us-east4-a-1zd2 2023/01/24 02:46:19 Dumping node nodes-us-east4-a-2sp9 2023/01/24 02:46:22 Dumping node nodes-us-east4-a-pz3f 2023/01/24 02:46:25 Dumping node nodes-us-east4-a-vm6v I0124 02:46:28.993103 5519 dumplogs.go:79] /home/prow/go/src/k8s.io/kops/_rundir/b0461ba1-9b8e-11ed-b10d-8a774b882db2/kops get cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local -o yaml I0124 02:46:28.993141 5519 local.go:42] ⚙️ /home/prow/go/src/k8s.io/kops/_rundir/b0461ba1-9b8e-11ed-b10d-8a774b882db2/kops get cluster --name e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local -o yaml ... skipping 154 lines ... Deleted cluster: "e2e-e2e-kops-grid-gce-calico-u2004-k26.k8s.local" I0124 02:48:39.293525 5519 gcs.go:88] gsutil -u k8s-jkns-gci-gce-serial-1-3 rm -r gs://k8s-jkns-gci-gce-serial-1-3-state-b0 I0124 02:48:39.293581 5519 local.go:42] ⚙️ gsutil -u k8s-jkns-gci-gce-serial-1-3 rm -r gs://k8s-jkns-gci-gce-serial-1-3-state-b0 Removing gs://k8s-jkns-gci-gce-serial-1-3-state-b0/... I0124 02:48:42.010623 5519 down.go:62] releasing boskos project I0124 02:48:42.019127 5519 boskos.go:83] Boskos heartbeat func received signal to close Error: exit status 1 + EXIT_VALUE=1 + set +o xtrace