This job view page is being replaced by Spyglass soon. Check out the new job view.
PRhakman: [WIP] Experiment with IPv6
ResultFAILURE
Tests 0 failed / 0 succeeded
Started2021-06-27 15:21
Elapsed23m7s
Revision81856d5f00044116aa32bdd8aefb4bd48877d9e3
Refs 11874

No Test Failures!


Error lines from build-log.txt

... skipping 489 lines ...
I0627 15:26:22.321896    4244 dumplogs.go:38] /home/prow/go/src/k8s.io/kops/bazel-bin/cmd/kops/linux-amd64/kops toolbox dump --name e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io --dir /logs/artifacts --private-key /etc/aws-ssh/aws-ssh-private --ssh-user ubuntu
I0627 15:26:22.337502   11812 featureflag.go:165] FeatureFlag "SpecOverrideFlag"=true
I0627 15:26:22.337871   11812 featureflag.go:165] FeatureFlag "AlphaAllowGCE"=true
I0627 15:26:22.337880   11812 featureflag.go:165] FeatureFlag "AWSIPv6"=true

Cluster.kops.k8s.io "e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io" not found
W0627 15:26:22.841759    4244 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1
I0627 15:26:22.841836    4244 down.go:48] /home/prow/go/src/k8s.io/kops/bazel-bin/cmd/kops/linux-amd64/kops delete cluster --name e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io --yes
I0627 15:26:22.856543   11823 featureflag.go:165] FeatureFlag "SpecOverrideFlag"=true
I0627 15:26:22.856627   11823 featureflag.go:165] FeatureFlag "AlphaAllowGCE"=true
I0627 15:26:22.856632   11823 featureflag.go:165] FeatureFlag "AWSIPv6"=true

error reading cluster configuration: Cluster.kops.k8s.io "e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io" not found
I0627 15:26:23.335448    4244 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip
2021/06/27 15:26:23 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404
I0627 15:26:23.343201    4244 http.go:37] curl https://ip.jsb.workers.dev
I0627 15:26:23.474363    4244 up.go:144] /home/prow/go/src/k8s.io/kops/bazel-bin/cmd/kops/linux-amd64/kops create cluster --name e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io --cloud aws --kubernetes-version https://storage.googleapis.com/kubernetes-release-dev/ci/v1.22.0-beta.0.145+a0f9c8c2778b97 --ssh-public-key /etc/aws-ssh/aws-ssh-public --override cluster.spec.nodePortAccess=0.0.0.0/0 --yes --image=099720109477/ubuntu/images/hvm-ssd/ubuntu-hirsute-21.04-amd64-server-20210622.1 --channel=alpha --networking=calico --container-runtime=containerd --ipv6 --override=cluster.spec.api.loadBalancer.type=Public --override=cluster.spec.api.loadBalancer.class=Network --override=cluster.spec.api.loadBalancer.useForInternalApi=true --override=cluster.spec.cloudControllerManager.cloudProvider=aws --override=cluster.spec.cloudControllerManager.image=hakman/cloud-controller-manager:ipv6-1 --override=cluster.spec.nonMasqueradeCIDR=fd00:10:96::/64 --override=cluster.spec.kubeDNS.upstreamNameservers=2620:119:53::53 --admin-access 34.134.51.8/32 --master-count 1 --master-volume-size 48 --node-count 4 --node-volume-size 48 --zones ca-central-1a --master-size c5.large
I0627 15:26:23.490719   11833 featureflag.go:165] FeatureFlag "SpecOverrideFlag"=true
I0627 15:26:23.490896   11833 featureflag.go:165] FeatureFlag "AlphaAllowGCE"=true
I0627 15:26:23.490927   11833 featureflag.go:165] FeatureFlag "AWSIPv6"=true
I0627 15:26:23.533124   11833 create_cluster.go:739] Using SSH public key: /etc/aws-ssh/aws-ssh-public
... skipping 36 lines ...
I0627 15:26:50.644217    4244 up.go:181] /home/prow/go/src/k8s.io/kops/bazel-bin/cmd/kops/linux-amd64/kops validate cluster --name e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io --count 10 --wait 15m0s
I0627 15:26:50.661385   11854 featureflag.go:165] FeatureFlag "SpecOverrideFlag"=true
I0627 15:26:50.661485   11854 featureflag.go:165] FeatureFlag "AlphaAllowGCE"=true
I0627 15:26:50.661490   11854 featureflag.go:165] FeatureFlag "AWSIPv6"=true
Validating cluster e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io

W0627 15:26:51.624239   11854 validate_cluster.go:173] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
W0627 15:27:01.654867   11854 validate_cluster.go:173] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
W0627 15:27:11.720740   11854 validate_cluster.go:173] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
W0627 15:27:21.764665   11854 validate_cluster.go:173] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
W0627 15:27:31.808186   11854 validate_cluster.go:173] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
W0627 15:27:41.863519   11854 validate_cluster.go:173] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
W0627 15:27:51.907967   11854 validate_cluster.go:173] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
W0627 15:28:01.956607   11854 validate_cluster.go:173] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
W0627 15:28:12.000849   11854 validate_cluster.go:173] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
W0627 15:28:22.374170   11854 validate_cluster.go:173] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
W0627 15:28:32.406146   11854 validate_cluster.go:173] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
W0627 15:28:42.434648   11854 validate_cluster.go:173] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
W0627 15:28:52.464001   11854 validate_cluster.go:173] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
W0627 15:29:02.502275   11854 validate_cluster.go:173] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
W0627 15:29:12.537435   11854 validate_cluster.go:173] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
W0627 15:29:22.574004   11854 validate_cluster.go:173] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
W0627 15:29:32.604348   11854 validate_cluster.go:173] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
W0627 15:29:42.632376   11854 validate_cluster.go:173] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
W0627 15:29:52.677923   11854 validate_cluster.go:173] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
W0627 15:30:02.712973   11854 validate_cluster.go:173] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
W0627 15:30:12.740605   11854 validate_cluster.go:173] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
W0627 15:30:22.820481   11854 validate_cluster.go:173] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
W0627 15:30:32.879773   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp [2600:1f11:b93:e501:f8c4:b8ef:c1e3:59d9]:443: connect: network is unreachable
W0627 15:30:42.898248   11854 validate_cluster.go:173] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
W0627 15:30:52.918934   11854 validate_cluster.go:173] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
W0627 15:31:02.936449   11854 validate_cluster.go:173] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
W0627 15:31:12.951858   11854 validate_cluster.go:173] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
W0627 15:31:23.035778   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:31:33.111484   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:31:43.205311   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:31:53.262903   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp [2600:1f11:b93:e501:f8c4:b8ef:c1e3:59d9]:443: connect: network is unreachable
W0627 15:32:03.333360   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp [2600:1f11:b93:e501:f8c4:b8ef:c1e3:59d9]:443: connect: network is unreachable
W0627 15:32:13.418293   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:32:23.481820   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:32:33.569145   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:32:43.643822   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:32:53.700721   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp: lookup api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
W0627 15:33:03.773773   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:33:13.853829   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:33:23.945628   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:33:35.657673   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp [2600:1f11:b93:e501:f8c4:b8ef:c1e3:59d9]:443: connect: network is unreachable
W0627 15:33:45.771556   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:33:55.863118   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:34:05.957008   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:34:16.041847   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:34:26.132132   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:34:36.192657   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:34:46.229639   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp [2600:1f11:b93:e501:f8c4:b8ef:c1e3:59d9]:443: connect: network is unreachable
W0627 15:34:56.315218   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:35:06.386196   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:35:16.486053   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:35:26.591846   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:35:36.670391   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:35:46.754780   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:35:56.854194   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:36:06.934144   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:36:16.995578   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:36:27.073125   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:36:37.174047   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:36:47.276113   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:36:57.399370   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:37:07.493384   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:37:17.567737   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:37:27.628758   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:37:37.713134   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:37:47.879676   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:37:58.002634   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:38:08.127752   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:38:18.213777   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:38:28.278803   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:38:38.350066   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:38:48.436064   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:38:58.698161   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:39:08.786004   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:39:18.846361   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:39:28.920717   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:39:39.003320   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:39:49.068170   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:39:59.145522   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:40:09.235242   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:40:19.337513   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:40:29.426362   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:40:39.502753   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:40:49.580755   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:40:59.759558   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:41:09.908838   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:41:19.986047   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:41:30.081601   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:41:40.181862   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
W0627 15:41:50.274423   11854 validate_cluster.go:173] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused

Validation failed: wait time exceeded during validation
I0627 15:42:00.280409    4244 dumplogs.go:38] /home/prow/go/src/k8s.io/kops/bazel-bin/cmd/kops/linux-amd64/kops toolbox dump --name e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io --dir /logs/artifacts --private-key /etc/aws-ssh/aws-ssh-private --ssh-user ubuntu
I0627 15:42:00.298164   11865 featureflag.go:165] FeatureFlag "SpecOverrideFlag"=true
I0627 15:42:00.298280   11865 featureflag.go:165] FeatureFlag "AlphaAllowGCE"=true
I0627 15:42:00.298285   11865 featureflag.go:165] FeatureFlag "AWSIPv6"=true
W0627 15:42:06.723579   11865 toolbox_dump.go:180] error listing nodes in cluster: Get "https://api.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 3.98.208.132:443: connect: connection refused
2021/06/27 15:42:06 dumping node not registered in kubernetes: 35.182.249.111
2021/06/27 15:42:06 Dumping node 35.182.249.111
2021/06/27 15:42:09 dumping node not registered in kubernetes: 3.96.205.0
2021/06/27 15:42:09 Dumping node 3.96.205.0
2021/06/27 15:42:11 dumping node not registered in kubernetes: 35.183.236.92
2021/06/27 15:42:11 Dumping node 35.183.236.92
... skipping 1122 lines ...
  zone: ca-central-1a
vpc:
  id: vpc-0fde77d7a6055bace
I0627 15:42:17.447304    4244 dumplogs.go:70] /home/prow/go/src/k8s.io/kops/bazel-bin/cmd/kops/linux-amd64/kops get cluster --name e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io -o yaml
I0627 15:42:17.985061    4244 dumplogs.go:70] /home/prow/go/src/k8s.io/kops/bazel-bin/cmd/kops/linux-amd64/kops get instancegroups --name e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io -o yaml
I0627 15:42:18.845964    4244 dumplogs.go:89] kubectl cluster-info dump --all-namespaces -o yaml --output-directory /logs/artifacts/cluster-info
W0627 15:42:19.252400    4244 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1
I0627 15:42:19.252447    4244 down.go:48] /home/prow/go/src/k8s.io/kops/bazel-bin/cmd/kops/linux-amd64/kops delete cluster --name e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io --yes
I0627 15:42:19.270343   11908 featureflag.go:165] FeatureFlag "SpecOverrideFlag"=true
I0627 15:42:19.270446   11908 featureflag.go:165] FeatureFlag "AlphaAllowGCE"=true
I0627 15:42:19.270451   11908 featureflag.go:165] FeatureFlag "AWSIPv6"=true
TYPE			NAME													ID
autoscaling-config	master-ca-central-1a.masters.e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io					lt-0429f7e0f9f9c90e9
... skipping 289 lines ...
route-table:rtb-010fe10f5c1cc6445	ok
vpc:vpc-0fde77d7a6055bace	ok
dhcp-options:dopt-012221a08eeaf8508	ok
Deleted kubectl config for e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io

Deleted cluster: "e2e-786ab8c4d7-b7ef6.test-cncf-aws.k8s.io"
Error: exit status 1
+ EXIT_VALUE=1
+ set +o xtrace
Cleaning up after docker in docker.
================================================================================
Cleaning up after docker
Stopping Docker: dockerProgram process in pidfile '/var/run/docker-ssd.pid', 1 process(es), refused to die.
... skipping 3 lines ...