PR #114068 pull-kubernetes-e2e-gce-alpha-features #1595046537447084032
Recent runs || View in Spyglass
Recent runs || View in Spyglass
| PR | cyclinder: remove GA feature-gate for 1.27 |
| Result | FAILURE |
| Tests | 1 failed / 9 succeeded |
| Started | |
| Elapsed | 39m43s |
| Revision | |
| Builder | 89f379e1-6a69-11ed-98db-f202eff4d0bd |
| Refs |
master:57eb5d63 114068:b8624b7d |
| infra-commit | b27527630 |
| job-version | v1.27.0-alpha.0.34+9c5760f1bd6517 |
| kubetest-version | v20221116-7c85504268 |
| repo | k8s.io/kubernetes |
| repo-commit | 9c5760f1bd6517ccf1448130ebb5d12b45cf9dda |
| repos | {u'k8s.io/kubernetes': u'master:57eb5d631ccd615cd161b6da36afc759af004b93,114068:b8624b7d3a9311957864f6907aa511415e13a201', u'k8s.io/release': u'master'} |
| revision | v1.27.0-alpha.0.34+9c5760f1bd6517 |
error during ./hack/e2e-internal/e2e-up.sh: exit status 2
from junit_runner.xml
Filter through log files
kubetest Build
kubetest Deferred TearDown
kubetest DumpClusterLogs (--up failed)
kubetest Extract
kubetest GetDeployer
kubetest Prepare
kubetest Stage
kubetest TearDown Previous
kubetest Timeout
... skipping 703 lines ... W1122 13:55:01.460] NODE_NAMES=e2e-4d5e117603-cc220-minion-group-3m2n e2e-4d5e117603-cc220-minion-group-4wtc e2e-4d5e117603-cc220-minion-group-6db4 W1122 13:55:01.460] Trying to find master named 'e2e-4d5e117603-cc220-master' W1122 13:55:01.460] Looking for address 'e2e-4d5e117603-cc220-master-ip' I1122 13:55:02.954] Waiting up to 300 seconds for cluster initialization. I1122 13:55:02.954] I1122 13:55:02.955] This will continually check to see if the API for kubernetes is reachable. I1122 13:55:02.955] This may time out if there was some uncaught error during start up. I1122 13:55:02.955] W1122 13:55:03.055] Using master: e2e-4d5e117603-cc220-master (external IP: 35.233.255.57; internal IP: (not set)) I1122 14:00:04.665] ...........................................................................................................................................Checking for custom logdump instances, if any I1122 14:00:04.672] ---------------------------------------------------------------------------------------------------- I1122 14:00:04.672] k/k version of the log-dump.sh script is deprecated! I1122 14:00:04.672] Please migrate your test job to use test-infra's repo version of log-dump.sh! ... skipping 2 lines ... I1122 14:00:04.674] Sourcing kube-util.sh I1122 14:00:04.733] Detecting project I1122 14:00:04.733] Project: k8s-jkns-e2e-protobuf I1122 14:00:04.734] Network Project: k8s-jkns-e2e-protobuf I1122 14:00:04.734] Zone: us-west1-b I1122 14:00:04.745] Dumping logs from master locally to '/workspace/_artifacts' W1122 14:00:04.846] [0;31mCluster failed to initialize within 300 seconds.[0m W1122 14:00:04.846] Last output from querying API server follows: W1122 14:00:04.846] ----------------------------------------------------- W1122 14:00:04.847] * Expire in 0 ms for 6 (transfer 0x55ba893510f0) W1122 14:00:04.847] * Expire in 5000 ms for 8 (transfer 0x55ba893510f0) W1122 14:00:04.847] * Trying 35.233.255.57... W1122 14:00:04.847] * TCP_NODELAY set W1122 14:00:04.847] * Expire in 200 ms for 4 (transfer 0x55ba893510f0) W1122 14:00:04.847] * connect to 35.233.255.57 port 443 failed: Connection refused W1122 14:00:04.848] * Failed to connect to 35.233.255.57 port 443: Connection refused W1122 14:00:04.848] * Closing connection 0 W1122 14:00:04.848] curl: (7) Failed to connect to 35.233.255.57 port 443: Connection refused W1122 14:00:04.848] ----------------------------------------------------- W1122 14:00:04.848] 2022/11/22 14:00:04 process.go:155: Step './hack/e2e-internal/e2e-up.sh' finished in 7m14.109999413s W1122 14:00:04.849] 2022/11/22 14:00:04 e2e.go:572: Dumping logs locally to: /workspace/_artifacts W1122 14:00:04.849] 2022/11/22 14:00:04 process.go:153: Running: ./cluster/log-dump/log-dump.sh /workspace/_artifacts W1122 14:00:04.849] Trying to find master named 'e2e-4d5e117603-cc220-master' W1122 14:00:04.849] Looking for address 'e2e-4d5e117603-cc220-master-ip' ... skipping 5 lines ... W1122 14:01:34.953] scp: /var/log/glbc.log*: No such file or directory W1122 14:01:34.953] scp: /var/log/cluster-autoscaler.log*: No such file or directory W1122 14:01:34.954] scp: /var/log/kube-addon-manager.log*: No such file or directory W1122 14:01:35.033] scp: /var/log/fluentd.log*: No such file or directory W1122 14:01:35.033] scp: /var/log/kubelet.cov*: No such file or directory W1122 14:01:35.034] scp: /var/log/startupscript.log*: No such file or directory W1122 14:01:35.042] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1]. I1122 14:01:35.352] Dumping logs from nodes locally to '/workspace/_artifacts' I1122 14:01:35.353] Detecting nodes in the cluster I1122 14:02:44.373] Changing logfiles to be world-readable for download I1122 14:02:44.407] Changing logfiles to be world-readable for download I1122 14:02:46.628] Changing logfiles to be world-readable for download I1122 14:02:49.416] Copying 'kube-proxy.log containers/konnectivity-agent-*.log fluentd.log node-problem-detector.log kubelet.cov startupscript.log' from e2e-4d5e117603-cc220-minion-group-4wtc ... skipping 8 lines ... W1122 14:02:53.313] scp: /var/log/fluentd.log*: No such file or directory W1122 14:02:53.313] scp: /var/log/node-problem-detector.log*: No such file or directory W1122 14:02:53.313] scp: /var/log/kubelet.cov*: No such file or directory W1122 14:02:53.313] scp: /var/log/startupscript.log*: No such file or directory W1122 14:02:53.314] W1122 14:02:53.314] Specify --start=111341 in the next get-serial-port-output invocation to get only the new output starting from here. W1122 14:02:53.318] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1]. W1122 14:02:53.420] scp: /var/log/kube-proxy.log*: No such file or directory W1122 14:02:53.421] scp: /var/log/containers/konnectivity-agent-*.log*: No such file or directory W1122 14:02:53.421] scp: /var/log/fluentd.log*: No such file or directory W1122 14:02:53.422] scp: /var/log/node-problem-detector.log*: No such file or directory W1122 14:02:53.422] scp: /var/log/kubelet.cov*: No such file or directory W1122 14:02:53.422] scp: /var/log/startupscript.log*: No such file or directory W1122 14:02:53.426] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1]. W1122 14:02:55.776] scp: /var/log/kube-proxy.log*: No such file or directory W1122 14:02:55.777] scp: /var/log/containers/konnectivity-agent-*.log*: No such file or directory W1122 14:02:55.777] scp: /var/log/fluentd.log*: No such file or directory W1122 14:02:55.778] scp: /var/log/node-problem-detector.log*: No such file or directory W1122 14:02:55.778] scp: /var/log/kubelet.cov*: No such file or directory W1122 14:02:55.778] scp: /var/log/startupscript.log*: No such file or directory W1122 14:02:55.783] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1]. W1122 14:03:01.649] INSTANCE_GROUPS=e2e-4d5e117603-cc220-minion-group W1122 14:03:01.649] NODE_NAMES=e2e-4d5e117603-cc220-minion-group-3m2n e2e-4d5e117603-cc220-minion-group-4wtc e2e-4d5e117603-cc220-minion-group-6db4 I1122 14:03:03.566] Failures for e2e-4d5e117603-cc220-minion-group (if any): W1122 14:03:05.415] 2022/11/22 14:03:05 process.go:155: Step './cluster/log-dump/log-dump.sh /workspace/_artifacts' finished in 3m0.752259009s W1122 14:03:05.416] 2022/11/22 14:03:05 process.go:153: Running: ./hack/e2e-internal/e2e-down.sh W1122 14:03:05.478] Project: k8s-jkns-e2e-protobuf ... skipping 15 lines ... W1122 14:03:20.484] Deleting Managed Instance Group... W1122 14:03:47.774] ..Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-protobuf/zones/us-west1-b/instanceGroupManagers/e2e-4d5e117603-cc220-minion-group]. W1122 14:03:47.775] done. W1122 14:03:53.831] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-protobuf/global/instanceTemplates/e2e-4d5e117603-cc220-minion-template]. W1122 14:03:54.471] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-protobuf/global/instanceTemplates/e2e-4d5e117603-cc220-windows-node-template]. I1122 14:05:02.592] Removing etcd replica, name: e2e-4d5e117603-cc220-master, port: 2379, result: 1 W1122 14:05:02.695] Failed to execute 'curl -s --cacert /etc/srv/kubernetes/pki/etcd-apiserver-ca.crt --cert /etc/srv/kubernetes/pki/etcd-apiserver-client.crt --key /etc/srv/kubernetes/pki/etcd-apiserver-client.key https://127.0.0.1:2379/v2/members/$(curl -s --cacert /etc/srv/kubernetes/pki/etcd-apiserver-ca.crt --cert /etc/srv/kubernetes/pki/etcd-apiserver-client.crt --key /etc/srv/kubernetes/pki/etcd-apiserver-client.key https://127.0.0.1:2379/v2/members -XGET | sed 's/{\"id/\n/g' | grep e2e-4d5e117603-cc220-master\" | cut -f 3 -d \") -XDELETE -L 2>/dev/null' on e2e-4d5e117603-cc220-master despite 5 attempts W1122 14:05:02.695] Last attempt failed with: I1122 14:06:09.174] Removing etcd replica, name: e2e-4d5e117603-cc220-master, port: 4002, result: 1 W1122 14:06:09.275] Failed to execute 'curl -s http://127.0.0.1:4002/v2/members/$(curl -s http://127.0.0.1:4002/v2/members -XGET | sed 's/{\"id/\n/g' | grep e2e-4d5e117603-cc220-master\" | cut -f 3 -d \") -XDELETE -L 2>/dev/null' on e2e-4d5e117603-cc220-master despite 5 attempts W1122 14:06:09.276] Last attempt failed with: W1122 14:06:14.661] Updated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-protobuf/zones/us-west1-b/instances/e2e-4d5e117603-cc220-master]. W1122 14:06:30.362] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-protobuf/zones/us-west1-b/instances/e2e-4d5e117603-cc220-master]. W1122 14:06:34.033] WARNING: The following filter keys were not present in any resource : name W1122 14:06:42.842] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-protobuf/global/firewalls/e2e-4d5e117603-cc220-master-https]. W1122 14:06:45.309] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-protobuf/global/firewalls/e2e-4d5e117603-cc220-master-etcd]. W1122 14:06:47.381] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-protobuf/global/firewalls/e2e-4d5e117603-cc220-minion-all]. ... skipping 21 lines ... I1122 14:07:55.302] Cleared config for k8s-jkns-e2e-protobuf_e2e-4d5e117603-cc220 from /workspace/.kube/config I1122 14:07:55.303] Done W1122 14:07:55.341] W1122 14:07:55.297576 86154 loader.go:222] Config not found: /workspace/.kube/config W1122 14:07:55.342] W1122 14:07:55.297775 86154 loader.go:222] Config not found: /workspace/.kube/config W1122 14:07:55.342] 2022/11/22 14:07:55 process.go:155: Step './hack/e2e-internal/e2e-down.sh' finished in 4m49.888767508s W1122 14:07:55.342] 2022/11/22 14:07:55 process.go:96: Saved XML output to /workspace/_artifacts/junit_runner.xml. W1122 14:07:55.343] 2022/11/22 14:07:55 main.go:328: Something went wrong: starting e2e cluster: error during ./hack/e2e-internal/e2e-up.sh: exit status 2 W1122 14:07:55.343] Traceback (most recent call last): W1122 14:07:55.343] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 723, in <module> W1122 14:07:55.343] main(parse_args()) W1122 14:07:55.343] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 569, in main W1122 14:07:55.344] mode.start(runner_args) W1122 14:07:55.344] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 228, in start W1122 14:07:55.344] check_env(env, self.command, *args) W1122 14:07:55.344] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 111, in check_env W1122 14:07:55.344] subprocess.check_call(cmd, env=env) W1122 14:07:55.345] File "/usr/lib/python2.7/subprocess.py", line 190, in check_call W1122 14:07:55.345] raise CalledProcessError(retcode, cmd) W1122 14:07:55.346] subprocess.CalledProcessError: Command '('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--build=quick', '--stage=gs://kubernetes-release-pull/ci/pull-kubernetes-e2e-gce-alpha-features', '--up', '--down', '--test', '--provider=gce', '--cluster=e2e-4d5e117603-cc220', '--gcp-network=e2e-4d5e117603-cc220', '--ginkgo-parallel=1', '--extract=local', '--gcp-node-image=gci', '--gcp-zone=us-west1-b', '--runtime-config=api/all=true', '--test_args=--ginkgo.focus=\\[Feature:(GRPCContainerProbe|InPlacePodVerticalScaling|ProbeTerminationGracePeriod|APIServerTracing|APISelfSubjectReview|StorageVersionAPI|PodPreset|StatefulSetMinReadySeconds|ProxyTerminatingEndpoints|NodeOutOfServiceVolumeDetach|RetroactiveDefaultStorageClass|ReadWriteOncePod)\\]|Networking --ginkgo.skip=\\[Feature:(SCTPConnectivity|Volumes|Networking-Performance)\\]|IPv6|csi-hostpath-v0 --minStartupPods=8', '--timeout=180m')' returned non-zero exit status 1 E1122 14:07:55.346] Command failed I1122 14:07:55.346] process 663 exited with code 1 after 37.9m E1122 14:07:55.347] FAIL: pull-kubernetes-e2e-gce-alpha-features I1122 14:07:55.347] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W1122 14:07:56.246] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com] I1122 14:07:56.455] process 86163 exited with code 0 after 0.0m I1122 14:07:56.456] Call: gcloud config get-value account I1122 14:07:57.448] process 86173 exited with code 0 after 0.0m I1122 14:07:57.449] Will upload results to gs://kubernetes-jenkins/pr-logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com I1122 14:07:57.449] Upload result and artifacts... I1122 14:07:57.449] Gubernator results at https://gubernator.k8s.io/build/kubernetes-jenkins/pr-logs/pull/114068/pull-kubernetes-e2e-gce-alpha-features/1595046537447084032 I1122 14:07:57.450] Call: gsutil ls gs://kubernetes-jenkins/pr-logs/pull/114068/pull-kubernetes-e2e-gce-alpha-features/1595046537447084032/artifacts W1122 14:07:59.082] CommandException: One or more URLs matched no objects. E1122 14:07:59.430] Command failed I1122 14:07:59.431] process 86183 exited with code 1 after 0.0m W1122 14:07:59.431] Remote dir gs://kubernetes-jenkins/pr-logs/pull/114068/pull-kubernetes-e2e-gce-alpha-features/1595046537447084032/artifacts not exist yet I1122 14:07:59.431] Call: gsutil -m -q -o GSUtil:use_magicfile=True cp -r -c -z log,txt,xml /workspace/_artifacts gs://kubernetes-jenkins/pr-logs/pull/114068/pull-kubernetes-e2e-gce-alpha-features/1595046537447084032/artifacts I1122 14:08:02.684] process 86317 exited with code 0 after 0.1m I1122 14:08:02.685] Call: git rev-parse HEAD I1122 14:08:02.723] process 86947 exited with code 0 after 0.0m ... skipping 20 lines ...