ci-kubernetes-e2e-gce-iscsi #1531631137552601088
Recent runs || View in Spyglass
error during ./hack/e2e-internal/e2e-up.sh: exit status 2
from junit_runner.xml
Filter through log files | View test history on testgrid
kubetest Deferred TearDown
kubetest DumpClusterLogs (--up failed)
kubetest Extract
kubetest GetDeployer
kubetest Prepare
kubetest TearDown Previous
kubetest Timeout
kubetest listResources Before
... skipping 15 lines ... I0531 13:38:20.059] process 57 exited with code 0 after 0.0m I0531 13:38:20.059] Will upload results to gs://kubernetes-jenkins/logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com I0531 13:38:20.060] Root: /workspace I0531 13:38:20.060] cd to /workspace I0531 13:38:20.060] Configure environment... I0531 13:38:20.060] Call: git show -s --format=format:%ct HEAD W0531 13:38:20.064] fatal: not a git repository (or any of the parent directories): .git I0531 13:38:20.065] process 71 exited with code 128 after 0.0m W0531 13:38:20.065] Unable to print commit date for HEAD I0531 13:38:20.065] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W0531 13:38:20.807] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com] I0531 13:38:21.086] process 72 exited with code 0 after 0.0m I0531 13:38:21.087] Call: gcloud config get-value account ... skipping 318 lines ... I0531 13:41:06.909] Generate peer certificates... I0531 13:41:06.910] Generate server certificates... I0531 13:41:06.910] Generate client certificates... I0531 13:41:06.969] NAME NETWORK DIRECTION PRIORITY ALLOW DENY DISABLED I0531 13:41:06.970] bootstrap-e2e-master-etcd bootstrap-e2e INGRESS 1000 tcp:2380,tcp:2381 False W0531 13:41:07.070] done. W0531 13:41:08.834] ERROR: (gcloud.compute.instances.create) Must specify either [--image] or [--image-family] when specifying [--image-project] flag. W0531 13:41:08.835] Failed to create master instance due to non-retryable error W0531 13:41:16.471] Creating firewall... W0531 13:41:16.472] ..Created [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gci-gce-alpha/global/firewalls/bootstrap-e2e-minion-all]. I0531 13:41:16.732] NAME NETWORK DIRECTION PRIORITY ALLOW DENY DISABLED I0531 13:41:16.733] bootstrap-e2e-minion-all bootstrap-e2e INGRESS 1000 tcp,udp,icmp,esp,ah,sctp False W0531 13:41:16.833] done. I0531 13:41:16.974] Creating nodes. W0531 13:41:17.074] [0;31mSome commands failed.[0m W0531 13:41:19.035] /workspace/kubernetes/cluster/../cluster/../cluster/gce/util.sh: line 1525: WINDOWS_CONTAINER_RUNTIME: unbound variable W0531 13:41:19.085] /workspace/kubernetes/cluster/../cluster/../cluster/gce/util.sh: line 1525: WINDOWS_ENABLE_HYPERV: unbound variable I0531 13:41:19.186] Using subnet bootstrap-e2e W0531 13:41:20.408] Attempt 1 to create bootstrap-e2e-minion-template W0531 13:41:21.527] WARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance. W0531 13:41:24.610] Created [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gci-gce-alpha/global/instanceTemplates/bootstrap-e2e-minion-template]. ... skipping 14 lines ... W0531 13:41:56.424] NODE_NAMES=bootstrap-e2e-minion-group-0zx9 bootstrap-e2e-minion-group-10b1 bootstrap-e2e-minion-group-8cxm W0531 13:41:56.424] Trying to find master named 'bootstrap-e2e-master' W0531 13:41:56.424] Looking for address 'bootstrap-e2e-master-ip' I0531 13:41:57.697] Waiting up to 300 seconds for cluster initialization. I0531 13:41:57.698] I0531 13:41:57.698] This will continually check to see if the API for kubernetes is reachable. I0531 13:41:57.698] This may time out if there was some uncaught error during start up. I0531 13:41:57.698] W0531 13:41:57.799] Using master: bootstrap-e2e-master (external IP: 34.168.166.253; internal IP: (not set)) I0531 13:47:04.434] ...........................................Checking for custom logdump instances, if any I0531 13:47:04.440] ---------------------------------------------------------------------------------------------------- I0531 13:47:04.440] k/k version of the log-dump.sh script is deprecated! I0531 13:47:04.441] Please migrate your test job to use test-infra's repo version of log-dump.sh! ... skipping 2 lines ... I0531 13:47:04.442] Sourcing kube-util.sh I0531 13:47:04.503] Detecting project I0531 13:47:04.503] Project: k8s-jkns-e2e-gci-gce-alpha I0531 13:47:04.504] Network Project: k8s-jkns-e2e-gci-gce-alpha I0531 13:47:04.504] Zone: us-west1-b I0531 13:47:04.514] Dumping logs from master locally to '/workspace/_artifacts' W0531 13:47:04.614] [0;31mCluster failed to initialize within 300 seconds.[0m W0531 13:47:04.615] Last output from querying API server follows: W0531 13:47:04.615] ----------------------------------------------------- W0531 13:47:04.615] * Expire in 0 ms for 6 (transfer 0x557a1f2490f0) W0531 13:47:04.615] * Expire in 5000 ms for 8 (transfer 0x557a1f2490f0) W0531 13:47:04.615] * Trying 34.168.166.253... W0531 13:47:04.616] * TCP_NODELAY set ... skipping 5 lines ... W0531 13:47:04.617] 2022/05/31 13:47:04 process.go:155: Step './hack/e2e-internal/e2e-up.sh' finished in 7m17.048268565s W0531 13:47:04.617] 2022/05/31 13:47:04 e2e.go:574: Dumping logs locally to: /workspace/_artifacts W0531 13:47:04.617] 2022/05/31 13:47:04 process.go:153: Running: ./cluster/log-dump/log-dump.sh /workspace/_artifacts W0531 13:47:04.617] Trying to find master named 'bootstrap-e2e-master' W0531 13:47:04.617] Looking for address 'bootstrap-e2e-master-ip' W0531 13:47:05.820] Using master: bootstrap-e2e-master (external IP: 34.168.166.253; internal IP: (not set)) W0531 13:47:39.510] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0531 13:47:39.510] - The resource 'projects/k8s-jkns-e2e-gci-gce-alpha/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0531 13:47:39.511] W0531 13:47:45.793] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0531 13:47:45.793] - The resource 'projects/k8s-jkns-e2e-gci-gce-alpha/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0531 13:47:45.793] W0531 13:47:52.069] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0531 13:47:52.069] - The resource 'projects/k8s-jkns-e2e-gci-gce-alpha/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0531 13:47:52.069] W0531 13:47:58.353] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0531 13:47:58.354] - The resource 'projects/k8s-jkns-e2e-gci-gce-alpha/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0531 13:47:58.354] W0531 13:48:04.594] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0531 13:48:04.595] - The resource 'projects/k8s-jkns-e2e-gci-gce-alpha/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0531 13:48:04.595] W0531 13:48:10.825] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0531 13:48:10.826] - The resource 'projects/k8s-jkns-e2e-gci-gce-alpha/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0531 13:48:10.826] W0531 13:48:12.116] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0531 13:48:12.117] - The resource 'projects/k8s-jkns-e2e-gci-gce-alpha/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0531 13:48:12.117] W0531 13:48:18.458] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0531 13:48:18.459] - The resource 'projects/k8s-jkns-e2e-gci-gce-alpha/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0531 13:48:18.459] W0531 13:48:24.723] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0531 13:48:24.724] - The resource 'projects/k8s-jkns-e2e-gci-gce-alpha/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0531 13:48:24.724] W0531 13:48:30.973] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0531 13:48:30.974] - The resource 'projects/k8s-jkns-e2e-gci-gce-alpha/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0531 13:48:30.974] W0531 13:48:37.234] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0531 13:48:37.235] - The resource 'projects/k8s-jkns-e2e-gci-gce-alpha/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0531 13:48:37.235] W0531 13:48:43.516] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0531 13:48:43.517] - The resource 'projects/k8s-jkns-e2e-gci-gce-alpha/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0531 13:48:43.517] I0531 13:49:16.378] Changing logfiles to be world-readable for download W0531 13:49:17.357] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0531 13:49:17.358] - The resource 'projects/k8s-jkns-e2e-gci-gce-alpha/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0531 13:49:17.358] W0531 13:49:23.620] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0531 13:49:23.620] - The resource 'projects/k8s-jkns-e2e-gci-gce-alpha/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0531 13:49:23.620] W0531 13:49:29.907] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0531 13:49:29.907] - The resource 'projects/k8s-jkns-e2e-gci-gce-alpha/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0531 13:49:29.907] W0531 13:49:36.171] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0531 13:49:36.171] - The resource 'projects/k8s-jkns-e2e-gci-gce-alpha/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0531 13:49:36.171] W0531 13:49:42.431] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0531 13:49:42.431] - The resource 'projects/k8s-jkns-e2e-gci-gce-alpha/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0531 13:49:42.431] W0531 13:49:48.674] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0531 13:49:48.675] - The resource 'projects/k8s-jkns-e2e-gci-gce-alpha/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0531 13:49:48.675] I0531 13:49:48.942] Copying 'kube-apiserver.log kube-apiserver-audit.log kube-scheduler.log kube-controller-manager.log etcd.log etcd-events.log glbc.log cluster-autoscaler.log kube-addon-manager.log konnectivity-server.log fluentd.log kubelet.cov startupscript.log kern.log docker/log kubelet.log supervisor/supervisord.log supervisor/kubelet-stdout.log supervisor/kubelet-stderr.log supervisor/docker-stdout.log supervisor/docker-stderr.log' from bootstrap-e2e-master W0531 13:49:49.926] ERROR: (gcloud.compute.instances.get-serial-port-output) Could not fetch serial port output: The resource 'projects/k8s-jkns-e2e-gci-gce-alpha/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0531 13:49:51.140] ERROR: (gcloud.compute.scp) Could not fetch resource: W0531 13:49:51.140] - The resource 'projects/k8s-jkns-e2e-gci-gce-alpha/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0531 13:49:51.140] I0531 13:49:51.398] Dumping logs from nodes locally to '/workspace/_artifacts' I0531 13:49:51.398] Detecting nodes in the cluster W0531 13:50:50.848] sudo: docker: command not found W0531 13:50:53.205] sudo: docker: command not found ... skipping 10 lines ... W0531 13:51:04.723] Specify --start=1152396 in the next get-serial-port-output invocation to get only the new output starting from here. W0531 13:51:04.725] scp: /var/log/containers/konnectivity-agent-*.log*: No such file or directory W0531 13:51:04.725] scp: /var/log/fluentd.log*: No such file or directory W0531 13:51:04.725] scp: /var/log/node-problem-detector.log*: No such file or directory W0531 13:51:04.726] scp: /var/log/kubelet.cov*: No such file or directory W0531 13:51:04.726] scp: /var/log/startupscript.log*: No such file or directory W0531 13:51:04.732] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1]. W0531 13:51:06.081] W0531 13:51:06.082] Specify --start=1151987 in the next get-serial-port-output invocation to get only the new output starting from here. W0531 13:51:07.311] scp: /var/log/containers/konnectivity-agent-*.log*: No such file or directory W0531 13:51:07.311] scp: /var/log/fluentd.log*: No such file or directory W0531 13:51:07.311] scp: /var/log/node-problem-detector.log*: No such file or directory W0531 13:51:07.311] scp: /var/log/kubelet.cov*: No such file or directory W0531 13:51:07.312] scp: /var/log/startupscript.log*: No such file or directory W0531 13:51:07.316] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1]. W0531 13:51:08.670] scp: /var/log/containers/konnectivity-agent-*.log*: No such file or directory W0531 13:51:08.671] scp: /var/log/fluentd.log*: No such file or directory W0531 13:51:08.671] scp: /var/log/node-problem-detector.log*: No such file or directory W0531 13:51:08.671] scp: /var/log/kubelet.cov*: No such file or directory W0531 13:51:08.671] scp: /var/log/startupscript.log*: No such file or directory W0531 13:51:08.674] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1]. W0531 13:51:13.644] INSTANCE_GROUPS=bootstrap-e2e-minion-group W0531 13:51:13.644] NODE_NAMES=bootstrap-e2e-minion-group-0zx9 bootstrap-e2e-minion-group-10b1 bootstrap-e2e-minion-group-8cxm I0531 13:51:15.035] Failures for bootstrap-e2e-minion-group (if any): W0531 13:51:16.533] 2022/05/31 13:51:16 process.go:155: Step './cluster/log-dump/log-dump.sh /workspace/_artifacts' finished in 4m12.101888938s W0531 13:51:16.533] 2022/05/31 13:51:16 process.go:153: Running: ./hack/e2e-internal/e2e-down.sh W0531 13:51:16.593] Project: k8s-jkns-e2e-gci-gce-alpha ... skipping 46 lines ... I0531 13:54:24.553] Cleared config for k8s-jkns-e2e-gci-gce-alpha_bootstrap-e2e from /workspace/.kube/config I0531 13:54:24.553] Done W0531 13:54:24.576] W0531 13:54:24.549513 11296 loader.go:221] Config not found: /workspace/.kube/config W0531 13:54:24.576] W0531 13:54:24.549716 11296 loader.go:221] Config not found: /workspace/.kube/config W0531 13:54:24.577] 2022/05/31 13:54:24 process.go:155: Step './hack/e2e-internal/e2e-down.sh' finished in 3m8.020925808s W0531 13:54:24.577] 2022/05/31 13:54:24 process.go:96: Saved XML output to /workspace/_artifacts/junit_runner.xml. W0531 13:54:24.577] 2022/05/31 13:54:24 main.go:331: Something went wrong: starting e2e cluster: error during ./hack/e2e-internal/e2e-up.sh: exit status 2 W0531 13:54:24.577] Traceback (most recent call last): W0531 13:54:24.577] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 723, in <module> W0531 13:54:24.577] main(parse_args()) W0531 13:54:24.577] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 569, in main W0531 13:54:24.577] mode.start(runner_args) W0531 13:54:24.578] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 228, in start W0531 13:54:24.578] check_env(env, self.command, *args) W0531 13:54:24.578] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 111, in check_env W0531 13:54:24.578] subprocess.check_call(cmd, env=env) W0531 13:54:24.578] File "/usr/lib/python2.7/subprocess.py", line 190, in check_call W0531 13:54:24.578] raise CalledProcessError(retcode, cmd) W0531 13:54:24.579] subprocess.CalledProcessError: Command '('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--up', '--down', '--test', '--provider=gce', '--cluster=bootstrap-e2e', '--gcp-network=bootstrap-e2e', '--check-leaked-resources', '--extract=ci/latest', '--gcp-master-image=ubuntu', '--gcp-node-image=ubuntu', '--image-family=ubuntu-2004-lts', '--image-project=ubuntu-os-cloud', '--gcp-zone=us-west1-b', '--ginkgo-parallel=30', '--test_args=--ginkgo.focus=\\[Driver:.iscsi\\] --ginkgo.skip=\\[Serial\\]|\\[Disruptive\\]|\\[Flaky\\] --minStartupPods=8', '--timeout=120m')' returned non-zero exit status 1 E0531 13:54:24.579] Command failed I0531 13:54:24.579] process 272 exited with code 1 after 16.0m E0531 13:54:24.579] FAIL: ci-kubernetes-e2e-gce-iscsi I0531 13:54:24.579] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W0531 13:54:25.296] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com] I0531 13:54:25.448] process 11305 exited with code 0 after 0.0m I0531 13:54:25.449] Call: gcloud config get-value account I0531 13:54:26.204] process 11319 exited with code 0 after 0.0m I0531 13:54:26.204] Will upload results to gs://kubernetes-jenkins/logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com I0531 13:54:26.204] Upload result and artifacts... I0531 13:54:26.204] Gubernator results at https://gubernator.k8s.io/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-iscsi/1531631137552601088 I0531 13:54:26.205] Call: gsutil ls gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-iscsi/1531631137552601088/artifacts W0531 13:54:27.469] CommandException: One or more URLs matched no objects. E0531 13:54:27.769] Command failed I0531 13:54:27.770] process 11333 exited with code 1 after 0.0m W0531 13:54:27.770] Remote dir gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-iscsi/1531631137552601088/artifacts not exist yet I0531 13:54:27.770] Call: gsutil -m -q -o GSUtil:use_magicfile=True cp -r -c -z log,txt,xml /workspace/_artifacts gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-iscsi/1531631137552601088/artifacts I0531 13:54:30.280] process 11473 exited with code 0 after 0.0m I0531 13:54:30.281] Call: git rev-parse HEAD W0531 13:54:30.284] fatal: not a git repository (or any of the parent directories): .git E0531 13:54:30.285] Command failed I0531 13:54:30.285] process 12098 exited with code 128 after 0.0m I0531 13:54:30.285] Call: git rev-parse HEAD I0531 13:54:30.289] process 12099 exited with code 0 after 0.0m I0531 13:54:30.289] Call: gsutil stat gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-iscsi/jobResultsCache.json I0531 13:54:31.761] process 12100 exited with code 0 after 0.0m I0531 13:54:31.762] Call: gsutil -q cat 'gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-iscsi/jobResultsCache.json#1653918817632552' ... skipping 8 lines ...