ci-kubernetes-e2e-gce-iscsi #1539605802640216064
Recent runs || View in Spyglass
error during ./hack/e2e-internal/e2e-up.sh: exit status 2
from junit_runner.xml
Filter through log files | View test history on testgrid
kubetest Deferred TearDown
kubetest DumpClusterLogs (--up failed)
kubetest Extract
kubetest GetDeployer
kubetest Prepare
kubetest TearDown Previous
kubetest Timeout
kubetest listResources Before
... skipping 15 lines ... I0622 13:46:48.232] process 58 exited with code 0 after 0.0m I0622 13:46:48.232] Will upload results to gs://kubernetes-jenkins/logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com I0622 13:46:48.233] Root: /workspace I0622 13:46:48.233] cd to /workspace I0622 13:46:48.233] Configure environment... I0622 13:46:48.234] Call: git show -s --format=format:%ct HEAD W0622 13:46:48.238] fatal: not a git repository (or any of the parent directories): .git I0622 13:46:48.238] process 72 exited with code 128 after 0.0m W0622 13:46:48.239] Unable to print commit date for HEAD I0622 13:46:48.239] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W0622 13:46:49.004] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com] I0622 13:46:49.282] process 73 exited with code 0 after 0.0m I0622 13:46:49.282] Call: gcloud config get-value account ... skipping 318 lines ... W0622 13:49:32.226] done. I0622 13:49:32.327] Generate peer certificates... I0622 13:49:32.327] Generate server certificates... I0622 13:49:32.327] Generate client certificates... I0622 13:49:32.328] NAME NETWORK DIRECTION PRIORITY ALLOW DENY DISABLED I0622 13:49:32.328] bootstrap-e2e-master-etcd bootstrap-e2e INGRESS 1000 tcp:2380,tcp:2381 False W0622 13:49:34.272] ERROR: (gcloud.compute.instances.create) Must specify either [--image] or [--image-family] when specifying [--image-project] flag. W0622 13:49:34.272] Failed to create master instance due to non-retryable error W0622 13:49:38.462] Creating firewall... W0622 13:49:38.462] ..Created [https://www.googleapis.com/compute/v1/projects/kube-gce-upg-1-4-1-5-upg-mas/global/firewalls/bootstrap-e2e-minion-all]. I0622 13:49:38.702] NAME NETWORK DIRECTION PRIORITY ALLOW DENY DISABLED I0622 13:49:38.703] bootstrap-e2e-minion-all bootstrap-e2e INGRESS 1000 tcp,udp,icmp,esp,ah,sctp False W0622 13:49:38.803] done. I0622 13:49:38.944] Creating nodes. W0622 13:49:39.044] [0;31mSome commands failed.[0m W0622 13:49:41.186] /workspace/kubernetes/cluster/../cluster/../cluster/gce/util.sh: line 1527: WINDOWS_CONTAINER_RUNTIME: unbound variable W0622 13:49:41.243] /workspace/kubernetes/cluster/../cluster/../cluster/gce/util.sh: line 1527: WINDOWS_ENABLE_HYPERV: unbound variable I0622 13:49:41.343] Using subnet bootstrap-e2e W0622 13:49:42.575] Attempt 1 to create bootstrap-e2e-minion-template W0622 13:49:43.766] WARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance. W0622 13:49:46.189] Created [https://www.googleapis.com/compute/v1/projects/kube-gce-upg-1-4-1-5-upg-mas/global/instanceTemplates/bootstrap-e2e-minion-template]. ... skipping 14 lines ... W0622 13:50:18.635] NODE_NAMES=bootstrap-e2e-minion-group-7ngn bootstrap-e2e-minion-group-c99f bootstrap-e2e-minion-group-jvkj W0622 13:50:18.635] Trying to find master named 'bootstrap-e2e-master' W0622 13:50:18.635] Looking for address 'bootstrap-e2e-master-ip' I0622 13:50:19.926] Waiting up to 300 seconds for cluster initialization. I0622 13:50:19.926] I0622 13:50:19.926] This will continually check to see if the API for kubernetes is reachable. I0622 13:50:19.926] This may time out if there was some uncaught error during start up. I0622 13:50:19.927] W0622 13:50:20.027] Using master: bootstrap-e2e-master (external IP: 35.227.171.140; internal IP: (not set)) I0622 13:55:26.738] ...........................................Checking for custom logdump instances, if any I0622 13:55:26.744] ---------------------------------------------------------------------------------------------------- I0622 13:55:26.744] k/k version of the log-dump.sh script is deprecated! I0622 13:55:26.744] Please migrate your test job to use test-infra's repo version of log-dump.sh! ... skipping 2 lines ... I0622 13:55:26.747] Sourcing kube-util.sh I0622 13:55:26.806] Detecting project I0622 13:55:26.807] Project: kube-gce-upg-1-4-1-5-upg-mas I0622 13:55:26.807] Network Project: kube-gce-upg-1-4-1-5-upg-mas I0622 13:55:26.807] Zone: us-west1-b I0622 13:55:26.819] Dumping logs from master locally to '/workspace/_artifacts' W0622 13:55:26.919] [0;31mCluster failed to initialize within 300 seconds.[0m W0622 13:55:26.920] Last output from querying API server follows: W0622 13:55:26.920] ----------------------------------------------------- W0622 13:55:26.920] * Expire in 0 ms for 6 (transfer 0x560c062320f0) W0622 13:55:26.920] * Expire in 5000 ms for 8 (transfer 0x560c062320f0) W0622 13:55:26.921] * Trying 35.227.171.140... W0622 13:55:26.921] * TCP_NODELAY set ... skipping 5 lines ... W0622 13:55:26.922] 2022/06/22 13:55:26 process.go:155: Step './hack/e2e-internal/e2e-up.sh' finished in 7m8.791859005s W0622 13:55:26.922] 2022/06/22 13:55:26 e2e.go:574: Dumping logs locally to: /workspace/_artifacts W0622 13:55:26.922] 2022/06/22 13:55:26 process.go:153: Running: ./cluster/log-dump/log-dump.sh /workspace/_artifacts W0622 13:55:26.922] Trying to find master named 'bootstrap-e2e-master' W0622 13:55:26.923] Looking for address 'bootstrap-e2e-master-ip' W0622 13:55:28.063] Using master: bootstrap-e2e-master (external IP: 35.227.171.140; internal IP: (not set)) W0622 13:56:01.545] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0622 13:56:01.545] - The resource 'projects/kube-gce-upg-1-4-1-5-upg-mas/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0622 13:56:01.545] W0622 13:56:07.805] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0622 13:56:07.805] - The resource 'projects/kube-gce-upg-1-4-1-5-upg-mas/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0622 13:56:07.805] W0622 13:56:14.169] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0622 13:56:14.170] - The resource 'projects/kube-gce-upg-1-4-1-5-upg-mas/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0622 13:56:14.170] W0622 13:56:20.462] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0622 13:56:20.463] - The resource 'projects/kube-gce-upg-1-4-1-5-upg-mas/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0622 13:56:20.463] W0622 13:56:26.714] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0622 13:56:26.714] - The resource 'projects/kube-gce-upg-1-4-1-5-upg-mas/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0622 13:56:26.714] W0622 13:56:32.934] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0622 13:56:32.934] - The resource 'projects/kube-gce-upg-1-4-1-5-upg-mas/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0622 13:56:32.934] W0622 13:56:34.192] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0622 13:56:34.192] - The resource 'projects/kube-gce-upg-1-4-1-5-upg-mas/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0622 13:56:34.193] W0622 13:56:40.463] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0622 13:56:40.463] - The resource 'projects/kube-gce-upg-1-4-1-5-upg-mas/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0622 13:56:40.463] W0622 13:56:46.727] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0622 13:56:46.728] - The resource 'projects/kube-gce-upg-1-4-1-5-upg-mas/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0622 13:56:46.728] W0622 13:56:52.983] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0622 13:56:52.983] - The resource 'projects/kube-gce-upg-1-4-1-5-upg-mas/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0622 13:56:52.984] W0622 13:56:59.239] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0622 13:56:59.240] - The resource 'projects/kube-gce-upg-1-4-1-5-upg-mas/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0622 13:56:59.240] W0622 13:57:05.535] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0622 13:57:05.535] - The resource 'projects/kube-gce-upg-1-4-1-5-upg-mas/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0622 13:57:05.535] I0622 13:57:38.383] Changing logfiles to be world-readable for download W0622 13:57:39.380] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0622 13:57:39.380] - The resource 'projects/kube-gce-upg-1-4-1-5-upg-mas/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0622 13:57:39.380] W0622 13:57:45.617] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0622 13:57:45.618] - The resource 'projects/kube-gce-upg-1-4-1-5-upg-mas/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0622 13:57:45.618] W0622 13:57:51.858] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0622 13:57:51.858] - The resource 'projects/kube-gce-upg-1-4-1-5-upg-mas/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0622 13:57:51.858] W0622 13:57:58.115] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0622 13:57:58.115] - The resource 'projects/kube-gce-upg-1-4-1-5-upg-mas/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0622 13:57:58.115] W0622 13:58:04.378] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0622 13:58:04.378] - The resource 'projects/kube-gce-upg-1-4-1-5-upg-mas/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0622 13:58:04.378] W0622 13:58:10.657] ERROR: (gcloud.compute.ssh) Could not fetch resource: W0622 13:58:10.657] - The resource 'projects/kube-gce-upg-1-4-1-5-upg-mas/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0622 13:58:10.657] I0622 13:58:10.904] Copying 'kube-apiserver.log kube-apiserver-audit.log kube-scheduler.log kube-controller-manager.log etcd.log etcd-events.log glbc.log cluster-autoscaler.log kube-addon-manager.log konnectivity-server.log fluentd.log kubelet.cov startupscript.log kern.log docker/log kubelet.log supervisor/supervisord.log supervisor/kubelet-stdout.log supervisor/kubelet-stderr.log supervisor/docker-stdout.log supervisor/docker-stderr.log' from bootstrap-e2e-master W0622 13:58:11.865] ERROR: (gcloud.compute.instances.get-serial-port-output) Could not fetch serial port output: The resource 'projects/kube-gce-upg-1-4-1-5-upg-mas/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0622 13:58:13.050] ERROR: (gcloud.compute.scp) Could not fetch resource: W0622 13:58:13.051] - The resource 'projects/kube-gce-upg-1-4-1-5-upg-mas/zones/us-west1-b/instances/bootstrap-e2e-master' was not found W0622 13:58:13.051] I0622 13:58:13.310] Dumping logs from nodes locally to '/workspace/_artifacts' I0622 13:58:13.310] Detecting nodes in the cluster W0622 13:59:11.155] sudo: docker: command not found W0622 13:59:11.244] sudo: docker: command not found ... skipping 12 lines ... W0622 13:59:23.693] Specify --start=1142195 in the next get-serial-port-output invocation to get only the new output starting from here. W0622 13:59:24.896] scp: /var/log/containers/konnectivity-agent-*.log*: No such file or directory W0622 13:59:24.896] scp: /var/log/fluentd.log*: No such file or directory W0622 13:59:24.896] scp: /var/log/node-problem-detector.log*: No such file or directory W0622 13:59:24.896] scp: /var/log/kubelet.cov*: No such file or directory W0622 13:59:24.896] scp: /var/log/startupscript.log*: No such file or directory W0622 13:59:24.901] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1]. W0622 13:59:25.029] scp: /var/log/containers/konnectivity-agent-*.log*: No such file or directory W0622 13:59:25.029] scp: /var/log/fluentd.log*: No such file or directory W0622 13:59:25.030] scp: /var/log/node-problem-detector.log*: No such file or directory W0622 13:59:25.030] scp: /var/log/kubelet.cov*: No such file or directory W0622 13:59:25.030] scp: /var/log/startupscript.log*: No such file or directory W0622 13:59:25.034] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1]. W0622 13:59:26.213] scp: /var/log/containers/konnectivity-agent-*.log*: No such file or directory W0622 13:59:26.213] scp: /var/log/fluentd.log*: No such file or directory W0622 13:59:26.213] scp: /var/log/node-problem-detector.log*: No such file or directory W0622 13:59:26.214] scp: /var/log/kubelet.cov*: No such file or directory W0622 13:59:26.214] scp: /var/log/startupscript.log*: No such file or directory W0622 13:59:26.217] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1]. W0622 13:59:30.850] INSTANCE_GROUPS=bootstrap-e2e-minion-group W0622 13:59:30.850] NODE_NAMES=bootstrap-e2e-minion-group-7ngn bootstrap-e2e-minion-group-c99f bootstrap-e2e-minion-group-jvkj I0622 13:59:32.208] Failures for bootstrap-e2e-minion-group (if any): W0622 13:59:33.595] 2022/06/22 13:59:33 process.go:155: Step './cluster/log-dump/log-dump.sh /workspace/_artifacts' finished in 4m6.860069014s W0622 13:59:33.595] 2022/06/22 13:59:33 process.go:153: Running: ./hack/e2e-internal/e2e-down.sh W0622 13:59:33.658] Project: kube-gce-upg-1-4-1-5-upg-mas ... skipping 46 lines ... I0622 14:02:22.156] Cleared config for kube-gce-upg-1-4-1-5-upg-mas_bootstrap-e2e from /workspace/.kube/config I0622 14:02:22.156] Done W0622 14:02:22.182] W0622 14:02:22.149871 11304 loader.go:221] Config not found: /workspace/.kube/config W0622 14:02:22.183] W0622 14:02:22.150120 11304 loader.go:221] Config not found: /workspace/.kube/config W0622 14:02:22.183] 2022/06/22 14:02:22 process.go:155: Step './hack/e2e-internal/e2e-down.sh' finished in 2m48.561956782s W0622 14:02:22.183] 2022/06/22 14:02:22 process.go:96: Saved XML output to /workspace/_artifacts/junit_runner.xml. W0622 14:02:22.184] 2022/06/22 14:02:22 main.go:331: Something went wrong: starting e2e cluster: error during ./hack/e2e-internal/e2e-up.sh: exit status 2 W0622 14:02:22.184] Traceback (most recent call last): W0622 14:02:22.184] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 723, in <module> W0622 14:02:22.184] main(parse_args()) W0622 14:02:22.184] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 569, in main W0622 14:02:22.185] mode.start(runner_args) W0622 14:02:22.185] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 228, in start W0622 14:02:22.185] check_env(env, self.command, *args) W0622 14:02:22.186] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 111, in check_env W0622 14:02:22.186] subprocess.check_call(cmd, env=env) W0622 14:02:22.186] File "/usr/lib/python2.7/subprocess.py", line 190, in check_call W0622 14:02:22.186] raise CalledProcessError(retcode, cmd) W0622 14:02:22.187] subprocess.CalledProcessError: Command '('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--up', '--down', '--test', '--provider=gce', '--cluster=bootstrap-e2e', '--gcp-network=bootstrap-e2e', '--check-leaked-resources', '--extract=ci/latest', '--gcp-master-image=ubuntu', '--gcp-node-image=ubuntu', '--image-family=ubuntu-2004-lts', '--image-project=ubuntu-os-cloud', '--gcp-zone=us-west1-b', '--ginkgo-parallel=30', '--test_args=--ginkgo.focus=\\[Driver:.iscsi\\] --ginkgo.skip=\\[Serial\\]|\\[Disruptive\\]|\\[Flaky\\] --minStartupPods=8', '--timeout=120m')' returned non-zero exit status 1 E0622 14:02:22.187] Command failed I0622 14:02:22.187] process 273 exited with code 1 after 15.5m E0622 14:02:22.188] FAIL: ci-kubernetes-e2e-gce-iscsi I0622 14:02:22.188] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W0622 14:02:22.918] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com] I0622 14:02:23.081] process 11314 exited with code 0 after 0.0m I0622 14:02:23.082] Call: gcloud config get-value account I0622 14:02:23.856] process 11328 exited with code 0 after 0.0m I0622 14:02:23.856] Will upload results to gs://kubernetes-jenkins/logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com I0622 14:02:23.856] Upload result and artifacts... I0622 14:02:23.856] Gubernator results at https://gubernator.k8s.io/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-iscsi/1539605802640216064 I0622 14:02:23.857] Call: gsutil ls gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-iscsi/1539605802640216064/artifacts W0622 14:02:25.092] CommandException: One or more URLs matched no objects. E0622 14:02:25.381] Command failed I0622 14:02:25.381] process 11342 exited with code 1 after 0.0m W0622 14:02:25.382] Remote dir gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-iscsi/1539605802640216064/artifacts not exist yet I0622 14:02:25.382] Call: gsutil -m -q -o GSUtil:use_magicfile=True cp -r -c -z log,txt,xml /workspace/_artifacts gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-iscsi/1539605802640216064/artifacts I0622 14:02:27.986] process 11482 exited with code 0 after 0.0m I0622 14:02:27.986] Call: git rev-parse HEAD W0622 14:02:27.994] fatal: not a git repository (or any of the parent directories): .git E0622 14:02:27.995] Command failed I0622 14:02:27.995] process 12107 exited with code 128 after 0.0m I0622 14:02:27.995] Call: git rev-parse HEAD I0622 14:02:27.999] process 12108 exited with code 0 after 0.0m I0622 14:02:28.000] Call: gsutil stat gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-iscsi/jobResultsCache.json I0622 14:02:29.505] process 12109 exited with code 0 after 0.0m I0622 14:02:29.506] Call: gsutil -q cat 'gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-iscsi/jobResultsCache.json#1655820115142921' ... skipping 8 lines ...