This job view page is being replaced by Spyglass soon. Check out the new job view.
PRjsafrane: WIP: Fix iscsi logout issues
ResultFAILURE
Tests 1 failed / 7 succeeded
Started2019-06-12 16:01
Elapsed33m25s
Revision
Buildergke-prow-containerd-pool-bigger-170c3937-8lj3
Refs master:9b15a5b0
78941:3629294d
pod0063a6ba-8d2b-11e9-a90f-0293453c48ce
infra-commit44d4bdc5e
job-versionv1.16.0-alpha.0.928+addbe324606d9c
pod0063a6ba-8d2b-11e9-a90f-0293453c48ce
repok8s.io/kubernetes
repo-commitaddbe324606d9cc5684b8b8d889979cfb4e40be2
repos{u'k8s.io/kubernetes': u'master:9b15a5b0700724d2ea1021ceafb72c378b638a0b,78941:3629294d155cb3e75d6efd458f0ae25d2e20a3c4', u'k8s.io/perf-tests': u'master', u'k8s.io/release': u'master'}
revisionv1.16.0-alpha.0.928+addbe324606d9c

Test Failures


Up 1m47s

error during ./hack/e2e-internal/e2e-up.sh: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 7 Passed Tests

Error lines from build-log.txt

... skipping 1007 lines ...
W0612 16:23:53.749] Zone: us-east1-b
I0612 16:23:57.261] Bringing down cluster
W0612 16:23:57.362] INSTANCE_GROUPS=
W0612 16:23:57.362] NODE_NAMES=
I0612 16:24:25.252] Deleting firewall rules remaining in network e2e-78941-ac87c: 
I0612 16:24:26.277] Deleting custom subnet...
W0612 16:24:27.046] ERROR: (gcloud.compute.networks.subnets.delete) Could not fetch resource:
W0612 16:24:27.047]  - The resource 'projects/k8s-presubmit-scale/regions/us-east1/subnetworks/e2e-78941-ac87c-custom-subnet' was not found
W0612 16:24:27.047] 
W0612 16:25:00.624] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/networks/e2e-78941-ac87c].
I0612 16:25:01.034] Property "clusters.k8s-presubmit-scale_e2e-78941-ac87c" unset.
I0612 16:25:01.198] Property "users.k8s-presubmit-scale_e2e-78941-ac87c" unset.
I0612 16:25:01.381] Property "users.k8s-presubmit-scale_e2e-78941-ac87c-basic-auth" unset.
... skipping 49 lines ...
I0612 16:26:47.190] NAME                           REGION    NETWORK          RANGE
I0612 16:26:47.190] e2e-78941-ac87c-custom-subnet  us-east1  e2e-78941-ac87c  10.40.0.0/22
I0612 16:26:47.265] Created subnetwork e2e-78941-ac87c-custom-subnet
I0612 16:26:47.265] Using subnet e2e-78941-ac87c-custom-subnet
I0612 16:26:47.269] Starting master and configuring firewalls
W0612 16:26:47.887] Creating firewall...
W0612 16:26:48.304] ..failed.
W0612 16:26:48.516] ERROR: (gcloud.compute.firewall-rules.create) Could not fetch resource:
W0612 16:26:48.517]  - The resource 'projects/k8s-presubmit-scale/global/firewalls/e2e-78941-ac87c-master-https' already exists
W0612 16:26:48.517] 
W0612 16:26:49.009] ERROR: (gcloud.compute.disks.create) Could not fetch resource:
W0612 16:26:49.010]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/disks/e2e-78941-ac87c-master-pd' already exists
W0612 16:26:49.010] 
W0612 16:26:49.101] 2019/06/12 16:26:49 process.go:155: Step './hack/e2e-internal/e2e-up.sh' finished in 1m47.535253026s
W0612 16:26:49.101] 2019/06/12 16:26:49 e2e.go:522: Dumping logs locally to: /workspace/_artifacts
W0612 16:26:49.101] 2019/06/12 16:26:49 process.go:153: Running: ./cluster/log-dump/log-dump.sh /workspace/_artifacts
W0612 16:26:49.169] Trying to find master named 'e2e-78941-ac87c-master'
... skipping 4 lines ...
I0612 16:26:49.271] Project: k8s-presubmit-scale
I0612 16:26:49.271] Network Project: k8s-presubmit-scale
I0612 16:26:49.271] Zone: us-east1-b
I0612 16:26:49.272] Dumping logs from master locally to '/workspace/_artifacts'
W0612 16:26:50.030] Using master: e2e-78941-ac87c-master (external IP: 35.185.84.14)
I0612 16:27:50.425] Changing logfiles to be world-readable for download
W0612 16:27:51.142] ERROR: (gcloud.compute.ssh) Could not fetch resource:
W0612 16:27:51.142]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-78941-ac87c-master' was not found
W0612 16:27:51.142] 
W0612 16:27:57.076] ERROR: (gcloud.compute.ssh) Could not fetch resource:
W0612 16:27:57.077]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-78941-ac87c-master' was not found
W0612 16:27:57.077] 
W0612 16:28:02.921] ERROR: (gcloud.compute.ssh) Could not fetch resource:
W0612 16:28:02.922]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-78941-ac87c-master' was not found
W0612 16:28:02.922] 
W0612 16:28:08.756] ERROR: (gcloud.compute.ssh) Could not fetch resource:
W0612 16:28:08.757]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-78941-ac87c-master' was not found
W0612 16:28:08.757] 
W0612 16:28:14.544] ERROR: (gcloud.compute.ssh) Could not fetch resource:
W0612 16:28:14.545]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-78941-ac87c-master' was not found
W0612 16:28:14.545] 
W0612 16:28:20.434] ERROR: (gcloud.compute.ssh) Could not fetch resource:
W0612 16:28:20.434]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-78941-ac87c-master' was not found
W0612 16:28:20.434] 
I0612 16:28:20.535] Copying 'kern.log kube-apiserver.log kube-apiserver-audit.log kube-scheduler.log kube-controller-manager.log etcd.log etcd-events.log glbc.log cluster-autoscaler.log kube-addon-manager.log fluentd.log kubelet.cov startupscript.log docker/log kubelet.log supervisor/supervisord.log supervisor/kubelet-stdout.log supervisor/kubelet-stderr.log supervisor/docker-stdout.log supervisor/docker-stderr.log' from e2e-78941-ac87c-master
W0612 16:28:21.256] ERROR: (gcloud.compute.instances.get-serial-port-output) Could not fetch serial port output: The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-78941-ac87c-master' was not found
W0612 16:28:22.109] ERROR: (gcloud.compute.scp) Could not fetch resource:
W0612 16:28:22.109]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-78941-ac87c-master' was not found
W0612 16:28:22.109] 
I0612 16:28:22.209] Dumping logs from nodes locally to '/workspace/_artifacts'
I0612 16:28:22.210] Detecting nodes in the cluster
I0612 16:29:01.501] Changing logfiles to be world-readable for download
I0612 16:29:01.606] Changing logfiles to be world-readable for download
... skipping 27 lines ...
W0612 16:29:09.454] scp: /var/log/node-problem-detector.log*: No such file or directory
W0612 16:29:09.454] scp: /var/log/kubelet.cov*: No such file or directory
W0612 16:29:09.454] scp: /var/log/kubelet-hollow-node-*.log*: No such file or directory
W0612 16:29:09.455] scp: /var/log/kubeproxy-hollow-node-*.log*: No such file or directory
W0612 16:29:09.455] scp: /var/log/npd-hollow-node-*.log*: No such file or directory
W0612 16:29:09.455] scp: /var/log/startupscript.log*: No such file or directory
W0612 16:29:09.479] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1].
W0612 16:29:09.874] scp: /var/log/fluentd.log*: No such file or directory
W0612 16:29:09.874] scp: /var/log/node-problem-detector.log*: No such file or directory
W0612 16:29:09.874] scp: /var/log/kubelet.cov*: No such file or directory
W0612 16:29:09.874] scp: /var/log/kubelet-hollow-node-*.log*: No such file or directory
W0612 16:29:09.874] scp: /var/log/kubeproxy-hollow-node-*.log*: No such file or directory
W0612 16:29:09.875] scp: /var/log/npd-hollow-node-*.log*: No such file or directory
W0612 16:29:09.875] scp: /var/log/startupscript.log*: No such file or directory
W0612 16:29:09.875] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1].
W0612 16:29:09.951] scp: /var/log/fluentd.log*: No such file or directory
W0612 16:29:09.953] scp: /var/log/node-problem-detector.log*: No such file or directory
W0612 16:29:09.954] scp: /var/log/kubelet.cov*: No such file or directory
W0612 16:29:09.954] scp: /var/log/kubelet-hollow-node-*.log*: No such file or directory
W0612 16:29:09.954] scp: /var/log/kubeproxy-hollow-node-*.log*: No such file or directory
W0612 16:29:09.955] scp: /var/log/npd-hollow-node-*.log*: No such file or directory
W0612 16:29:09.955] scp: /var/log/startupscript.log*: No such file or directory
W0612 16:29:09.957] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1].
W0612 16:29:10.012] scp: /var/log/fluentd.log*: No such file or directory
W0612 16:29:10.013] scp: /var/log/node-problem-detector.log*: No such file or directory
W0612 16:29:10.013] scp: /var/log/kubelet.cov*: No such file or directory
W0612 16:29:10.013] scp: /var/log/kubelet-hollow-node-*.log*: No such file or directory
W0612 16:29:10.013] scp: /var/log/kubeproxy-hollow-node-*.log*: No such file or directory
W0612 16:29:10.014] scp: /var/log/npd-hollow-node-*.log*: No such file or directory
W0612 16:29:10.014] scp: /var/log/startupscript.log*: No such file or directory
W0612 16:29:10.017] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1].
W0612 16:29:10.166] scp: /var/log/fluentd.log*: No such file or directory
W0612 16:29:10.166] scp: /var/log/node-problem-detector.log*: No such file or directory
W0612 16:29:10.166] scp: /var/log/kubelet.cov*: No such file or directory
W0612 16:29:10.166] scp: /var/log/kubelet-hollow-node-*.log*: No such file or directory
W0612 16:29:10.166] scp: /var/log/kubeproxy-hollow-node-*.log*: No such file or directory
W0612 16:29:10.166] scp: /var/log/npd-hollow-node-*.log*: No such file or directory
W0612 16:29:10.167] scp: /var/log/startupscript.log*: No such file or directory
W0612 16:29:10.171] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1].
W0612 16:29:10.201] scp: /var/log/fluentd.log*: No such file or directory
W0612 16:29:10.201] scp: /var/log/node-problem-detector.log*: No such file or directory
W0612 16:29:10.201] scp: /var/log/kubelet.cov*: No such file or directory
W0612 16:29:10.201] scp: /var/log/kubelet-hollow-node-*.log*: No such file or directory
W0612 16:29:10.202] scp: /var/log/kubeproxy-hollow-node-*.log*: No such file or directory
W0612 16:29:10.202] scp: /var/log/npd-hollow-node-*.log*: No such file or directory
W0612 16:29:10.202] scp: /var/log/startupscript.log*: No such file or directory
W0612 16:29:10.206] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1].
W0612 16:29:10.597] scp: /var/log/fluentd.log*: No such file or directory
W0612 16:29:10.597] scp: /var/log/node-problem-detector.log*: No such file or directory
W0612 16:29:10.597] scp: /var/log/kubelet.cov*: No such file or directory
W0612 16:29:10.597] scp: /var/log/kubelet-hollow-node-*.log*: No such file or directory
W0612 16:29:10.597] scp: /var/log/kubeproxy-hollow-node-*.log*: No such file or directory
W0612 16:29:10.598] scp: /var/log/npd-hollow-node-*.log*: No such file or directory
W0612 16:29:10.598] scp: /var/log/startupscript.log*: No such file or directory
W0612 16:29:10.601] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1].
W0612 16:29:14.120] INSTANCE_GROUPS=e2e-78941-ac87c-minion-group
W0612 16:29:14.120] NODE_NAMES=e2e-78941-ac87c-minion-group-b2h5 e2e-78941-ac87c-minion-group-c7bn e2e-78941-ac87c-minion-group-dshp e2e-78941-ac87c-minion-group-l0kz e2e-78941-ac87c-minion-group-mr29 e2e-78941-ac87c-minion-group-mv27 e2e-78941-ac87c-minion-group-spq1
I0612 16:29:15.168] Failures for e2e-78941-ac87c-minion-group
W0612 16:29:16.742] 2019/06/12 16:29:16 process.go:155: Step './cluster/log-dump/log-dump.sh /workspace/_artifacts' finished in 2m27.641057865s
W0612 16:29:16.742] 2019/06/12 16:29:16 process.go:153: Running: ./hack/e2e-internal/e2e-down.sh
W0612 16:29:16.801] Project: k8s-presubmit-scale
... skipping 32 lines ...
I0612 16:34:29.025] Property "users.k8s-presubmit-scale_e2e-78941-ac87c-basic-auth" unset.
I0612 16:34:29.188] Property "contexts.k8s-presubmit-scale_e2e-78941-ac87c" unset.
I0612 16:34:29.194] Cleared config for k8s-presubmit-scale_e2e-78941-ac87c from /workspace/.kube/config
I0612 16:34:29.195] Done
W0612 16:34:29.230] 2019/06/12 16:34:29 process.go:155: Step './hack/e2e-internal/e2e-down.sh' finished in 5m12.453895276s
W0612 16:34:29.230] 2019/06/12 16:34:29 process.go:96: Saved XML output to /workspace/_artifacts/junit_runner.xml.
W0612 16:34:29.231] 2019/06/12 16:34:29 main.go:314: Something went wrong: starting e2e cluster: error during ./hack/e2e-internal/e2e-up.sh: exit status 1
W0612 16:34:29.231] Traceback (most recent call last):
W0612 16:34:29.231]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 778, in <module>
W0612 16:34:29.231]     main(parse_args())
W0612 16:34:29.231]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 626, in main
W0612 16:34:29.231]     mode.start(runner_args)
W0612 16:34:29.232]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 262, in start
W0612 16:34:29.232]     check_env(env, self.command, *args)
W0612 16:34:29.232]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 111, in check_env
W0612 16:34:29.232]     subprocess.check_call(cmd, env=env)
W0612 16:34:29.232]   File "/usr/lib/python2.7/subprocess.py", line 186, in check_call
W0612 16:34:29.232]     raise CalledProcessError(retcode, cmd)
W0612 16:34:29.233] subprocess.CalledProcessError: Command '('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--build=bazel', '--stage=gs://kubernetes-release-pull/ci/pull-kubernetes-kubemark-e2e-gce-big', '--up', '--down', '--provider=gce', '--cluster=e2e-78941-ac87c', '--gcp-network=e2e-78941-ac87c', '--extract=local', '--gcp-master-size=n1-standard-4', '--gcp-node-size=n1-standard-8', '--gcp-nodes=7', '--gcp-project=k8s-presubmit-scale', '--gcp-zone=us-east1-b', '--kubemark', '--kubemark-nodes=500', '--test_args=--ginkgo.focus=xxxx', '--test-cmd=/go/src/k8s.io/perf-tests/run-e2e.sh', '--test-cmd-args=cluster-loader2', '--test-cmd-args=--nodes=500', '--test-cmd-args=--provider=kubemark', '--test-cmd-args=--report-dir=/workspace/_artifacts', '--test-cmd-args=--testconfig=testing/density/config.yaml', '--test-cmd-args=--testconfig=testing/load/config.yaml', '--test-cmd-args=--testoverrides=./testing/load/kubemark/500_nodes/override.yaml', '--test-cmd-name=ClusterLoaderV2', '--timeout=100m')' returned non-zero exit status 1
E0612 16:34:29.233] Command failed
I0612 16:34:29.233] process 700 exited with code 1 after 31.8m
E0612 16:34:29.233] FAIL: pull-kubernetes-kubemark-e2e-gce-big
I0612 16:34:29.234] Call:  gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json
W0612 16:34:29.767] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
I0612 16:34:29.848] process 80270 exited with code 0 after 0.0m
I0612 16:34:29.848] Call:  gcloud config get-value account
I0612 16:34:30.197] process 80282 exited with code 0 after 0.0m
I0612 16:34:30.197] Will upload results to gs://kubernetes-jenkins/pr-logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com
I0612 16:34:30.198] Upload result and artifacts...
I0612 16:34:30.198] Gubernator results at https://gubernator.k8s.io/build/kubernetes-jenkins/pr-logs/pull/78941/pull-kubernetes-kubemark-e2e-gce-big/1138838216879640576
I0612 16:34:30.198] Call:  gsutil ls gs://kubernetes-jenkins/pr-logs/pull/78941/pull-kubernetes-kubemark-e2e-gce-big/1138838216879640576/artifacts
W0612 16:34:31.349] CommandException: One or more URLs matched no objects.
E0612 16:34:31.480] Command failed
I0612 16:34:31.480] process 80294 exited with code 1 after 0.0m
W0612 16:34:31.480] Remote dir gs://kubernetes-jenkins/pr-logs/pull/78941/pull-kubernetes-kubemark-e2e-gce-big/1138838216879640576/artifacts not exist yet
I0612 16:34:31.480] Call:  gsutil -m -q -o GSUtil:use_magicfile=True cp -r -c -z log,txt,xml /workspace/_artifacts gs://kubernetes-jenkins/pr-logs/pull/78941/pull-kubernetes-kubemark-e2e-gce-big/1138838216879640576/artifacts
I0612 16:34:34.196] process 80436 exited with code 0 after 0.0m
I0612 16:34:34.197] Call:  git rev-parse HEAD
I0612 16:34:34.201] process 81107 exited with code 0 after 0.0m
... skipping 20 lines ...