This job view page is being replaced by Spyglass soon. Check out the new job view.
PRmm4tt: Adjust nginx lb timeout depending on the cluster size in tests
ResultFAILURE
Tests 1 failed / 7 succeeded
Started2019-09-16 11:03
Elapsed27m30s
Revision
Buildergke-prow-ssd-pool-1a225945-9x2b
Refs master:32735e4c
82696:e035c68e
pod82493ed0-d871-11e9-af7a-7ecbb7a97bb8
infra-commite1cbc3ccd
job-versionv1.17.0-alpha.0.1447+1ac86d26d9847e
pod82493ed0-d871-11e9-af7a-7ecbb7a97bb8
repok8s.io/kubernetes
repo-commit1ac86d26d9847ebf48cd128a25aecf4c0b26766a
repos{u'k8s.io/kubernetes': u'master:32735e4c459ef5ccf99e43ae5b966e92e65c1250,82696:e035c68e2260aae35eb8b43abe611c931c571e35', u'k8s.io/perf-tests': u'master', u'k8s.io/release': u'master'}
revisionv1.17.0-alpha.0.1447+1ac86d26d9847e

Test Failures


Up 2m50s

error during ./hack/e2e-internal/e2e-up.sh: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 7 Passed Tests

Error lines from build-log.txt

... skipping 264 lines ...
W0916 11:18:55.199] INFO: 5219 processes: 5219 processwrapper-sandbox.
W0916 11:18:55.207] INFO: Build completed successfully, 5312 total actions
W0916 11:18:55.218] INFO: Build completed successfully, 5312 total actions
W0916 11:18:55.229] 2019/09/16 11:18:55 process.go:155: Step 'make -C /go/src/k8s.io/kubernetes bazel-release' finished in 14m18.139140654s
W0916 11:18:55.230] 2019/09/16 11:18:55 util.go:255: Flushing memory.
I0916 11:18:55.331] make: Leaving directory '/go/src/k8s.io/kubernetes'
W0916 11:18:58.621] 2019/09/16 11:18:58 util.go:265: flushMem error (page cache): exit status 1
W0916 11:18:58.621] 2019/09/16 11:18:58 process.go:153: Running: /go/src/k8s.io/release/push-build.sh --nomock --verbose --noupdatelatest --bucket=kubernetes-release-pull --ci --gcs-suffix=/pull-kubernetes-e2e-gce-100-performance --allow-dup
W0916 11:18:58.711] $TEST_TMPDIR defined: output root default is '/bazel-scratch/.cache/bazel' and max_idle_secs default is '15'.
I0916 11:18:58.812] push-build.sh: BEGIN main on 82493ed0-d871-11e9-af7a-7ecbb7a97bb8 Mon Sep 16 11:18:58 UTC 2019
I0916 11:18:58.812] 
W0916 11:18:59.426] Loading: 
W0916 11:18:59.430] Loading: 0 packages loaded
... skipping 806 lines ...
W0916 11:26:09.449] 2019/09/16 11:26:09 [WARNING] This certificate lacks a "hosts" field. This makes it unsuitable for
W0916 11:26:09.449] websites. For more information see the Baseline Requirements for the Issuance and Management
W0916 11:26:09.450] of Publicly-Trusted Certificates, v.1.1.6, from the CA/Browser Forum (https://cabforum.org);
W0916 11:26:09.450] specifically, section 10.2.3 ("Information Requirements").
I0916 11:26:09.551] Generate client certificates...
W0916 11:26:19.832] WARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.
W0916 11:26:19.833] ERROR: (gcloud.compute.instances.create) Could not fetch resource:
W0916 11:26:19.834]  - Invalid value for field 'resource.networkInterfaces[0].aliasIpRanges[0].subnetworkRangeName': 'pods-default'. The specified subnetwork secondary range does not exist.
W0916 11:26:19.834] Failed to create master instance due to non-retryable error
W0916 11:26:19.861] 2019/09/16 11:26:19 process.go:155: Step './hack/e2e-internal/e2e-up.sh' finished in 2m50.969461698s
W0916 11:26:19.862] 2019/09/16 11:26:19 e2e.go:519: Dumping logs from nodes to GCS directly at path: gs://kubernetes-jenkins/pr-logs/pull/82696/pull-kubernetes-e2e-gce-100-performance/1173552860407795712/artifacts
W0916 11:26:19.863] 2019/09/16 11:26:19 process.go:153: Running: ./cluster/log-dump/log-dump.sh /workspace/_artifacts gs://kubernetes-jenkins/pr-logs/pull/82696/pull-kubernetes-e2e-gce-100-performance/1173552860407795712/artifacts
I0916 11:26:19.964] Checking for custom logdump instances, if any
I0916 11:26:19.965] Sourcing kube-util.sh
I0916 11:26:20.276] Detecting project
... skipping 2 lines ...
I0916 11:26:20.277] Zone: us-east1-b
I0916 11:26:20.278] Dumping logs from master locally to '/workspace/_artifacts'
W0916 11:26:20.382] Trying to find master named 'e2e-82696-95a39-master'
W0916 11:26:20.383] Looking for address 'e2e-82696-95a39-master-ip'
W0916 11:26:23.517] Using master: e2e-82696-95a39-master (external IP: 35.237.207.166; internal IP: (not set))
I0916 11:27:33.580] Changing logfiles to be world-readable for download
W0916 11:27:35.024] ERROR: (gcloud.compute.ssh) Could not fetch resource:
W0916 11:27:35.025]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-82696-95a39-master' was not found
W0916 11:27:35.025] 
W0916 11:27:41.154] ERROR: (gcloud.compute.ssh) Could not fetch resource:
W0916 11:27:41.155]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-82696-95a39-master' was not found
W0916 11:27:41.155] 
W0916 11:27:49.321] ERROR: (gcloud.compute.ssh) Could not fetch resource:
W0916 11:27:49.322]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-82696-95a39-master' was not found
W0916 11:27:49.323] 
W0916 11:27:56.054] ERROR: (gcloud.compute.ssh) Could not fetch resource:
W0916 11:27:56.055]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-82696-95a39-master' was not found
W0916 11:27:56.055] 
W0916 11:28:02.224] ERROR: (gcloud.compute.ssh) Could not fetch resource:
W0916 11:28:02.225]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-82696-95a39-master' was not found
W0916 11:28:02.226] 
W0916 11:28:08.758] ERROR: (gcloud.compute.ssh) Could not fetch resource:
W0916 11:28:08.759]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-82696-95a39-master' was not found
W0916 11:28:08.759] 
I0916 11:28:08.894] Copying 'kern.log kube-apiserver.log kube-apiserver-audit.log kube-scheduler.log kube-controller-manager.log etcd.log etcd-events.log glbc.log cluster-autoscaler.log kube-addon-manager.log fluentd.log kubelet.cov startupscript.log docker/log kubelet.log supervisor/supervisord.log supervisor/kubelet-stdout.log supervisor/kubelet-stderr.log supervisor/docker-stdout.log supervisor/docker-stderr.log' from e2e-82696-95a39-master
W0916 11:28:10.042] ERROR: (gcloud.compute.instances.get-serial-port-output) Could not fetch serial port output: The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-82696-95a39-master' was not found
W0916 11:28:11.390] ERROR: (gcloud.compute.scp) Could not fetch resource:
W0916 11:28:11.391]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-82696-95a39-master' was not found
W0916 11:28:11.392] 
I0916 11:28:11.492] Dumping logs from nodes to GCS directly at 'gs://kubernetes-jenkins/pr-logs/pull/82696/pull-kubernetes-e2e-gce-100-performance/1173552860407795712/artifacts' using logexporter
I0916 11:28:11.493] Detecting nodes in the cluster
I0916 11:28:15.853] No nodes found!
W0916 11:28:19.917] INSTANCE_GROUPS=
... skipping 21 lines ...
W0916 11:29:39.204] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-82696-95a39-default-ssh].
I0916 11:29:41.012] Deleting firewall rules remaining in network e2e-82696-95a39: e2e-82696-95a39-master-etcd
I0916 11:29:41.013] e2e-82696-95a39-master-https
W0916 11:29:59.757] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-82696-95a39-master-etcd].
W0916 11:30:07.177] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-82696-95a39-master-https].
I0916 11:30:08.876] Deleting custom subnet...
W0916 11:30:10.360] ERROR: (gcloud.compute.networks.subnets.delete) Could not fetch resource:
W0916 11:30:10.361]  - The subnetwork resource 'projects/k8s-presubmit-scale/regions/us-east1/subnetworks/e2e-82696-95a39-custom-subnet' is already being used by 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-82696-95a39-master'
W0916 11:30:10.361] 
W0916 11:30:17.060] ERROR: (gcloud.compute.networks.delete) Could not fetch resource:
W0916 11:30:17.061]  - The network resource 'projects/k8s-presubmit-scale/global/networks/e2e-82696-95a39' is already being used by 'projects/k8s-presubmit-scale/global/firewalls/e2e-82696-95a39-minion-all'
W0916 11:30:17.061] 
I0916 11:30:17.173] Failed to delete network 'e2e-82696-95a39'. Listing firewall-rules:
I0916 11:30:18.465] NAME                        NETWORK          DIRECTION  PRIORITY  ALLOW                     DENY  DISABLED
I0916 11:30:18.466] e2e-82696-95a39-minion-all  e2e-82696-95a39  INGRESS    1000      tcp,udp,icmp,esp,ah,sctp        False
W0916 11:30:18.567] 
W0916 11:30:18.567] To show all fields of the firewall, please show in JSON format: --format=json
W0916 11:30:18.568] To show all fields in table format, please see the examples in --help.
W0916 11:30:18.568] 
... skipping 8 lines ...
W0916 11:30:19.541] W0916 11:30:19.541042   77566 loader.go:223] Config not found: /workspace/.kube/config
I0916 11:30:19.641] Property "users.k8s-presubmit-scale_e2e-82696-95a39-basic-auth" unset.
W0916 11:30:19.802] W0916 11:30:19.801806   77621 loader.go:223] Config not found: /workspace/.kube/config
W0916 11:30:19.802] W0916 11:30:19.802617   77621 loader.go:223] Config not found: /workspace/.kube/config
W0916 11:30:19.809] 2019/09/16 11:30:19 process.go:155: Step './hack/e2e-internal/e2e-down.sh' finished in 1m59.892260887s
W0916 11:30:19.810] 2019/09/16 11:30:19 process.go:96: Saved XML output to /workspace/_artifacts/junit_runner.xml.
W0916 11:30:19.813] 2019/09/16 11:30:19 main.go:319: Something went wrong: starting e2e cluster: error during ./hack/e2e-internal/e2e-up.sh: exit status 1
W0916 11:30:19.814] Traceback (most recent call last):
W0916 11:30:19.815]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 778, in <module>
W0916 11:30:19.816]     main(parse_args())
W0916 11:30:19.817]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 626, in main
W0916 11:30:19.819]     mode.start(runner_args)
W0916 11:30:19.820]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 262, in start
... skipping 3 lines ...
W0916 11:30:19.821]   File "/usr/lib/python2.7/subprocess.py", line 186, in check_call
W0916 11:30:19.821]     raise CalledProcessError(retcode, cmd)
W0916 11:30:19.822] subprocess.CalledProcessError: Command '('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--build=bazel', '--stage=gs://kubernetes-release-pull/ci/pull-kubernetes-e2e-gce-100-performance', '--up', '--down', '--provider=gce', '--cluster=e2e-82696-95a39', '--gcp-network=e2e-82696-95a39', '--extract=local', '--gcp-nodes=100', '--gcp-project=k8s-presubmit-scale', '--gcp-zone=us-east1-b', '--test-cmd=/go/src/k8s.io/perf-tests/run-e2e.sh', '--test-cmd-args=cluster-loader2', '--test-cmd-args=--nodes=100', '--test-cmd-args=--prometheus-scrape-etcd', '--test-cmd-args=--provider=gce', '--test-cmd-args=--report-dir=/workspace/_artifacts', '--test-cmd-args=--testconfig=testing/density/config.yaml', '--test-cmd-args=--testconfig=testing/load/config.yaml', '--test-cmd-args=--testoverrides=./testing/density/100_nodes/override.yaml', '--test-cmd-args=--testoverrides=./testing/load/gce/throughput_override.yaml', '--test-cmd-args=--testoverrides=./testing/load/experimental/overrides/enable_configmaps.yaml', '--test-cmd-args=--testoverrides=./testing/load/experimental/overrides/enable_daemonsets.yaml', '--test-cmd-args=--testoverrides=./testing/load/experimental/overrides/enable_jobs.yaml', '--test-cmd-args=--testoverrides=./testing/load/experimental/overrides/enable_pvs.yaml', '--test-cmd-args=--testoverrides=./testing/load/experimental/overrides/enable_secrets.yaml', '--test-cmd-args=--testoverrides=./testing/load/experimental/overrides/enable_statefulsets.yaml', '--test-cmd-name=ClusterLoaderV2', '--timeout=100m', '--logexporter-gcs-path=gs://kubernetes-jenkins/pr-logs/pull/82696/pull-kubernetes-e2e-gce-100-performance/1173552860407795712/artifacts')' returned non-zero exit status 1
I0916 11:30:19.832] Property "contexts.k8s-presubmit-scale_e2e-82696-95a39" unset.
I0916 11:30:19.832] Cleared config for k8s-presubmit-scale_e2e-82696-95a39 from /workspace/.kube/config
I0916 11:30:19.832] Done
E0916 11:30:19.832] Command failed
I0916 11:30:19.833] process 524 exited with code 1 after 25.8m
E0916 11:30:19.833] FAIL: pull-kubernetes-e2e-gce-100-performance
I0916 11:30:19.833] Call:  gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json
W0916 11:30:20.646] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
I0916 11:30:20.738] process 77632 exited with code 0 after 0.0m
I0916 11:30:20.739] Call:  gcloud config get-value account
I0916 11:30:21.210] process 77644 exited with code 0 after 0.0m
I0916 11:30:21.211] Will upload results to gs://kubernetes-jenkins/pr-logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com
I0916 11:30:21.211] Upload result and artifacts...
I0916 11:30:21.211] Gubernator results at https://gubernator.k8s.io/build/kubernetes-jenkins/pr-logs/pull/82696/pull-kubernetes-e2e-gce-100-performance/1173552860407795712
I0916 11:30:21.212] Call:  gsutil ls gs://kubernetes-jenkins/pr-logs/pull/82696/pull-kubernetes-e2e-gce-100-performance/1173552860407795712/artifacts
W0916 11:30:23.078] CommandException: One or more URLs matched no objects.
E0916 11:30:23.327] Command failed
I0916 11:30:23.328] process 77656 exited with code 1 after 0.0m
W0916 11:30:23.328] Remote dir gs://kubernetes-jenkins/pr-logs/pull/82696/pull-kubernetes-e2e-gce-100-performance/1173552860407795712/artifacts not exist yet
I0916 11:30:23.328] Call:  gsutil -m -q -o GSUtil:use_magicfile=True cp -r -c -z log,txt,xml /workspace/_artifacts gs://kubernetes-jenkins/pr-logs/pull/82696/pull-kubernetes-e2e-gce-100-performance/1173552860407795712/artifacts
I0916 11:30:26.663] process 77798 exited with code 0 after 0.1m
I0916 11:30:26.666] Call:  git rev-parse HEAD
I0916 11:30:26.672] process 78325 exited with code 0 after 0.0m
... skipping 21 lines ...