This job view page is being replaced by Spyglass soon. Check out the new job view.
PRoxddr: Run DNS probes in tests
ResultFAILURE
Tests 1 failed / 5 succeeded
Started2019-08-07 13:43
Elapsed6m28s
Revision
Buildergke-prow-ssd-pool-1a225945-j823
Refs master:fdd022ba
709:420099ae
pod285706f3-b919-11e9-b1c4-3aae2d9a6b38
infra-commit394117159
job-versionv1.16.0-alpha.2.401+1e962072f1123d
pod285706f3-b919-11e9-b1c4-3aae2d9a6b38
repok8s.io/perf-tests
repo-commitaab55ee4ef94f37b60cb22d665bc3ea6c957805f
repos{u'k8s.io/perf-tests': u'master:fdd022ba5ca6c82e7e853f168ae4a0002e29e5c7,709:420099ae0fe352a766af4f78231cfb8be5fa11e4', u'k8s.io/release': u'master'}
revisionv1.16.0-alpha.2.401+1e962072f1123d

Test Failures


Up 1m13s

error during ./hack/e2e-internal/e2e-up.sh: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 5 Passed Tests

Error lines from build-log.txt

... skipping 250 lines ...
W0807 13:44:17.463] Zone: us-east1-b
I0807 13:44:20.612] Bringing down cluster
W0807 13:44:20.713] INSTANCE_GROUPS=
W0807 13:44:20.713] NODE_NAMES=
I0807 13:45:15.437] Deleting firewall rules remaining in network e2e-709-62db2: 
I0807 13:45:16.546] Deleting custom subnet...
W0807 13:45:17.290] ERROR: (gcloud.compute.networks.subnets.delete) Could not fetch resource:
W0807 13:45:17.291]  - The resource 'projects/k8s-presubmit-scale/regions/us-east1/subnetworks/e2e-709-62db2-custom-subnet' was not found
W0807 13:45:17.291] 
W0807 13:45:45.839] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/networks/e2e-709-62db2].
W0807 13:45:46.085] W0807 13:45:46.084954    1185 loader.go:223] Config not found: /workspace/.kube/config
I0807 13:45:46.282] Property "clusters.k8s-presubmit-scale_e2e-709-62db2" unset.
W0807 13:45:46.383] W0807 13:45:46.281392    1238 loader.go:223] Config not found: /workspace/.kube/config
... skipping 88 lines ...
W0807 13:46:57.902] of Publicly-Trusted Certificates, v.1.1.6, from the CA/Browser Forum (https://cabforum.org);
W0807 13:46:57.902] specifically, section 10.2.3 ("Information Requirements").
I0807 13:46:58.003] Generate peer certificates...
I0807 13:46:58.003] Generate server certificates...
I0807 13:46:58.003] Generate client certificates...
W0807 13:47:00.422] .WARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.
W0807 13:47:00.422] ERROR: (gcloud.compute.instances.create) Could not fetch resource:
W0807 13:47:00.422]  - The resource 'projects/k8s-presubmit-scale/regions/us-east1/subnetworks/e2e-709-62db2-custom-subnet' is not ready
W0807 13:47:00.423] Failed to create master instance due to non-retryable error
W0807 13:47:00.429] 2019/08/07 13:47:00 process.go:155: Step './hack/e2e-internal/e2e-up.sh' finished in 1m13.586510566s
W0807 13:47:00.430] 2019/08/07 13:47:00 e2e.go:519: Dumping logs from nodes to GCS directly at path: gs://kubernetes-jenkins/pr-logs/pull/perf-tests/709/pull-perf-tests-clusterloader2/1159097496404758528/artifacts
W0807 13:47:00.430] 2019/08/07 13:47:00 process.go:153: Running: ./cluster/log-dump/log-dump.sh /workspace/_artifacts gs://kubernetes-jenkins/pr-logs/pull/perf-tests/709/pull-perf-tests-clusterloader2/1159097496404758528/artifacts
W0807 13:47:00.504] Trying to find master named 'e2e-709-62db2-master'
W0807 13:47:00.504] Looking for address 'e2e-709-62db2-master-ip'
I0807 13:47:00.605] Checking for custom logdump instances, if any
... skipping 6 lines ...
W0807 13:47:01.317] Using master: e2e-709-62db2-master (external IP: 35.227.78.181)
W0807 13:47:04.702] .Created [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-709-62db2-master-etcd].
W0807 13:47:04.848] done.
I0807 13:47:04.949] NAME                       NETWORK        DIRECTION  PRIORITY  ALLOW              DENY  DISABLED
I0807 13:47:04.950] e2e-709-62db2-master-etcd  e2e-709-62db2  INGRESS    1000      tcp:2380,tcp:2381        False
I0807 13:48:02.680] Changing logfiles to be world-readable for download
W0807 13:48:03.757] ERROR: (gcloud.compute.ssh) Could not fetch resource:
W0807 13:48:03.758]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-709-62db2-master' was not found
W0807 13:48:03.759] 
W0807 13:48:12.881] ERROR: (gcloud.compute.ssh) Could not fetch resource:
W0807 13:48:12.881]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-709-62db2-master' was not found
W0807 13:48:12.881] 
W0807 13:48:18.991] ERROR: (gcloud.compute.ssh) Could not fetch resource:
W0807 13:48:18.991]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-709-62db2-master' was not found
W0807 13:48:18.992] 
W0807 13:48:25.115] ERROR: (gcloud.compute.ssh) Could not fetch resource:
W0807 13:48:25.116]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-709-62db2-master' was not found
W0807 13:48:25.116] 
W0807 13:48:31.061] ERROR: (gcloud.compute.ssh) Could not fetch resource:
W0807 13:48:31.061]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-709-62db2-master' was not found
W0807 13:48:31.061] 
W0807 13:48:36.928] ERROR: (gcloud.compute.ssh) Could not fetch resource:
W0807 13:48:36.929]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-709-62db2-master' was not found
W0807 13:48:36.929] 
I0807 13:48:37.030] Copying 'kern.log kube-apiserver.log kube-apiserver-audit.log kube-scheduler.log kube-controller-manager.log etcd.log etcd-events.log glbc.log cluster-autoscaler.log kube-addon-manager.log fluentd.log kubelet.cov startupscript.log docker/log kubelet.log supervisor/supervisord.log supervisor/kubelet-stdout.log supervisor/kubelet-stderr.log supervisor/docker-stdout.log supervisor/docker-stderr.log' from e2e-709-62db2-master
W0807 13:48:38.397] ERROR: (gcloud.compute.instances.get-serial-port-output) Could not fetch serial port output: The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-709-62db2-master' was not found
W0807 13:48:39.263] ERROR: (gcloud.compute.scp) Could not fetch resource:
W0807 13:48:39.263]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-709-62db2-master' was not found
W0807 13:48:39.264] 
I0807 13:48:39.364] Dumping logs from nodes to GCS directly at 'gs://kubernetes-jenkins/pr-logs/pull/perf-tests/709/pull-perf-tests-clusterloader2/1159097496404758528/artifacts' using logexporter
I0807 13:48:39.365] Detecting nodes in the cluster
I0807 13:48:42.355] No nodes found!
W0807 13:48:45.371] INSTANCE_GROUPS=
... skipping 30 lines ...
I0807 13:49:44.980] Cleared config for k8s-presubmit-scale_e2e-709-62db2 from /workspace/.kube/config
I0807 13:49:44.980] Done
W0807 13:49:44.998] W0807 13:49:44.975151    4742 loader.go:223] Config not found: /workspace/.kube/config
W0807 13:49:44.998] W0807 13:49:44.975366    4742 loader.go:223] Config not found: /workspace/.kube/config
W0807 13:49:44.998] 2019/08/07 13:49:44 process.go:155: Step './hack/e2e-internal/e2e-down.sh' finished in 59.609020162s
W0807 13:49:44.999] 2019/08/07 13:49:44 process.go:96: Saved XML output to /workspace/_artifacts/junit_runner.xml.
W0807 13:49:44.999] 2019/08/07 13:49:44 main.go:316: Something went wrong: starting e2e cluster: error during ./hack/e2e-internal/e2e-up.sh: exit status 1
W0807 13:49:44.999] Traceback (most recent call last):
W0807 13:49:45.000]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 778, in <module>
W0807 13:49:45.000]     main(parse_args())
W0807 13:49:45.000]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 626, in main
W0807 13:49:45.001]     mode.start(runner_args)
W0807 13:49:45.001]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 262, in start
W0807 13:49:45.001]     check_env(env, self.command, *args)
W0807 13:49:45.001]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 111, in check_env
W0807 13:49:45.002]     subprocess.check_call(cmd, env=env)
W0807 13:49:45.002]   File "/usr/lib/python2.7/subprocess.py", line 186, in check_call
W0807 13:49:45.002]     raise CalledProcessError(retcode, cmd)
W0807 13:49:45.003] subprocess.CalledProcessError: Command '('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--up', '--down', '--provider=gce', '--cluster=e2e-709-62db2', '--gcp-network=e2e-709-62db2', '--extract=ci/latest', '--gcp-nodes=100', '--gcp-project=k8s-presubmit-scale', '--gcp-zone=us-east1-b', '--test-cmd=/go/src/k8s.io/perf-tests/run-e2e.sh', '--test-cmd-args=cluster-loader2', '--test-cmd-args=--nodes=100', '--test-cmd-args=--prometheus-scrape-etcd', '--test-cmd-args=--prometheus-scrape-node-exporter', '--test-cmd-args=--provider=gce', '--test-cmd-args=--report-dir=/workspace/_artifacts', '--test-cmd-args=--testconfig=testing/density/config.yaml', '--test-cmd-args=--testconfig=testing/load/config.yaml', '--test-cmd-args=--testoverrides=./testing/density/100_nodes/override.yaml', '--test-cmd-args=--testoverrides=./testing/load/gce/throughput_override.yaml', '--test-cmd-args=--testoverrides=./testing/experiments/enable_dns_probes.yaml', '--test-cmd-name=ClusterLoaderV2', '--timeout=100m', '--logexporter-gcs-path=gs://kubernetes-jenkins/pr-logs/pull/perf-tests/709/pull-perf-tests-clusterloader2/1159097496404758528/artifacts')' returned non-zero exit status 1
E0807 13:49:45.003] Command failed
I0807 13:49:45.004] process 473 exited with code 1 after 6.1m
E0807 13:49:45.004] FAIL: pull-perf-tests-clusterloader2
I0807 13:49:45.004] Call:  gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json
W0807 13:49:45.540] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
I0807 13:49:45.612] process 4753 exited with code 0 after 0.0m
I0807 13:49:45.612] Call:  gcloud config get-value account
I0807 13:49:45.959] process 4765 exited with code 0 after 0.0m
I0807 13:49:45.960] Will upload results to gs://kubernetes-jenkins/pr-logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com
I0807 13:49:45.960] Upload result and artifacts...
I0807 13:49:45.960] Gubernator results at https://gubernator.k8s.io/build/kubernetes-jenkins/pr-logs/pull/perf-tests/709/pull-perf-tests-clusterloader2/1159097496404758528
I0807 13:49:45.960] Call:  gsutil ls gs://kubernetes-jenkins/pr-logs/pull/perf-tests/709/pull-perf-tests-clusterloader2/1159097496404758528/artifacts
W0807 13:49:47.118] CommandException: One or more URLs matched no objects.
E0807 13:49:47.264] Command failed
I0807 13:49:47.264] process 4777 exited with code 1 after 0.0m
W0807 13:49:47.265] Remote dir gs://kubernetes-jenkins/pr-logs/pull/perf-tests/709/pull-perf-tests-clusterloader2/1159097496404758528/artifacts not exist yet
I0807 13:49:47.265] Call:  gsutil -m -q -o GSUtil:use_magicfile=True cp -r -c -z log,txt,xml /workspace/_artifacts gs://kubernetes-jenkins/pr-logs/pull/perf-tests/709/pull-perf-tests-clusterloader2/1159097496404758528/artifacts
I0807 13:49:49.042] process 4919 exited with code 0 after 0.0m
I0807 13:49:49.045] Call:  git rev-parse HEAD
I0807 13:49:49.050] process 5446 exited with code 0 after 0.0m
... skipping 21 lines ...