This job view page is being replaced by Spyglass soon. Check out the new job view.
PRmatthyx: Add startupProbe to health checks
ResultFAILURE
Tests 1 failed / 7 succeeded
Started2019-08-22 21:41
Elapsed30m11s
Revision
Buildergke-prow-ssd-pool-1a225945-50fp
Refs master:37651f1c
77807:412ebfb3
pod877860ac-c525-11e9-9342-e69cf4ca5bc2
infra-commit1c5f719f8
job-versionv1.17.0-alpha.0.467+7679c1e08ae893
pod877860ac-c525-11e9-9342-e69cf4ca5bc2
repok8s.io/kubernetes
repo-commit7679c1e08ae893f860ba8fe127918a4168d6347b
repos{u'k8s.io/kubernetes': u'master:37651f1cef5ec5c7286ba409ee0fe298c4605d66,77807:412ebfb3651ad1fb54370723ba638837d94f6b73', u'k8s.io/perf-tests': u'master', u'k8s.io/release': u'master'}
revisionv1.17.0-alpha.0.467+7679c1e08ae893

Test Failures


Up 1m37s

error during ./hack/e2e-internal/e2e-up.sh: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 7 Passed Tests

Error lines from build-log.txt

... skipping 388 lines ...
W0822 21:57:05.582] INFO: Elapsed time: 815.247s, Critical Path: 254.91s
W0822 21:57:05.582] INFO: 5130 processes: 5130 processwrapper-sandbox.
W0822 21:57:05.589] INFO: Build completed successfully, 5223 total actions
W0822 21:57:05.593] INFO: Build completed successfully, 5223 total actions
W0822 21:57:05.615] 2019/08/22 21:57:05 process.go:155: Step 'make -C /go/src/k8s.io/kubernetes bazel-release' finished in 13m35.558921993s
W0822 21:57:05.615] 2019/08/22 21:57:05 util.go:255: Flushing memory.
W0822 21:57:05.651] 2019/08/22 21:57:05 util.go:265: flushMem error (page cache): exit status 1
W0822 21:57:05.652] 2019/08/22 21:57:05 process.go:153: Running: /go/src/k8s.io/release/push-build.sh --nomock --verbose --noupdatelatest --bucket=kubernetes-release-pull --ci --gcs-suffix=/pull-kubernetes-e2e-gce-100-performance --allow-dup
W0822 21:57:05.751] $TEST_TMPDIR defined: output root default is '/bazel-scratch/.cache/bazel' and max_idle_secs default is '15'.
I0822 21:57:05.852] make: Leaving directory '/go/src/k8s.io/kubernetes'
I0822 21:57:05.852] push-build.sh: BEGIN main on 877860ac-c525-11e9-9342-e69cf4ca5bc2 Thu Aug 22 21:57:05 UTC 2019
I0822 21:57:05.853] 
W0822 21:57:06.596] Loading: 
... skipping 689 lines ...
W0822 22:01:49.652] Network Project: k8s-presubmit-scale
W0822 22:01:49.652] Zone: us-east1-b
I0822 22:01:55.277] Bringing down cluster
W0822 22:01:55.378] INSTANCE_GROUPS=
W0822 22:01:55.379] NODE_NAMES=
W0822 22:02:10.755] ssh: connect to host 35.243.209.64 port 22: Connection refused
W0822 22:02:10.764] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
I0822 22:02:10.902] Removing etcd replica, name: e2e-77807-95a39-master, port: 2379, result: 255
W0822 22:02:12.481] ssh: connect to host 35.243.209.64 port 22: Connection refused
W0822 22:02:12.487] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
I0822 22:02:12.602] Removing etcd replica, name: e2e-77807-95a39-master, port: 4002, result: 255
W0822 22:04:02.514] ERROR: (gcloud.compute.instances.delete) Could not fetch resource:
W0822 22:04:02.515]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-77807-95a39-master' was not found
W0822 22:04:02.515] 
W0822 22:04:13.302] ERROR: (gcloud.compute.firewall-rules.delete) Could not fetch resource:
W0822 22:04:13.303]  - The resource 'projects/k8s-presubmit-scale/global/firewalls/e2e-77807-95a39-master-https' is not ready
W0822 22:04:13.303] 
W0822 22:04:14.870] ERROR: (gcloud.compute.firewall-rules.delete) Could not fetch resource:
W0822 22:04:14.870]  - The resource 'projects/k8s-presubmit-scale/global/firewalls/e2e-77807-95a39-master-etcd' is not ready
W0822 22:04:14.870] 
W0822 22:04:15.957] ERROR: (gcloud.compute.firewall-rules.delete) Could not fetch resource:
W0822 22:04:15.958]  - The resource 'projects/k8s-presubmit-scale/global/firewalls/e2e-77807-95a39-minion-all' is not ready
W0822 22:04:15.958] 
W0822 22:04:16.048] Failed to delete firewall rules.
W0822 22:04:30.063] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/regions/us-east1/addresses/e2e-77807-95a39-master-ip].
W0822 22:05:04.944] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-77807-95a39-default-internal-master].
W0822 22:05:07.001] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-77807-95a39-default-internal-node].
W0822 22:05:08.449] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-77807-95a39-default-ssh].
I0822 22:05:10.603] Deleting firewall rules remaining in network e2e-77807-95a39: 
I0822 22:05:12.061] Deleting custom subnet...
W0822 22:05:13.560] ERROR: (gcloud.compute.networks.subnets.delete) Could not fetch resource:
W0822 22:05:13.561]  - The resource 'projects/k8s-presubmit-scale/regions/us-east1/subnetworks/e2e-77807-95a39-custom-subnet' is not ready
W0822 22:05:13.561] 
W0822 22:05:23.261] ERROR: (gcloud.compute.networks.delete) Could not fetch resource:
W0822 22:05:23.262]  - The network resource 'projects/k8s-presubmit-scale/global/networks/e2e-77807-95a39' is already being used by 'projects/k8s-presubmit-scale/regions/us-east1/subnetworks/e2e-77807-95a39-custom-subnet'
W0822 22:05:23.262] 
I0822 22:05:23.362] Failed to delete network 'e2e-77807-95a39'. Listing firewall-rules:
W0822 22:05:25.068] 
W0822 22:05:25.068] To show all fields of the firewall, please show in JSON format: --format=json
W0822 22:05:25.069] To show all fields in table format, please see the examples in --help.
W0822 22:05:25.069] 
W0822 22:05:25.577] W0822 22:05:25.577172   71623 loader.go:223] Config not found: /workspace/.kube/config
W0822 22:05:25.945] W0822 22:05:25.945400   71676 loader.go:223] Config not found: /workspace/.kube/config
... skipping 36 lines ...
W0822 22:06:31.086] instances as well as SSH, RDP, and ICMP by running:
W0822 22:06:31.086] 
W0822 22:06:31.086] $ gcloud compute firewall-rules create <FIREWALL_NAME> --network e2e-77807-95a39 --allow tcp,udp,icmp --source-ranges <IP_RANGE>
W0822 22:06:31.087] $ gcloud compute firewall-rules create <FIREWALL_NAME> --network e2e-77807-95a39 --allow tcp:22,tcp:3389,icmp
W0822 22:06:31.088] 
W0822 22:06:33.371] Creating firewall...
W0822 22:06:34.483] failed.
W0822 22:06:34.488] ERROR: (gcloud.compute.firewall-rules.create) Could not fetch resource:
W0822 22:06:34.489]  - The resource 'projects/k8s-presubmit-scale/global/firewalls/e2e-77807-95a39-default-internal-master' already exists
W0822 22:06:34.489] 
W0822 22:06:34.743] Creating firewall...
I0822 22:06:34.956] IP aliases are enabled. Creating subnetworks.
W0822 22:06:35.106] failed.
W0822 22:06:35.113] ERROR: (gcloud.compute.firewall-rules.create) Could not fetch resource:
W0822 22:06:35.114]  - The resource 'projects/k8s-presubmit-scale/global/firewalls/e2e-77807-95a39-default-internal-node' already exists
W0822 22:06:35.114] 
W0822 22:06:36.042] Creating firewall...
W0822 22:06:36.318] failed.
W0822 22:06:36.321] ERROR: (gcloud.compute.firewall-rules.create) Could not fetch resource:
W0822 22:06:36.322]  - The resource 'projects/k8s-presubmit-scale/global/firewalls/e2e-77807-95a39-default-ssh' already exists
W0822 22:06:36.322] 
I0822 22:06:36.650] Using subnet e2e-77807-95a39-custom-subnet
I0822 22:06:36.658] Starting master and configuring firewalls
I0822 22:06:36.660] Configuring firewall for apiserver konnectivity server
W0822 22:06:37.954] Creating firewall...
... skipping 43 lines ...
W0822 22:06:59.370] specifically, section 10.2.3 ("Information Requirements").
W0822 22:07:02.187] .Created [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-77807-95a39-master-etcd].
W0822 22:07:02.336] done.
I0822 22:07:02.442] NAME                         NETWORK          DIRECTION  PRIORITY  ALLOW              DENY  DISABLED
I0822 22:07:02.451] e2e-77807-95a39-master-etcd  e2e-77807-95a39  INGRESS    1000      tcp:2380,tcp:2381        False
W0822 22:07:04.058] WARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.
W0822 22:07:04.059] ERROR: (gcloud.compute.instances.create) Could not fetch resource:
W0822 22:07:04.059]  - The resource 'projects/k8s-presubmit-scale/regions/us-east1/subnetworks/e2e-77807-95a39-custom-subnet' is not ready
W0822 22:07:04.059] Failed to create master instance due to non-retryable error
W0822 22:07:04.078] 2019/08/22 22:07:04 process.go:155: Step './hack/e2e-internal/e2e-up.sh' finished in 1m37.078455782s
W0822 22:07:04.078] 2019/08/22 22:07:04 e2e.go:519: Dumping logs from nodes to GCS directly at path: gs://kubernetes-jenkins/pr-logs/pull/77807/pull-kubernetes-e2e-gce-100-performance/1164653874556964864/artifacts
W0822 22:07:04.079] 2019/08/22 22:07:04 process.go:153: Running: ./cluster/log-dump/log-dump.sh /workspace/_artifacts gs://kubernetes-jenkins/pr-logs/pull/77807/pull-kubernetes-e2e-gce-100-performance/1164653874556964864/artifacts
I0822 22:07:04.179] Checking for custom logdump instances, if any
I0822 22:07:04.180] Sourcing kube-util.sh
I0822 22:07:04.265] Detecting project
... skipping 2 lines ...
I0822 22:07:04.266] Zone: us-east1-b
I0822 22:07:04.266] Dumping logs from master locally to '/workspace/_artifacts'
W0822 22:07:04.367] Trying to find master named 'e2e-77807-95a39-master'
W0822 22:07:04.367] Looking for address 'e2e-77807-95a39-master-ip'
W0822 22:07:05.622] Using master: e2e-77807-95a39-master (external IP: 35.237.11.121; internal IP: (not set))
I0822 22:08:10.700] Changing logfiles to be world-readable for download
W0822 22:08:11.841] ERROR: (gcloud.compute.ssh) Could not fetch resource:
W0822 22:08:11.841]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-77807-95a39-master' was not found
W0822 22:08:11.841] 
W0822 22:08:18.209] ERROR: (gcloud.compute.ssh) Could not fetch resource:
W0822 22:08:18.209]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-77807-95a39-master' was not found
W0822 22:08:18.209] 
W0822 22:08:24.649] ERROR: (gcloud.compute.ssh) Could not fetch resource:
W0822 22:08:24.649]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-77807-95a39-master' was not found
W0822 22:08:24.649] 
W0822 22:08:30.856] ERROR: (gcloud.compute.ssh) Could not fetch resource:
W0822 22:08:30.856]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-77807-95a39-master' was not found
W0822 22:08:30.856] 
W0822 22:08:36.995] ERROR: (gcloud.compute.ssh) Could not fetch resource:
W0822 22:08:36.995]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-77807-95a39-master' was not found
W0822 22:08:36.995] 
W0822 22:08:43.191] ERROR: (gcloud.compute.ssh) Could not fetch resource:
W0822 22:08:43.192]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-77807-95a39-master' was not found
W0822 22:08:43.192] 
I0822 22:08:43.296] Copying 'kern.log kube-apiserver.log kube-apiserver-audit.log kube-scheduler.log kube-controller-manager.log etcd.log etcd-events.log glbc.log cluster-autoscaler.log kube-addon-manager.log fluentd.log kubelet.cov startupscript.log docker/log kubelet.log supervisor/supervisord.log supervisor/kubelet-stdout.log supervisor/kubelet-stderr.log supervisor/docker-stdout.log supervisor/docker-stderr.log' from e2e-77807-95a39-master
W0822 22:08:44.534] ERROR: (gcloud.compute.instances.get-serial-port-output) Could not fetch serial port output: The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-77807-95a39-master' was not found
W0822 22:08:45.948] ERROR: (gcloud.compute.scp) Could not fetch resource:
W0822 22:08:45.949]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-77807-95a39-master' was not found
W0822 22:08:45.949] 
I0822 22:08:46.050] Dumping logs from nodes to GCS directly at 'gs://kubernetes-jenkins/pr-logs/pull/77807/pull-kubernetes-e2e-gce-100-performance/1164653874556964864/artifacts' using logexporter
I0822 22:08:46.051] Detecting nodes in the cluster
I0822 22:08:49.440] No nodes found!
W0822 22:08:53.367] INSTANCE_GROUPS=
... skipping 36 lines ...
W0822 22:11:47.920] W0822 22:11:47.818865   76516 loader.go:223] Config not found: /workspace/.kube/config
W0822 22:11:47.920] W0822 22:11:47.819169   76516 loader.go:223] Config not found: /workspace/.kube/config
W0822 22:11:48.048] W0822 22:11:48.048115   76570 loader.go:223] Config not found: /workspace/.kube/config
W0822 22:11:48.049] W0822 22:11:48.048402   76570 loader.go:223] Config not found: /workspace/.kube/config
W0822 22:11:48.055] 2019/08/22 22:11:48 process.go:155: Step './hack/e2e-internal/e2e-down.sh' finished in 2m54.68805106s
W0822 22:11:48.055] 2019/08/22 22:11:48 process.go:96: Saved XML output to /workspace/_artifacts/junit_runner.xml.
W0822 22:11:48.055] 2019/08/22 22:11:48 main.go:319: Something went wrong: starting e2e cluster: error during ./hack/e2e-internal/e2e-up.sh: exit status 1
W0822 22:11:48.058] Traceback (most recent call last):
W0822 22:11:48.058]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 778, in <module>
W0822 22:11:48.067]     main(parse_args())
W0822 22:11:48.068]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 626, in main
W0822 22:11:48.068]     mode.start(runner_args)
W0822 22:11:48.068]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 262, in start
... skipping 3 lines ...
W0822 22:11:48.069]   File "/usr/lib/python2.7/subprocess.py", line 186, in check_call
W0822 22:11:48.069]     raise CalledProcessError(retcode, cmd)
W0822 22:11:48.070] subprocess.CalledProcessError: Command '('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--build=bazel', '--stage=gs://kubernetes-release-pull/ci/pull-kubernetes-e2e-gce-100-performance', '--up', '--down', '--provider=gce', '--cluster=e2e-77807-95a39', '--gcp-network=e2e-77807-95a39', '--extract=local', '--gcp-nodes=100', '--gcp-project=k8s-presubmit-scale', '--gcp-zone=us-east1-b', '--test-cmd=/go/src/k8s.io/perf-tests/run-e2e.sh', '--test-cmd-args=cluster-loader2', '--test-cmd-args=--nodes=100', '--test-cmd-args=--prometheus-scrape-etcd', '--test-cmd-args=--provider=gce', '--test-cmd-args=--report-dir=/workspace/_artifacts', '--test-cmd-args=--testconfig=testing/density/config.yaml', '--test-cmd-args=--testconfig=testing/load/config.yaml', '--test-cmd-args=--testoverrides=./testing/density/100_nodes/override.yaml', '--test-cmd-args=--testoverrides=./testing/load/gce/throughput_override.yaml', '--test-cmd-args=--testoverrides=./testing/experiments/enable_dns_probes.yaml', '--test-cmd-name=ClusterLoaderV2', '--timeout=100m', '--logexporter-gcs-path=gs://kubernetes-jenkins/pr-logs/pull/77807/pull-kubernetes-e2e-gce-100-performance/1164653874556964864/artifacts')' returned non-zero exit status 1
I0822 22:11:48.078] Property "contexts.k8s-presubmit-scale_e2e-77807-95a39" unset.
I0822 22:11:48.079] Cleared config for k8s-presubmit-scale_e2e-77807-95a39 from /workspace/.kube/config
I0822 22:11:48.079] Done
E0822 22:11:48.079] Command failed
I0822 22:11:48.079] process 524 exited with code 1 after 28.4m
E0822 22:11:48.079] FAIL: pull-kubernetes-e2e-gce-100-performance
I0822 22:11:48.080] Call:  gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json
W0822 22:11:48.682] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
I0822 22:11:48.750] process 76581 exited with code 0 after 0.0m
I0822 22:11:48.751] Call:  gcloud config get-value account
I0822 22:11:49.142] process 76593 exited with code 0 after 0.0m
I0822 22:11:49.142] Will upload results to gs://kubernetes-jenkins/pr-logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com
I0822 22:11:49.143] Upload result and artifacts...
I0822 22:11:49.143] Gubernator results at https://gubernator.k8s.io/build/kubernetes-jenkins/pr-logs/pull/77807/pull-kubernetes-e2e-gce-100-performance/1164653874556964864
I0822 22:11:49.143] Call:  gsutil ls gs://kubernetes-jenkins/pr-logs/pull/77807/pull-kubernetes-e2e-gce-100-performance/1164653874556964864/artifacts
W0822 22:11:50.374] CommandException: One or more URLs matched no objects.
E0822 22:11:50.510] Command failed
I0822 22:11:50.510] process 76605 exited with code 1 after 0.0m
W0822 22:11:50.511] Remote dir gs://kubernetes-jenkins/pr-logs/pull/77807/pull-kubernetes-e2e-gce-100-performance/1164653874556964864/artifacts not exist yet
I0822 22:11:50.511] Call:  gsutil -m -q -o GSUtil:use_magicfile=True cp -r -c -z log,txt,xml /workspace/_artifacts gs://kubernetes-jenkins/pr-logs/pull/77807/pull-kubernetes-e2e-gce-100-performance/1164653874556964864/artifacts
I0822 22:11:52.679] process 76747 exited with code 0 after 0.0m
I0822 22:11:52.681] Call:  git rev-parse HEAD
I0822 22:11:52.687] process 77274 exited with code 0 after 0.0m
... skipping 21 lines ...