This job view page is being replaced by Spyglass soon. Check out the new job view.
PRliggitt: WIP - [v1.16] Update to go1.13.4
ResultFAILURE
Tests 1 failed / 7 succeeded
Started2019-11-09 01:04
Elapsed47m47s
Revision
Buildergke-prow-ssd-pool-1a225945-mv4c
Refs release-1.16:09185a04
85019:1b04ea51
pod7de10e97-0286-11ea-af0d-f65e2caa0e15
infra-commit00626a12e
job-versionv1.16.3-beta.0.64+8a9eb8eda93be0
pod7de10e97-0286-11ea-af0d-f65e2caa0e15
repok8s.io/kubernetes
repo-commit8a9eb8eda93be0ba30d352b6dabe38ae5247e4de
repos{u'k8s.io/kubernetes': u'release-1.16:09185a04091510940228e6b63df0671aaa37606f,85019:1b04ea5148f415f1c35a535f7d34ef9e2ffa5b4a', u'k8s.io/perf-tests': u'master', u'k8s.io/release': u'master'}
revisionv1.16.3-beta.0.64+8a9eb8eda93be0

Test Failures


Up 16m16s

error during ./hack/e2e-internal/e2e-up.sh: exit status 2
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 7 Passed Tests

Error lines from build-log.txt

... skipping 2387 lines ...
W1109 01:22:03.129] .............................................Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/zones/us-east1-b/instanceGroupManagers/e2e-85019-ac87c-minion-group].
W1109 01:22:03.129] done.
W1109 01:22:08.966] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/instanceTemplates/e2e-85019-ac87c-minion-template].
W1109 01:22:15.975] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/instanceTemplates/e2e-85019-ac87c-windows-node-template].
W1109 01:22:57.047] Warning: Permanently added 'compute.3114447897121801090' (ED25519) to the list of known hosts.
I1109 01:22:57.498] Removing etcd replica, name: e2e-85019-ac87c-master, port: 2379, result: 52
I1109 01:22:59.101] {"message":"Internal Server Error"}Removing etcd replica, name: e2e-85019-ac87c-master, port: 4002, result: 0
W1109 01:23:04.615] Updated [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-85019-ac87c-master].
W1109 01:25:41.883] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-85019-ac87c-master].
W1109 01:26:11.887] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-85019-ac87c-master-https].
W1109 01:26:12.788] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-85019-ac87c-master-etcd].
W1109 01:26:13.354] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-85019-ac87c-minion-all].
W1109 01:26:19.318] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/regions/us-east1/addresses/e2e-85019-ac87c-master-ip].
... skipping 15 lines ...
W1109 01:27:21.182] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-85019-ac87c-kubemark-default-internal-node].
W1109 01:27:21.657] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-85019-ac87c-kubemark-master-etcd].
W1109 01:27:22.372] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-85019-ac87c-kubemark-master-https].
W1109 01:27:23.303] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-85019-ac87c-kubemark-minion-all].
W1109 01:27:23.757] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-85019-ac87c-kubemark-minion-http-alt].
I1109 01:27:24.837] Deleting custom subnet...
W1109 01:27:25.847] ERROR: (gcloud.compute.networks.subnets.delete) Could not fetch resource:
W1109 01:27:25.848]  - The subnetwork resource 'projects/k8s-presubmit-scale/regions/us-east1/subnetworks/e2e-85019-ac87c-custom-subnet' is already being used by 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-85019-ac87c-kubemark-master'
W1109 01:27:25.848] 
W1109 01:27:29.142] ERROR: (gcloud.compute.networks.delete) Could not fetch resource:
W1109 01:27:29.143]  - The network resource 'projects/k8s-presubmit-scale/global/networks/e2e-85019-ac87c' is already being used by 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-85019-ac87c-kubemark-master'
W1109 01:27:29.143] 
I1109 01:27:29.243] Failed to delete network 'e2e-85019-ac87c'. Listing firewall-rules:
W1109 01:27:29.918] 
W1109 01:27:29.918] To show all fields of the firewall, please show in JSON format: --format=json
W1109 01:27:29.918] To show all fields in table format, please see the examples in --help.
W1109 01:27:29.918] 
W1109 01:27:30.147] W1109 01:27:30.146080   74133 loader.go:223] Config not found: /workspace/.kube/config
W1109 01:27:30.279] W1109 01:27:30.279104   74175 loader.go:223] Config not found: /workspace/.kube/config
... skipping 112 lines ...
I1109 01:29:47.782] Creating nodes.
W1109 01:29:47.882] WARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.
W1109 01:29:47.883] WARNING: Some requests generated warnings:
W1109 01:29:47.884]  - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
W1109 01:29:47.884]  - The resource 'projects/cos-cloud/global/images/cos-73-11647-163-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-73-11647-182-0'.
W1109 01:29:47.884] 
W1109 01:29:47.884] ERROR: (gcloud.compute.instances.create) Could not fetch resource:
W1109 01:29:47.885]  - Quota 'CPUS' exceeded.  Limit: 2500.0 in region us-east1.
W1109 01:29:47.885] Failed to create master instance due to non-retryable error
W1109 01:29:47.885] Some commands failed.
I1109 01:29:49.436] Using subnet e2e-85019-ac87c-custom-subnet
W1109 01:29:50.262] Attempt 1 to create e2e-85019-ac87c-minion-template
W1109 01:29:50.768] WARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.
W1109 01:29:53.463] Created [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/instanceTemplates/e2e-85019-ac87c-minion-template].
W1109 01:29:53.684] NAME                             MACHINE_TYPE   PREEMPTIBLE  CREATION_TIMESTAMP
W1109 01:29:53.684] e2e-85019-ac87c-minion-template  n1-standard-8               2019-11-08T17:29:51.567-08:00
... skipping 59 lines ...
W1109 01:38:38.458] Trying to find master named 'e2e-85019-ac87c-master'
W1109 01:38:38.458] Looking for address 'e2e-85019-ac87c-master-ip'
W1109 01:38:39.198] Looking for address 'e2e-85019-ac87c-master-internal-ip'
I1109 01:38:40.024] Waiting up to 300 seconds for cluster initialization.
I1109 01:38:40.024] 
I1109 01:38:40.024]   This will continually check to see if the API for kubernetes is reachable.
I1109 01:38:40.025]   This may time out if there was some uncaught error during start up.
I1109 01:38:40.025] 
W1109 01:38:40.125] Using master: e2e-85019-ac87c-master (external IP: 34.73.35.57; internal IP: 10.40.0.12)
I1109 01:43:46.822] ...........................................Checking for custom logdump instances, if any
I1109 01:43:46.828] Sourcing kube-util.sh
I1109 01:43:46.872] Detecting project
I1109 01:43:46.873] Project: k8s-presubmit-scale
I1109 01:43:46.873] Network Project: k8s-presubmit-scale
I1109 01:43:46.873] Zone: us-east1-b
I1109 01:43:46.874] Dumping logs from master locally to '/workspace/_artifacts'
W1109 01:43:46.974] Cluster failed to initialize within 300 seconds.
W1109 01:43:46.975] Last output from querying API server follows:
W1109 01:43:46.975] -----------------------------------------------------
W1109 01:43:46.976]   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
W1109 01:43:46.976]                                  Dload  Upload   Total   Spent    Left  Speed
W1109 01:43:46.977] 
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
  0     0    0     0    0     0      0      0 --:--:--  0:00:01 --:--:--     0
  0     0    0     0    0     0      0      0 --:--:--  0:00:02 --:--:--     0
  0     0    0     0    0     0      0      0 --:--:--  0:00:03 --:--:--     0
  0     0    0     0    0     0      0      0 --:--:--  0:00:04 --:--:--     0
  0     0    0     0    0     0      0      0 --:--:--  0:00:05 --:--:--     0
W1109 01:43:46.977] curl: (28) Connection timed out after 5001 milliseconds
... skipping 3 lines ...
W1109 01:43:46.979] 2019/11/09 01:43:46 process.go:153: Running: ./cluster/log-dump/log-dump.sh /workspace/_artifacts
W1109 01:43:46.979] Trying to find master named 'e2e-85019-ac87c-master'
W1109 01:43:46.979] Looking for address 'e2e-85019-ac87c-master-ip'
W1109 01:43:47.742] Looking for address 'e2e-85019-ac87c-master-internal-ip'
W1109 01:43:48.598] Using master: e2e-85019-ac87c-master (external IP: 34.73.35.57; internal IP: 10.40.0.12)
I1109 01:44:48.377] Changing logfiles to be world-readable for download
W1109 01:44:49.144] ERROR: (gcloud.compute.ssh) Could not fetch resource:
W1109 01:44:49.145]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-85019-ac87c-master' was not found
W1109 01:44:49.145] 
W1109 01:44:54.953] ERROR: (gcloud.compute.ssh) Could not fetch resource:
W1109 01:44:54.953]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-85019-ac87c-master' was not found
W1109 01:44:54.954] 
W1109 01:45:00.749] ERROR: (gcloud.compute.ssh) Could not fetch resource:
W1109 01:45:00.749]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-85019-ac87c-master' was not found
W1109 01:45:00.749] 
W1109 01:45:06.525] ERROR: (gcloud.compute.ssh) Could not fetch resource:
W1109 01:45:06.525]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-85019-ac87c-master' was not found
W1109 01:45:06.525] 
W1109 01:45:12.408] ERROR: (gcloud.compute.ssh) Could not fetch resource:
W1109 01:45:12.409]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-85019-ac87c-master' was not found
W1109 01:45:12.409] 
W1109 01:45:18.245] ERROR: (gcloud.compute.ssh) Could not fetch resource:
W1109 01:45:18.246]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-85019-ac87c-master' was not found
W1109 01:45:18.246] 
I1109 01:45:18.347] Copying 'kern.log kube-apiserver.log kube-apiserver-audit.log kube-scheduler.log kube-controller-manager.log etcd.log etcd-events.log glbc.log cluster-autoscaler.log kube-addon-manager.log fluentd.log kubelet.cov startupscript.log docker/log kubelet.log supervisor/supervisord.log supervisor/kubelet-stdout.log supervisor/kubelet-stderr.log supervisor/docker-stdout.log supervisor/docker-stderr.log' from e2e-85019-ac87c-master
W1109 01:45:19.060] ERROR: (gcloud.compute.instances.get-serial-port-output) Could not fetch serial port output: The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-85019-ac87c-master' was not found
W1109 01:45:19.871] ERROR: (gcloud.compute.scp) Could not fetch resource:
W1109 01:45:19.871]  - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-85019-ac87c-master' was not found
W1109 01:45:19.872] 
I1109 01:45:19.972] Dumping logs from nodes locally to '/workspace/_artifacts'
I1109 01:45:19.972] Detecting nodes in the cluster
I1109 01:46:42.722] Changing logfiles to be world-readable for download
I1109 01:46:42.757] Changing logfiles to be world-readable for download
... skipping 6 lines ...
W1109 01:46:43.953] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:46:44.028] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:46:44.447] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:46:44.600] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:46:44.698] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:46:44.769] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:46:45.177] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:46:45.253] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:46:45.279] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:46:45.377] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:46:45.405] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:46:45.497] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:46:45.563] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:46:45.656] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:46:45.710] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:46:45.790] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:46:45.804] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:46:45.847] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:46:45.882] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:46:45.931] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:46:51.386] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:46:51.447] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:46:51.636] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:46:51.769] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:46:51.963] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:46:51.966] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:46:51.972] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:46:52.466] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:46:52.560] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:46:52.596] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:46:52.683] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:46:52.747] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:46:52.850] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:46:52.922] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:46:53.009] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:46:53.110] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:46:53.186] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:46:53.192] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:46:53.248] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:46:53.285] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:46:53.346] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:46:58.639] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:46:58.761] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:46:58.943] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:46:59.234] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:46:59.386] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:46:59.469] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:46:59.540] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:46:59.786] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:46:59.896] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:46:59.923] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:47:00.019] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:47:00.034] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:47:00.146] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:47:00.262] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:47:00.335] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:47:00.563] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:47:00.642] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:47:00.645] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:47:00.724] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:47:00.870] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:47:00.947] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:47:05.924] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:47:06.077] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:47:06.190] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:47:06.401] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:47:06.754] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:47:06.852] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:47:07.046] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:47:07.068] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:47:07.132] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:47:07.221] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:47:07.324] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:47:07.332] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:47:07.446] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:47:07.450] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:47:07.519] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:47:07.778] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:47:07.834] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:47:07.856] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:47:07.905] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:47:08.103] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:47:08.188] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:47:13.286] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:47:13.456] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:47:13.607] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:47:13.677] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:47:14.120] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:47:14.122] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:47:14.438] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:47:14.521] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:47:14.632] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:47:14.706] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:47:14.803] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:47:14.876] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:47:14.893] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:47:14.971] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:47:15.001] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:47:15.269] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:47:15.346] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:47:15.368] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:47:15.443] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:47:15.569] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:47:15.659] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:47:20.768] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:47:20.837] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:47:21.021] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:47:21.078] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:47:21.470] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:47:21.581] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:47:21.855] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:47:21.874] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:47:21.984] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:47:21.986] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:47:22.082] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:47:22.104] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:47:22.189] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:47:22.199] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
I1109 01:47:22.300] Copying 'kern.log kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov kubelet-hollow-node-*.log kubeproxy-hollow-node-*.log npd-hollow-node-*.log startupscript.log docker/log kubelet.log supervisor/supervisord.log supervisor/kubelet-stdout.log supervisor/kubelet-stderr.log supervisor/docker-stdout.log supervisor/docker-stderr.log' from e2e-85019-ac87c-minion-group-dzxd
I1109 01:47:22.301] Copying 'kern.log kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov kubelet-hollow-node-*.log kubeproxy-hollow-node-*.log npd-hollow-node-*.log startupscript.log docker/log kubelet.log supervisor/supervisord.log supervisor/kubelet-stdout.log supervisor/kubelet-stderr.log supervisor/docker-stdout.log supervisor/docker-stderr.log' from e2e-85019-ac87c-minion-group-l5mb
I1109 01:47:22.335] Copying 'kern.log kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov kubelet-hollow-node-*.log kubeproxy-hollow-node-*.log npd-hollow-node-*.log startupscript.log docker/log kubelet.log supervisor/supervisord.log supervisor/kubelet-stdout.log supervisor/kubelet-stderr.log supervisor/docker-stdout.log supervisor/docker-stderr.log' from e2e-85019-ac87c-minion-group-mmjj
W1109 01:47:22.436] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
I1109 01:47:22.537] Copying 'kern.log kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov kubelet-hollow-node-*.log kubeproxy-hollow-node-*.log npd-hollow-node-*.log startupscript.log docker/log kubelet.log supervisor/supervisord.log supervisor/kubelet-stdout.log supervisor/kubelet-stderr.log supervisor/docker-stdout.log supervisor/docker-stderr.log' from e2e-85019-ac87c-minion-group-zl1v
W1109 01:47:22.637] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:47:22.709] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
W1109 01:47:22.757] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
I1109 01:47:22.858] Copying 'kern.log kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov kubelet-hollow-node-*.log kubeproxy-hollow-node-*.log npd-hollow-node-*.log startupscript.log docker/log kubelet.log supervisor/supervisord.log supervisor/kubelet-stdout.log supervisor/kubelet-stderr.log supervisor/docker-stdout.log supervisor/docker-stderr.log' from e2e-85019-ac87c-minion-group-8bmt
W1109 01:47:22.958] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
I1109 01:47:23.090] Copying 'kern.log kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov kubelet-hollow-node-*.log kubeproxy-hollow-node-*.log npd-hollow-node-*.log startupscript.log docker/log kubelet.log supervisor/supervisord.log supervisor/kubelet-stdout.log supervisor/kubelet-stderr.log supervisor/docker-stdout.log supervisor/docker-stderr.log' from e2e-85019-ac87c-minion-group-z48k
W1109 01:47:23.191] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:47:23.247] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255].
I1109 01:47:23.373] Copying 'kern.log kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov kubelet-hollow-node-*.log kubeproxy-hollow-node-*.log npd-hollow-node-*.log startupscript.log docker/log kubelet.log supervisor/supervisord.log supervisor/kubelet-stdout.log supervisor/kubelet-stderr.log supervisor/docker-stdout.log supervisor/docker-stderr.log' from e2e-85019-ac87c-minion-group-3ql9
W1109 01:47:23.558] 
W1109 01:47:23.558] Specify --start=41997 in the next get-serial-port-output invocation to get only the new output starting from here.
W1109 01:47:23.624] 
W1109 01:47:23.624] Specify --start=43614 in the next get-serial-port-output invocation to get only the new output starting from here.
W1109 01:47:23.757] 
... skipping 10 lines ...
W1109 01:47:24.974] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:47:25.042] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:47:25.179] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:47:25.253] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:47:25.535] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:47:25.824] External IP address was not found; defaulting to using IAP tunneling.
W1109 01:47:25.897] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:47:26.001] ssh_exchange_identification: Connection closed by remote host
W1109 01:47:26.007] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1].
W1109 01:47:26.160] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:47:26.174] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:47:26.246] ssh_exchange_identification: Connection closed by remote host
W1109 01:47:26.249] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1].
W1109 01:47:26.265] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:47:26.280] ssh_exchange_identification: Connection closed by remote host
W1109 01:47:26.282] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1].
W1109 01:47:26.346] ssh_exchange_identification: Connection closed by remote host
W1109 01:47:26.349] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:47:26.353] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1].
W1109 01:47:26.455] ssh_exchange_identification: Connection closed by remote host
W1109 01:47:26.458] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1].
W1109 01:47:26.604] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:47:26.678] ssh_exchange_identification: Connection closed by remote host
W1109 01:47:26.682] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1].
W1109 01:47:26.914] ERROR: (gcloud.compute.start-iap-tunnel) Error while connecting [4033: u'not authorized'].
W1109 01:47:26.998] ssh_exchange_identification: Connection closed by remote host
W1109 01:47:27.002] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1].
W1109 01:47:30.319] INSTANCE_GROUPS=e2e-85019-ac87c-minion-group
W1109 01:47:30.319] NODE_NAMES=e2e-85019-ac87c-minion-group-3ql9 e2e-85019-ac87c-minion-group-8bmt e2e-85019-ac87c-minion-group-dzxd e2e-85019-ac87c-minion-group-l5mb e2e-85019-ac87c-minion-group-mmjj e2e-85019-ac87c-minion-group-z48k e2e-85019-ac87c-minion-group-zl1v
I1109 01:47:31.259] Failures for e2e-85019-ac87c-minion-group
W1109 01:47:32.714] 2019/11/09 01:47:32 process.go:155: Step './cluster/log-dump/log-dump.sh /workspace/_artifacts' finished in 3m45.895474411s
W1109 01:47:32.714] 2019/11/09 01:47:32 process.go:153: Running: ./hack/e2e-internal/e2e-down.sh
W1109 01:47:32.760] Project: k8s-presubmit-scale
... skipping 25 lines ...
W1109 01:51:43.788] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-85019-ac87c-default-internal-node].
W1109 01:51:44.229] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-85019-ac87c-default-ssh].
I1109 01:51:45.105] Deleting Cloud NAT router...
W1109 01:51:53.164] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/regions/us-east1/routers/e2e-85019-ac87c-nat-router].
I1109 01:51:54.082] Deleting firewall rules remaining in network e2e-85019-ac87c: 
I1109 01:51:54.825] Deleting custom subnet...
W1109 01:51:55.860] ERROR: (gcloud.compute.networks.subnets.delete) Could not fetch resource:
W1109 01:51:55.860]  - The subnetwork resource 'projects/k8s-presubmit-scale/regions/us-east1/subnetworks/e2e-85019-ac87c-custom-subnet' is already being used by 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-85019-ac87c-kubemark-master'
W1109 01:51:55.861] 
W1109 01:51:58.935] ERROR: (gcloud.compute.networks.delete) Could not fetch resource:
W1109 01:51:58.935]  - The network resource 'projects/k8s-presubmit-scale/global/networks/e2e-85019-ac87c' is already being used by 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-85019-ac87c-kubemark-master'
W1109 01:51:58.935] 
I1109 01:51:59.036] Failed to delete network 'e2e-85019-ac87c'. Listing firewall-rules:
W1109 01:51:59.800] 
W1109 01:51:59.800] To show all fields of the firewall, please show in JSON format: --format=json
W1109 01:51:59.800] To show all fields in table format, please see the examples in --help.
W1109 01:51:59.800] 
W1109 01:52:00.006] W1109 01:52:00.006751   83509 loader.go:223] Config not found: /workspace/.kube/config
W1109 01:52:00.141] W1109 01:52:00.141466   83551 loader.go:223] Config not found: /workspace/.kube/config
... skipping 9 lines ...
I1109 01:52:00.546] Cleared config for k8s-presubmit-scale_e2e-85019-ac87c from /workspace/.kube/config
I1109 01:52:00.546] Done
W1109 01:52:00.571] W1109 01:52:00.541782   83675 loader.go:223] Config not found: /workspace/.kube/config
W1109 01:52:00.571] W1109 01:52:00.541969   83675 loader.go:223] Config not found: /workspace/.kube/config
W1109 01:52:00.571] 2019/11/09 01:52:00 process.go:155: Step './hack/e2e-internal/e2e-down.sh' finished in 4m27.833924402s
W1109 01:52:00.571] 2019/11/09 01:52:00 process.go:96: Saved XML output to /workspace/_artifacts/junit_runner.xml.
W1109 01:52:00.571] 2019/11/09 01:52:00 main.go:319: Something went wrong: starting e2e cluster: error during ./hack/e2e-internal/e2e-up.sh: exit status 2
W1109 01:52:00.572] Traceback (most recent call last):
W1109 01:52:00.572]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 778, in <module>
W1109 01:52:00.572]     main(parse_args())
W1109 01:52:00.572]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 626, in main
W1109 01:52:00.572]     mode.start(runner_args)
W1109 01:52:00.572]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 262, in start
W1109 01:52:00.572]     check_env(env, self.command, *args)
W1109 01:52:00.572]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 111, in check_env
W1109 01:52:00.572]     subprocess.check_call(cmd, env=env)
W1109 01:52:00.573]   File "/usr/lib/python2.7/subprocess.py", line 190, in check_call
W1109 01:52:00.573]     raise CalledProcessError(retcode, cmd)
W1109 01:52:00.574] subprocess.CalledProcessError: Command '('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--build=bazel', '--stage=gs://kubernetes-release-pull/ci/pull-kubernetes-kubemark-e2e-gce-big', '--up', '--down', '--provider=gce', '--cluster=e2e-85019-ac87c', '--gcp-network=e2e-85019-ac87c', '--extract=local', '--gcp-master-size=n1-standard-4', '--gcp-node-size=n1-standard-8', '--gcp-nodes=7', '--gcp-project=k8s-presubmit-scale', '--gcp-zone=us-east1-b', '--kubemark', '--kubemark-nodes=500', '--test_args=--ginkgo.focus=xxxx', '--test-cmd=/go/src/k8s.io/perf-tests/run-e2e.sh', '--test-cmd-args=cluster-loader2', '--test-cmd-args=--nodes=500', '--test-cmd-args=--provider=kubemark', '--test-cmd-args=--report-dir=/workspace/_artifacts', '--test-cmd-args=--testconfig=testing/density/config.yaml', '--test-cmd-args=--testconfig=testing/load/config.yaml', '--test-cmd-args=--testoverrides=./testing/load/kubemark/500_nodes/override.yaml', '--test-cmd-name=ClusterLoaderV2', '--timeout=100m')' returned non-zero exit status 1
E1109 01:52:00.574] Command failed
I1109 01:52:00.574] process 721 exited with code 1 after 46.3m
E1109 01:52:00.574] FAIL: pull-kubernetes-kubemark-e2e-gce-big
I1109 01:52:00.574] Call:  gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json
W1109 01:52:01.030] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
I1109 01:52:01.083] process 83686 exited with code 0 after 0.0m
I1109 01:52:01.083] Call:  gcloud config get-value account
I1109 01:52:01.381] process 83698 exited with code 0 after 0.0m
I1109 01:52:01.382] Will upload results to gs://kubernetes-jenkins/pr-logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com
I1109 01:52:01.382] Upload result and artifacts...
I1109 01:52:01.382] Gubernator results at https://gubernator.k8s.io/build/kubernetes-jenkins/pr-logs/pull/85019/pull-kubernetes-kubemark-e2e-gce-big/1192971092843565056
I1109 01:52:01.382] Call:  gsutil ls gs://kubernetes-jenkins/pr-logs/pull/85019/pull-kubernetes-kubemark-e2e-gce-big/1192971092843565056/artifacts
W1109 01:52:02.152] CommandException: One or more URLs matched no objects.
E1109 01:52:02.291] Command failed
I1109 01:52:02.291] process 83710 exited with code 1 after 0.0m
W1109 01:52:02.291] Remote dir gs://kubernetes-jenkins/pr-logs/pull/85019/pull-kubernetes-kubemark-e2e-gce-big/1192971092843565056/artifacts not exist yet
I1109 01:52:02.291] Call:  gsutil -m -q -o GSUtil:use_magicfile=True cp -r -c -z log,txt,xml /workspace/_artifacts gs://kubernetes-jenkins/pr-logs/pull/85019/pull-kubernetes-kubemark-e2e-gce-big/1192971092843565056/artifacts
I1109 01:52:04.033] process 83854 exited with code 0 after 0.0m
I1109 01:52:04.034] Call:  git rev-parse HEAD
I1109 01:52:04.038] process 84404 exited with code 0 after 0.0m
... skipping 20 lines ...