This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 5 succeeded
Started2020-02-18 11:23
Elapsed13m41s
Revision
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/a6d3c72c-8695-4e30-9b4c-e49fdbc17fd0/targets/test'}}
resultstorehttps://source.cloud.google.com/results/invocations/a6d3c72c-8695-4e30-9b4c-e49fdbc17fd0/targets/test
job-versionv1.18.0-alpha.5.178+5bd719b6a6f6ea
revisionv1.18.0-alpha.5.178+5bd719b6a6f6ea

Test Failures


Up 10m15s

kops update cluster failed: error during /tmp/kops094272039/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 5 Passed Tests

Error lines from build-log.txt

Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
fatal: not a git repository (or any of the parent directories): .git
+ /workspace/scenarios/kubernetes_e2e.py --cluster=e2e-kops-gce-canary.k8s.local --deployment=kops --extract=ci/latest --ginkgo-parallel=30 --kops-priority-path=/workspace/kubernetes/platforms/linux/amd64 --kops-version=https://storage.googleapis.com/kops-ci/bin/latest-ci-updown-green.txt --kops-zones=us-central1-c --provider=gce '--test_args=--ginkgo.skip=\[Slow\]|\[Serial\]|\[Disruptive\]|\[Flaky\]|\[Feature:.+\]|\[HPA\]|Dashboard|Services.*functioning.*NodePort' --timeout=120m
starts with local mode
Environment:
ARTIFACTS=/logs/artifacts
BAZEL_REMOTE_CACHE_ENABLED=false
BAZEL_VERSION=0.23.2
... skipping 479 lines ...
I0218 11:24:03.199944     235 vfs_castore.go:675] Issuing new certificate: "etcd-clients-ca"
I0218 11:24:03.225295     235 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-main"
I0218 11:24:03.231415     235 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-events"
I0218 11:24:03.250532     235 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-events"
I0218 11:24:03.426627     235 vfs_castore.go:675] Issuing new certificate: "apiserver-aggregator-ca"
I0218 11:24:03.532878     235 vfs_castore.go:675] Issuing new certificate: "ca"
W0218 11:24:12.676049     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:24:12.676092     235 executor.go:103] Tasks: 36 done / 64 total; 26 can run
I0218 11:24:12.794418     235 instancetemplate.go:223] We should be using NVME for GCE
I0218 11:24:12.853816     235 instancetemplate.go:223] We should be using NVME for GCE
I0218 11:24:12.858233     235 instancetemplate.go:223] We should be using NVME for GCE
I0218 11:24:12.860233     235 instancetemplate.go:223] We should be using NVME for GCE
I0218 11:24:12.964885     235 vfs_castore.go:675] Issuing new certificate: "apiserver-aggregator"
... skipping 3 lines ...
I0218 11:24:13.275227     235 vfs_castore.go:675] Issuing new certificate: "kube-scheduler"
I0218 11:24:13.404373     235 vfs_castore.go:675] Issuing new certificate: "apiserver-proxy-client"
I0218 11:24:13.451152     235 vfs_castore.go:675] Issuing new certificate: "kube-controller-manager"
I0218 11:24:13.475832     235 vfs_castore.go:675] Issuing new certificate: "master"
I0218 11:24:13.563035     235 vfs_castore.go:675] Issuing new certificate: "kube-proxy"
I0218 11:24:13.595847     235 vfs_castore.go:675] Issuing new certificate: "kubelet"
W0218 11:24:20.680169     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m42s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:24:20.680208     235 executor.go:103] Tasks: 61 done / 64 total; 3 can run
W0218 11:24:35.442644     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m27s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:24:35.442681     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:24:36.000568     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m26s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:24:36.000593     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:24:46.000955     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:24:46.497596     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m16s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:24:46.497624     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:24:56.497833     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:24:57.158764     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m5s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:24:57.158801     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:25:07.159042     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:25:07.596464     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m55s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:25:07.596498     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:25:17.596808     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:25:17.999967     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m44s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:25:18.000009     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:25:28.000196     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:25:28.459983     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m34s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:25:28.460027     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:25:38.460337     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:25:38.860300     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m23s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:25:38.860336     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:25:48.860477     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:25:49.359390     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m13s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:25:49.359416     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:25:59.359841     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:25:59.760127     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m3s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:25:59.760157     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:26:09.760318     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:26:10.165476     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m52s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:26:10.165508     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:26:20.166101     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:26:20.561015     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m42s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:26:20.561408     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:26:30.562001     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:26:31.097517     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m31s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:26:31.097543     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:26:41.097744     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:26:41.560607     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m21s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:26:41.560640     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:26:51.561052     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:26:51.960320     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m10s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:26:51.960349     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:27:01.960827     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:27:02.458670     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m0s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:27:02.458696     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:27:12.458923     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:27:12.860551     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m49s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:27:12.860577     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:27:22.860757     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:27:23.376308     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m39s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:27:23.376337     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:27:33.376537     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:27:34.001322     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m28s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:27:34.001348     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:27:44.001522     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:27:44.505859     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m18s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:27:44.505893     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:27:54.506093     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:27:54.862482     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m7s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:27:54.862508     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:28:04.862700     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:28:05.363181     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m57s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:28:05.363208     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:28:15.363393     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:28:15.760245     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m47s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:28:15.760280     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:28:25.760548     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:28:26.200315     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m36s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:28:26.200344     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:28:36.200596     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:28:36.659939     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m26s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:28:36.659964     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:28:46.660211     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:28:47.064109     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m15s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:28:47.064139     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:28:57.064296     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:28:57.602744     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m5s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:28:57.602778     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:29:07.602939     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:29:08.059749     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m54s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:29:08.059783     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:29:18.060118     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:29:18.466000     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m44s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:29:18.466034     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:29:28.466258     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:29:29.097314     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m33s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:29:29.097351     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:29:39.097670     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:29:39.461656     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m23s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:29:39.461686     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:29:49.461863     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:29:50.105204     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m12s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:29:50.105234     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:30:00.105478     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:30:00.466294     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m2s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:30:00.466322     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:30:10.466606     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:30:10.995352     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m51s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:30:10.995378     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:30:20.995757     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:30:21.500744     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m41s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:30:21.500772     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:30:31.500935     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:30:31.961761     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m30s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:30:31.961786     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:30:41.962049     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:30:42.357809     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m20s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:30:42.357836     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:30:52.358406     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:30:52.903818     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m9s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:30:52.903854     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:31:02.904041     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:31:03.267995     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m59s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:31:03.268025     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:31:13.268260     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:31:13.661681     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m49s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:31:13.661718     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:31:23.662027     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:31:24.060660     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m38s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:31:24.060684     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:31:34.060921     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:31:34.895094     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m27s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:31:34.895121     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:31:44.895372     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:31:45.359600     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m17s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:31:45.359637     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:31:55.359930     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:31:55.966208     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m6s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:31:55.966241     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:32:05.966470     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:32:06.465645     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m56s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:32:06.465686     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:32:16.465868     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:32:16.963659     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m45s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:32:16.963686     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:32:26.963829     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:32:27.501747     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m35s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:32:27.501782     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:32:37.502055     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:32:37.963330     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m24s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:32:37.963381     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:32:47.963534     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:32:48.363676     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m14s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:32:48.363711     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:32:58.363900     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:32:58.757538     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m4s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:32:58.757566     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:33:08.757960     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:33:09.164116     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (53s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:33:09.164144     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:33:19.164287     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:33:19.764845     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (43s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:33:19.764882     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:33:29.765076     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:33:30.305052     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:33:30.305086     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:33:40.305274     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:33:40.761026     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (22s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:33:40.761063     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:33:50.761233     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:33:51.199673     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (11s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:33:51.199719     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:34:01.199921     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:34:01.697037     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:34:01.697066     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)

error running tasks: deadline exceeded executing task StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce. Example error: error creating GCS bucket ACL for gs://k8s-kops-gce for user-949803036774-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
2020/02/18 11:34:11 process.go:155: Step '/tmp/kops094272039/kops update cluster e2e-kops-gce-canary.k8s.local --yes' finished in 10m11.868884s
2020/02/18 11:34:11 process.go:153: Running: kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller
2020/02/18 11:34:11 process.go:153: Running: /tmp/kops094272039/kops export kubecfg e2e-kops-gce-canary.k8s.local
I0218 11:34:11.766930     259 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 11:34:11.766983     259 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 11:34:11.973564     259 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
... skipping 3 lines ...
I0218 11:34:12.579720     282 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 11:34:12.579772     282 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 11:34:12.727629     282 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
I0218 11:34:13.018514     282 gce.go:82] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b]
2020/02/18 11:34:15 process.go:155: Step '/tmp/kops094272039/kops toolbox dump --name e2e-kops-gce-canary.k8s.local -ojson' finished in 3.27914787s
2020/02/18 11:34:15 process.go:153: Running: kubectl get nodes -ojson
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 11:34:56 process.go:155: Step 'kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller' finished in 45.114553044s
2020/02/18 11:34:56 kubernetes.go:117: kubectl get pods failed: error during kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller: exit status 1
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 11:35:00 process.go:155: Step 'kubectl get nodes -ojson' finished in 45.129999852s
2020/02/18 11:35:00 kubernetes.go:35: kubectl get nodes failed: error during kubectl get nodes -ojson: exit status 1
2020/02/18 11:35:00 dump.go:92: Failed to get nodes for dumping via kubectl: error during kubectl get nodes -ojson: exit status 1
2020/02/18 11:35:00 dump.go:126: dumping node not registered in kubernetes: 35.239.248.200
2020/02/18 11:35:00 dump.go:160: Dumping node 35.239.248.200
2020/02/18 11:35:01 dump.go:399: Running SSH command: sudo journalctl --output=short-precise -k
2020/02/18 11:35:01 dump.go:399: Running SSH command: sudo journalctl --output=short-precise
2020/02/18 11:35:01 dump.go:399: Running SSH command: sudo systemctl list-units -t service --no-pager --no-legend --all
2020/02/18 11:35:01 dump.go:399: Running SSH command: sudo journalctl --output=cat -u kubelet.service
... skipping 127 lines ...
TargetPool:api-e2e-kops-gce-canary-k8s-local	ok
Deleted kubectl config for e2e-kops-gce-canary.k8s.local

Deleted cluster: "e2e-kops-gce-canary.k8s.local"
2020/02/18 11:37:09 process.go:155: Step '/tmp/kops094272039/kops delete cluster e2e-kops-gce-canary.k8s.local --yes' finished in 2m5.131529731s
2020/02/18 11:37:09 process.go:96: Saved XML output to /logs/artifacts/junit_runner.xml.
2020/02/18 11:37:09 main.go:316: Something went wrong: starting e2e cluster: kops update cluster failed: error during /tmp/kops094272039/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
Traceback (most recent call last):
  File "/workspace/scenarios/kubernetes_e2e.py", line 779, in <module>
    main(parse_args())
  File "/workspace/scenarios/kubernetes_e2e.py", line 627, in main
    mode.start(runner_args)
  File "/workspace/scenarios/kubernetes_e2e.py", line 262, in start
... skipping 9 lines ...