This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 5 succeeded
Started2020-02-18 16:52
Elapsed13m49s
Revision
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/5ca42106-e0b6-4e89-8979-42cdcdd78cc5/targets/test'}}
resultstorehttps://source.cloud.google.com/results/invocations/5ca42106-e0b6-4e89-8979-42cdcdd78cc5/targets/test
job-versionv1.18.0-alpha.5.183+1e12d92a5179db
revisionv1.18.0-alpha.5.183+1e12d92a5179db

Test Failures


Up 10m16s

kops update cluster failed: error during /tmp/kops198343913/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 5 Passed Tests

Error lines from build-log.txt

Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
fatal: not a git repository (or any of the parent directories): .git
+ /workspace/scenarios/kubernetes_e2e.py --cluster=e2e-kops-gce-canary.k8s.local --deployment=kops --extract=ci/latest --ginkgo-parallel=30 --kops-priority-path=/workspace/kubernetes/platforms/linux/amd64 --kops-version=https://storage.googleapis.com/kops-ci/bin/latest-ci-updown-green.txt --kops-zones=us-central1-c --provider=gce '--test_args=--ginkgo.skip=\[Slow\]|\[Serial\]|\[Disruptive\]|\[Flaky\]|\[Feature:.+\]|\[HPA\]|Dashboard|Services.*functioning.*NodePort' --timeout=120m
starts with local mode
Environment:
ARTIFACTS=/logs/artifacts
BAZEL_REMOTE_CACHE_ENABLED=false
BAZEL_VERSION=0.23.2
... skipping 479 lines ...
I0218 16:53:08.098653     237 vfs_castore.go:675] Issuing new certificate: "ca"
I0218 16:53:08.242723     237 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-main"
I0218 16:53:08.305595     237 vfs_castore.go:675] Issuing new certificate: "etcd-clients-ca"
I0218 16:53:08.311392     237 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-events"
I0218 16:53:08.328429     237 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-main"
I0218 16:53:08.345119     237 vfs_castore.go:675] Issuing new certificate: "apiserver-aggregator-ca"
W0218 16:53:15.626994     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m51s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:53:15.627059     237 executor.go:103] Tasks: 36 done / 64 total; 26 can run
I0218 16:53:15.725989     237 instancetemplate.go:223] We should be using NVME for GCE
I0218 16:53:15.728673     237 instancetemplate.go:223] We should be using NVME for GCE
I0218 16:53:15.758748     237 instancetemplate.go:223] We should be using NVME for GCE
I0218 16:53:15.841372     237 instancetemplate.go:223] We should be using NVME for GCE
I0218 16:53:16.068365     237 vfs_castore.go:675] Issuing new certificate: "kubecfg"
... skipping 3 lines ...
I0218 16:53:16.216586     237 vfs_castore.go:675] Issuing new certificate: "kubelet-api"
I0218 16:53:16.283435     237 vfs_castore.go:675] Issuing new certificate: "apiserver-aggregator"
I0218 16:53:16.332806     237 vfs_castore.go:675] Issuing new certificate: "kubelet"
I0218 16:53:16.462043     237 vfs_castore.go:675] Issuing new certificate: "master"
I0218 16:53:16.577714     237 vfs_castore.go:675] Issuing new certificate: "apiserver-proxy-client"
I0218 16:53:16.787702     237 vfs_castore.go:675] Issuing new certificate: "kube-scheduler"
W0218 16:53:22.645706     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m44s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:53:22.645762     237 executor.go:103] Tasks: 61 done / 64 total; 3 can run
W0218 16:53:34.060564     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m33s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:53:34.060610     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:53:34.460604     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m33s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:53:34.460639     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:53:44.463851     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:53:44.964216     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m22s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:53:44.964257     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:53:54.964433     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:53:55.360347     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m12s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:53:55.360376     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:54:05.360776     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:54:05.866637     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m1s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:54:05.866677     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:54:15.866839     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:54:16.264403     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m51s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:54:16.264434     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:54:26.264587     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:54:26.662226     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m40s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:54:26.662264     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:54:36.662484     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:54:37.096377     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m30s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:54:37.096406     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:54:47.096594     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:54:47.464854     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m20s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:54:47.464887     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:54:57.465114     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:54:57.864245     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m9s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:54:57.864323     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:55:07.864605     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:55:08.302857     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m59s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:55:08.302885     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:55:18.303091     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:55:18.761568     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m48s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:55:18.761598     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:55:28.761768     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:55:29.165748     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m38s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:55:29.165783     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:55:39.166013     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:55:39.561222     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m28s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:55:39.561256     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:55:49.561430     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:55:49.959441     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m17s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:55:49.959471     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:55:59.959642     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:56:00.359503     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m7s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:56:00.359543     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:56:10.359968     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:56:10.862624     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m56s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:56:10.862659     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:56:20.862844     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:56:21.266672     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m46s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:56:21.266708     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:56:31.266864     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:56:31.663701     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m35s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:56:31.663731     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:56:41.664111     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:56:42.062418     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m25s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:56:42.062448     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:56:52.062670     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:56:52.460404     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m15s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:56:52.460437     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:57:02.460630     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:57:02.896297     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m4s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:57:02.896326     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:57:12.896556     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:57:13.262987     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m54s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:57:13.263019     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:57:23.263214     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:57:23.696535     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m43s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:57:23.696567     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:57:33.696829     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:57:34.063544     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m33s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:57:34.063574     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:57:44.064035     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:57:44.565690     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m23s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:57:44.565725     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:57:54.567029     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:57:54.960775     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m12s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:57:54.960811     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:58:04.961708     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:58:05.366686     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m2s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:58:05.366861     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:58:15.368402     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:58:15.759224     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m51s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:58:15.759266     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:58:25.759507     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:58:26.180235     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m41s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:58:26.180268     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:58:36.185029     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:58:36.564218     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m31s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:58:36.564256     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:58:46.566491     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:58:46.964212     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m20s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:58:46.964249     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:58:56.968236     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:58:57.498273     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m10s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:58:57.498311     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:59:07.498503     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:59:07.861655     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m59s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:59:07.861696     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:59:17.861915     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:59:18.262710     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m49s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:59:18.262742     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:59:28.262908     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:59:28.763089     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m38s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:59:28.763122     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:59:38.763456     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:59:39.162933     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m28s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:59:39.162961     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:59:49.163218     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:59:49.562461     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m18s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:59:49.562495     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 16:59:59.562682     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 16:59:59.967588     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m7s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 16:59:59.967627     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 17:00:09.968128     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 17:00:10.398948     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m57s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 17:00:10.398983     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 17:00:20.399146     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 17:00:20.859501     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m46s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 17:00:20.859531     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 17:00:30.859687     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 17:00:31.260859     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m36s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 17:00:31.260923     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 17:00:41.261068     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 17:00:41.760101     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m25s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 17:00:41.760137     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 17:00:51.760252     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 17:00:52.184212     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m15s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 17:00:52.184247     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 17:01:02.184509     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 17:01:02.668344     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m4s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 17:01:02.668376     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 17:01:12.668524     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 17:01:13.062876     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m54s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 17:01:13.062910     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 17:01:23.063217     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 17:01:23.468369     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m44s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 17:01:23.468401     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 17:01:33.468607     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 17:01:33.866751     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m33s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 17:01:33.866790     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 17:01:43.867087     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 17:01:44.266411     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m23s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 17:01:44.266445     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 17:01:54.266696     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 17:01:54.663040     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m12s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 17:01:54.663083     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 17:02:04.663256     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 17:02:05.077284     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m2s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 17:02:05.077322     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 17:02:15.077525     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 17:02:15.513554     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (52s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 17:02:15.513589     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 17:02:25.513763     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 17:02:26.060017     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (41s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 17:02:26.060060     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 17:02:36.060324     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 17:02:36.458850     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (31s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 17:02:36.458896     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 17:02:46.459099     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 17:02:46.862434     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (20s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 17:02:46.862462     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 17:02:56.862627     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 17:02:57.467280     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (10s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 17:02:57.467320     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 17:03:07.467526     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 17:03:07.860309     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (0s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 17:03:07.860334     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)

error running tasks: deadline exceeded executing task StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce. Example error: error creating GCS bucket ACL for gs://k8s-kops-gce for user-977375586953-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
2020/02/18 17:03:17 process.go:155: Step '/tmp/kops198343913/kops update cluster e2e-kops-gce-canary.k8s.local --yes' finished in 10m13.114434584s
2020/02/18 17:03:17 process.go:153: Running: kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller
2020/02/18 17:03:17 process.go:153: Running: /tmp/kops198343913/kops export kubecfg e2e-kops-gce-canary.k8s.local
I0218 17:03:17.961110     257 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 17:03:17.961196     257 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 17:03:18.210593     257 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
... skipping 3 lines ...
I0218 17:03:18.748079     282 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 17:03:18.748148     282 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 17:03:18.950782     282 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
I0218 17:03:19.248804     282 gce.go:82] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b]
2020/02/18 17:03:21 process.go:155: Step '/tmp/kops198343913/kops toolbox dump --name e2e-kops-gce-canary.k8s.local -ojson' finished in 3.089522771s
2020/02/18 17:03:21 process.go:153: Running: kubectl get nodes -ojson
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 17:04:03 process.go:155: Step 'kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller' finished in 45.149171451s
2020/02/18 17:04:03 kubernetes.go:117: kubectl get pods failed: error during kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller: exit status 1
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 17:04:18 process.go:155: Step 'kubectl get nodes -ojson' finished in 56.799735372s
2020/02/18 17:04:18 kubernetes.go:35: kubectl get nodes failed: error during kubectl get nodes -ojson: exit status 1
2020/02/18 17:04:18 dump.go:92: Failed to get nodes for dumping via kubectl: error during kubectl get nodes -ojson: exit status 1
2020/02/18 17:04:18 dump.go:126: dumping node not registered in kubernetes: 34.67.129.241
2020/02/18 17:04:18 dump.go:160: Dumping node 34.67.129.241
2020/02/18 17:04:18 dump.go:399: Running SSH command: sudo journalctl --output=short-precise -k
2020/02/18 17:04:18 dump.go:399: Running SSH command: sudo journalctl --output=short-precise
2020/02/18 17:04:19 dump.go:399: Running SSH command: sudo systemctl list-units -t service --no-pager --no-legend --all
2020/02/18 17:04:19 dump.go:399: Running SSH command: sudo journalctl --output=cat -u kubelet.service
... skipping 127 lines ...
TargetPool:api-e2e-kops-gce-canary-k8s-local	ok
Deleted kubectl config for e2e-kops-gce-canary.k8s.local

Deleted cluster: "e2e-kops-gce-canary.k8s.local"
2020/02/18 17:06:19 process.go:155: Step '/tmp/kops198343913/kops delete cluster e2e-kops-gce-canary.k8s.local --yes' finished in 1m56.898540013s
2020/02/18 17:06:19 process.go:96: Saved XML output to /logs/artifacts/junit_runner.xml.
2020/02/18 17:06:19 main.go:316: Something went wrong: starting e2e cluster: kops update cluster failed: error during /tmp/kops198343913/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
Traceback (most recent call last):
  File "/workspace/scenarios/kubernetes_e2e.py", line 779, in <module>
    main(parse_args())
  File "/workspace/scenarios/kubernetes_e2e.py", line 627, in main
    mode.start(runner_args)
  File "/workspace/scenarios/kubernetes_e2e.py", line 262, in start
... skipping 9 lines ...