This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 5 succeeded
Started2020-02-18 09:49
Elapsed14m5s
Revision
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/0607a392-1894-4805-9cea-9501b7c39cd6/targets/test'}}
resultstorehttps://source.cloud.google.com/results/invocations/0607a392-1894-4805-9cea-9501b7c39cd6/targets/test
job-versionv1.18.0-alpha.5.178+5bd719b6a6f6ea
revisionv1.18.0-alpha.5.178+5bd719b6a6f6ea

Test Failures


Up 10m13s

kops update cluster failed: error during /tmp/kops973197045/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 5 Passed Tests

Error lines from build-log.txt

Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
fatal: not a git repository (or any of the parent directories): .git
+ /workspace/scenarios/kubernetes_e2e.py --cluster=e2e-kops-gce-canary.k8s.local --deployment=kops --extract=ci/latest --ginkgo-parallel=30 --kops-priority-path=/workspace/kubernetes/platforms/linux/amd64 --kops-version=https://storage.googleapis.com/kops-ci/bin/latest-ci-updown-green.txt --kops-zones=us-central1-c --provider=gce '--test_args=--ginkgo.skip=\[Slow\]|\[Serial\]|\[Disruptive\]|\[Flaky\]|\[Feature:.+\]|\[HPA\]|Dashboard|Services.*functioning.*NodePort' --timeout=120m
starts with local mode
Environment:
ARTIFACTS=/logs/artifacts
BAZEL_REMOTE_CACHE_ENABLED=false
BAZEL_VERSION=0.23.2
... skipping 479 lines ...
I0218 09:50:14.157791     236 vfs_castore.go:675] Issuing new certificate: "apiserver-aggregator-ca"
I0218 09:50:14.213380     236 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-main"
I0218 09:50:14.288204     236 vfs_castore.go:675] Issuing new certificate: "ca"
I0218 09:50:14.323299     236 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-events"
I0218 09:50:14.345468     236 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-events"
I0218 09:50:14.560813     236 vfs_castore.go:675] Issuing new certificate: "etcd-clients-ca"
W0218 09:50:22.674285     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:50:22.674361     236 executor.go:103] Tasks: 36 done / 64 total; 26 can run
I0218 09:50:22.837893     236 instancetemplate.go:223] We should be using NVME for GCE
I0218 09:50:22.838632     236 instancetemplate.go:223] We should be using NVME for GCE
I0218 09:50:22.845062     236 instancetemplate.go:223] We should be using NVME for GCE
I0218 09:50:23.016990     236 instancetemplate.go:223] We should be using NVME for GCE
I0218 09:50:23.268498     236 vfs_castore.go:675] Issuing new certificate: "kube-controller-manager"
... skipping 3 lines ...
I0218 09:50:23.424757     236 vfs_castore.go:675] Issuing new certificate: "kubelet"
I0218 09:50:23.469939     236 vfs_castore.go:675] Issuing new certificate: "master"
I0218 09:50:23.583281     236 vfs_castore.go:675] Issuing new certificate: "apiserver-aggregator"
I0218 09:50:23.756423     236 vfs_castore.go:675] Issuing new certificate: "kube-scheduler"
I0218 09:50:24.011333     236 vfs_castore.go:675] Issuing new certificate: "kubecfg"
I0218 09:50:24.027321     236 vfs_castore.go:675] Issuing new certificate: "kube-proxy"
W0218 09:50:30.607912     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m42s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:50:30.607966     236 executor.go:103] Tasks: 61 done / 64 total; 3 can run
W0218 09:50:45.688911     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m27s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:50:45.688967     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:50:46.696933     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m26s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:50:46.696964     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:50:56.697219     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:50:57.063446     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m16s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:50:57.063497     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:51:07.063917     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:51:07.499728     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m6s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:51:07.499776     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:51:17.500028     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:51:18.097296     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m55s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:51:18.097329     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:51:28.097581     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:51:28.599474     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m44s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:51:28.599512     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:51:38.599725     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:51:39.068254     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m34s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:51:39.068300     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:51:49.068572     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:51:49.557303     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m24s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:51:49.557336     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:51:59.557560     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:52:00.003621     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m13s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:52:00.003654     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:52:10.003858     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:52:10.360740     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m3s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:52:10.360766     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:52:20.361017     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:52:20.761341     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m52s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:52:20.761374     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:52:30.761577     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:52:31.158223     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m42s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:52:31.158256     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:52:41.158513     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:52:41.559948     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:52:41.559983     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:52:51.560219     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:52:51.958801     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m21s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:52:51.958844     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:53:01.959182     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:53:02.396999     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m11s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:53:02.397030     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:53:12.397288     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:53:12.760662     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m0s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:53:12.760707     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:53:22.761003     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:53:23.202283     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:53:23.202319     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:53:33.202533     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:53:33.664231     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m39s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:53:33.664278     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:53:43.664490     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:53:44.066571     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:53:44.066598     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:53:54.066782     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:53:54.568138     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m19s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:53:54.568173     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:54:04.569119     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:54:04.962413     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m8s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:54:04.962441     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:54:14.962656     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:54:15.362882     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m58s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:54:15.362914     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:54:25.363314     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:54:25.763396     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m47s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:54:25.763431     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:54:35.763738     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:54:36.396159     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m37s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:54:36.396196     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:54:46.396500     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:54:46.760783     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m26s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:54:46.760822     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:54:56.761065     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:54:57.267052     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m16s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:54:57.267084     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:55:07.267333     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:55:07.697133     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m5s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:55:07.697180     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:55:17.697351     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:55:18.063462     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m55s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:55:18.063499     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:55:28.063760     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:55:28.462560     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m45s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:55:28.462593     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:55:38.463002     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:55:38.861929     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m34s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:55:38.861961     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:55:48.862328     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:55:49.262152     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m24s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:55:49.262182     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:55:59.262432     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:55:59.700259     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m13s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:55:59.700289     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:56:09.700508     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:56:10.272477     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m3s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:56:10.272513     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:56:20.272807     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:56:20.658675     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m52s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:56:20.658707     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:56:30.658876     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:56:31.062788     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m42s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:56:31.062830     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:56:41.063018     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:56:41.460928     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:56:41.460967     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:56:51.461133     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:56:51.964073     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m21s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:56:51.964108     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:57:01.964355     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:57:02.391358     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m11s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:57:02.391389     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:57:12.391722     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:57:12.858992     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m0s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:57:12.859026     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:57:22.859234     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:57:23.261804     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:57:23.261838     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:57:33.261987     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:57:33.662204     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m39s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:57:33.662238     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:57:43.663231     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:57:44.203415     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:57:44.203507     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:57:54.203765     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:57:54.556638     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m19s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:57:54.556669     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:58:04.556894     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:58:04.993711     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m8s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:58:04.993747     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:58:14.994051     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:58:15.357346     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m58s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:58:15.357383     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:58:25.357634     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:58:25.797369     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m47s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:58:25.797404     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:58:35.797654     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:58:36.199300     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m37s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:58:36.199335     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:58:46.199637     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:58:46.600817     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m26s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:58:46.600861     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:58:56.601146     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:58:56.961483     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m16s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:58:56.961527     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:59:06.962708     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:59:07.460460     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m6s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:59:07.460502     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:59:17.460723     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:59:17.861352     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (55s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:59:17.861383     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:59:27.861592     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:59:28.264450     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (45s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:59:28.264489     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:59:38.264669     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:59:38.697911     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (34s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:59:38.697961     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:59:48.698177     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:59:49.158154     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (24s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:59:49.158181     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 09:59:59.158410     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 09:59:59.696012     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (13s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 09:59:59.696051     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:00:09.696306     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:00:10.159862     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:00:10.159974     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)

error running tasks: deadline exceeded executing task StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce. Example error: error creating GCS bucket ACL for gs://k8s-kops-gce for user-51573941961-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
2020/02/18 10:00:20 process.go:155: Step '/tmp/kops973197045/kops update cluster e2e-kops-gce-canary.k8s.local --yes' finished in 10m9.594193695s
2020/02/18 10:00:20 process.go:153: Running: kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller
2020/02/18 10:00:20 process.go:153: Running: /tmp/kops973197045/kops export kubecfg e2e-kops-gce-canary.k8s.local
I0218 10:00:20.269083     256 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 10:00:20.269154     256 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 10:00:20.489279     256 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
... skipping 3 lines ...
I0218 10:00:21.084072     282 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 10:00:21.084178     282 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 10:00:21.270033     282 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
I0218 10:00:21.589072     282 gce.go:82] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b]
2020/02/18 10:00:24 process.go:155: Step '/tmp/kops973197045/kops toolbox dump --name e2e-kops-gce-canary.k8s.local -ojson' finished in 3.095954282s
2020/02/18 10:00:24 process.go:153: Running: kubectl get nodes -ojson
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 10:01:05 process.go:155: Step 'kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller' finished in 45.144835125s
2020/02/18 10:01:05 kubernetes.go:117: kubectl get pods failed: error during kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller: exit status 1
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 10:01:15 process.go:155: Step 'kubectl get nodes -ojson' finished in 51.359737065s
2020/02/18 10:01:15 kubernetes.go:35: kubectl get nodes failed: error during kubectl get nodes -ojson: exit status 1
2020/02/18 10:01:15 dump.go:92: Failed to get nodes for dumping via kubectl: error during kubectl get nodes -ojson: exit status 1
2020/02/18 10:01:15 dump.go:126: dumping node not registered in kubernetes: 35.222.37.69
2020/02/18 10:01:15 dump.go:160: Dumping node 35.222.37.69
2020/02/18 10:01:15 dump.go:399: Running SSH command: sudo journalctl --output=short-precise -k
2020/02/18 10:01:15 dump.go:399: Running SSH command: sudo journalctl --output=short-precise
2020/02/18 10:01:16 dump.go:399: Running SSH command: sudo systemctl list-units -t service --no-pager --no-legend --all
2020/02/18 10:01:16 dump.go:399: Running SSH command: sudo journalctl --output=cat -u kubelet.service
... skipping 125 lines ...
InstanceTemplate:master-us-central1-c-e2e--a8i4mi-1582019423	ok
Deleted kubectl config for e2e-kops-gce-canary.k8s.local

Deleted cluster: "e2e-kops-gce-canary.k8s.local"
2020/02/18 10:03:33 process.go:155: Step '/tmp/kops973197045/kops delete cluster e2e-kops-gce-canary.k8s.local --yes' finished in 2m14.862058794s
2020/02/18 10:03:33 process.go:96: Saved XML output to /logs/artifacts/junit_runner.xml.
2020/02/18 10:03:33 main.go:316: Something went wrong: starting e2e cluster: kops update cluster failed: error during /tmp/kops973197045/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
Traceback (most recent call last):
  File "/workspace/scenarios/kubernetes_e2e.py", line 779, in <module>
    main(parse_args())
  File "/workspace/scenarios/kubernetes_e2e.py", line 627, in main
    mode.start(runner_args)
  File "/workspace/scenarios/kubernetes_e2e.py", line 262, in start
... skipping 9 lines ...