This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 5 succeeded
Started2020-02-18 08:42
Elapsed13m34s
Revision
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/ab06e167-65a6-47d3-8419-eeb63e2077c3/targets/test'}}
resultstorehttps://source.cloud.google.com/results/invocations/ab06e167-65a6-47d3-8419-eeb63e2077c3/targets/test
job-versionv1.18.0-alpha.5.178+5bd719b6a6f6ea
revisionv1.18.0-alpha.5.178+5bd719b6a6f6ea

Test Failures


Up 10m9s

kops update cluster failed: error during /tmp/kops379260820/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 5 Passed Tests

Error lines from build-log.txt

Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
fatal: not a git repository (or any of the parent directories): .git
+ /workspace/scenarios/kubernetes_e2e.py --cluster=e2e-kops-gce-canary.k8s.local --deployment=kops --extract=ci/latest --ginkgo-parallel=30 --kops-priority-path=/workspace/kubernetes/platforms/linux/amd64 --kops-version=https://storage.googleapis.com/kops-ci/bin/latest-ci-updown-green.txt --kops-zones=us-central1-c --provider=gce '--test_args=--ginkgo.skip=\[Slow\]|\[Serial\]|\[Disruptive\]|\[Flaky\]|\[Feature:.+\]|\[HPA\]|Dashboard|Services.*functioning.*NodePort' --timeout=120m
starts with local mode
Environment:
ARTIFACTS=/logs/artifacts
BAZEL_REMOTE_CACHE_ENABLED=false
BAZEL_VERSION=0.23.2
... skipping 479 lines ...
I0218 08:43:03.622297     235 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-main"
I0218 08:43:03.624135     235 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-events"
I0218 08:43:03.779699     235 vfs_castore.go:675] Issuing new certificate: "ca"
I0218 08:43:03.821835     235 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-events"
I0218 08:43:03.882445     235 vfs_castore.go:675] Issuing new certificate: "apiserver-aggregator-ca"
I0218 08:43:04.114235     235 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-main"
W0218 08:43:11.058104     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m52s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:43:11.058153     235 executor.go:103] Tasks: 36 done / 64 total; 26 can run
I0218 08:43:11.205328     235 instancetemplate.go:223] We should be using NVME for GCE
I0218 08:43:11.207846     235 instancetemplate.go:223] We should be using NVME for GCE
I0218 08:43:11.228521     235 instancetemplate.go:223] We should be using NVME for GCE
I0218 08:43:11.300075     235 instancetemplate.go:223] We should be using NVME for GCE
I0218 08:43:11.359900     235 vfs_castore.go:675] Issuing new certificate: "kube-controller-manager"
... skipping 3 lines ...
I0218 08:43:11.562363     235 vfs_castore.go:675] Issuing new certificate: "apiserver-proxy-client"
I0218 08:43:11.634968     235 vfs_castore.go:675] Issuing new certificate: "kubelet-api"
I0218 08:43:11.661112     235 vfs_castore.go:675] Issuing new certificate: "master"
I0218 08:43:11.678742     235 vfs_castore.go:675] Issuing new certificate: "apiserver-aggregator"
I0218 08:43:11.685124     235 vfs_castore.go:675] Issuing new certificate: "kubecfg"
I0218 08:43:11.767071     235 vfs_castore.go:675] Issuing new certificate: "kubelet"
W0218 08:43:17.855591     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m45s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:43:17.855638     235 executor.go:103] Tasks: 61 done / 64 total; 3 can run
W0218 08:43:33.270047     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:43:33.270103     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:43:33.664778     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:43:33.664817     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:43:43.665076     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:43:44.068095     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m19s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:43:44.068167     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:43:54.068460     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:43:54.700976     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m8s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:43:54.701006     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:44:04.701259     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:44:05.064683     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m58s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:44:05.064732     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:44:15.064956     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:44:15.460152     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m47s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:44:15.460185     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:44:25.460472     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:44:25.858904     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m37s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:44:25.858932     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:44:35.859177     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:44:36.299096     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m26s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:44:36.299134     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:44:46.299374     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:44:46.797457     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m16s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:44:46.797493     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:44:56.797642     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:44:57.160168     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m6s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:44:57.160208     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:45:07.160469     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:45:07.561435     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m55s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:45:07.561465     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:45:17.561678     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:45:18.000889     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m45s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:45:18.000919     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:45:28.001437     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:45:28.360150     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m34s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:45:28.360183     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:45:38.360506     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:45:38.859142     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m24s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:45:38.859179     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:45:48.859416     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:45:49.363381     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m13s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:45:49.363424     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:45:59.363822     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:45:59.759772     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m3s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:45:59.759807     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:46:09.760096     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:46:10.167605     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m53s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:46:10.167647     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:46:20.167905     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:46:20.664946     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m42s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:46:20.664976     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:46:30.665241     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:46:31.058873     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:46:31.058914     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:46:41.059148     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:46:41.464090     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m21s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:46:41.464126     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:46:51.464415     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:46:51.870930     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m11s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:46:51.870973     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:47:01.871272     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:47:02.296378     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m0s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:47:02.296408     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:47:12.296639     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:47:12.661627     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:47:12.661673     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:47:22.661898     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:47:23.083215     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m40s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:47:23.083252     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:47:33.083429     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:47:33.600929     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:47:33.600972     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:47:43.601461     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:47:43.969292     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m19s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:47:43.969330     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:47:53.969499     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:47:54.399206     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m8s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:47:54.399239     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:48:04.399407     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:48:04.797223     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m58s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:48:04.797276     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:48:14.797561     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:48:15.158858     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m48s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:48:15.158904     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:48:25.159211     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:48:25.561601     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m37s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:48:25.561636     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:48:35.561796     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:48:35.961762     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m27s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:48:35.961796     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:48:45.962008     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:48:46.362501     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m16s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:48:46.362539     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:48:56.362801     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:48:56.897755     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m6s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:48:56.897790     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:49:06.898108     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:49:07.296635     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m55s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:49:07.296669     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:49:17.296964     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:49:17.656914     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m45s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:49:17.656956     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:49:27.657379     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:49:28.060151     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m35s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:49:28.060186     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:49:38.060464     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:49:38.458832     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m24s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:49:38.458867     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:49:48.459151     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:49:48.863376     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m14s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:49:48.863412     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:49:58.863723     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:49:59.299395     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m3s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:49:59.299433     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:50:09.299707     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:50:09.760916     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m53s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:50:09.760952     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:50:19.761289     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:50:20.161065     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m43s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:50:20.161315     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:50:30.161578     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:50:30.561620     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:50:30.561649     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:50:40.561889     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:50:41.059630     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m22s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:50:41.059678     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:50:51.059943     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:50:51.471997     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m11s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:50:51.472027     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:51:01.472303     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:51:01.896145     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m1s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:51:01.896192     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:51:11.896545     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:51:12.363018     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:51:12.363055     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:51:22.363600     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:51:22.863161     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m40s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:51:22.863197     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:51:32.863507     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:51:33.263578     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:51:33.263610     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:51:43.263830     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:51:43.658931     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m19s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:51:43.658976     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:51:53.659301     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:51:54.100003     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m9s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:51:54.100038     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:52:04.100303     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:52:04.557997     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (58s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:52:04.558030     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:52:14.558301     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:52:14.962183     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (48s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:52:14.962216     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:52:24.962497     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:52:25.464575     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (37s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:52:25.464659     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:52:35.464928     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:52:35.898351     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (27s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:52:35.898381     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:52:45.898665     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:52:46.262178     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (16s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:52:46.262208     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:52:56.262484     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:52:56.665690     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:52:56.665724     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)

error running tasks: deadline exceeded executing task StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce. Example error: error creating GCS bucket ACL for gs://k8s-kops-gce for user-385645069465-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
2020/02/18 08:53:06 process.go:155: Step '/tmp/kops379260820/kops update cluster e2e-kops-gce-canary.k8s.local --yes' finished in 10m6.667275881s
2020/02/18 08:53:06 process.go:153: Running: kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller
2020/02/18 08:53:06 process.go:153: Running: /tmp/kops379260820/kops export kubecfg e2e-kops-gce-canary.k8s.local
I0218 08:53:06.732645     255 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 08:53:06.732844     255 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 08:53:06.933377     255 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
... skipping 3 lines ...
I0218 08:53:07.431712     280 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 08:53:07.431796     280 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 08:53:07.608294     280 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
I0218 08:53:07.839598     280 gce.go:82] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b]
2020/02/18 08:53:10 process.go:155: Step '/tmp/kops379260820/kops toolbox dump --name e2e-kops-gce-canary.k8s.local -ojson' finished in 2.811167187s
2020/02/18 08:53:10 process.go:153: Running: kubectl get nodes -ojson
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 08:53:51 process.go:155: Step 'kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller' finished in 45.135055469s
2020/02/18 08:53:51 kubernetes.go:117: kubectl get pods failed: error during kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller: exit status 1
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 08:53:55 process.go:155: Step 'kubectl get nodes -ojson' finished in 45.148402919s
2020/02/18 08:53:55 kubernetes.go:35: kubectl get nodes failed: error during kubectl get nodes -ojson: exit status 1
2020/02/18 08:53:55 dump.go:92: Failed to get nodes for dumping via kubectl: error during kubectl get nodes -ojson: exit status 1
2020/02/18 08:53:55 dump.go:126: dumping node not registered in kubernetes: 35.225.94.215
2020/02/18 08:53:55 dump.go:160: Dumping node 35.225.94.215
2020/02/18 08:53:55 dump.go:399: Running SSH command: sudo journalctl --output=short-precise -k
2020/02/18 08:53:55 dump.go:399: Running SSH command: sudo journalctl --output=short-precise
2020/02/18 08:53:55 dump.go:399: Running SSH command: sudo systemctl list-units -t service --no-pager --no-legend --all
2020/02/18 08:53:55 dump.go:399: Running SSH command: sudo journalctl --output=cat -u kubelet.service
... skipping 127 lines ...
Disk:c-etcd-events-e2e-kops-gce-canary-k8s-local	ok
Deleted kubectl config for e2e-kops-gce-canary.k8s.local

Deleted cluster: "e2e-kops-gce-canary.k8s.local"
2020/02/18 08:56:02 process.go:155: Step '/tmp/kops379260820/kops delete cluster e2e-kops-gce-canary.k8s.local --yes' finished in 2m3.865371388s
2020/02/18 08:56:02 process.go:96: Saved XML output to /logs/artifacts/junit_runner.xml.
2020/02/18 08:56:02 main.go:316: Something went wrong: starting e2e cluster: kops update cluster failed: error during /tmp/kops379260820/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
Traceback (most recent call last):
  File "/workspace/scenarios/kubernetes_e2e.py", line 779, in <module>
    main(parse_args())
  File "/workspace/scenarios/kubernetes_e2e.py", line 627, in main
    mode.start(runner_args)
  File "/workspace/scenarios/kubernetes_e2e.py", line 262, in start
... skipping 9 lines ...