This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 5 succeeded
Started2020-02-18 03:03
Elapsed14m6s
Revision
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/c41542ce-8bf5-4964-933f-ddcd6890e0a3/targets/test'}}
resultstorehttps://source.cloud.google.com/results/invocations/c41542ce-8bf5-4964-933f-ddcd6890e0a3/targets/test
job-versionv1.18.0-alpha.5.178+5bd719b6a6f6ea
revisionv1.18.0-alpha.5.178+5bd719b6a6f6ea

Test Failures


Up 10m14s

kops update cluster failed: error during /tmp/kops720210600/kops update cluster e2e-kops-gce.k8s.local --yes: exit status 1
				from junit_runner.xml

Filter through log files


Show 5 Passed Tests

Error lines from build-log.txt

Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
fatal: not a git repository (or any of the parent directories): .git
+ /workspace/scenarios/kubernetes_e2e.py --cluster=e2e-kops-gce.k8s.local --deployment=kops --env=KOPS_PUBLISH_GREEN_PATH=gs://kops-ci/bin/latest-ci-gce-green.txt --extract=ci/latest --ginkgo-parallel=30 --kops-priority-path=/workspace/kubernetes/platforms/linux/amd64 --kops-version=https://storage.googleapis.com/kops-ci/bin/latest-ci-updown-green.txt --kops-zones=us-central1-c --provider=gce '--test_args=--ginkgo.skip=\[Slow\]|\[Serial\]|\[Disruptive\]|\[Flaky\]|\[Feature:.+\]|\[HPA\]|Dashboard|Services.*functioning.*NodePort' --timeout=120m
starts with local mode
Environment:
ARTIFACTS=/logs/artifacts
BAZEL_REMOTE_CACHE_ENABLED=false
BAZEL_VERSION=0.23.2
... skipping 480 lines ...
I0218 03:04:07.207650     234 vfs_castore.go:675] Issuing new certificate: "etcd-clients-ca"
I0218 03:04:07.280618     234 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-main"
I0218 03:04:07.415797     234 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-events"
I0218 03:04:07.442707     234 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-events"
I0218 03:04:07.480437     234 vfs_castore.go:675] Issuing new certificate: "apiserver-aggregator-ca"
I0218 03:04:07.605949     234 vfs_castore.go:675] Issuing new certificate: "ca"
W0218 03:04:15.974166     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:04:15.974298     234 executor.go:103] Tasks: 36 done / 64 total; 26 can run
I0218 03:04:16.114471     234 instancetemplate.go:223] We should be using NVME for GCE
I0218 03:04:16.117823     234 instancetemplate.go:223] We should be using NVME for GCE
I0218 03:04:16.120591     234 instancetemplate.go:223] We should be using NVME for GCE
I0218 03:04:16.185731     234 instancetemplate.go:223] We should be using NVME for GCE
I0218 03:04:16.370895     234 vfs_castore.go:675] Issuing new certificate: "kops"
... skipping 3 lines ...
I0218 03:04:16.700467     234 vfs_castore.go:675] Issuing new certificate: "apiserver-aggregator"
I0218 03:04:16.722299     234 vfs_castore.go:675] Issuing new certificate: "master"
I0218 03:04:16.792841     234 vfs_castore.go:675] Issuing new certificate: "kubelet"
I0218 03:04:16.796868     234 vfs_castore.go:675] Issuing new certificate: "apiserver-proxy-client"
I0218 03:04:16.868377     234 vfs_castore.go:675] Issuing new certificate: "kube-scheduler"
I0218 03:04:16.916149     234 vfs_castore.go:675] Issuing new certificate: "kube-proxy"
W0218 03:04:23.628969     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m43s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:04:23.629018     234 executor.go:103] Tasks: 61 done / 64 total; 3 can run
W0218 03:04:38.329234     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m28s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:04:38.329294     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:04:38.869238     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m27s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:04:38.869289     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:04:48.869501     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:04:49.366837     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m17s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:04:49.366873     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:04:59.367143     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:04:59.897137     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m6s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:04:59.897178     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:05:09.897440     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:05:10.361017     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m56s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:05:10.361057     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:05:20.361317     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:05:20.862620     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m45s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:05:20.862662     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:05:30.862906     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:05:31.259851     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m35s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:05:31.259891     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:05:41.260155     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:05:41.857732     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m24s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:05:41.857770     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:05:51.858006     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:05:52.300090     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m14s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:05:52.300123     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:06:02.300444     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:06:02.664271     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m3s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:06:02.664306     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:06:12.664622     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:06:13.159092     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m53s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:06:13.159133     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:06:23.159733     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:06:23.765737     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m42s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:06:23.765770     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:06:33.766039     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:06:34.270567     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:06:34.270608     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:06:44.270806     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:06:44.672656     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m21s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:06:44.672698     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:06:54.672941     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:06:55.204281     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m11s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:06:55.204324     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:07:05.204497     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:07:05.562030     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m1s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:07:05.562070     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:07:15.562278     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:07:15.959954     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:07:15.959993     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:07:25.960302     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:07:26.361315     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m40s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:07:26.361348     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:07:36.361593     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:07:36.760059     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:07:36.760101     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:07:46.760414     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:07:47.168058     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m19s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:07:47.168104     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:07:57.168381     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:07:57.562063     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m9s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:07:57.562100     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:08:07.562377     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:08:08.063139     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m58s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:08:08.063189     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:08:18.063685     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:08:18.802139     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m47s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:08:18.802176     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:08:28.802384     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:08:29.370254     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m37s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:08:29.370303     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:08:39.370776     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:08:39.858492     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m26s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:08:39.858534     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:08:49.858748     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:08:50.361278     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m16s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:08:50.361318     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:09:00.361615     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:09:00.762157     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m5s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:09:00.762193     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:09:10.762383     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:09:11.168422     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m55s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:09:11.168462     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:09:21.168783     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:09:21.698507     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m44s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:09:21.698554     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:09:31.698749     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:09:32.162689     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m34s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:09:32.162730     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:09:42.162937     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:09:42.657906     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m23s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:09:42.657966     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:09:52.658155     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:09:53.061580     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m13s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:09:53.061618     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:10:03.061824     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:10:03.459833     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m3s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:10:03.459871     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:10:13.460032     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:10:13.861830     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m52s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:10:13.861873     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:10:23.862118     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:10:24.264026     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m42s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:10:24.264081     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:10:34.264355     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:10:34.663329     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m31s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:10:34.663364     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:10:44.663693     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:10:45.075154     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m21s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:10:45.075194     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:10:55.075393     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:10:55.559969     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m11s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:10:55.560009     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:11:05.560191     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:11:05.959141     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m0s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:11:05.959203     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:11:15.959816     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:11:16.364072     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:11:16.364114     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:11:26.364348     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:11:26.764754     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m39s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:11:26.764789     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:11:36.765067     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:11:37.262020     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:11:37.262054     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:11:47.262262     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:11:47.865031     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m18s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:11:47.865066     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:11:57.865310     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:11:58.360104     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m8s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:11:58.360141     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:12:08.360438     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:12:08.762593     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m57s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:12:08.762630     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:12:18.762919     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:12:19.161448     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m47s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:12:19.161484     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:12:29.161696     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:12:29.664103     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m36s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:12:29.664147     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:12:39.664357     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:12:40.607646     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m26s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:12:40.607678     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:12:50.607867     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:12:51.065424     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m15s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:12:51.065981     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:13:01.066338     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:13:01.559987     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m5s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:13:01.560022     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:13:11.560268     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:13:11.961109     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (54s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:13:11.961150     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:13:21.961308     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:13:22.465027     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (44s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:13:22.465059     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:13:32.465296     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:13:32.861239     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (33s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:13:32.861273     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:13:42.861518     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:13:43.376221     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (23s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:13:43.376254     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:13:53.376502     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:13:53.965175     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (12s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:13:53.965209     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:14:03.965504     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:14:04.378413     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:14:04.378458     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)

error running tasks: deadline exceeded executing task StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce. Example error: error creating GCS bucket ACL for gs://k8s-kops-gce for user-54868033931-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
2020/02/18 03:14:14 process.go:155: Step '/tmp/kops720210600/kops update cluster e2e-kops-gce.k8s.local --yes' finished in 10m10.624799893s
2020/02/18 03:14:14 process.go:153: Running: kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller
2020/02/18 03:14:14 process.go:153: Running: /tmp/kops720210600/kops export kubecfg e2e-kops-gce.k8s.local
I0218 03:14:14.460980     254 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 03:14:14.461118     254 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 03:14:14.679605     254 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
... skipping 3 lines ...
I0218 03:14:15.259857     280 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 03:14:15.259944     280 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 03:14:15.460802     280 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
I0218 03:14:15.726565     280 gce.go:82] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b]
2020/02/18 03:14:18 process.go:155: Step '/tmp/kops720210600/kops toolbox dump --name e2e-kops-gce.k8s.local -ojson' finished in 2.914151434s
2020/02/18 03:14:18 process.go:153: Running: kubectl get nodes -ojson
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 03:14:59 process.go:155: Step 'kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller' finished in 45.153419895s
2020/02/18 03:14:59 kubernetes.go:117: kubectl get pods failed: error during kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller: exit status 1
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 03:15:11 process.go:155: Step 'kubectl get nodes -ojson' finished in 53.835142626s
2020/02/18 03:15:11 kubernetes.go:35: kubectl get nodes failed: error during kubectl get nodes -ojson: exit status 1
2020/02/18 03:15:11 dump.go:92: Failed to get nodes for dumping via kubectl: error during kubectl get nodes -ojson: exit status 1
2020/02/18 03:15:11 dump.go:126: dumping node not registered in kubernetes: 35.226.188.173
2020/02/18 03:15:11 dump.go:160: Dumping node 35.226.188.173
2020/02/18 03:15:12 dump.go:399: Running SSH command: sudo journalctl --output=short-precise -k
2020/02/18 03:15:12 dump.go:399: Running SSH command: sudo journalctl --output=short-precise
2020/02/18 03:15:12 dump.go:399: Running SSH command: sudo systemctl list-units -t service --no-pager --no-legend --all
2020/02/18 03:15:12 dump.go:399: Running SSH command: sudo journalctl --output=cat -u kubelet.service
... skipping 126 lines ...
InstanceTemplate:nodes-e2e-kops-gce-k8s-local-1581995056	ok
Deleted kubectl config for e2e-kops-gce.k8s.local

Deleted cluster: "e2e-kops-gce.k8s.local"
2020/02/18 03:17:34 process.go:155: Step '/tmp/kops720210600/kops delete cluster e2e-kops-gce.k8s.local --yes' finished in 2m18.453893854s
2020/02/18 03:17:34 process.go:96: Saved XML output to /logs/artifacts/junit_runner.xml.
2020/02/18 03:17:34 main.go:316: Something went wrong: starting e2e cluster: kops update cluster failed: error during /tmp/kops720210600/kops update cluster e2e-kops-gce.k8s.local --yes: exit status 1
Traceback (most recent call last):
  File "/workspace/scenarios/kubernetes_e2e.py", line 779, in <module>
    main(parse_args())
  File "/workspace/scenarios/kubernetes_e2e.py", line 627, in main
    mode.start(runner_args)
  File "/workspace/scenarios/kubernetes_e2e.py", line 262, in start
... skipping 9 lines ...