This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 5 succeeded
Started2020-02-18 10:52
Elapsed13m40s
Revision
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/64568610-dc0e-43cd-bbb6-33ae014c68c8/targets/test'}}
resultstorehttps://source.cloud.google.com/results/invocations/64568610-dc0e-43cd-bbb6-33ae014c68c8/targets/test
job-versionv1.18.0-alpha.5.178+5bd719b6a6f6ea
revisionv1.18.0-alpha.5.178+5bd719b6a6f6ea

Test Failures


Up 10m13s

kops update cluster failed: error during /tmp/kops107934306/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 5 Passed Tests

Error lines from build-log.txt

Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
fatal: not a git repository (or any of the parent directories): .git
+ /workspace/scenarios/kubernetes_e2e.py --cluster=e2e-kops-gce-canary.k8s.local --deployment=kops --extract=ci/latest --ginkgo-parallel=30 --kops-priority-path=/workspace/kubernetes/platforms/linux/amd64 --kops-version=https://storage.googleapis.com/kops-ci/bin/latest-ci-updown-green.txt --kops-zones=us-central1-c --provider=gce '--test_args=--ginkgo.skip=\[Slow\]|\[Serial\]|\[Disruptive\]|\[Flaky\]|\[Feature:.+\]|\[HPA\]|Dashboard|Services.*functioning.*NodePort' --timeout=120m
starts with local mode
Environment:
ARTIFACTS=/logs/artifacts
BAZEL_REMOTE_CACHE_ENABLED=false
BAZEL_VERSION=0.23.2
... skipping 479 lines ...
I0218 10:53:04.118675     235 vfs_castore.go:675] Issuing new certificate: "apiserver-aggregator-ca"
I0218 10:53:04.257763     235 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-events"
I0218 10:53:04.337697     235 vfs_castore.go:675] Issuing new certificate: "ca"
I0218 10:53:04.483822     235 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-main"
I0218 10:53:04.615122     235 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-events"
I0218 10:53:04.778036     235 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-main"
W0218 10:53:12.389185     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m51s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:53:12.389239     235 executor.go:103] Tasks: 36 done / 64 total; 26 can run
I0218 10:53:12.482165     235 instancetemplate.go:223] We should be using NVME for GCE
I0218 10:53:12.484729     235 instancetemplate.go:223] We should be using NVME for GCE
I0218 10:53:12.535989     235 instancetemplate.go:223] We should be using NVME for GCE
I0218 10:53:12.620972     235 instancetemplate.go:223] We should be using NVME for GCE
I0218 10:53:12.807041     235 vfs_castore.go:675] Issuing new certificate: "apiserver-aggregator"
... skipping 3 lines ...
I0218 10:53:13.010859     235 vfs_castore.go:675] Issuing new certificate: "kubelet"
I0218 10:53:13.046760     235 vfs_castore.go:675] Issuing new certificate: "kube-scheduler"
I0218 10:53:13.078460     235 vfs_castore.go:675] Issuing new certificate: "kubelet-api"
I0218 10:53:13.102333     235 vfs_castore.go:675] Issuing new certificate: "kube-controller-manager"
I0218 10:53:13.174038     235 vfs_castore.go:675] Issuing new certificate: "master"
I0218 10:53:13.358982     235 vfs_castore.go:675] Issuing new certificate: "kube-proxy"
W0218 10:53:19.344303     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m44s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:53:19.344397     235 executor.go:103] Tasks: 61 done / 64 total; 3 can run
W0218 10:53:33.810503     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:53:33.810565     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:53:34.296454     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:53:34.296486     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:53:44.296780     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:53:44.773392     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m18s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:53:44.773433     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:53:54.773860     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:53:55.271473     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m8s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:53:55.271511     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:54:05.271866     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:54:05.796420     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m57s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:54:05.796457     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:54:15.796635     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:54:16.173375     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m47s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:54:16.173416     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:54:26.173765     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:54:26.659229     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m37s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:54:26.659270     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:54:36.659527     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:54:37.205193     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m26s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:54:37.205232     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:54:47.205506     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:54:47.662046     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m16s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:54:47.662086     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:54:57.662344     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:54:58.060283     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m5s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:54:58.060313     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:55:08.060572     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:55:08.549038     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m55s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:55:08.549074     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:55:18.549316     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:55:18.961928     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m44s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:55:18.962028     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:55:28.962274     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:55:29.358506     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m34s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:55:29.358547     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:55:39.358771     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:55:39.860180     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m23s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:55:39.860226     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:55:49.860456     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:55:50.316270     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m13s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:55:50.316301     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:56:00.316554     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:56:00.764965     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m2s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:56:00.765002     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:56:10.765232     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:56:11.159425     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m52s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:56:11.159465     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:56:21.159739     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:56:21.596991     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m42s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:56:21.597027     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:56:31.597287     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:56:32.252885     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m31s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:56:32.252925     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:56:42.253260     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:56:42.662123     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m21s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:56:42.662152     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:56:52.662689     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:56:53.159498     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m10s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:56:53.159537     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:57:03.159727     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:57:03.599606     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m0s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:57:03.599636     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:57:13.599829     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:57:14.067032     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m49s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:57:14.067077     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:57:24.067284     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:57:24.461271     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m39s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:57:24.461307     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:57:34.461752     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:57:34.967147     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m28s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:57:34.967176     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:57:44.967476     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:57:45.363692     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m18s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:57:45.363725     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:57:55.366795     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:57:55.906719     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m7s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:57:55.907417     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:58:05.909716     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:58:06.446073     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m57s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:58:06.446113     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:58:16.446398     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:58:16.864904     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m46s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:58:16.865465     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:58:26.866059     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:58:27.496613     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m36s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:58:27.496652     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:58:37.499790     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:58:38.067125     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m25s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:58:38.072559     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:58:48.072976     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:58:48.459466     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m15s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:58:48.459520     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:58:58.459705     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:58:59.067752     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m4s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:58:59.067782     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:59:09.067945     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:59:09.466092     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m54s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:59:09.466135     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:59:19.466396     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:59:19.862729     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m43s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:59:19.862765     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:59:29.862984     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:59:30.266412     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m33s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:59:30.266446     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:59:40.266732     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:59:40.660249     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m23s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:59:40.660282     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 10:59:50.660547     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 10:59:51.058501     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m12s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 10:59:51.058556     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:00:01.058770     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:00:01.460226     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m2s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:00:01.460269     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:00:11.460535     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:00:12.000366     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m51s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:00:12.000412     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:00:22.000654     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:00:22.700708     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m40s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:00:22.700753     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:00:32.700948     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:00:33.101125     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m30s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:00:33.101163     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:00:43.101477     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:00:43.570120     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m20s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:00:43.689704     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:00:53.706152     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:00:54.099841     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m9s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:00:54.099886     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:01:04.100168     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:01:04.497317     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m59s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:01:04.497352     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:01:14.497627     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:01:14.997183     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m48s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:01:14.997228     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:01:24.997433     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:01:25.460842     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m38s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:01:25.460879     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:01:35.461234     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:01:35.902547     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m27s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:01:35.902584     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:01:45.902851     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:01:46.365725     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m17s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:01:46.365774     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:01:56.366084     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:01:56.795173     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m6s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:01:56.795211     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:02:06.795435     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:02:07.264123     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (56s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:02:07.264166     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:02:17.264393     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:02:17.662305     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (46s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:02:17.662338     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:02:27.662509     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:02:28.095708     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (35s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:02:28.095746     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:02:38.095986     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:02:38.463250     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (25s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:02:38.463299     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:02:48.463522     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:02:49.082143     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (14s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:02:49.082372     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 11:02:59.089688     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 11:02:59.602291     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 11:02:59.745681     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)

error running tasks: deadline exceeded executing task StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce. Example error: error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
2020/02/18 11:03:09 process.go:155: Step '/tmp/kops107934306/kops update cluster e2e-kops-gce-canary.k8s.local --yes' finished in 10m9.169352629s
2020/02/18 11:03:09 process.go:153: Running: kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller
2020/02/18 11:03:09 process.go:153: Running: /tmp/kops107934306/kops export kubecfg e2e-kops-gce-canary.k8s.local
I0218 11:03:09.937703     255 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 11:03:09.937795     255 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 11:03:10.697522     255 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
... skipping 3 lines ...
I0218 11:03:11.240651     279 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 11:03:11.240742     279 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 11:03:11.522006     279 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
I0218 11:03:11.738591     279 gce.go:82] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b]
2020/02/18 11:03:14 process.go:155: Step '/tmp/kops107934306/kops toolbox dump --name e2e-kops-gce-canary.k8s.local -ojson' finished in 2.825265722s
2020/02/18 11:03:14 process.go:153: Running: kubectl get nodes -ojson
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 11:03:55 process.go:155: Step 'kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller' finished in 45.746070778s
2020/02/18 11:03:55 kubernetes.go:117: kubectl get pods failed: error during kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller: exit status 1
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 11:04:02 process.go:155: Step 'kubectl get nodes -ojson' finished in 48.794639455s
2020/02/18 11:04:02 kubernetes.go:35: kubectl get nodes failed: error during kubectl get nodes -ojson: exit status 1
2020/02/18 11:04:02 dump.go:92: Failed to get nodes for dumping via kubectl: error during kubectl get nodes -ojson: exit status 1
2020/02/18 11:04:02 dump.go:126: dumping node not registered in kubernetes: 34.68.247.115
2020/02/18 11:04:02 dump.go:160: Dumping node 34.68.247.115
2020/02/18 11:04:02 dump.go:399: Running SSH command: sudo journalctl --output=short-precise -k
2020/02/18 11:04:03 dump.go:399: Running SSH command: sudo journalctl --output=short-precise
2020/02/18 11:04:03 dump.go:399: Running SSH command: sudo systemctl list-units -t service --no-pager --no-legend --all
2020/02/18 11:04:03 dump.go:399: Running SSH command: sudo journalctl --output=cat -u kubelet.service
... skipping 127 lines ...
InstanceTemplate:nodes-e2e-kops-gce-canary-1m0s02-1582023192	ok
Deleted kubectl config for e2e-kops-gce-canary.k8s.local

Deleted cluster: "e2e-kops-gce-canary.k8s.local"
2020/02/18 11:06:08 process.go:155: Step '/tmp/kops107934306/kops delete cluster e2e-kops-gce-canary.k8s.local --yes' finished in 2m1.504810475s
2020/02/18 11:06:08 process.go:96: Saved XML output to /logs/artifacts/junit_runner.xml.
2020/02/18 11:06:08 main.go:316: Something went wrong: starting e2e cluster: kops update cluster failed: error during /tmp/kops107934306/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
Traceback (most recent call last):
  File "/workspace/scenarios/kubernetes_e2e.py", line 779, in <module>
    main(parse_args())
  File "/workspace/scenarios/kubernetes_e2e.py", line 627, in main
    mode.start(runner_args)
  File "/workspace/scenarios/kubernetes_e2e.py", line 262, in start
... skipping 9 lines ...