This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 5 succeeded
Started2020-02-18 19:03
Elapsed14m6s
Revision
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/4021be28-e0b2-40bf-9b71-d88a3454033a/targets/test'}}
resultstorehttps://source.cloud.google.com/results/invocations/4021be28-e0b2-40bf-9b71-d88a3454033a/targets/test
job-versionv1.19.0-alpha.0
revisionv1.19.0-alpha.0

Test Failures


Up 10m10s

kops update cluster failed: error during /tmp/kops680145490/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 5 Passed Tests

Error lines from build-log.txt

Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
fatal: not a git repository (or any of the parent directories): .git
+ /workspace/scenarios/kubernetes_e2e.py --cluster=e2e-kops-gce-canary.k8s.local --deployment=kops --extract=ci/latest --ginkgo-parallel=30 --kops-priority-path=/workspace/kubernetes/platforms/linux/amd64 --kops-version=https://storage.googleapis.com/kops-ci/bin/latest-ci-updown-green.txt --kops-zones=us-central1-c --provider=gce '--test_args=--ginkgo.skip=\[Slow\]|\[Serial\]|\[Disruptive\]|\[Flaky\]|\[Feature:.+\]|\[HPA\]|Dashboard|Services.*functioning.*NodePort' --timeout=120m
starts with local mode
Environment:
ARTIFACTS=/logs/artifacts
BAZEL_REMOTE_CACHE_ENABLED=false
BAZEL_VERSION=0.23.2
... skipping 479 lines ...
I0218 19:04:15.375804     237 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-events"
I0218 19:04:15.394376     237 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-events"
I0218 19:04:15.536896     237 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-main"
I0218 19:04:15.610153     237 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-main"
I0218 19:04:15.660626     237 vfs_castore.go:675] Issuing new certificate: "etcd-clients-ca"
I0218 19:04:15.743943     237 vfs_castore.go:675] Issuing new certificate: "ca"
W0218 19:04:23.440499     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m51s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:04:23.440571     237 executor.go:103] Tasks: 36 done / 64 total; 26 can run
I0218 19:04:23.543491     237 instancetemplate.go:223] We should be using NVME for GCE
I0218 19:04:23.546262     237 instancetemplate.go:223] We should be using NVME for GCE
I0218 19:04:23.572468     237 instancetemplate.go:223] We should be using NVME for GCE
I0218 19:04:23.664078     237 instancetemplate.go:223] We should be using NVME for GCE
I0218 19:04:23.834527     237 vfs_castore.go:675] Issuing new certificate: "kube-controller-manager"
... skipping 3 lines ...
I0218 19:04:24.148364     237 vfs_castore.go:675] Issuing new certificate: "apiserver-aggregator"
I0218 19:04:24.165006     237 vfs_castore.go:675] Issuing new certificate: "kubelet-api"
I0218 19:04:24.221568     237 vfs_castore.go:675] Issuing new certificate: "kubelet"
I0218 19:04:24.277860     237 vfs_castore.go:675] Issuing new certificate: "kubecfg"
I0218 19:04:24.369123     237 vfs_castore.go:675] Issuing new certificate: "master"
I0218 19:04:24.702753     237 vfs_castore.go:675] Issuing new certificate: "kube-proxy"
W0218 19:04:30.215652     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m44s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:04:30.215695     237 executor.go:103] Tasks: 61 done / 64 total; 3 can run
W0218 19:04:45.002686     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:04:45.002744     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:04:45.395825     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:04:45.395864     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:04:55.397887     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:04:55.762002     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m18s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:04:55.762038     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:05:05.762331     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:05:06.196809     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m8s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:05:06.196842     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:05:16.197054     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:05:16.558653     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m58s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:05:16.558705     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:05:26.559655     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:05:26.960672     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m47s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:05:26.960706     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:05:36.960970     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:05:37.364320     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m37s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:05:37.364355     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:05:47.364579     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:05:47.763530     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m26s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:05:47.763559     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:05:57.763745     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:05:58.163790     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m16s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:05:58.163832     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:06:08.164088     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:06:08.564152     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m6s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:06:08.564187     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:06:18.564465     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:06:18.962043     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m55s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:06:18.962071     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:06:28.962300     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:06:29.367544     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m45s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:06:29.367586     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:06:39.367760     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:06:39.801537     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m34s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:06:39.801697     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:06:49.801929     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:06:50.159083     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m24s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:06:50.159116     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:07:00.159356     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:07:00.598997     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m14s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:07:00.599035     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:07:10.599260     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:07:11.000348     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m3s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:07:11.000397     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:07:21.000684     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:07:21.459572     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m53s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:07:21.459600     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:07:31.459851     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:07:31.863207     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m42s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:07:31.863262     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:07:41.864168     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:07:42.402920     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:07:42.402967     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:07:52.403175     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:07:52.860323     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m21s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:07:52.860352     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:08:02.860603     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:08:03.297951     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m11s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:08:03.297991     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:08:13.298229     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:08:13.664134     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m1s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:08:13.664174     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:08:23.664418     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:08:24.105322     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:08:24.105358     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:08:34.105819     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:08:34.566684     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m40s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:08:34.566729     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:08:44.567033     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:08:44.960428     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:08:44.960465     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:08:54.960708     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:08:55.400824     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m19s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:08:55.400858     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:09:05.401201     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:09:05.759316     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m8s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:09:05.759342     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:09:15.759635     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:09:16.398599     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m58s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:09:16.398633     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:09:26.398887     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:09:26.800765     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m47s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:09:26.800812     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:09:36.800958     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:09:37.203600     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m37s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:09:37.203625     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:09:47.203920     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:09:47.567860     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m27s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:09:47.567898     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:09:57.571814     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:09:58.107146     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m16s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:09:58.107347     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:10:08.107671     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:10:08.494903     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m6s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:10:08.494937     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:10:18.495183     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:10:19.000655     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m55s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:10:19.000686     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:10:29.000980     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:10:29.400237     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m45s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:10:29.400271     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:10:39.400796     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:10:39.774990     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m34s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:10:39.775031     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:10:49.775311     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:10:50.200926     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m24s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:10:50.200961     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:11:00.202098     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:11:00.663177     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m14s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:11:00.663212     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:11:10.664862     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:11:11.060249     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m3s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:11:11.060301     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:11:21.060540     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:11:21.473730     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m53s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:11:21.473765     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:11:31.474227     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:11:31.867089     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m42s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:11:31.867123     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:11:41.867341     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:11:42.301069     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:11:42.301113     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:11:52.301463     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:11:52.694905     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m22s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:11:52.694940     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:12:02.695199     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:12:03.059063     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m11s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:12:03.059100     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:12:13.059370     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:12:13.465532     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m1s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:12:13.465568     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:12:23.465982     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:12:23.898711     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:12:23.898774     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:12:33.900092     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:12:34.262665     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m40s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:12:34.262701     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:12:44.262913     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:12:44.661376     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m30s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:12:44.661409     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:12:54.661813     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:12:55.096677     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m19s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:12:55.096710     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:13:05.101697     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:13:05.471300     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m9s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:13:05.471343     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:13:15.471601     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:13:15.898017     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (58s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:13:15.898049     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:13:25.898288     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:13:26.267858     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (48s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:13:26.267892     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:13:36.268199     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:13:36.814376     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (37s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:13:36.814410     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:13:46.814668     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:13:47.264657     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (27s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:13:47.264689     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:13:57.264839     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:13:57.695989     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (17s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:13:57.696031     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 19:14:07.696264     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 19:14:08.061524     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 19:14:08.061559     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)

error running tasks: deadline exceeded executing task StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce. Example error: error creating GCS bucket ACL for gs://k8s-kops-gce for user-1065773147982-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
2020/02/18 19:14:18 process.go:155: Step '/tmp/kops680145490/kops update cluster e2e-kops-gce-canary.k8s.local --yes' finished in 10m6.3346576s
2020/02/18 19:14:18 process.go:153: Running: kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller
2020/02/18 19:14:18 process.go:153: Running: /tmp/kops680145490/kops export kubecfg e2e-kops-gce-canary.k8s.local
I0218 19:14:18.189608     256 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 19:14:18.189718     256 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 19:14:18.529613     256 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
... skipping 3 lines ...
I0218 19:14:19.177044     281 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 19:14:19.177128     281 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 19:14:19.459098     281 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
I0218 19:14:19.674257     281 gce.go:82] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b]
2020/02/18 19:14:22 process.go:155: Step '/tmp/kops680145490/kops toolbox dump --name e2e-kops-gce-canary.k8s.local -ojson' finished in 3.046730581s
2020/02/18 19:14:22 process.go:153: Running: kubectl get nodes -ojson
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 19:15:04 process.go:155: Step 'kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller' finished in 45.962671115s
2020/02/18 19:15:04 kubernetes.go:117: kubectl get pods failed: error during kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller: exit status 1
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 19:15:17 process.go:155: Step 'kubectl get nodes -ojson' finished in 55.067020912s
2020/02/18 19:15:17 kubernetes.go:35: kubectl get nodes failed: error during kubectl get nodes -ojson: exit status 1
2020/02/18 19:15:17 dump.go:92: Failed to get nodes for dumping via kubectl: error during kubectl get nodes -ojson: exit status 1
2020/02/18 19:15:17 dump.go:126: dumping node not registered in kubernetes: 35.225.161.249
2020/02/18 19:15:17 dump.go:160: Dumping node 35.225.161.249
2020/02/18 19:15:17 dump.go:399: Running SSH command: sudo journalctl --output=short-precise -k
2020/02/18 19:15:17 dump.go:399: Running SSH command: sudo journalctl --output=short-precise
2020/02/18 19:15:17 dump.go:399: Running SSH command: sudo systemctl list-units -t service --no-pager --no-legend --all
2020/02/18 19:15:18 dump.go:399: Running SSH command: sudo journalctl --output=cat -u kubelet.service
... skipping 127 lines ...
InstanceTemplate:master-us-central1-c-e2e--a8i4mi-1582052663	ok
Deleted kubectl config for e2e-kops-gce-canary.k8s.local

Deleted cluster: "e2e-kops-gce-canary.k8s.local"
2020/02/18 19:17:38 process.go:155: Step '/tmp/kops680145490/kops delete cluster e2e-kops-gce-canary.k8s.local --yes' finished in 2m17.915718269s
2020/02/18 19:17:38 process.go:96: Saved XML output to /logs/artifacts/junit_runner.xml.
2020/02/18 19:17:38 main.go:316: Something went wrong: starting e2e cluster: kops update cluster failed: error during /tmp/kops680145490/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
Traceback (most recent call last):
  File "/workspace/scenarios/kubernetes_e2e.py", line 779, in <module>
    main(parse_args())
  File "/workspace/scenarios/kubernetes_e2e.py", line 627, in main
    mode.start(runner_args)
  File "/workspace/scenarios/kubernetes_e2e.py", line 262, in start
... skipping 9 lines ...