This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 5 succeeded
Started2020-02-18 06:35
Elapsed13m43s
Revision
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/be3d2325-f6c1-4316-b804-cc2741ec7c6b/targets/test'}}
resultstorehttps://source.cloud.google.com/results/invocations/be3d2325-f6c1-4316-b804-cc2741ec7c6b/targets/test
job-versionv1.18.0-alpha.5.178+5bd719b6a6f6ea
revisionv1.18.0-alpha.5.178+5bd719b6a6f6ea

Test Failures


Up 10m10s

kops update cluster failed: error during /tmp/kops429560156/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 5 Passed Tests

Error lines from build-log.txt

Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
fatal: not a git repository (or any of the parent directories): .git
+ /workspace/scenarios/kubernetes_e2e.py --cluster=e2e-kops-gce-canary.k8s.local --deployment=kops --extract=ci/latest --ginkgo-parallel=30 --kops-priority-path=/workspace/kubernetes/platforms/linux/amd64 --kops-version=https://storage.googleapis.com/kops-ci/bin/latest-ci-updown-green.txt --kops-zones=us-central1-c --provider=gce '--test_args=--ginkgo.skip=\[Slow\]|\[Serial\]|\[Disruptive\]|\[Flaky\]|\[Feature:.+\]|\[HPA\]|Dashboard|Services.*functioning.*NodePort' --timeout=120m
starts with local mode
Environment:
ARTIFACTS=/logs/artifacts
BAZEL_REMOTE_CACHE_ENABLED=false
BAZEL_VERSION=0.23.2
... skipping 479 lines ...
I0218 06:36:02.757199     234 vfs_castore.go:675] Issuing new certificate: "apiserver-aggregator-ca"
I0218 06:36:02.760310     234 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-main"
I0218 06:36:02.850212     234 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-events"
I0218 06:36:02.902714     234 vfs_castore.go:675] Issuing new certificate: "etcd-clients-ca"
I0218 06:36:03.052746     234 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-events"
I0218 06:36:03.074253     234 vfs_castore.go:675] Issuing new certificate: "ca"
W0218 06:36:10.342871     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m51s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:36:10.342979     234 executor.go:103] Tasks: 36 done / 64 total; 26 can run
I0218 06:36:10.466465     234 instancetemplate.go:223] We should be using NVME for GCE
I0218 06:36:10.513440     234 instancetemplate.go:223] We should be using NVME for GCE
I0218 06:36:10.516121     234 instancetemplate.go:223] We should be using NVME for GCE
I0218 06:36:10.566452     234 instancetemplate.go:223] We should be using NVME for GCE
I0218 06:36:10.656058     234 vfs_castore.go:675] Issuing new certificate: "apiserver-aggregator"
... skipping 3 lines ...
I0218 06:36:11.076597     234 vfs_castore.go:675] Issuing new certificate: "master"
I0218 06:36:11.114337     234 vfs_castore.go:675] Issuing new certificate: "kube-proxy"
I0218 06:36:11.138658     234 vfs_castore.go:675] Issuing new certificate: "kube-scheduler"
I0218 06:36:11.177664     234 vfs_castore.go:675] Issuing new certificate: "apiserver-proxy-client"
I0218 06:36:11.311655     234 vfs_castore.go:675] Issuing new certificate: "kubecfg"
I0218 06:36:11.466004     234 vfs_castore.go:675] Issuing new certificate: "kubelet"
W0218 06:36:17.535293     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m44s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:36:17.535340     234 executor.go:103] Tasks: 61 done / 64 total; 3 can run
W0218 06:36:29.342810     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:36:29.342861     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:36:29.799613     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:36:29.799649     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:36:39.799850     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:36:40.166589     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m22s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:36:40.166629     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:36:50.166852     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:36:50.561633     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m11s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:36:50.561667     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:37:00.561878     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:37:00.964213     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m1s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:37:00.964245     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:37:10.964545     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:37:11.464390     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:37:11.464418     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:37:21.464651     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:37:21.972523     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m40s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:37:21.972556     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:37:31.972836     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:37:32.495880     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:37:32.495921     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:37:42.496184     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:37:43.058211     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m19s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:37:43.058251     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:37:53.058557     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:37:53.495342     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m8s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:37:53.495379     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:38:03.495535     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:38:03.959630     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m58s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:38:03.959661     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:38:13.959946     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:38:14.358245     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m47s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:38:14.358278     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:38:24.358509     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:38:24.760690     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m37s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:38:24.760724     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:38:34.760965     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:38:35.197993     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m27s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:38:35.198033     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:38:45.198183     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:38:45.801361     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m16s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:38:45.801391     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:38:55.801668     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:38:56.597452     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m5s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:38:56.597483     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:39:06.597729     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:39:07.064641     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m55s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:39:07.064672     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:39:17.064945     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:39:17.463241     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m44s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:39:17.463273     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:39:27.463548     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:39:27.961523     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m34s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:39:27.961554     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:39:37.961825     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:39:38.363263     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m23s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:39:38.363300     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:39:48.363562     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:39:48.859534     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m13s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:39:48.859564     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:39:58.859803     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:39:59.538658     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m2s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:39:59.538776     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:40:09.538944     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:40:10.096523     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m52s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:40:10.096556     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:40:20.096765     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:40:21.163979     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m41s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:40:21.164026     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:40:31.164264     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:40:31.663506     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m30s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:40:31.663539     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:40:41.663718     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:40:42.057580     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m20s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:40:42.057611     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:40:52.057844     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:40:52.560001     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m9s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:40:52.560047     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:41:02.560256     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:41:02.961342     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m59s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:41:02.961395     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:41:12.961659     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:41:13.367415     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m48s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:41:13.367449     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:41:23.367778     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:41:23.997994     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m38s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:41:23.998031     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:41:33.998232     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:41:34.464081     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m27s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:41:34.464114     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:41:44.464324     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:41:44.859992     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m17s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:41:44.860030     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:41:54.860255     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:41:55.507441     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m6s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:41:55.507479     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:42:05.507689     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:42:06.259744     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m55s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:42:06.259777     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:42:16.259986     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:42:16.767069     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m45s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:42:16.767113     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:42:26.767341     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:42:27.296012     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m34s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:42:27.296047     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:42:37.296308     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:42:37.662739     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m24s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:42:37.662768     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:42:47.663026     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:42:48.161325     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m14s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:42:48.161358     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:42:58.161601     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:42:58.571164     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m3s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:42:58.571196     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:43:08.571402     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:43:08.997609     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m53s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:43:08.997646     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:43:18.997907     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:43:19.501400     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m42s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:43:19.501435     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:43:29.501666     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:43:29.860877     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:43:29.860918     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:43:39.861156     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:43:40.259342     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m21s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:43:40.259372     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:43:50.259639     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:43:51.097807     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m11s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:43:51.097835     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:44:01.098072     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:44:01.561893     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m0s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:44:01.561951     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:44:11.562139     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:44:12.161051     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:44:12.161083     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:44:22.161400     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:44:22.597934     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m39s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:44:22.597995     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:44:32.598219     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:44:33.104879     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:44:33.104912     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:44:43.105233     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:44:43.562418     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m18s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:44:43.562452     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:44:53.562657     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:44:54.001293     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m8s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:44:54.001326     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:45:04.001564     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:45:04.357015     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (57s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:45:04.357045     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:45:14.357390     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:45:14.859981     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (47s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:45:14.860024     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:45:24.860234     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:45:25.361715     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (36s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:45:25.361755     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:45:35.362024     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:45:35.900139     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (26s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:45:35.900181     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:45:45.900404     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:45:46.359336     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (15s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:45:46.359364     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 06:45:56.359735     234 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 06:45:56.766643     234 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 06:45:56.766683     234 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)

error running tasks: deadline exceeded executing task StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce. Example error: error creating GCS bucket ACL for gs://k8s-kops-gce for user-928587112265-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
2020/02/18 06:46:06 process.go:155: Step '/tmp/kops429560156/kops update cluster e2e-kops-gce-canary.k8s.local --yes' finished in 10m7.640640544s
2020/02/18 06:46:06 process.go:153: Running: kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller
2020/02/18 06:46:06 process.go:153: Running: /tmp/kops429560156/kops export kubecfg e2e-kops-gce-canary.k8s.local
I0218 06:46:06.833639     254 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 06:46:06.833716     254 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 06:46:07.049135     254 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
... skipping 3 lines ...
I0218 06:46:07.625385     280 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 06:46:07.625475     280 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 06:46:07.823381     280 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
I0218 06:46:08.053633     280 gce.go:82] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b]
2020/02/18 06:46:10 process.go:155: Step '/tmp/kops429560156/kops toolbox dump --name e2e-kops-gce-canary.k8s.local -ojson' finished in 2.900411839s
2020/02/18 06:46:10 process.go:153: Running: kubectl get nodes -ojson
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 06:46:51 process.go:155: Step 'kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller' finished in 45.141375953s
2020/02/18 06:46:51 kubernetes.go:117: kubectl get pods failed: error during kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller: exit status 1
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 06:47:04 process.go:155: Step 'kubectl get nodes -ojson' finished in 53.521049692s
2020/02/18 06:47:04 kubernetes.go:35: kubectl get nodes failed: error during kubectl get nodes -ojson: exit status 1
2020/02/18 06:47:04 dump.go:92: Failed to get nodes for dumping via kubectl: error during kubectl get nodes -ojson: exit status 1
2020/02/18 06:47:04 dump.go:126: dumping node not registered in kubernetes: 34.70.206.161
2020/02/18 06:47:04 dump.go:160: Dumping node 34.70.206.161
2020/02/18 06:47:04 dump.go:399: Running SSH command: sudo journalctl --output=short-precise -k
2020/02/18 06:47:04 dump.go:399: Running SSH command: sudo journalctl --output=short-precise
2020/02/18 06:47:04 dump.go:399: Running SSH command: sudo systemctl list-units -t service --no-pager --no-legend --all
2020/02/18 06:47:04 dump.go:399: Running SSH command: sudo journalctl --output=cat -u kubelet.service
... skipping 127 lines ...
InstanceTemplate:nodes-e2e-kops-gce-canary-1m0s02-1582007770	ok
Deleted kubectl config for e2e-kops-gce-canary.k8s.local

Deleted cluster: "e2e-kops-gce-canary.k8s.local"
2020/02/18 06:49:11 process.go:155: Step '/tmp/kops429560156/kops delete cluster e2e-kops-gce-canary.k8s.local --yes' finished in 2m4.490468406s
2020/02/18 06:49:11 process.go:96: Saved XML output to /logs/artifacts/junit_runner.xml.
2020/02/18 06:49:11 main.go:316: Something went wrong: starting e2e cluster: kops update cluster failed: error during /tmp/kops429560156/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
Traceback (most recent call last):
  File "/workspace/scenarios/kubernetes_e2e.py", line 779, in <module>
    main(parse_args())
  File "/workspace/scenarios/kubernetes_e2e.py", line 627, in main
    mode.start(runner_args)
  File "/workspace/scenarios/kubernetes_e2e.py", line 262, in start
... skipping 9 lines ...