This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 5 succeeded
Started2020-02-18 07:06
Elapsed13m27s
Revision
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/2b53f282-516e-4263-b3a2-666d91b554a8/targets/test'}}
resultstorehttps://source.cloud.google.com/results/invocations/2b53f282-516e-4263-b3a2-666d91b554a8/targets/test
job-versionv1.18.0-alpha.5.178+5bd719b6a6f6ea
revisionv1.18.0-alpha.5.178+5bd719b6a6f6ea

Test Failures


Up 10m11s

kops update cluster failed: error during /tmp/kops993239706/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 5 Passed Tests

Error lines from build-log.txt

Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
fatal: not a git repository (or any of the parent directories): .git
+ /workspace/scenarios/kubernetes_e2e.py --cluster=e2e-kops-gce-canary.k8s.local --deployment=kops --extract=ci/latest --ginkgo-parallel=30 --kops-priority-path=/workspace/kubernetes/platforms/linux/amd64 --kops-version=https://storage.googleapis.com/kops-ci/bin/latest-ci-updown-green.txt --kops-zones=us-central1-c --provider=gce '--test_args=--ginkgo.skip=\[Slow\]|\[Serial\]|\[Disruptive\]|\[Flaky\]|\[Feature:.+\]|\[HPA\]|Dashboard|Services.*functioning.*NodePort' --timeout=120m
starts with local mode
Environment:
ARTIFACTS=/logs/artifacts
BAZEL_REMOTE_CACHE_ENABLED=false
BAZEL_VERSION=0.23.2
... skipping 479 lines ...
I0218 07:07:37.054828     238 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-main"
I0218 07:07:37.078328     238 vfs_castore.go:675] Issuing new certificate: "etcd-clients-ca"
I0218 07:07:37.181562     238 vfs_castore.go:675] Issuing new certificate: "ca"
I0218 07:07:37.277624     238 vfs_castore.go:675] Issuing new certificate: "apiserver-aggregator-ca"
I0218 07:07:37.369276     238 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-events"
I0218 07:07:37.443280     238 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-events"
W0218 07:07:45.913362     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:07:45.913430     238 executor.go:103] Tasks: 36 done / 64 total; 26 can run
I0218 07:07:46.055953     238 instancetemplate.go:223] We should be using NVME for GCE
I0218 07:07:46.058646     238 instancetemplate.go:223] We should be using NVME for GCE
I0218 07:07:46.096143     238 instancetemplate.go:223] We should be using NVME for GCE
I0218 07:07:46.196749     238 instancetemplate.go:223] We should be using NVME for GCE
I0218 07:07:46.312878     238 vfs_castore.go:675] Issuing new certificate: "apiserver-proxy-client"
... skipping 3 lines ...
I0218 07:07:46.504506     238 vfs_castore.go:675] Issuing new certificate: "kube-scheduler"
I0218 07:07:46.551898     238 vfs_castore.go:675] Issuing new certificate: "apiserver-aggregator"
I0218 07:07:46.653391     238 vfs_castore.go:675] Issuing new certificate: "kops"
I0218 07:07:46.852922     238 vfs_castore.go:675] Issuing new certificate: "kube-controller-manager"
I0218 07:07:46.933411     238 vfs_castore.go:675] Issuing new certificate: "master"
I0218 07:07:46.936802     238 vfs_castore.go:675] Issuing new certificate: "kubecfg"
W0218 07:07:53.832211     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m42s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:07:53.832277     238 executor.go:103] Tasks: 61 done / 64 total; 3 can run
W0218 07:08:05.326849     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m31s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:08:05.326899     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:08:05.805700     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m30s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:08:05.805734     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:08:15.806007     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:08:16.159905     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m20s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:08:16.159940     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:08:26.160208     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:08:26.564147     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m10s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:08:26.564186     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:08:36.564527     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:08:36.998192     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m59s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:08:36.998228     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:08:46.998507     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:08:47.461459     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m49s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:08:47.461494     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:08:57.461790     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:08:57.997620     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m38s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:08:57.997654     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:09:07.997943     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:09:08.400539     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m28s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:09:08.400580     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:09:18.400821     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:09:18.759471     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m17s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:09:18.759503     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:09:28.759858     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:09:29.162811     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m7s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:09:29.162844     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:09:39.163110     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:09:39.899895     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m56s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:09:39.899933     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:09:49.900164     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:09:50.396064     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m46s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:09:50.396106     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:10:00.396390     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:10:00.858977     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m35s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:10:00.859017     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:10:10.859275     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:10:11.264238     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m25s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:10:11.264363     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:10:21.264730     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:10:21.762292     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m14s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:10:21.762327     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:10:31.762550     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:10:32.195819     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m4s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:10:32.195861     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:10:42.196114     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:10:42.667396     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m53s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:10:42.667427     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:10:52.693892     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:10:53.168151     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m43s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:10:53.168200     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:11:03.168417     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:11:03.698480     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:11:03.698534     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:11:13.698709     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:11:14.164539     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m22s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:11:14.164571     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:11:24.164819     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:11:24.560786     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m12s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:11:24.560817     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:11:34.560974     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:11:35.002036     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m1s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:11:35.002067     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:11:45.002322     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:11:45.400277     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m51s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:11:45.400334     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:11:55.400559     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:11:55.897834     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m40s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:11:55.897873     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:12:05.898054     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:12:06.259423     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m30s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:12:06.259464     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:12:16.259808     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:12:16.661332     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m19s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:12:16.661366     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:12:26.661601     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:12:27.060251     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m9s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:12:27.060287     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:12:37.060429     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:12:37.668730     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m58s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:12:37.668777     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:12:47.669040     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:12:48.197133     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m48s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:12:48.197170     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:12:58.197402     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:12:58.564566     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m38s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:12:58.564602     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:13:08.564858     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:13:08.997412     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m27s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:13:08.997446     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:13:18.997814     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:13:19.462819     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m17s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:13:19.462859     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:13:29.463150     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:13:29.900449     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m6s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:13:29.900491     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:13:39.900884     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:13:40.259915     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m56s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:13:40.260040     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:13:50.260317     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:13:50.695413     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m45s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:13:50.695446     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:14:00.695904     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:14:01.258965     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m35s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:14:01.259000     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:14:11.261565     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:14:11.658799     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m24s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:14:11.658830     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:14:21.659001     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:14:22.060911     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m14s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:14:22.060951     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:14:32.061134     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:14:32.605239     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m3s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:14:32.605275     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:14:42.605506     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:14:43.063226     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m53s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:14:43.063260     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:14:53.063433     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:14:53.506733     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m43s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:14:53.506767     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:15:03.506932     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:15:03.960675     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:15:03.960719     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:15:13.961056     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:15:14.563401     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m22s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:15:14.563435     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:15:24.563754     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:15:25.000825     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m11s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:15:25.000862     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:15:35.001104     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:15:35.398484     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m1s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:15:35.398589     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:15:45.398842     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:15:45.758800     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:15:45.758836     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:15:55.759125     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:15:56.262882     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m40s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:15:56.262922     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:16:06.263188     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:16:06.662216     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:16:06.662255     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:16:16.663963     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:16:17.157745     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m19s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:16:17.157798     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:16:27.158045     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:16:27.906182     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m8s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:16:27.906216     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:16:37.906455     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:16:38.262304     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (58s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:16:38.262339     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:16:48.262543     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:16:48.661187     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (47s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:16:48.661223     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:16:58.661529     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:16:59.098865     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (37s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:16:59.098895     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:17:09.099094     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:17:09.601506     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (26s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:17:09.601539     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:17:19.601757     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:17:19.998403     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (16s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:17:19.998438     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 07:17:29.998679     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 07:17:30.363459     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 07:17:30.363501     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)

error running tasks: deadline exceeded executing task StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce. Example error: error creating GCS bucket ACL for gs://k8s-kops-gce for user-790587036140-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
2020/02/18 07:17:40 process.go:155: Step '/tmp/kops993239706/kops update cluster e2e-kops-gce-canary.k8s.local --yes' finished in 10m7.310295182s
2020/02/18 07:17:40 process.go:153: Running: kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller
2020/02/18 07:17:40 process.go:153: Running: /tmp/kops993239706/kops export kubecfg e2e-kops-gce-canary.k8s.local
I0218 07:17:40.763754     257 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 07:17:40.763858     257 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 07:17:41.070045     257 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
... skipping 3 lines ...
I0218 07:17:41.629999     282 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 07:17:41.630081     282 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 07:17:41.963122     282 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
I0218 07:17:42.203967     282 gce.go:82] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b]
2020/02/18 07:17:44 process.go:155: Step '/tmp/kops993239706/kops toolbox dump --name e2e-kops-gce-canary.k8s.local -ojson' finished in 3.218523433s
2020/02/18 07:17:44 process.go:153: Running: kubectl get nodes -ojson
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 07:18:25 process.go:155: Step 'kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller' finished in 45.23461921s
2020/02/18 07:18:25 kubernetes.go:117: kubectl get pods failed: error during kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller: exit status 1
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 07:18:34 process.go:155: Step 'kubectl get nodes -ojson' finished in 49.417897949s
2020/02/18 07:18:34 kubernetes.go:35: kubectl get nodes failed: error during kubectl get nodes -ojson: exit status 1
2020/02/18 07:18:34 dump.go:92: Failed to get nodes for dumping via kubectl: error during kubectl get nodes -ojson: exit status 1
2020/02/18 07:18:34 dump.go:126: dumping node not registered in kubernetes: 35.184.232.245
2020/02/18 07:18:34 dump.go:160: Dumping node 35.184.232.245
2020/02/18 07:18:34 dump.go:399: Running SSH command: sudo journalctl --output=short-precise -k
2020/02/18 07:18:34 dump.go:399: Running SSH command: sudo journalctl --output=short-precise
2020/02/18 07:18:34 dump.go:399: Running SSH command: sudo systemctl list-units -t service --no-pager --no-legend --all
2020/02/18 07:18:34 dump.go:399: Running SSH command: sudo journalctl --output=cat -u kubelet.service
... skipping 119 lines ...
TargetPool:api-e2e-kops-gce-canary-k8s-local	ok
Deleted kubectl config for e2e-kops-gce-canary.k8s.local

Deleted cluster: "e2e-kops-gce-canary.k8s.local"
2020/02/18 07:19:57 process.go:155: Step '/tmp/kops993239706/kops delete cluster e2e-kops-gce-canary.k8s.local --yes' finished in 1m20.233230659s
2020/02/18 07:19:57 process.go:96: Saved XML output to /logs/artifacts/junit_runner.xml.
2020/02/18 07:19:57 main.go:316: Something went wrong: starting e2e cluster: kops update cluster failed: error during /tmp/kops993239706/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
Traceback (most recent call last):
  File "/workspace/scenarios/kubernetes_e2e.py", line 779, in <module>
    main(parse_args())
  File "/workspace/scenarios/kubernetes_e2e.py", line 627, in main
    mode.start(runner_args)
  File "/workspace/scenarios/kubernetes_e2e.py", line 262, in start
... skipping 9 lines ...