This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 5 succeeded
Started2020-02-18 12:25
Elapsed14m24s
Revision
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/4435068b-634d-4d35-889e-f7d2b90d15df/targets/test'}}
resultstorehttps://source.cloud.google.com/results/invocations/4435068b-634d-4d35-889e-f7d2b90d15df/targets/test
job-versionv1.18.0-alpha.5.178+5bd719b6a6f6ea
revisionv1.18.0-alpha.5.178+5bd719b6a6f6ea

Test Failures


Up 10m13s

kops update cluster failed: error during /tmp/kops439267296/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 5 Passed Tests

Error lines from build-log.txt

Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
fatal: not a git repository (or any of the parent directories): .git
+ /workspace/scenarios/kubernetes_e2e.py --cluster=e2e-kops-gce-canary.k8s.local --deployment=kops --extract=ci/latest --ginkgo-parallel=30 --kops-priority-path=/workspace/kubernetes/platforms/linux/amd64 --kops-version=https://storage.googleapis.com/kops-ci/bin/latest-ci-updown-green.txt --kops-zones=us-central1-c --provider=gce '--test_args=--ginkgo.skip=\[Slow\]|\[Serial\]|\[Disruptive\]|\[Flaky\]|\[Feature:.+\]|\[HPA\]|Dashboard|Services.*functioning.*NodePort' --timeout=120m
starts with local mode
Environment:
ARTIFACTS=/logs/artifacts
BAZEL_REMOTE_CACHE_ENABLED=false
BAZEL_VERSION=0.23.2
... skipping 479 lines ...
I0218 12:26:33.934503     230 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-main"
I0218 12:26:34.056799     230 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-events"
I0218 12:26:34.149113     230 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-events"
I0218 12:26:34.172869     230 vfs_castore.go:675] Issuing new certificate: "apiserver-aggregator-ca"
I0218 12:26:34.306396     230 vfs_castore.go:675] Issuing new certificate: "etcd-clients-ca"
I0218 12:26:34.546845     230 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-main"
W0218 12:26:42.051025     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m51s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:26:42.051091     230 executor.go:103] Tasks: 36 done / 64 total; 26 can run
I0218 12:26:42.316449     230 instancetemplate.go:223] We should be using NVME for GCE
I0218 12:26:42.318646     230 instancetemplate.go:223] We should be using NVME for GCE
I0218 12:26:42.337570     230 instancetemplate.go:223] We should be using NVME for GCE
I0218 12:26:42.442507     230 instancetemplate.go:223] We should be using NVME for GCE
I0218 12:26:42.489373     230 vfs_castore.go:675] Issuing new certificate: "kubelet-api"
... skipping 3 lines ...
I0218 12:26:42.898035     230 vfs_castore.go:675] Issuing new certificate: "kubecfg"
I0218 12:26:42.969108     230 vfs_castore.go:675] Issuing new certificate: "kube-proxy"
I0218 12:26:43.060629     230 vfs_castore.go:675] Issuing new certificate: "apiserver-aggregator"
I0218 12:26:43.110178     230 vfs_castore.go:675] Issuing new certificate: "kops"
I0218 12:26:43.135512     230 vfs_castore.go:675] Issuing new certificate: "master"
I0218 12:26:43.212210     230 vfs_castore.go:675] Issuing new certificate: "kube-scheduler"
W0218 12:26:49.655068     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m43s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:26:49.655138     230 executor.go:103] Tasks: 61 done / 64 total; 3 can run
W0218 12:27:04.848081     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m28s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:27:04.848305     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:27:05.262510     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m28s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:27:05.262546     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:27:15.262768     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:27:15.665522     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m17s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:27:15.665567     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:27:25.665878     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:27:26.165681     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m7s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:27:26.165715     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:27:36.166004     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:27:36.669714     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m56s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:27:36.669741     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:27:46.669971     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:27:47.062161     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m46s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:27:47.062197     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:27:57.062394     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:27:57.497733     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m35s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:27:57.497767     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:28:07.497971     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:28:07.965994     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m25s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:28:07.966025     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:28:17.966279     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:28:18.398086     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m14s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:28:18.398114     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:28:28.398381     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:28:29.300755     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m4s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:28:29.300810     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:28:39.301035     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:28:39.660842     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m53s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:28:39.660887     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:28:49.661227     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:28:50.105038     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m43s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:28:50.105098     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:29:00.105360     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:29:00.470233     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:29:00.470278     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:29:10.470643     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:29:10.958125     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m22s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:29:10.958157     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:29:20.958339     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:29:21.360857     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m11s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:29:21.360892     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:29:31.361147     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:29:31.860336     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m1s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:29:31.860368     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:29:41.860559     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:29:42.412657     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:29:42.412692     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:29:52.412985     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:29:52.860819     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m40s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:29:52.860889     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:30:02.861121     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:30:03.362293     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:30:03.362334     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:30:13.362586     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:30:13.802859     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m19s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:30:13.802891     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:30:23.803155     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:30:24.295772     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m9s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:30:24.295807     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:30:34.298169     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:30:34.766198     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m58s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:30:34.766226     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:30:44.766425     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:30:45.260722     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m48s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:30:45.260780     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:30:55.260986     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:30:55.659604     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m37s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:30:55.659653     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:31:05.659864     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:31:06.097352     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m27s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:31:06.097383     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:31:16.097696     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:31:16.564264     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m16s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:31:16.564294     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:31:26.564519     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:31:27.001188     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m6s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:31:27.001226     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:31:37.001471     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:31:37.468887     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m55s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:31:37.468919     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:31:47.469157     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:31:47.961910     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m45s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:31:47.961956     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:31:57.962185     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:31:58.557905     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m34s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:31:58.557939     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:32:08.558133     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:32:08.966377     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m24s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:32:08.966410     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:32:18.966697     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:32:19.365046     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m13s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:32:19.365080     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:32:29.365295     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:32:29.867131     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m3s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:32:29.867168     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:32:39.867620     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:32:40.262483     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m53s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:32:40.262523     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:32:50.262709     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:32:50.671848     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m42s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:32:50.671878     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:33:00.672033     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:33:01.061970     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:33:01.062002     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:33:11.062313     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:33:11.504251     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m21s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:33:11.504287     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:33:21.504460     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:33:21.957483     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m11s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:33:21.957520     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:33:31.960983     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:33:32.562337     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m0s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:33:32.562366     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:33:42.562608     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:33:42.964536     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:33:42.964563     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:33:52.964806     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:33:53.362012     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m39s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:33:53.362039     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:34:03.362234     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:34:03.767063     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:34:03.767092     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:34:13.767253     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:34:14.193911     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m19s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:34:14.193940     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:34:24.194162     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:34:24.658516     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m8s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:34:24.658575     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:34:34.658824     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:34:35.098513     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m58s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:34:35.098543     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:34:45.098789     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:34:45.603944     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m47s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:34:45.603973     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:34:55.604302     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:34:56.157857     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m37s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:34:56.157884     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:35:06.158110     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:35:06.568286     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m26s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:35:06.568319     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:35:16.568581     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:35:16.968283     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m16s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:35:16.968309     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:35:26.968517     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:35:27.496016     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m5s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:35:27.496042     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:35:37.496257     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:35:37.861321     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (55s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:35:37.861351     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:35:47.861499     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:35:48.296828     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (45s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:35:48.296854     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:35:58.297065     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:35:58.761351     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (34s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:35:58.761380     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:36:08.761628     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:36:09.261661     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (24s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:36:09.261692     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:36:19.261980     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:36:19.698620     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (13s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:36:19.698650     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:36:29.699009     230 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:36:30.165925     230 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:36:30.165957     230 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)

error running tasks: deadline exceeded executing task StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce. Example error: error creating GCS bucket ACL for gs://k8s-kops-gce for user-366111553019-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
2020/02/18 12:36:40 process.go:155: Step '/tmp/kops439267296/kops update cluster e2e-kops-gce-canary.k8s.local --yes' finished in 10m10.251172099s
2020/02/18 12:36:40 process.go:153: Running: kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller
2020/02/18 12:36:40 process.go:153: Running: /tmp/kops439267296/kops export kubecfg e2e-kops-gce-canary.k8s.local
I0218 12:36:40.425769     252 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 12:36:40.425848     252 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 12:36:40.677024     252 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
... skipping 3 lines ...
I0218 12:36:41.287426     277 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 12:36:41.287520     277 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 12:36:41.529710     277 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
I0218 12:36:41.758453     277 gce.go:82] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b]
2020/02/18 12:36:44 process.go:155: Step '/tmp/kops439267296/kops toolbox dump --name e2e-kops-gce-canary.k8s.local -ojson' finished in 2.88307448s
2020/02/18 12:36:44 process.go:153: Running: kubectl get nodes -ojson
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 12:37:25 process.go:155: Step 'kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller' finished in 45.22267258s
2020/02/18 12:37:25 kubernetes.go:117: kubectl get pods failed: error during kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller: exit status 1
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 12:37:45 process.go:155: Step 'kubectl get nodes -ojson' finished in 1m1.707496247s
2020/02/18 12:37:45 kubernetes.go:35: kubectl get nodes failed: error during kubectl get nodes -ojson: exit status 1
2020/02/18 12:37:45 dump.go:92: Failed to get nodes for dumping via kubectl: error during kubectl get nodes -ojson: exit status 1
2020/02/18 12:37:45 dump.go:126: dumping node not registered in kubernetes: 35.224.217.163
2020/02/18 12:37:45 dump.go:160: Dumping node 35.224.217.163
2020/02/18 12:37:45 dump.go:399: Running SSH command: sudo journalctl --output=short-precise -k
2020/02/18 12:37:46 dump.go:399: Running SSH command: sudo journalctl --output=short-precise
2020/02/18 12:37:46 dump.go:399: Running SSH command: sudo systemctl list-units -t service --no-pager --no-legend --all
2020/02/18 12:37:46 dump.go:399: Running SSH command: sudo journalctl --output=cat -u kubelet.service
... skipping 126 lines ...
TargetPool:api-e2e-kops-gce-canary-k8s-local	ok
Deleted kubectl config for e2e-kops-gce-canary.k8s.local

Deleted cluster: "e2e-kops-gce-canary.k8s.local"
2020/02/18 12:39:54 process.go:155: Step '/tmp/kops439267296/kops delete cluster e2e-kops-gce-canary.k8s.local --yes' finished in 2m5.3540762s
2020/02/18 12:39:54 process.go:96: Saved XML output to /logs/artifacts/junit_runner.xml.
2020/02/18 12:39:54 main.go:316: Something went wrong: starting e2e cluster: kops update cluster failed: error during /tmp/kops439267296/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
Traceback (most recent call last):
  File "/workspace/scenarios/kubernetes_e2e.py", line 779, in <module>
    main(parse_args())
  File "/workspace/scenarios/kubernetes_e2e.py", line 627, in main
    mode.start(runner_args)
  File "/workspace/scenarios/kubernetes_e2e.py", line 262, in start
... skipping 9 lines ...