This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 5 succeeded
Started2020-02-18 01:09
Elapsed13m52s
Revision
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/aa5b0bf1-cc20-4d4c-97c8-92fa30f12f54/targets/test'}}
resultstorehttps://source.cloud.google.com/results/invocations/aa5b0bf1-cc20-4d4c-97c8-92fa30f12f54/targets/test
job-versionv1.18.0-alpha.5.174+ea5cef1c65b589
revisionv1.18.0-alpha.5.174+ea5cef1c65b589

Test Failures


Up 10m9s

kops update cluster failed: error during /tmp/kops813700158/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 5 Passed Tests

Error lines from build-log.txt

Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
fatal: not a git repository (or any of the parent directories): .git
+ /workspace/scenarios/kubernetes_e2e.py --cluster=e2e-kops-gce-canary.k8s.local --deployment=kops --extract=ci/latest --ginkgo-parallel=30 --kops-priority-path=/workspace/kubernetes/platforms/linux/amd64 --kops-version=https://storage.googleapis.com/kops-ci/bin/latest-ci-updown-green.txt --kops-zones=us-central1-c --provider=gce '--test_args=--ginkgo.skip=\[Slow\]|\[Serial\]|\[Disruptive\]|\[Flaky\]|\[Feature:.+\]|\[HPA\]|Dashboard|Services.*functioning.*NodePort' --timeout=120m
starts with local mode
Environment:
ARTIFACTS=/logs/artifacts
BAZEL_REMOTE_CACHE_ENABLED=false
BAZEL_VERSION=0.23.2
... skipping 479 lines ...
I0218 01:10:25.921247     225 vfs_castore.go:675] Issuing new certificate: "etcd-clients-ca"
I0218 01:10:25.953196     225 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-events"
I0218 01:10:26.607528     225 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-main"
I0218 01:10:26.610309     225 vfs_castore.go:675] Issuing new certificate: "ca"
I0218 01:10:26.637191     225 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-events"
I0218 01:10:26.808235     225 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-main"
W0218 01:10:33.480244     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m51s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:10:33.480824     225 executor.go:103] Tasks: 36 done / 64 total; 26 can run
I0218 01:10:33.621206     225 instancetemplate.go:223] We should be using NVME for GCE
I0218 01:10:33.640574     225 instancetemplate.go:223] We should be using NVME for GCE
I0218 01:10:33.646706     225 instancetemplate.go:223] We should be using NVME for GCE
I0218 01:10:33.732236     225 instancetemplate.go:223] We should be using NVME for GCE
I0218 01:10:34.443229     225 vfs_castore.go:675] Issuing new certificate: "kube-scheduler"
... skipping 3 lines ...
I0218 01:10:35.069454     225 vfs_castore.go:675] Issuing new certificate: "apiserver-aggregator"
I0218 01:10:35.399427     225 vfs_castore.go:675] Issuing new certificate: "apiserver-proxy-client"
I0218 01:10:35.483516     225 vfs_castore.go:675] Issuing new certificate: "master"
I0218 01:10:35.546768     225 vfs_castore.go:675] Issuing new certificate: "kubelet"
I0218 01:10:35.810048     225 vfs_castore.go:675] Issuing new certificate: "kube-proxy"
I0218 01:10:36.173962     225 vfs_castore.go:675] Issuing new certificate: "kubelet-api"
W0218 01:10:40.876349     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m44s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:10:40.876403     225 executor.go:103] Tasks: 61 done / 64 total; 3 can run
W0218 01:10:52.163269     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:10:52.163321     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:10:52.661189     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:10:52.661219     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:11:02.661500     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:11:03.164066     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m21s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:11:03.164105     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:11:13.164320     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:11:13.600065     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m11s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:11:13.600102     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:11:23.600978     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:11:23.958702     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m1s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:11:23.958739     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:11:33.959853     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:11:34.460253     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:11:34.460287     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:11:44.460505     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:11:44.861627     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m40s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:11:44.861662     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:11:54.863797     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:11:55.258587     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:11:55.258623     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:12:05.259052     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:12:05.656445     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m19s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:12:05.656488     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:12:15.657802     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:12:16.459851     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m8s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:12:16.459892     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:12:26.460340     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:12:27.260172     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m57s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:12:27.260209     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:12:37.260538     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:12:37.660092     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m47s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:12:37.660123     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:12:47.660255     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:12:48.060163     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m37s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:12:48.060195     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:12:58.060483     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:12:58.461155     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m26s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:12:58.461185     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:13:08.461432     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:13:08.859399     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m16s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:13:08.859431     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:13:18.859812     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:13:19.261064     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m5s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:13:19.261104     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:13:29.261351     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:13:29.698166     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m55s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:13:29.698193     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:13:39.698407     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:13:40.156554     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m44s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:13:40.156581     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:13:50.156794     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:13:51.196033     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m33s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:13:51.196068     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:14:01.196277     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:14:01.562845     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m23s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:14:01.562873     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:14:11.563125     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:14:11.960316     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m13s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:14:11.960345     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:14:21.960587     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:14:22.366619     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m2s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:14:22.366652     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:14:32.366885     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:14:32.758316     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m52s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:14:32.758353     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:14:42.758523     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:14:43.166789     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m41s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:14:43.166858     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:14:53.167078     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:14:53.561638     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m31s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:14:53.562042     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:15:03.562304     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:15:03.960061     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m21s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:15:03.960090     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:15:13.960422     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:15:14.359046     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m10s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:15:14.359084     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:15:24.359320     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:15:24.762669     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m0s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:15:24.762700     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:15:34.762934     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:15:35.200372     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m49s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:15:35.200408     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:15:45.200644     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:15:45.564388     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m39s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:15:45.564425     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:15:55.567221     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:15:56.259813     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m28s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:15:56.259840     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:16:06.260028     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:16:06.662569     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m18s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:16:06.662597     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:16:16.662833     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:16:17.059857     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m8s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:16:17.059886     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:16:27.060085     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:16:27.480008     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m57s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:16:27.481542     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:16:37.482214     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:16:37.900937     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m47s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:16:37.900969     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:16:47.911766     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:16:48.472129     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m36s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:16:48.472174     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:16:58.472381     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:16:58.979888     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m26s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:16:59.071735     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:17:09.086802     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:17:09.469263     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m15s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:17:09.469301     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:17:19.479782     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:17:19.863377     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m5s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:17:19.863402     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:17:29.863608     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:17:30.363483     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m54s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:17:30.363537     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:17:40.363931     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:17:40.764414     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m44s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:17:40.764445     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:17:50.764644     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:17:51.166919     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m33s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:17:51.166962     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:18:01.167206     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:18:01.679508     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m23s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:18:01.679546     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:18:11.679931     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:18:12.061911     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m13s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:18:12.061941     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:18:22.062198     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:18:22.461434     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m2s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:18:22.461474     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:18:32.461685     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:18:32.859578     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m52s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:18:32.859625     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:18:42.859800     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:18:43.263342     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m41s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:18:43.263388     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:18:53.263796     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:18:53.661744     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m31s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:18:53.661782     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:19:03.662007     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:19:04.061428     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m21s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:19:04.061467     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:19:14.061704     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:19:14.461499     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m10s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:19:14.461541     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:19:24.461706     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:19:24.859055     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m0s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:19:24.859103     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:19:34.859253     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:19:35.261866     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (49s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:19:35.261919     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:19:45.262094     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:19:45.759754     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (39s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:19:45.759784     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:19:55.760019     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:19:56.269110     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (28s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:19:56.269157     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:20:06.269400     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:20:06.659931     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (18s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:20:06.659965     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 01:20:16.660203     225 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 01:20:17.160408     225 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 01:20:17.160438     225 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)

error running tasks: deadline exceeded executing task StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce. Example error: error creating GCS bucket ACL for gs://k8s-kops-gce for user-595004040585-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
2020/02/18 01:20:27 process.go:155: Step '/tmp/kops813700158/kops update cluster e2e-kops-gce-canary.k8s.local --yes' finished in 10m5.339495061s
2020/02/18 01:20:27 process.go:153: Running: kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller
2020/02/18 01:20:27 process.go:153: Running: /tmp/kops813700158/kops export kubecfg e2e-kops-gce-canary.k8s.local
I0218 01:20:27.258343     250 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 01:20:27.258431     250 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 01:20:27.462934     250 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
... skipping 3 lines ...
I0218 01:20:28.065358     271 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 01:20:28.065444     271 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 01:20:28.282942     271 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
I0218 01:20:28.490285     271 gce.go:82] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b]
2020/02/18 01:20:30 process.go:155: Step '/tmp/kops813700158/kops toolbox dump --name e2e-kops-gce-canary.k8s.local -ojson' finished in 2.738911502s
2020/02/18 01:20:30 process.go:153: Running: kubectl get nodes -ojson
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 01:21:12 process.go:155: Step 'kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller' finished in 45.18292283s
2020/02/18 01:21:12 kubernetes.go:117: kubectl get pods failed: error during kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller: exit status 1
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 01:21:23 process.go:155: Step 'kubectl get nodes -ojson' finished in 52.666004357s
2020/02/18 01:21:23 kubernetes.go:35: kubectl get nodes failed: error during kubectl get nodes -ojson: exit status 1
2020/02/18 01:21:23 dump.go:92: Failed to get nodes for dumping via kubectl: error during kubectl get nodes -ojson: exit status 1
2020/02/18 01:21:23 dump.go:126: dumping node not registered in kubernetes: 34.66.115.95
2020/02/18 01:21:23 dump.go:160: Dumping node 34.66.115.95
2020/02/18 01:21:23 dump.go:399: Running SSH command: sudo journalctl --output=short-precise -k
2020/02/18 01:21:23 dump.go:399: Running SSH command: sudo journalctl --output=short-precise
2020/02/18 01:21:23 dump.go:399: Running SSH command: sudo systemctl list-units -t service --no-pager --no-legend --all
2020/02/18 01:21:23 dump.go:399: Running SSH command: sudo journalctl --output=cat -u kubelet.service
... skipping 127 lines ...
Disk:c-etcd-main-e2e-kops-gce-canary-k8s-local	ok
Deleted kubectl config for e2e-kops-gce-canary.k8s.local

Deleted cluster: "e2e-kops-gce-canary.k8s.local"
2020/02/18 01:23:23 process.go:155: Step '/tmp/kops813700158/kops delete cluster e2e-kops-gce-canary.k8s.local --yes' finished in 1m56.08999906s
2020/02/18 01:23:23 process.go:96: Saved XML output to /logs/artifacts/junit_runner.xml.
2020/02/18 01:23:23 main.go:316: Something went wrong: starting e2e cluster: kops update cluster failed: error during /tmp/kops813700158/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
Traceback (most recent call last):
  File "/workspace/scenarios/kubernetes_e2e.py", line 779, in <module>
    main(parse_args())
  File "/workspace/scenarios/kubernetes_e2e.py", line 627, in main
    mode.start(runner_args)
  File "/workspace/scenarios/kubernetes_e2e.py", line 262, in start
... skipping 9 lines ...