This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 5 succeeded
Started2020-02-18 15:09
Elapsed13m48s
Revision
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/274a1b00-7bda-47b3-bf00-a68b4c1293d3/targets/test'}}
resultstorehttps://source.cloud.google.com/results/invocations/274a1b00-7bda-47b3-bf00-a68b4c1293d3/targets/test
job-versionv1.18.0-alpha.5.181+2e5d5ebf593c55
revisionv1.18.0-alpha.5.181+2e5d5ebf593c55

Test Failures


Up 10m9s

kops update cluster failed: error during /tmp/kops664394470/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 5 Passed Tests

Error lines from build-log.txt

Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
fatal: not a git repository (or any of the parent directories): .git
+ /workspace/scenarios/kubernetes_e2e.py --cluster=e2e-kops-gce-canary.k8s.local --deployment=kops --extract=ci/latest --ginkgo-parallel=30 --kops-priority-path=/workspace/kubernetes/platforms/linux/amd64 --kops-version=https://storage.googleapis.com/kops-ci/bin/latest-ci-updown-green.txt --kops-zones=us-central1-c --provider=gce '--test_args=--ginkgo.skip=\[Slow\]|\[Serial\]|\[Disruptive\]|\[Flaky\]|\[Feature:.+\]|\[HPA\]|Dashboard|Services.*functioning.*NodePort' --timeout=120m
starts with local mode
Environment:
ARTIFACTS=/logs/artifacts
BAZEL_REMOTE_CACHE_ENABLED=false
BAZEL_VERSION=0.23.2
... skipping 479 lines ...
I0218 15:10:05.622341     237 vfs_castore.go:675] Issuing new certificate: "apiserver-aggregator-ca"
I0218 15:10:05.661067     237 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-events"
I0218 15:10:05.738234     237 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-events"
I0218 15:10:05.749573     237 vfs_castore.go:675] Issuing new certificate: "ca"
I0218 15:10:05.797815     237 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-main"
I0218 15:10:06.086365     237 vfs_castore.go:675] Issuing new certificate: "etcd-clients-ca"
W0218 15:10:13.605270     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m51s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:10:13.605323     237 executor.go:103] Tasks: 36 done / 64 total; 26 can run
I0218 15:10:13.790022     237 instancetemplate.go:223] We should be using NVME for GCE
I0218 15:10:13.793143     237 instancetemplate.go:223] We should be using NVME for GCE
I0218 15:10:13.821115     237 instancetemplate.go:223] We should be using NVME for GCE
I0218 15:10:13.962452     237 vfs_castore.go:675] Issuing new certificate: "kubelet"
I0218 15:10:13.983331     237 instancetemplate.go:223] We should be using NVME for GCE
... skipping 3 lines ...
I0218 15:10:14.226429     237 vfs_castore.go:675] Issuing new certificate: "kube-proxy"
I0218 15:10:14.314106     237 vfs_castore.go:675] Issuing new certificate: "kubecfg"
I0218 15:10:14.327583     237 vfs_castore.go:675] Issuing new certificate: "apiserver-aggregator"
I0218 15:10:14.428359     237 vfs_castore.go:675] Issuing new certificate: "kubelet-api"
I0218 15:10:14.576095     237 vfs_castore.go:675] Issuing new certificate: "kube-controller-manager"
I0218 15:10:14.711412     237 vfs_castore.go:675] Issuing new certificate: "master"
W0218 15:10:20.814284     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m44s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:10:20.814339     237 executor.go:103] Tasks: 61 done / 64 total; 3 can run
W0218 15:10:32.279640     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:10:32.279702     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:10:32.661302     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:10:32.661339     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:10:42.661618     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:10:43.162732     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m21s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:10:43.162766     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:10:53.162974     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:10:53.560825     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m11s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:10:53.560858     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:11:03.561097     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:11:03.998912     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m1s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:11:03.998943     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:11:13.999232     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:11:14.462708     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:11:14.462743     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:11:24.463040     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:11:24.960660     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m40s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:11:24.960707     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:11:34.960939     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:11:35.402353     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:11:35.402391     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:11:45.402665     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:11:45.858848     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m19s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:11:45.858881     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:11:55.859095     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:11:56.360972     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m8s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:11:56.361014     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:12:06.361251     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:12:06.899954     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m58s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:12:06.899989     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:12:16.900146     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:12:17.359291     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m47s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:12:17.359325     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:12:27.359553     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:12:27.862861     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m37s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:12:27.862902     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:12:37.863165     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:12:38.302189     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m26s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:12:38.302235     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:12:48.302501     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:12:48.864370     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m16s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:12:48.864409     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:12:58.864699     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:12:59.366104     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m5s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:12:59.366151     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:13:09.366475     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:13:09.961490     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m55s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:13:09.961524     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:13:19.961826     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:13:20.395425     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m44s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:13:20.395459     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:13:30.395712     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:13:30.863571     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m34s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:13:30.863604     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:13:40.863846     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:13:41.361415     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m23s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:13:41.361458     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:13:51.361660     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:13:51.761158     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m13s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:13:51.761202     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:14:01.761448     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:14:02.263791     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m2s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:14:02.263836     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:14:12.264139     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:14:12.668393     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m52s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:14:12.668426     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:14:22.668591     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:14:23.098751     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m41s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:14:23.098817     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:14:33.099135     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:14:33.599823     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m31s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:14:33.599859     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:14:43.600143     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:14:44.198875     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m20s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:14:44.198918     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:14:54.199193     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:14:54.861112     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m10s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:14:54.861146     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:15:04.861412     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:15:05.262531     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m59s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:15:05.262565     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:15:15.262773     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:15:15.875470     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m49s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:15:15.875508     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:15:25.875829     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:15:26.296114     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m38s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:15:26.296150     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:15:36.296452     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:15:36.783445     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m28s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:15:36.783493     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:15:46.788586     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:15:47.511850     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m17s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:15:47.511889     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:15:57.512118     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:15:58.067269     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m6s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:15:58.067302     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:16:08.067544     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:16:08.465241     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m56s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:16:08.465274     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:16:18.465492     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:16:18.868044     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m46s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:16:18.868085     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:16:28.868351     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:16:29.460389     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m35s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:16:29.460429     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:16:39.460701     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:16:39.968987     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m25s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:16:39.969027     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:16:49.969359     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:16:50.367878     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m14s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:16:50.367918     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:17:00.368166     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:17:00.861907     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m4s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:17:00.861957     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:17:10.862252     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:17:11.263566     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m53s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:17:11.263597     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:17:21.263838     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:17:21.763823     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m43s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:17:21.763862     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:17:31.764106     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:17:32.164266     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:17:32.164307     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:17:42.164706     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:17:42.661719     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m22s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:17:42.661763     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:17:52.661941     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:17:53.266001     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m11s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:17:53.266035     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:18:03.266205     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:18:03.866355     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m1s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:18:03.866399     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:18:13.866633     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:18:14.261800     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:18:14.261840     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:18:24.262066     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:18:24.776872     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m40s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:18:24.776913     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:18:34.777190     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:18:35.266760     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:18:35.266799     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:18:45.267064     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:18:45.668115     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m19s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:18:45.668151     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:18:55.668334     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:18:56.058593     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m8s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:18:56.058629     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:19:06.058905     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:19:06.459703     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (58s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:19:06.459748     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:19:16.460037     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:19:16.862741     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (48s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:19:16.862827     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:19:26.863068     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:19:27.264844     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (37s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:19:27.264884     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:19:37.265163     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:19:37.661315     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (27s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:19:37.661345     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:19:47.661593     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:19:48.065241     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (16s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:19:48.065277     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 15:19:58.065551     237 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 15:19:58.496273     237 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 15:19:58.496305     237 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)

error running tasks: deadline exceeded executing task StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce. Example error: error creating GCS bucket ACL for gs://k8s-kops-gce for user-702598152339-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
2020/02/18 15:20:08 process.go:155: Step '/tmp/kops664394470/kops update cluster e2e-kops-gce-canary.k8s.local --yes' finished in 10m6.223292989s
2020/02/18 15:20:08 process.go:153: Running: kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller
2020/02/18 15:20:08 process.go:153: Running: /tmp/kops664394470/kops export kubecfg e2e-kops-gce-canary.k8s.local
I0218 15:20:08.586858     257 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 15:20:08.586945     257 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 15:20:08.819697     257 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
... skipping 3 lines ...
I0218 15:20:09.447868     284 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 15:20:09.447950     284 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 15:20:09.649413     284 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
I0218 15:20:09.973605     284 gce.go:82] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b]
2020/02/18 15:20:12 process.go:155: Step '/tmp/kops664394470/kops toolbox dump --name e2e-kops-gce-canary.k8s.local -ojson' finished in 2.908383282s
2020/02/18 15:20:12 process.go:153: Running: kubectl get nodes -ojson
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 15:20:53 process.go:155: Step 'kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller' finished in 45.134744524s
2020/02/18 15:20:53 kubernetes.go:117: kubectl get pods failed: error during kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller: exit status 1
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 15:21:04 process.go:155: Step 'kubectl get nodes -ojson' finished in 52.563654731s
2020/02/18 15:21:04 kubernetes.go:35: kubectl get nodes failed: error during kubectl get nodes -ojson: exit status 1
2020/02/18 15:21:04 dump.go:92: Failed to get nodes for dumping via kubectl: error during kubectl get nodes -ojson: exit status 1
2020/02/18 15:21:04 dump.go:126: dumping node not registered in kubernetes: 34.70.55.59
2020/02/18 15:21:04 dump.go:160: Dumping node 34.70.55.59
2020/02/18 15:21:05 dump.go:399: Running SSH command: sudo journalctl --output=short-precise -k
2020/02/18 15:21:05 dump.go:399: Running SSH command: sudo journalctl --output=short-precise
2020/02/18 15:21:05 dump.go:399: Running SSH command: sudo systemctl list-units -t service --no-pager --no-legend --all
2020/02/18 15:21:05 dump.go:399: Running SSH command: sudo journalctl --output=cat -u kubelet.service
... skipping 127 lines ...
InstanceTemplate:master-us-central1-c-e2e--a8i4mi-1582038614	ok
Deleted kubectl config for e2e-kops-gce-canary.k8s.local

Deleted cluster: "e2e-kops-gce-canary.k8s.local"
2020/02/18 15:23:17 process.go:155: Step '/tmp/kops664394470/kops delete cluster e2e-kops-gce-canary.k8s.local --yes' finished in 2m9.015273464s
2020/02/18 15:23:17 process.go:96: Saved XML output to /logs/artifacts/junit_runner.xml.
2020/02/18 15:23:17 main.go:316: Something went wrong: starting e2e cluster: kops update cluster failed: error during /tmp/kops664394470/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
Traceback (most recent call last):
  File "/workspace/scenarios/kubernetes_e2e.py", line 779, in <module>
    main(parse_args())
  File "/workspace/scenarios/kubernetes_e2e.py", line 627, in main
    mode.start(runner_args)
  File "/workspace/scenarios/kubernetes_e2e.py", line 262, in start
... skipping 9 lines ...