This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 5 succeeded
Started2020-02-18 12:56
Elapsed14m20s
Revision
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/507b36cc-4e80-4d07-a053-d69bd6c2c7ee/targets/test'}}
resultstorehttps://source.cloud.google.com/results/invocations/507b36cc-4e80-4d07-a053-d69bd6c2c7ee/targets/test
job-versionv1.18.0-alpha.5.178+5bd719b6a6f6ea
revisionv1.18.0-alpha.5.178+5bd719b6a6f6ea

Test Failures


Up 10m13s

kops update cluster failed: error during /tmp/kops350630105/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 5 Passed Tests

Error lines from build-log.txt

Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
fatal: not a git repository (or any of the parent directories): .git
+ /workspace/scenarios/kubernetes_e2e.py --cluster=e2e-kops-gce-canary.k8s.local --deployment=kops --extract=ci/latest --ginkgo-parallel=30 --kops-priority-path=/workspace/kubernetes/platforms/linux/amd64 --kops-version=https://storage.googleapis.com/kops-ci/bin/latest-ci-updown-green.txt --kops-zones=us-central1-c --provider=gce '--test_args=--ginkgo.skip=\[Slow\]|\[Serial\]|\[Disruptive\]|\[Flaky\]|\[Feature:.+\]|\[HPA\]|Dashboard|Services.*functioning.*NodePort' --timeout=120m
starts with local mode
Environment:
ARTIFACTS=/logs/artifacts
BAZEL_REMOTE_CACHE_ENABLED=false
BAZEL_VERSION=0.23.2
... skipping 479 lines ...
I0218 12:57:25.426094     233 vfs_castore.go:675] Issuing new certificate: "apiserver-aggregator-ca"
I0218 12:57:25.527393     233 vfs_castore.go:675] Issuing new certificate: "ca"
I0218 12:57:25.543360     233 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-main"
I0218 12:57:25.717647     233 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-events"
I0218 12:57:25.819865     233 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-main"
I0218 12:57:25.941550     233 vfs_castore.go:675] Issuing new certificate: "etcd-clients-ca"
W0218 12:57:34.322263     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:57:34.322321     233 executor.go:103] Tasks: 36 done / 64 total; 26 can run
I0218 12:57:34.468948     233 instancetemplate.go:223] We should be using NVME for GCE
I0218 12:57:34.470517     233 instancetemplate.go:223] We should be using NVME for GCE
I0218 12:57:34.500135     233 instancetemplate.go:223] We should be using NVME for GCE
I0218 12:57:34.554895     233 instancetemplate.go:223] We should be using NVME for GCE
I0218 12:57:34.819771     233 vfs_castore.go:675] Issuing new certificate: "kubelet"
... skipping 3 lines ...
I0218 12:57:35.001892     233 vfs_castore.go:675] Issuing new certificate: "kops"
I0218 12:57:35.198325     233 vfs_castore.go:675] Issuing new certificate: "kubecfg"
I0218 12:57:35.314701     233 vfs_castore.go:675] Issuing new certificate: "kubelet-api"
I0218 12:57:35.368822     233 vfs_castore.go:675] Issuing new certificate: "apiserver-aggregator"
I0218 12:57:35.518390     233 vfs_castore.go:675] Issuing new certificate: "kube-proxy"
I0218 12:57:35.728653     233 vfs_castore.go:675] Issuing new certificate: "apiserver-proxy-client"
W0218 12:57:41.745180     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m43s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:57:41.745230     233 executor.go:103] Tasks: 61 done / 64 total; 3 can run
W0218 12:57:56.371518     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m28s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:57:56.371573     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:57:56.862221     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m28s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:57:56.862261     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:58:06.863175     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:58:07.363434     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m17s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:58:07.363476     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:58:17.363747     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:58:17.762095     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m7s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:58:17.762127     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:58:27.762410     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:58:28.259879     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m56s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:58:28.259921     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:58:38.260155     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:58:38.702455     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m46s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:58:38.702486     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:58:48.702856     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:58:49.196882     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m35s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:58:49.196924     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:58:59.197206     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:58:59.706160     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m25s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:58:59.706209     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:59:09.706501     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:59:10.062175     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m14s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:59:10.062205     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:59:20.062428     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:59:20.600276     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m4s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:59:20.600314     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:59:30.600596     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:59:31.063763     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m53s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:59:31.063804     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:59:41.064071     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:59:41.462088     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m43s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:59:41.462131     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 12:59:51.462333     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 12:59:51.918815     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m33s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 12:59:51.918852     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:00:01.919036     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:00:02.460768     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m22s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:00:02.460811     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:00:12.461067     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:00:12.867881     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m12s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:00:12.867914     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:00:22.868120     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:00:23.262301     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m1s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:00:23.262356     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:00:33.262689     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:00:33.763899     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m51s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:00:33.763948     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:00:43.764160     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:00:44.297900     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m40s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:00:44.297929     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:00:54.298175     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:00:54.659466     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m30s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:00:54.659499     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:01:04.659729     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:01:05.060811     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m19s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:01:05.060859     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:01:15.061068     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:01:15.463741     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m9s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:01:15.463770     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:01:25.464023     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:01:25.899393     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m59s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:01:25.899432     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:01:35.899686     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:01:36.361975     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m48s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:01:36.362003     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:01:46.362194     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:01:46.962145     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m37s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:01:46.962182     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:01:56.962340     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:01:57.463594     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m27s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:01:57.463633     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:02:07.463905     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:02:07.859556     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m17s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:02:07.859598     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:02:17.859776     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:02:18.270857     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m6s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:02:18.271317     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:02:28.271591     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:02:28.698328     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m56s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:02:28.698359     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:02:38.699181     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:02:39.103476     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m45s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:02:39.103888     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:02:49.104062     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:02:49.665527     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m35s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:02:49.665563     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:02:59.665731     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:03:00.146093     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m24s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:03:00.146131     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:03:10.146377     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:03:10.563387     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m14s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:03:10.563420     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:03:20.563652     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:03:20.959617     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m3s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:03:20.959652     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:03:30.959901     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:03:31.362825     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m53s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:03:31.362982     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:03:41.363184     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:03:41.796907     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m43s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:03:41.796939     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:03:51.797195     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:03:52.300112     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:03:52.300149     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:04:02.300322     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:04:02.809109     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m22s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:04:02.809167     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:04:12.809375     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:04:13.360639     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m11s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:04:13.360669     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:04:23.360925     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:04:23.799275     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m1s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:04:23.799312     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:04:33.799504     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:04:34.263457     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:04:34.263492     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:04:44.263697     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:04:44.759348     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m40s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:04:44.759384     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:04:54.759542     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:04:55.263498     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:04:55.263552     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:05:05.263773     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:05:05.697860     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m19s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:05:05.697907     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:05:15.698103     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:05:16.161013     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m8s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:05:16.161058     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:05:26.161313     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:05:26.560669     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m58s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:05:26.560701     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:05:36.560960     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:05:36.963765     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m47s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:05:36.963800     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:05:46.964002     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:05:47.366791     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m37s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:05:47.366825     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:05:57.367060     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:05:57.964769     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m26s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:05:57.964801     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:06:07.964972     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:06:08.412166     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m16s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:06:08.412198     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:06:18.412416     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:06:18.860400     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m6s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:06:18.860436     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:06:28.860655     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:06:29.267805     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (55s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:06:29.267851     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:06:39.268101     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:06:39.660066     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (45s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:06:39.660108     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:06:49.660294     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:06:50.168227     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (34s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:06:50.168258     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:07:00.168438     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:07:00.560107     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (24s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:07:00.560140     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:07:10.560506     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:07:10.995737     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (13s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:07:10.995767     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 13:07:20.996231     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 13:07:21.464218     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 13:07:21.464269     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)

error running tasks: deadline exceeded executing task StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce. Example error: error creating GCS bucket ACL for gs://k8s-kops-gce for user-277332189081-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
2020/02/18 13:07:31 process.go:155: Step '/tmp/kops350630105/kops update cluster e2e-kops-gce-canary.k8s.local --yes' finished in 10m9.751222684s
2020/02/18 13:07:31 process.go:153: Running: kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller
2020/02/18 13:07:31 process.go:153: Running: /tmp/kops350630105/kops export kubecfg e2e-kops-gce-canary.k8s.local
I0218 13:07:31.661904     254 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 13:07:31.662005     254 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 13:07:31.923373     254 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
... skipping 3 lines ...
I0218 13:07:32.616604     280 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 13:07:32.616678     280 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 13:07:32.884382     280 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
I0218 13:07:33.145158     280 gce.go:82] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b]
2020/02/18 13:07:35 process.go:155: Step '/tmp/kops350630105/kops toolbox dump --name e2e-kops-gce-canary.k8s.local -ojson' finished in 2.987804084s
2020/02/18 13:07:35 process.go:153: Running: kubectl get nodes -ojson
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 13:08:16 process.go:155: Step 'kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller' finished in 45.232393549s
2020/02/18 13:08:16 kubernetes.go:117: kubectl get pods failed: error during kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller: exit status 1
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 13:08:33 process.go:155: Step 'kubectl get nodes -ojson' finished in 57.773347463s
2020/02/18 13:08:33 kubernetes.go:35: kubectl get nodes failed: error during kubectl get nodes -ojson: exit status 1
2020/02/18 13:08:33 dump.go:92: Failed to get nodes for dumping via kubectl: error during kubectl get nodes -ojson: exit status 1
2020/02/18 13:08:33 dump.go:126: dumping node not registered in kubernetes: 35.239.20.41
2020/02/18 13:08:33 dump.go:160: Dumping node 35.239.20.41
2020/02/18 13:08:33 dump.go:399: Running SSH command: sudo journalctl --output=short-precise -k
2020/02/18 13:08:33 dump.go:399: Running SSH command: sudo journalctl --output=short-precise
2020/02/18 13:08:33 dump.go:399: Running SSH command: sudo systemctl list-units -t service --no-pager --no-legend --all
2020/02/18 13:08:33 dump.go:399: Running SSH command: sudo journalctl --output=cat -u kubelet.service
... skipping 127 lines ...
InstanceTemplate:nodes-e2e-kops-gce-canary-1m0s02-1582030654	ok
Deleted kubectl config for e2e-kops-gce-canary.k8s.local

Deleted cluster: "e2e-kops-gce-canary.k8s.local"
2020/02/18 13:10:49 process.go:155: Step '/tmp/kops350630105/kops delete cluster e2e-kops-gce-canary.k8s.local --yes' finished in 2m12.378636332s
2020/02/18 13:10:49 process.go:96: Saved XML output to /logs/artifacts/junit_runner.xml.
2020/02/18 13:10:49 main.go:316: Something went wrong: starting e2e cluster: kops update cluster failed: error during /tmp/kops350630105/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
Traceback (most recent call last):
  File "/workspace/scenarios/kubernetes_e2e.py", line 779, in <module>
    main(parse_args())
  File "/workspace/scenarios/kubernetes_e2e.py", line 627, in main
    mode.start(runner_args)
  File "/workspace/scenarios/kubernetes_e2e.py", line 262, in start
... skipping 9 lines ...