This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 5 succeeded
Started2020-02-18 02:42
Elapsed13m23s
Revision
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/2b44867c-18a2-4a36-92ea-f7effbe5cb14/targets/test'}}
resultstorehttps://source.cloud.google.com/results/invocations/2b44867c-18a2-4a36-92ea-f7effbe5cb14/targets/test
job-versionv1.18.0-alpha.5.178+5bd719b6a6f6ea
revisionv1.18.0-alpha.5.178+5bd719b6a6f6ea

Test Failures


Up 10m14s

kops update cluster failed: error during /tmp/kops654047513/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 5 Passed Tests

Error lines from build-log.txt

Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
fatal: not a git repository (or any of the parent directories): .git
+ /workspace/scenarios/kubernetes_e2e.py --cluster=e2e-kops-gce-canary.k8s.local --deployment=kops --extract=ci/latest --ginkgo-parallel=30 --kops-priority-path=/workspace/kubernetes/platforms/linux/amd64 --kops-version=https://storage.googleapis.com/kops-ci/bin/latest-ci-updown-green.txt --kops-zones=us-central1-c --provider=gce '--test_args=--ginkgo.skip=\[Slow\]|\[Serial\]|\[Disruptive\]|\[Flaky\]|\[Feature:.+\]|\[HPA\]|Dashboard|Services.*functioning.*NodePort' --timeout=120m
starts with local mode
Environment:
ARTIFACTS=/logs/artifacts
BAZEL_REMOTE_CACHE_ENABLED=false
BAZEL_VERSION=0.23.2
... skipping 479 lines ...
I0218 02:43:09.099991     238 vfs_castore.go:675] Issuing new certificate: "etcd-clients-ca"
I0218 02:43:09.384296     238 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-events"
I0218 02:43:09.393087     238 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-main"
I0218 02:43:09.505036     238 vfs_castore.go:675] Issuing new certificate: "apiserver-aggregator-ca"
I0218 02:43:10.560046     238 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-main"
I0218 02:43:14.422433     238 vfs_castore.go:675] Issuing new certificate: "ca"
W0218 02:43:22.101794     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m46s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:43:22.101865     238 executor.go:103] Tasks: 36 done / 64 total; 26 can run
I0218 02:43:22.220621     238 instancetemplate.go:223] We should be using NVME for GCE
I0218 02:43:22.235452     238 instancetemplate.go:223] We should be using NVME for GCE
I0218 02:43:22.238852     238 instancetemplate.go:223] We should be using NVME for GCE
I0218 02:43:22.310077     238 instancetemplate.go:223] We should be using NVME for GCE
I0218 02:43:22.371594     238 vfs_castore.go:675] Issuing new certificate: "kubelet-api"
... skipping 3 lines ...
I0218 02:43:22.611944     238 vfs_castore.go:675] Issuing new certificate: "kops"
I0218 02:43:22.695204     238 vfs_castore.go:675] Issuing new certificate: "apiserver-aggregator"
I0218 02:43:22.705337     238 vfs_castore.go:675] Issuing new certificate: "kubecfg"
I0218 02:43:22.752936     238 vfs_castore.go:675] Issuing new certificate: "kube-controller-manager"
I0218 02:43:22.829368     238 vfs_castore.go:675] Issuing new certificate: "kubelet"
I0218 02:43:23.466086     238 vfs_castore.go:675] Issuing new certificate: "master"
W0218 02:43:29.232493     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m39s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:43:29.232533     238 executor.go:103] Tasks: 61 done / 64 total; 3 can run
W0218 02:43:41.134060     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m27s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:43:41.134107     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:43:41.561290     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m27s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:43:41.561325     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:43:51.561506     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:43:51.996573     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m16s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:43:51.996606     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:44:01.996834     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:44:02.361464     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m6s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:44:02.361503     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:44:12.361839     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:44:12.761100     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m55s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:44:12.761145     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:44:22.761324     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:44:23.191398     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m45s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:44:23.191437     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:44:33.192149     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:44:33.664837     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m34s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:44:33.664876     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:44:43.665082     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:44:44.163274     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m24s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:44:44.163305     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:44:54.163526     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:44:54.688905     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m13s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:44:54.688944     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:45:04.689207     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:45:05.098780     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m3s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:45:05.098813     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:45:15.099044     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:45:15.597234     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m53s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:45:15.597266     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:45:25.597438     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:45:26.061262     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m42s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:45:26.061306     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:45:36.061508     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:45:36.460267     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:45:36.460298     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:45:46.461115     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:45:46.869358     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m21s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:45:46.869390     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:45:56.869610     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:45:57.277825     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m11s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:45:57.277860     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:46:07.278094     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:46:07.787751     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m0s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:46:07.787989     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:46:17.788197     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:46:18.461550     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:46:18.461582     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:46:28.461800     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:46:28.861032     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m39s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:46:28.861076     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:46:38.861323     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:46:39.299560     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:46:39.299592     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:46:49.300085     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:46:49.759040     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m18s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:46:49.759073     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:46:59.759315     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:47:00.163488     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m8s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:47:00.163591     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:47:10.164470     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:47:10.561780     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m58s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:47:10.561809     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:47:20.562128     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:47:20.958219     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m47s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:47:20.958285     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:47:30.958468     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:47:31.499397     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m37s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:47:31.499440     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:47:41.499595     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:47:42.062210     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m26s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:47:42.062244     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:47:52.062541     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:47:52.497705     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m16s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:47:52.497740     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:48:02.497925     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:48:02.898988     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m5s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:48:02.899165     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:48:12.899324     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:48:13.264300     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m55s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:48:13.264331     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:48:23.264567     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:48:23.665175     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m44s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:48:23.665219     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:48:33.665483     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:48:34.062741     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m34s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:48:34.062780     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:48:44.063049     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:48:44.472243     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m24s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:48:44.472278     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:48:54.472634     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:48:54.865229     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m13s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:48:54.865260     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:49:04.865459     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:49:05.259502     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m3s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:49:05.259560     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:49:15.262615     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:49:15.660226     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m52s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:49:15.660264     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:49:25.662476     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:49:26.068235     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m42s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:49:26.068276     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:49:36.069900     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:49:36.460286     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:49:36.460327     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:49:46.463918     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:49:46.961287     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m21s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:49:46.961320     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:49:56.961496     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:49:57.360362     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m11s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:49:57.360399     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:50:07.360612     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:50:07.864329     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m0s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:50:07.864372     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:50:17.864989     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:50:18.660563     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m49s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:50:18.660592     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:50:28.660816     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:50:29.060230     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m39s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:50:29.060266     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:50:39.060489     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:50:39.497615     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:50:39.497646     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:50:49.497835     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:50:49.859407     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m18s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:50:49.859442     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:50:59.859710     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:51:00.263500     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m8s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:51:00.263531     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:51:10.267203     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:51:10.666120     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m57s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:51:10.666157     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:51:20.668351     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:51:21.163812     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m47s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:51:21.163847     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:51:31.167913     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:51:31.668895     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m36s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:51:31.668931     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:51:41.671906     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:51:42.467272     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m26s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:51:42.467317     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:51:52.467587     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:51:52.896259     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m15s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:51:52.896295     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:52:02.899909     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:52:03.260239     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m5s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:52:03.263966     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:52:13.264164     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:52:13.964290     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (54s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:52:13.964331     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:52:23.965502     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:52:24.396193     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (44s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:52:24.396228     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:52:34.396607     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:52:34.859262     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (33s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:52:34.859288     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:52:44.859901     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:52:45.259569     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (23s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:52:45.259599     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:52:55.259803     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:52:55.658520     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (12s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:52:55.658556     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 02:53:05.681446     238 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 02:53:06.064186     238 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 02:53:06.064221     238 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)

error running tasks: deadline exceeded executing task StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce. Example error: error creating GCS bucket ACL for gs://k8s-kops-gce for user-978571949182-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
2020/02/18 02:53:16 process.go:155: Step '/tmp/kops654047513/kops update cluster e2e-kops-gce-canary.k8s.local --yes' finished in 10m10.635482007s
2020/02/18 02:53:16 process.go:153: Running: kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller
2020/02/18 02:53:16 process.go:153: Running: /tmp/kops654047513/kops export kubecfg e2e-kops-gce-canary.k8s.local
I0218 02:53:16.317395     257 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 02:53:16.317924     257 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 02:53:16.738445     257 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
... skipping 3 lines ...
I0218 02:53:17.371084     279 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 02:53:17.371378     279 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 02:53:17.754994     279 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
I0218 02:53:18.042756     279 gce.go:82] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b]
2020/02/18 02:53:20 process.go:155: Step '/tmp/kops654047513/kops toolbox dump --name e2e-kops-gce-canary.k8s.local -ojson' finished in 2.982539909s
2020/02/18 02:53:20 process.go:153: Running: kubectl get nodes -ojson
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 02:54:01 process.go:155: Step 'kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller' finished in 45.531900799s
2020/02/18 02:54:01 kubernetes.go:117: kubectl get pods failed: error during kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller: exit status 1
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 02:54:14 process.go:155: Step 'kubectl get nodes -ojson' finished in 54.123739482s
2020/02/18 02:54:14 kubernetes.go:35: kubectl get nodes failed: error during kubectl get nodes -ojson: exit status 1
2020/02/18 02:54:14 dump.go:92: Failed to get nodes for dumping via kubectl: error during kubectl get nodes -ojson: exit status 1
2020/02/18 02:54:14 dump.go:126: dumping node not registered in kubernetes: 35.238.139.86
2020/02/18 02:54:14 dump.go:160: Dumping node 35.238.139.86
2020/02/18 02:54:14 dump.go:399: Running SSH command: sudo journalctl --output=short-precise -k
2020/02/18 02:54:14 dump.go:399: Running SSH command: sudo journalctl --output=short-precise
2020/02/18 02:54:14 dump.go:399: Running SSH command: sudo systemctl list-units -t service --no-pager --no-legend --all
2020/02/18 02:54:14 dump.go:399: Running SSH command: sudo journalctl --output=cat -u kubelet.service
... skipping 121 lines ...
InstanceTemplate:master-us-central1-c-e2e--a8i4mi-1581993802	ok
Deleted kubectl config for e2e-kops-gce-canary.k8s.local

Deleted cluster: "e2e-kops-gce-canary.k8s.local"
2020/02/18 02:55:51 process.go:155: Step '/tmp/kops654047513/kops delete cluster e2e-kops-gce-canary.k8s.local --yes' finished in 1m32.74611877s
2020/02/18 02:55:51 process.go:96: Saved XML output to /logs/artifacts/junit_runner.xml.
2020/02/18 02:55:51 main.go:316: Something went wrong: starting e2e cluster: kops update cluster failed: error during /tmp/kops654047513/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
Traceback (most recent call last):
  File "/workspace/scenarios/kubernetes_e2e.py", line 779, in <module>
    main(parse_args())
  File "/workspace/scenarios/kubernetes_e2e.py", line 627, in main
    mode.start(runner_args)
  File "/workspace/scenarios/kubernetes_e2e.py", line 262, in start
... skipping 9 lines ...