This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 5 succeeded
Started2020-02-18 04:25
Elapsed14m9s
Revision
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/13c979e6-7f4a-42d0-aa7b-e4b2632fef50/targets/test'}}
resultstorehttps://source.cloud.google.com/results/invocations/13c979e6-7f4a-42d0-aa7b-e4b2632fef50/targets/test
job-versionv1.18.0-alpha.5.178+5bd719b6a6f6ea
revisionv1.18.0-alpha.5.178+5bd719b6a6f6ea

Test Failures


Up 10m10s

kops update cluster failed: error during /tmp/kops638991909/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 5 Passed Tests

Error lines from build-log.txt

Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
fatal: not a git repository (or any of the parent directories): .git
+ /workspace/scenarios/kubernetes_e2e.py --cluster=e2e-kops-gce-canary.k8s.local --deployment=kops --extract=ci/latest --ginkgo-parallel=30 --kops-priority-path=/workspace/kubernetes/platforms/linux/amd64 --kops-version=https://storage.googleapis.com/kops-ci/bin/latest-ci-updown-green.txt --kops-zones=us-central1-c --provider=gce '--test_args=--ginkgo.skip=\[Slow\]|\[Serial\]|\[Disruptive\]|\[Flaky\]|\[Feature:.+\]|\[HPA\]|Dashboard|Services.*functioning.*NodePort' --timeout=120m
starts with local mode
Environment:
ARTIFACTS=/logs/artifacts
BAZEL_REMOTE_CACHE_ENABLED=false
BAZEL_VERSION=0.23.2
... skipping 479 lines ...
I0218 04:26:10.665613     235 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-main"
I0218 04:26:10.790137     235 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-main"
I0218 04:26:11.195949     235 vfs_castore.go:675] Issuing new certificate: "ca"
I0218 04:26:11.272391     235 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-events"
I0218 04:26:11.316004     235 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-events"
I0218 04:26:11.588435     235 vfs_castore.go:675] Issuing new certificate: "apiserver-aggregator-ca"
W0218 04:26:20.218286     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:26:20.218343     235 executor.go:103] Tasks: 36 done / 64 total; 26 can run
I0218 04:26:20.340497     235 instancetemplate.go:223] We should be using NVME for GCE
I0218 04:26:20.346238     235 instancetemplate.go:223] We should be using NVME for GCE
I0218 04:26:20.350656     235 instancetemplate.go:223] We should be using NVME for GCE
I0218 04:26:20.433950     235 instancetemplate.go:223] We should be using NVME for GCE
I0218 04:26:20.718081     235 vfs_castore.go:675] Issuing new certificate: "kubelet-api"
... skipping 3 lines ...
I0218 04:26:20.957654     235 vfs_castore.go:675] Issuing new certificate: "master"
I0218 04:26:20.968567     235 vfs_castore.go:675] Issuing new certificate: "kubecfg"
I0218 04:26:20.969270     235 vfs_castore.go:675] Issuing new certificate: "kube-proxy"
I0218 04:26:21.024531     235 vfs_castore.go:675] Issuing new certificate: "apiserver-proxy-client"
I0218 04:26:21.088427     235 vfs_castore.go:675] Issuing new certificate: "kops"
I0218 04:26:21.135267     235 vfs_castore.go:675] Issuing new certificate: "kubelet"
W0218 04:26:28.405215     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m41s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:26:28.405257     235 executor.go:103] Tasks: 61 done / 64 total; 3 can run
W0218 04:26:49.183447     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m21s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:26:49.183503     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:26:49.600781     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m20s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:26:49.600810     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:26:59.600982     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:26:59.958993     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m10s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:26:59.959025     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:27:09.959274     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:27:10.496174     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m59s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:27:10.496212     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:27:20.496458     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:27:21.064861     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m49s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:27:21.064895     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:27:31.065081     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:27:31.562966     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m38s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:27:31.562999     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:27:41.563236     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:27:42.064749     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m28s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:27:42.064786     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:27:52.065063     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:27:52.563330     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m17s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:27:52.563369     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:28:02.563591     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:28:03.007582     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m7s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:28:03.007614     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:28:13.015186     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:28:13.498687     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m56s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:28:13.498861     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:28:23.499161     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:28:23.959582     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m46s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:28:23.959618     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:28:33.963209     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:28:34.367571     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m35s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:28:34.368175     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:28:44.372070     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:28:44.767585     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m25s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:28:44.767995     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:28:54.771238     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:28:55.186671     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m15s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:28:55.186713     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:29:05.186932     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:29:05.560106     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m4s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:29:05.560146     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:29:15.560441     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:29:15.967689     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m54s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:29:15.967889     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:29:25.968209     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:29:26.477649     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m43s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:29:26.477691     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:29:36.477893     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:29:36.861379     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m33s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:29:36.861414     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:29:46.861672     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:29:47.366899     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m22s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:29:47.366932     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:29:57.367213     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:29:57.863328     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m12s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:29:57.863358     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:30:07.863652     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:30:08.567393     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m1s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:30:08.567433     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:30:18.567718     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:30:18.999761     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m51s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:30:18.999802     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:30:28.999990     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:30:29.462468     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m40s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:30:29.462503     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:30:39.462788     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:30:39.858979     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m30s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:30:39.859016     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:30:49.859276     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:30:50.359802     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m19s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:30:50.359843     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:31:00.360089     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:31:01.099279     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m9s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:31:01.099316     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:31:11.099538     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:31:11.562206     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m58s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:31:11.562244     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:31:21.562469     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:31:22.061891     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m48s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:31:22.061923     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:31:32.062167     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:31:32.461561     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m37s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:31:32.461598     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:31:42.461915     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:31:43.161749     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m27s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:31:43.161784     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:31:53.162023     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:31:53.664280     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m16s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:31:53.664307     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:32:03.664554     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:32:04.070637     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m6s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:32:04.070670     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:32:14.070966     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:32:14.566616     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m55s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:32:14.566647     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:32:24.566931     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:32:24.997640     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m45s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:32:24.997676     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:32:34.997949     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:32:35.358653     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m34s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:32:35.358693     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:32:45.358956     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:32:45.761319     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m24s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:32:45.761359     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:32:55.761686     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:32:56.159870     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m14s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:32:56.159916     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:33:06.160252     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:33:06.561183     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m3s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:33:06.561216     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:33:16.561450     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:33:16.963510     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m53s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:33:16.963541     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:33:26.963772     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:33:27.358141     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m42s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:33:27.358181     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:33:37.358408     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:33:37.769844     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:33:37.769903     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:33:47.770224     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:33:48.196938     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m22s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:33:48.196971     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:33:58.197212     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:33:58.759533     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m11s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:33:58.759564     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:34:08.759865     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:34:09.259711     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m0s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:34:09.259747     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:34:19.260021     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:34:19.795215     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:34:19.795289     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:34:29.795524     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:34:30.203671     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m40s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:34:30.203704     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:34:40.204012     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:34:40.559809     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:34:40.559849     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:34:50.560179     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:34:50.958939     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m19s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:34:50.958999     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:35:00.959325     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:35:01.363857     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m8s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:35:01.363886     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:35:11.364151     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:35:11.762394     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (58s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:35:11.762427     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:35:21.762697     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:35:22.161879     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (48s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:35:22.161909     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:35:32.162168     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:35:32.560792     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (37s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:35:32.560823     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:35:42.561080     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:35:42.961581     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (27s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:35:42.961612     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:35:52.961914     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:35:53.363020     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (16s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:35:53.363052     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:36:03.363287     235 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:36:03.763223     235 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:36:03.763270     235 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)

error running tasks: deadline exceeded executing task StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce. Example error: error creating GCS bucket ACL for gs://k8s-kops-gce for user-494915670520-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
2020/02/18 04:36:13 process.go:155: Step '/tmp/kops638991909/kops update cluster e2e-kops-gce-canary.k8s.local --yes' finished in 10m6.45759657s
2020/02/18 04:36:13 process.go:153: Running: kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller
2020/02/18 04:36:13 process.go:153: Running: /tmp/kops638991909/kops export kubecfg e2e-kops-gce-canary.k8s.local
I0218 04:36:13.822467     253 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 04:36:13.822559     253 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 04:36:14.056340     253 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
... skipping 3 lines ...
I0218 04:36:14.658024     277 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 04:36:14.658110     277 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 04:36:14.854980     277 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
I0218 04:36:15.146836     277 gce.go:82] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b]
2020/02/18 04:36:17 process.go:155: Step '/tmp/kops638991909/kops toolbox dump --name e2e-kops-gce-canary.k8s.local -ojson' finished in 3.104493201s
2020/02/18 04:36:17 process.go:153: Running: kubectl get nodes -ojson
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 04:36:58 process.go:155: Step 'kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller' finished in 45.143077133s
2020/02/18 04:36:58 kubernetes.go:117: kubectl get pods failed: error during kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller: exit status 1
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 04:37:10 process.go:155: Step 'kubectl get nodes -ojson' finished in 52.286998747s
2020/02/18 04:37:10 kubernetes.go:35: kubectl get nodes failed: error during kubectl get nodes -ojson: exit status 1
2020/02/18 04:37:10 dump.go:92: Failed to get nodes for dumping via kubectl: error during kubectl get nodes -ojson: exit status 1
2020/02/18 04:37:10 dump.go:126: dumping node not registered in kubernetes: 35.238.85.6
2020/02/18 04:37:10 dump.go:160: Dumping node 35.238.85.6
2020/02/18 04:37:10 dump.go:399: Running SSH command: sudo journalctl --output=short-precise -k
2020/02/18 04:37:10 dump.go:399: Running SSH command: sudo journalctl --output=short-precise
2020/02/18 04:37:10 dump.go:399: Running SSH command: sudo systemctl list-units -t service --no-pager --no-legend --all
2020/02/18 04:37:10 dump.go:399: Running SSH command: sudo journalctl --output=cat -u kubelet.service
... skipping 127 lines ...
TargetPool:api-e2e-kops-gce-canary-k8s-local	ok
Deleted kubectl config for e2e-kops-gce-canary.k8s.local

Deleted cluster: "e2e-kops-gce-canary.k8s.local"
2020/02/18 04:39:36 process.go:155: Step '/tmp/kops638991909/kops delete cluster e2e-kops-gce-canary.k8s.local --yes' finished in 2m23.398901895s
2020/02/18 04:39:36 process.go:96: Saved XML output to /logs/artifacts/junit_runner.xml.
2020/02/18 04:39:36 main.go:316: Something went wrong: starting e2e cluster: kops update cluster failed: error during /tmp/kops638991909/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
Traceback (most recent call last):
  File "/workspace/scenarios/kubernetes_e2e.py", line 779, in <module>
    main(parse_args())
  File "/workspace/scenarios/kubernetes_e2e.py", line 627, in main
    mode.start(runner_args)
  File "/workspace/scenarios/kubernetes_e2e.py", line 262, in start
... skipping 9 lines ...