This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 5 succeeded
Started2020-02-18 03:54
Elapsed13m45s
Revision
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/dbadd246-7865-4c04-9e4d-16f4cb781d92/targets/test'}}
resultstorehttps://source.cloud.google.com/results/invocations/dbadd246-7865-4c04-9e4d-16f4cb781d92/targets/test
job-versionv1.18.0-alpha.5.178+5bd719b6a6f6ea
revisionv1.18.0-alpha.5.178+5bd719b6a6f6ea

Test Failures


Up 10m7s

kops update cluster failed: error during /tmp/kops427504864/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 5 Passed Tests

Error lines from build-log.txt

Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
fatal: not a git repository (or any of the parent directories): .git
+ /workspace/scenarios/kubernetes_e2e.py --cluster=e2e-kops-gce-canary.k8s.local --deployment=kops --extract=ci/latest --ginkgo-parallel=30 --kops-priority-path=/workspace/kubernetes/platforms/linux/amd64 --kops-version=https://storage.googleapis.com/kops-ci/bin/latest-ci-updown-green.txt --kops-zones=us-central1-c --provider=gce '--test_args=--ginkgo.skip=\[Slow\]|\[Serial\]|\[Disruptive\]|\[Flaky\]|\[Feature:.+\]|\[HPA\]|Dashboard|Services.*functioning.*NodePort' --timeout=120m
starts with local mode
Environment:
ARTIFACTS=/logs/artifacts
BAZEL_REMOTE_CACHE_ENABLED=false
BAZEL_VERSION=0.23.2
... skipping 479 lines ...
I0218 03:55:07.573329     236 vfs_castore.go:675] Issuing new certificate: "etcd-clients-ca"
I0218 03:55:07.618119     236 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-main"
I0218 03:55:07.618688     236 vfs_castore.go:675] Issuing new certificate: "apiserver-aggregator-ca"
I0218 03:55:07.627408     236 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-main"
I0218 03:55:07.734511     236 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-events"
I0218 03:55:07.953136     236 vfs_castore.go:675] Issuing new certificate: "ca"
W0218 03:55:15.597106     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m51s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:55:15.597148     236 executor.go:103] Tasks: 36 done / 64 total; 26 can run
I0218 03:55:15.720217     236 instancetemplate.go:223] We should be using NVME for GCE
I0218 03:55:15.722824     236 instancetemplate.go:223] We should be using NVME for GCE
I0218 03:55:15.862386     236 instancetemplate.go:223] We should be using NVME for GCE
I0218 03:55:15.975033     236 instancetemplate.go:223] We should be using NVME for GCE
I0218 03:55:15.989253     236 vfs_castore.go:675] Issuing new certificate: "kube-scheduler"
... skipping 3 lines ...
I0218 03:55:16.091086     236 vfs_castore.go:675] Issuing new certificate: "kube-controller-manager"
I0218 03:55:16.182336     236 vfs_castore.go:675] Issuing new certificate: "kubelet"
I0218 03:55:16.196004     236 vfs_castore.go:675] Issuing new certificate: "kops"
I0218 03:55:16.201316     236 vfs_castore.go:675] Issuing new certificate: "apiserver-proxy-client"
I0218 03:55:16.217046     236 vfs_castore.go:675] Issuing new certificate: "kubelet-api"
I0218 03:55:16.327592     236 vfs_castore.go:675] Issuing new certificate: "master"
W0218 03:55:22.140634     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m45s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:55:22.140682     236 executor.go:103] Tasks: 61 done / 64 total; 3 can run
W0218 03:55:33.850866     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m33s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:55:33.850913     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:55:34.368331     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:55:34.368361     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:55:44.368595     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:55:44.760490     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m22s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:55:44.760521     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:55:54.760720     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:55:55.162733     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m12s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:55:55.162761     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:56:05.163011     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:56:05.569180     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m1s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:56:05.569208     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:56:15.569387     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:56:16.060631     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m51s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:56:16.060662     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:56:26.061007     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:56:26.462113     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m40s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:56:26.462143     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:56:36.462369     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:56:36.856211     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m30s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:56:36.856239     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:56:46.856496     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:56:47.262705     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m19s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:56:47.262739     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:56:57.262945     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:56:57.659655     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m9s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:56:57.659691     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:57:07.660024     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:57:08.064722     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m59s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:57:08.064749     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:57:18.064985     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:57:18.563981     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m48s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:57:18.564097     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:57:28.564339     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:57:28.961270     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m38s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:57:28.961305     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:57:38.961488     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:57:39.399806     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m27s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:57:39.399844     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:57:49.400082     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:57:49.774014     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m17s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:57:49.774051     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:57:59.774320     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:58:00.160033     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m7s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:58:00.160080     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:58:10.160272     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:58:10.769009     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m56s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:58:10.769075     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:58:20.769336     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:58:21.405576     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m45s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:58:21.405609     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:58:31.405784     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:58:31.864389     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m35s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:58:31.864425     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:58:41.864572     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:58:42.460657     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m24s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:58:42.460692     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:58:52.460936     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:58:52.858317     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m14s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:58:52.858352     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:59:02.858518     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:59:03.297354     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m3s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:59:03.297395     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:59:13.297617     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:59:13.664358     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m53s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:59:13.664395     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:59:23.664558     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:59:24.100007     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m43s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:59:24.100038     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:59:34.100206     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:59:34.560970     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:59:34.561002     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:59:44.561260     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:59:44.964352     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m22s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:59:44.964393     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 03:59:54.964694     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 03:59:55.359879     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m11s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 03:59:55.359907     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:00:05.360069     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:00:05.796405     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m1s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:00:05.796440     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:00:15.796658     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:00:16.201537     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m51s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:00:16.201584     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:00:26.201801     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:00:26.559667     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m40s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:00:26.559699     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:00:36.559946     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:00:36.999983     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m30s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:00:37.000013     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:00:47.000235     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:00:47.467243     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m19s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:00:47.467276     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:00:57.467573     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:00:57.862060     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m9s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:00:57.862100     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:01:07.862343     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:01:08.471754     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m58s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:01:08.471789     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:01:18.472073     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:01:18.871628     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m48s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:01:18.871656     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:01:28.871875     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:01:29.403901     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m37s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:01:29.403932     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:01:39.404142     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:01:39.857639     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m27s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:01:39.857669     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:01:49.857867     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:01:50.260719     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m16s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:01:50.260747     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:02:00.260958     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:02:00.764116     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m6s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:02:00.764150     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:02:10.764441     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:02:11.162706     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m56s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:02:11.162738     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:02:21.162976     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:02:21.964136     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m45s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:02:21.964224     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:02:31.964445     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:02:32.362163     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m34s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:02:32.362205     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:02:42.362435     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:02:42.766295     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m24s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:02:42.766335     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:02:52.766518     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:02:53.162578     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m14s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:02:53.162609     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:03:03.162838     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:03:03.602202     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m3s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:03:03.602227     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:03:13.602471     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:03:14.001683     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m53s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:03:14.001714     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:03:24.001932     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:03:24.365614     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m42s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:03:24.365644     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:03:34.365855     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:03:34.767792     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:03:34.767839     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:03:44.768069     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:03:45.171167     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m22s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:03:45.171204     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:03:55.171671     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:03:55.601294     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m11s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:03:55.601342     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:04:05.601619     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:04:05.968338     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m1s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:04:05.968366     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:04:15.968586     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:04:16.364520     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:04:16.364546     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:04:26.364765     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:04:26.773008     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (40s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:04:26.773040     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:04:36.773258     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:04:37.276302     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:04:37.276337     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:04:47.276520     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:04:47.661753     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (19s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:04:47.661821     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 04:04:57.662090     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 04:04:58.265727     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 04:04:58.265766     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)

error running tasks: deadline exceeded executing task StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce. Example error: error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
2020/02/18 04:05:08 process.go:155: Step '/tmp/kops427504864/kops update cluster e2e-kops-gce-canary.k8s.local --yes' finished in 10m4.163002151s
2020/02/18 04:05:08 process.go:153: Running: kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller
2020/02/18 04:05:08 process.go:153: Running: /tmp/kops427504864/kops export kubecfg e2e-kops-gce-canary.k8s.local
I0218 04:05:08.433463     256 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 04:05:08.433554     256 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 04:05:08.668468     256 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
... skipping 3 lines ...
I0218 04:05:09.196131     281 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 04:05:09.196192     281 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 04:05:09.430086     281 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
I0218 04:05:09.642773     281 gce.go:82] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b]
2020/02/18 04:05:12 process.go:155: Step '/tmp/kops427504864/kops toolbox dump --name e2e-kops-gce-canary.k8s.local -ojson' finished in 2.873633822s
2020/02/18 04:05:12 process.go:153: Running: kubectl get nodes -ojson
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 04:05:53 process.go:155: Step 'kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller' finished in 45.166742717s
2020/02/18 04:05:53 kubernetes.go:117: kubectl get pods failed: error during kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller: exit status 1
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 04:05:59 process.go:155: Step 'kubectl get nodes -ojson' finished in 47.473722367s
2020/02/18 04:05:59 kubernetes.go:35: kubectl get nodes failed: error during kubectl get nodes -ojson: exit status 1
2020/02/18 04:05:59 dump.go:92: Failed to get nodes for dumping via kubectl: error during kubectl get nodes -ojson: exit status 1
2020/02/18 04:05:59 dump.go:126: dumping node not registered in kubernetes: 34.68.108.72
2020/02/18 04:05:59 dump.go:160: Dumping node 34.68.108.72
2020/02/18 04:05:59 dump.go:399: Running SSH command: sudo journalctl --output=short-precise -k
2020/02/18 04:05:59 dump.go:399: Running SSH command: sudo journalctl --output=short-precise
2020/02/18 04:06:00 dump.go:399: Running SSH command: sudo systemctl list-units -t service --no-pager --no-legend --all
2020/02/18 04:06:00 dump.go:399: Running SSH command: sudo journalctl --output=cat -u kubelet.service
... skipping 127 lines ...
InstanceTemplate:master-us-central1-c-e2e--a8i4mi-1581998116	ok
Deleted kubectl config for e2e-kops-gce-canary.k8s.local

Deleted cluster: "e2e-kops-gce-canary.k8s.local"
2020/02/18 04:08:13 process.go:155: Step '/tmp/kops427504864/kops delete cluster e2e-kops-gce-canary.k8s.local --yes' finished in 2m10.239780475s
2020/02/18 04:08:13 process.go:96: Saved XML output to /logs/artifacts/junit_runner.xml.
2020/02/18 04:08:13 main.go:316: Something went wrong: starting e2e cluster: kops update cluster failed: error during /tmp/kops427504864/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
Traceback (most recent call last):
  File "/workspace/scenarios/kubernetes_e2e.py", line 779, in <module>
    main(parse_args())
  File "/workspace/scenarios/kubernetes_e2e.py", line 627, in main
    mode.start(runner_args)
  File "/workspace/scenarios/kubernetes_e2e.py", line 262, in start
... skipping 9 lines ...