This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 5 succeeded
Started2020-02-18 08:11
Elapsed13m32s
Revision
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/45a1b819-f998-4433-b158-54fa419f17b1/targets/test'}}
resultstorehttps://source.cloud.google.com/results/invocations/45a1b819-f998-4433-b158-54fa419f17b1/targets/test
job-versionv1.18.0-alpha.5.178+5bd719b6a6f6ea
revisionv1.18.0-alpha.5.178+5bd719b6a6f6ea

Test Failures


Up 10m10s

kops update cluster failed: error during /tmp/kops523057445/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 5 Passed Tests

Error lines from build-log.txt

Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
fatal: not a git repository (or any of the parent directories): .git
+ /workspace/scenarios/kubernetes_e2e.py --cluster=e2e-kops-gce-canary.k8s.local --deployment=kops --extract=ci/latest --ginkgo-parallel=30 --kops-priority-path=/workspace/kubernetes/platforms/linux/amd64 --kops-version=https://storage.googleapis.com/kops-ci/bin/latest-ci-updown-green.txt --kops-zones=us-central1-c --provider=gce '--test_args=--ginkgo.skip=\[Slow\]|\[Serial\]|\[Disruptive\]|\[Flaky\]|\[Feature:.+\]|\[HPA\]|Dashboard|Services.*functioning.*NodePort' --timeout=120m
starts with local mode
Environment:
ARTIFACTS=/logs/artifacts
BAZEL_REMOTE_CACHE_ENABLED=false
BAZEL_VERSION=0.23.2
... skipping 479 lines ...
I0218 08:12:11.500587     236 vfs_castore.go:675] Issuing new certificate: "etcd-clients-ca"
I0218 08:12:11.508884     236 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-events"
I0218 08:12:11.710072     236 vfs_castore.go:675] Issuing new certificate: "ca"
I0218 08:12:11.849086     236 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-main"
I0218 08:12:11.864687     236 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-main"
I0218 08:12:11.982133     236 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-events"
W0218 08:12:19.090055     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m51s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:12:19.090111     236 executor.go:103] Tasks: 36 done / 64 total; 26 can run
I0218 08:12:19.203513     236 instancetemplate.go:223] We should be using NVME for GCE
I0218 08:12:19.301864     236 instancetemplate.go:223] We should be using NVME for GCE
I0218 08:12:19.312410     236 instancetemplate.go:223] We should be using NVME for GCE
I0218 08:12:19.312650     236 instancetemplate.go:223] We should be using NVME for GCE
I0218 08:12:19.480167     236 vfs_castore.go:675] Issuing new certificate: "apiserver-proxy-client"
... skipping 3 lines ...
I0218 08:12:19.784339     236 vfs_castore.go:675] Issuing new certificate: "kube-scheduler"
I0218 08:12:19.801118     236 vfs_castore.go:675] Issuing new certificate: "kops"
I0218 08:12:19.825222     236 vfs_castore.go:675] Issuing new certificate: "apiserver-aggregator"
I0218 08:12:19.916578     236 vfs_castore.go:675] Issuing new certificate: "kubecfg"
I0218 08:12:20.163545     236 vfs_castore.go:675] Issuing new certificate: "master"
I0218 08:12:20.224727     236 vfs_castore.go:675] Issuing new certificate: "kubelet-api"
W0218 08:12:26.048223     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m45s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:12:26.048261     236 executor.go:103] Tasks: 61 done / 64 total; 3 can run
W0218 08:12:40.849078     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m30s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:12:40.849127     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:12:41.262321     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:12:41.262351     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:12:51.262569     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:12:51.703683     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m19s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:12:51.703714     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:13:01.703989     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:13:02.097348     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m8s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:13:02.097375     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:13:12.097593     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:13:12.499908     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m58s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:13:12.499941     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:13:22.500221     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:13:22.860788     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m48s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:13:22.860824     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:13:32.861051     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:13:33.259523     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m37s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:13:33.259557     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:13:43.259769     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:13:43.662209     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m27s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:13:43.662242     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:13:53.662490     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:13:54.063693     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m17s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:13:54.063749     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:14:04.063974     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:14:04.466369     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m6s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:14:04.466412     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:14:14.466606     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:14:15.009564     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m56s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:14:15.009593     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:14:25.009841     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:14:25.599521     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m45s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:14:25.599551     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:14:35.599781     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:14:35.993357     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m35s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:14:35.993384     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:14:45.993667     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:14:46.369031     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m24s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:14:46.369068     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:14:56.369318     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:14:56.858024     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m14s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:14:56.858051     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:15:06.858315     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:15:07.399729     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m3s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:15:07.399759     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:15:17.399934     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:15:18.161874     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m52s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:15:18.161903     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:15:28.162211     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:15:28.561532     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m42s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:15:28.561579     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:15:38.561805     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:15:39.000589     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:15:39.000617     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:15:49.000852     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:15:49.393966     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m21s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:15:49.393995     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:15:59.394589     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:15:59.761547     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m11s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:15:59.761576     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:16:09.761847     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:16:10.198340     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m0s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:16:10.198384     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:16:20.198569     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:16:20.653321     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:16:20.653355     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:16:30.653543     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:16:31.201856     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m39s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:16:31.201893     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:16:41.202086     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:16:41.594453     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:16:41.594511     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:16:51.594736     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:16:51.958891     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m19s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:16:51.958938     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:17:01.959182     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:17:02.365369     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m8s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:17:02.365398     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:17:12.365596     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:17:12.866299     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m58s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:17:12.866335     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:17:22.866544     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:17:23.298558     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m47s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:17:23.298598     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:17:33.298886     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:17:33.662939     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m37s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:17:33.662966     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:17:43.663221     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:17:44.062029     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m27s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:17:44.062087     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:17:54.062442     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:17:54.462900     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m16s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:17:54.462935     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:18:04.463265     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:18:04.899351     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m6s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:18:04.899387     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:18:14.899567     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:18:15.261861     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m55s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:18:15.261892     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:18:25.262127     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:18:25.662094     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m45s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:18:25.662122     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:18:35.662387     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:18:36.061881     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m35s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:18:36.061913     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:18:46.062170     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:18:46.561955     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m24s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:18:46.561985     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:18:56.562195     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:18:56.961485     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m14s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:18:56.961510     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:19:06.961726     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:19:07.364794     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m3s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:19:07.364828     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:19:17.365035     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:19:17.797504     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m53s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:19:17.797532     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:19:27.797753     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:19:28.199506     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m42s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:19:28.199540     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:19:38.199751     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:19:38.594878     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:19:38.594914     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:19:48.595083     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:19:48.997020     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m22s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:19:48.997063     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:19:58.997308     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:19:59.399721     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m11s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:19:59.399759     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:20:09.399964     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:20:09.803201     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m1s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:20:09.803239     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:20:19.803427     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:20:20.261441     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:20:20.261478     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:20:30.261661     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:20:30.661318     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m40s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:20:30.661361     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:20:40.661595     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:20:41.066456     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m30s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:20:41.066484     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:20:51.066674     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:20:52.367009     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m18s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:20:52.367038     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:21:02.367319     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:21:02.760469     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m8s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:21:02.760515     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:21:12.760685     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:21:13.199891     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (57s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:21:13.199929     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:21:23.200137     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:21:23.558086     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (47s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:21:23.558117     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:21:33.558323     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:21:34.096629     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (36s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:21:34.096667     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:21:44.097008     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:21:44.564258     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (26s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:21:44.564288     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:21:54.564478     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:21:54.965542     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (16s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:21:54.965576     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 08:22:04.965789     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 08:22:05.400317     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 08:22:05.400348     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)

error running tasks: deadline exceeded executing task StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce. Example error: error creating GCS bucket ACL for gs://k8s-kops-gce for user-300786067696-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
2020/02/18 08:22:15 process.go:155: Step '/tmp/kops523057445/kops update cluster e2e-kops-gce-canary.k8s.local --yes' finished in 10m7.269107736s
2020/02/18 08:22:15 process.go:153: Running: kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller
2020/02/18 08:22:15 process.go:153: Running: /tmp/kops523057445/kops export kubecfg e2e-kops-gce-canary.k8s.local
I0218 08:22:15.486108     260 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 08:22:15.486183     260 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 08:22:15.692716     260 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
... skipping 3 lines ...
I0218 08:22:16.190015     282 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 08:22:16.190083     282 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 08:22:16.360252     282 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
I0218 08:22:16.555061     282 gce.go:82] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b]
2020/02/18 08:22:18 process.go:155: Step '/tmp/kops523057445/kops toolbox dump --name e2e-kops-gce-canary.k8s.local -ojson' finished in 2.807853337s
2020/02/18 08:22:18 process.go:153: Running: kubectl get nodes -ojson
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 08:23:00 process.go:155: Step 'kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller' finished in 45.13320072s
2020/02/18 08:23:00 kubernetes.go:117: kubectl get pods failed: error during kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller: exit status 1
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 08:23:07 process.go:155: Step 'kubectl get nodes -ojson' finished in 48.149290032s
2020/02/18 08:23:07 kubernetes.go:35: kubectl get nodes failed: error during kubectl get nodes -ojson: exit status 1
2020/02/18 08:23:07 dump.go:92: Failed to get nodes for dumping via kubectl: error during kubectl get nodes -ojson: exit status 1
2020/02/18 08:23:07 dump.go:126: dumping node not registered in kubernetes: 35.239.105.191
2020/02/18 08:23:07 dump.go:160: Dumping node 35.239.105.191
2020/02/18 08:23:07 dump.go:399: Running SSH command: sudo journalctl --output=short-precise -k
2020/02/18 08:23:07 dump.go:399: Running SSH command: sudo journalctl --output=short-precise
2020/02/18 08:23:07 dump.go:399: Running SSH command: sudo systemctl list-units -t service --no-pager --no-legend --all
2020/02/18 08:23:07 dump.go:399: Running SSH command: sudo journalctl --output=cat -u kubelet.service
... skipping 127 lines ...
InstanceTemplate:nodes-e2e-kops-gce-canary-1m0s02-1582013539	ok
Deleted kubectl config for e2e-kops-gce-canary.k8s.local

Deleted cluster: "e2e-kops-gce-canary.k8s.local"
2020/02/18 08:25:00 process.go:155: Step '/tmp/kops523057445/kops delete cluster e2e-kops-gce-canary.k8s.local --yes' finished in 1m49.93689939s
2020/02/18 08:25:00 process.go:96: Saved XML output to /logs/artifacts/junit_runner.xml.
2020/02/18 08:25:00 main.go:316: Something went wrong: starting e2e cluster: kops update cluster failed: error during /tmp/kops523057445/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
Traceback (most recent call last):
  File "/workspace/scenarios/kubernetes_e2e.py", line 779, in <module>
    main(parse_args())
  File "/workspace/scenarios/kubernetes_e2e.py", line 627, in main
    mode.start(runner_args)
  File "/workspace/scenarios/kubernetes_e2e.py", line 262, in start
... skipping 9 lines ...