This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 5 succeeded
Started2020-02-18 20:04
Elapsed14m13s
Revision
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/7530daf8-d8c2-44c5-88e0-b52c51796eaf/targets/test'}}
resultstorehttps://source.cloud.google.com/results/invocations/7530daf8-d8c2-44c5-88e0-b52c51796eaf/targets/test
job-versionv1.19.0-alpha.0.2+d5e0a941aa4d1c
revisionv1.19.0-alpha.0.2+d5e0a941aa4d1c

Test Failures


Up 10m7s

kops update cluster failed: error during /tmp/kops561817219/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 5 Passed Tests

Error lines from build-log.txt

Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
fatal: not a git repository (or any of the parent directories): .git
+ /workspace/scenarios/kubernetes_e2e.py --cluster=e2e-kops-gce-canary.k8s.local --deployment=kops --extract=ci/latest --ginkgo-parallel=30 --kops-priority-path=/workspace/kubernetes/platforms/linux/amd64 --kops-version=https://storage.googleapis.com/kops-ci/bin/latest-ci-updown-green.txt --kops-zones=us-central1-c --provider=gce '--test_args=--ginkgo.skip=\[Slow\]|\[Serial\]|\[Disruptive\]|\[Flaky\]|\[Feature:.+\]|\[HPA\]|Dashboard|Services.*functioning.*NodePort' --timeout=120m
starts with local mode
Environment:
ARTIFACTS=/logs/artifacts
BAZEL_REMOTE_CACHE_ENABLED=false
BAZEL_VERSION=0.23.2
... skipping 479 lines ...
I0218 20:05:54.531075     239 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-main"
I0218 20:05:54.558907     239 vfs_castore.go:675] Issuing new certificate: "apiserver-aggregator-ca"
I0218 20:05:54.616832     239 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-main"
I0218 20:05:55.103704     239 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-events"
I0218 20:05:55.120575     239 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-events"
I0218 20:05:55.139469     239 vfs_castore.go:675] Issuing new certificate: "ca"
W0218 20:06:02.566588     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m51s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:06:02.566647     239 executor.go:103] Tasks: 36 done / 64 total; 26 can run
I0218 20:06:02.674111     239 instancetemplate.go:223] We should be using NVME for GCE
I0218 20:06:02.677417     239 instancetemplate.go:223] We should be using NVME for GCE
I0218 20:06:02.742484     239 instancetemplate.go:223] We should be using NVME for GCE
I0218 20:06:02.838304     239 instancetemplate.go:223] We should be using NVME for GCE
I0218 20:06:03.031097     239 vfs_castore.go:675] Issuing new certificate: "kube-controller-manager"
... skipping 3 lines ...
I0218 20:06:03.258218     239 vfs_castore.go:675] Issuing new certificate: "apiserver-proxy-client"
I0218 20:06:03.263184     239 vfs_castore.go:675] Issuing new certificate: "kubecfg"
I0218 20:06:03.285205     239 vfs_castore.go:675] Issuing new certificate: "kubelet"
I0218 20:06:03.441460     239 vfs_castore.go:675] Issuing new certificate: "kops"
I0218 20:06:03.612578     239 vfs_castore.go:675] Issuing new certificate: "master"
I0218 20:06:03.910100     239 vfs_castore.go:675] Issuing new certificate: "kube-scheduler"
W0218 20:06:09.461155     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m44s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:06:09.461206     239 executor.go:103] Tasks: 61 done / 64 total; 3 can run
W0218 20:06:20.832500     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m33s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:06:20.832557     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:06:21.268788     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:06:21.268827     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:06:31.269120     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:06:31.761728     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m22s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:06:31.761758     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:06:41.762074     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:06:42.160807     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m11s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:06:42.160841     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:06:52.161068     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:06:52.563461     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m1s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:06:52.563493     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:07:02.563798     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:07:02.963867     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m51s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:07:02.963899     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:07:12.964177     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:07:13.395633     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m40s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:07:13.395664     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:07:23.395925     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:07:23.861454     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m30s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:07:23.861490     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:07:33.861767     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:07:34.361561     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m19s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:07:34.361595     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:07:44.361886     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:07:44.867313     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m9s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:07:44.867365     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:07:54.867616     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:07:55.296565     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m58s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:07:55.296603     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:08:05.296890     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:08:05.761693     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m48s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:08:05.761752     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:08:15.762292     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:08:16.166336     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m37s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:08:16.166373     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:08:26.166638     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:08:26.597708     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m27s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:08:26.597741     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:08:36.598175     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:08:37.102966     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m16s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:08:37.103017     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:08:47.103279     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:08:47.564901     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m6s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:08:47.564948     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:08:57.565198     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:08:58.168342     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m55s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:08:58.168376     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:09:08.168602     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:09:08.560100     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m45s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:09:08.560145     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:09:18.560345     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:09:19.063560     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m34s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:09:19.063593     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:09:29.063903     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:09:29.465655     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m24s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:09:29.465686     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:09:39.466127     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:09:39.963221     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m14s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:09:39.963258     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:09:49.963509     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:09:50.480090     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m3s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:09:50.480124     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:10:00.480434     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:10:00.896176     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m53s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:10:00.896215     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:10:10.896467     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:10:11.265389     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m42s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:10:11.265432     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:10:21.265746     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:10:21.797779     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:10:21.797839     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:10:31.798041     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:10:32.159189     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m21s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:10:32.159227     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:10:42.159503     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:10:42.599591     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m11s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:10:42.599625     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:10:52.599888     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:10:52.962111     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m1s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:10:52.962145     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:11:02.962421     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:11:03.491636     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:11:03.491674     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:11:13.491899     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:11:13.962542     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m40s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:11:13.962573     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:11:23.962725     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:11:24.361691     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:11:24.361753     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:11:34.362102     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:11:34.796282     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m19s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:11:34.796324     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:11:44.796546     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:11:45.300871     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m8s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:11:45.300930     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:11:55.302498     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:11:55.801380     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m58s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:11:55.801456     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:12:05.801754     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:12:06.162264     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m47s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:12:06.162305     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:12:16.162479     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:12:16.564088     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m37s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:12:16.564130     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:12:26.564316     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:12:27.001768     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m26s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:12:27.001805     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:12:37.002063     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:12:37.465415     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m16s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:12:37.465453     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:12:47.465701     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:12:47.861593     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m6s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:12:47.861637     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:12:57.861893     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:12:58.264142     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m55s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:12:58.264186     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:13:08.264455     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:13:08.658808     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m45s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:13:08.658840     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:13:18.659127     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:13:19.063559     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m34s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:13:19.063595     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:13:29.063896     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:13:29.459582     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m24s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:13:29.459614     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:13:39.459820     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:13:39.856920     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m14s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:13:39.856953     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:13:49.857184     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:13:50.303782     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m3s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:13:50.303818     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:14:00.304062     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:14:00.766249     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m53s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:14:00.766279     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:14:10.766530     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:14:11.201276     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m42s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:14:11.201311     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:14:21.201551     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:14:21.709229     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:14:21.709263     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:14:31.709603     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:14:32.167223     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m21s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:14:32.167262     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:14:42.167634     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:14:42.667353     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m11s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:14:42.667391     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:14:52.667649     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:14:53.061687     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m0s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:14:53.061718     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:15:03.062214     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:15:03.470582     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:15:03.470653     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:15:13.471029     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:15:13.860125     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (40s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:15:13.860189     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:15:23.860583     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:15:24.259282     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:15:24.259315     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:15:34.259624     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:15:34.696927     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (19s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:15:34.696958     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 20:15:44.697242     239 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 20:15:45.269063     239 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 20:15:45.269110     239 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)

error running tasks: deadline exceeded executing task StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce. Example error: error creating GCS bucket ACL for gs://k8s-kops-gce for user-931555952164-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
2020/02/18 20:15:55 process.go:155: Step '/tmp/kops561817219/kops update cluster e2e-kops-gce-canary.k8s.local --yes' finished in 10m4.34139944s
2020/02/18 20:15:55 process.go:153: Running: kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller
2020/02/18 20:15:55 process.go:153: Running: /tmp/kops561817219/kops export kubecfg e2e-kops-gce-canary.k8s.local
I0218 20:15:55.398622     258 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 20:15:55.398847     258 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 20:15:55.677921     258 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
... skipping 3 lines ...
I0218 20:15:56.305562     285 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 20:15:56.305648     285 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 20:15:56.518338     285 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
I0218 20:15:56.809479     285 gce.go:82] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b]
2020/02/18 20:15:59 process.go:155: Step '/tmp/kops561817219/kops toolbox dump --name e2e-kops-gce-canary.k8s.local -ojson' finished in 3.142425105s
2020/02/18 20:15:59 process.go:153: Running: kubectl get nodes -ojson
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 20:16:40 process.go:155: Step 'kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller' finished in 45.185564439s
2020/02/18 20:16:40 kubernetes.go:117: kubectl get pods failed: error during kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller: exit status 1
Unable to connect to the server: net/http: TLS handshake timeout
2020/02/18 20:17:01 process.go:155: Step 'kubectl get nodes -ojson' finished in 1m2.56597758s
2020/02/18 20:17:01 kubernetes.go:35: kubectl get nodes failed: error during kubectl get nodes -ojson: exit status 1
2020/02/18 20:17:01 dump.go:92: Failed to get nodes for dumping via kubectl: error during kubectl get nodes -ojson: exit status 1
2020/02/18 20:17:01 dump.go:126: dumping node not registered in kubernetes: 35.239.16.242
2020/02/18 20:17:01 dump.go:160: Dumping node 35.239.16.242
2020/02/18 20:17:02 dump.go:399: Running SSH command: sudo journalctl --output=short-precise -k
2020/02/18 20:17:02 dump.go:399: Running SSH command: sudo journalctl --output=short-precise
2020/02/18 20:17:02 dump.go:399: Running SSH command: sudo systemctl list-units -t service --no-pager --no-legend --all
2020/02/18 20:17:02 dump.go:399: Running SSH command: sudo journalctl --output=cat -u kubelet.service
... skipping 127 lines ...
TargetPool:api-e2e-kops-gce-canary-k8s-local	ok
Deleted kubectl config for e2e-kops-gce-canary.k8s.local

Deleted cluster: "e2e-kops-gce-canary.k8s.local"
2020/02/18 20:19:08 process.go:155: Step '/tmp/kops561817219/kops delete cluster e2e-kops-gce-canary.k8s.local --yes' finished in 2m3.227677165s
2020/02/18 20:19:08 process.go:96: Saved XML output to /logs/artifacts/junit_runner.xml.
2020/02/18 20:19:08 main.go:316: Something went wrong: starting e2e cluster: kops update cluster failed: error during /tmp/kops561817219/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
Traceback (most recent call last):
  File "/workspace/scenarios/kubernetes_e2e.py", line 779, in <module>
    main(parse_args())
  File "/workspace/scenarios/kubernetes_e2e.py", line 627, in main
    mode.start(runner_args)
  File "/workspace/scenarios/kubernetes_e2e.py", line 262, in start
... skipping 9 lines ...