This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 5 succeeded
Started2020-02-18 14:38
Elapsed14m2s
Revision
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/afe2983a-4492-4e98-99ae-255746288ad7/targets/test'}}
resultstorehttps://source.cloud.google.com/results/invocations/afe2983a-4492-4e98-99ae-255746288ad7/targets/test
job-versionv1.18.0-alpha.5.181+2e5d5ebf593c55
revisionv1.18.0-alpha.5.181+2e5d5ebf593c55

Test Failures


Up 10m8s

kops update cluster failed: error during /tmp/kops936269785/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 5 Passed Tests

Error lines from build-log.txt

Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
fatal: not a git repository (or any of the parent directories): .git
+ /workspace/scenarios/kubernetes_e2e.py --cluster=e2e-kops-gce-canary.k8s.local --deployment=kops --extract=ci/latest --ginkgo-parallel=30 --kops-priority-path=/workspace/kubernetes/platforms/linux/amd64 --kops-version=https://storage.googleapis.com/kops-ci/bin/latest-ci-updown-green.txt --kops-zones=us-central1-c --provider=gce '--test_args=--ginkgo.skip=\[Slow\]|\[Serial\]|\[Disruptive\]|\[Flaky\]|\[Feature:.+\]|\[HPA\]|Dashboard|Services.*functioning.*NodePort' --timeout=120m
starts with local mode
Environment:
ARTIFACTS=/logs/artifacts
BAZEL_REMOTE_CACHE_ENABLED=false
BAZEL_VERSION=0.23.2
... skipping 479 lines ...
I0218 14:39:39.843113     233 vfs_castore.go:675] Issuing new certificate: "apiserver-aggregator-ca"
I0218 14:39:39.895027     233 vfs_castore.go:675] Issuing new certificate: "etcd-clients-ca"
I0218 14:39:39.912079     233 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-events"
I0218 14:39:39.951239     233 vfs_castore.go:675] Issuing new certificate: "ca"
I0218 14:39:40.134798     233 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-events"
I0218 14:39:40.276667     233 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-main"
W0218 14:39:47.721455     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m51s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:39:47.721503     233 executor.go:103] Tasks: 36 done / 64 total; 26 can run
I0218 14:39:47.930699     233 instancetemplate.go:223] We should be using NVME for GCE
I0218 14:39:47.936329     233 instancetemplate.go:223] We should be using NVME for GCE
I0218 14:39:47.941788     233 instancetemplate.go:223] We should be using NVME for GCE
I0218 14:39:48.064776     233 instancetemplate.go:223] We should be using NVME for GCE
I0218 14:39:48.337934     233 vfs_castore.go:675] Issuing new certificate: "apiserver-aggregator"
... skipping 3 lines ...
I0218 14:39:48.647079     233 vfs_castore.go:675] Issuing new certificate: "master"
I0218 14:39:48.696478     233 vfs_castore.go:675] Issuing new certificate: "kubecfg"
I0218 14:39:48.717522     233 vfs_castore.go:675] Issuing new certificate: "kubelet"
I0218 14:39:48.752173     233 vfs_castore.go:675] Issuing new certificate: "kube-controller-manager"
I0218 14:39:48.892219     233 vfs_castore.go:675] Issuing new certificate: "kube-proxy"
I0218 14:39:48.929941     233 vfs_castore.go:675] Issuing new certificate: "kube-scheduler"
W0218 14:39:54.856413     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m44s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:39:54.856484     233 executor.go:103] Tasks: 61 done / 64 total; 3 can run
W0218 14:40:06.083933     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m33s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:40:06.084090     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:40:06.459556     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:40:06.459593     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:40:16.460519     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:40:16.964650     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m22s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:40:16.964687     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:40:26.964856     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:40:27.663282     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m11s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:40:27.663314     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:40:37.663488     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:40:38.062135     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m1s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:40:38.062169     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:40:48.062352     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:40:48.461433     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:40:48.461469     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:40:58.461677     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:40:58.865940     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m40s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:40:58.865969     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:41:08.866151     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:41:09.696695     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:41:09.696741     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:41:19.696898     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:41:20.105458     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m19s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:41:20.105704     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:41:30.105878     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:41:30.563409     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m8s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:41:30.563447     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:41:40.563666     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:41:41.003246     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m58s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:41:41.003874     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:41:51.004547     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:41:51.459722     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m47s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:41:51.459761     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:42:01.462051     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:42:01.864716     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m37s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:42:01.864746     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:42:11.865018     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:42:12.267160     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m27s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:42:12.267191     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:42:22.267464     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:42:22.663358     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m16s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:42:22.663392     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:42:32.664551     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:42:33.091289     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m6s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:42:33.091323     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:42:43.091544     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:42:43.507433     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m55s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:42:43.507659     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:42:53.507861     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:42:53.895042     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m45s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:42:53.895074     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:43:03.895251     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:43:04.361205     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m34s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:43:04.361243     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:43:14.361525     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:43:14.759935     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m24s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:43:14.759968     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:43:24.760196     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:43:25.160999     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m14s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:43:25.161028     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:43:35.161237     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:43:35.563608     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m3s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:43:35.563645     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:43:45.563859     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:43:45.965093     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m53s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:43:45.965126     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:43:55.965355     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:43:56.460953     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m42s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:43:56.461021     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:44:06.461270     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:44:07.014363     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:44:07.014407     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:44:17.014680     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:44:17.395491     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m21s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:44:17.395714     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:44:27.395957     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:44:27.866437     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m11s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:44:27.866476     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:44:37.866946     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:44:38.260517     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m1s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:44:38.260549     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:44:48.260774     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:44:48.763810     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:44:48.763846     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:44:58.764062     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:44:59.169131     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m40s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:44:59.169165     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:45:09.169428     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:45:09.559778     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:45:09.559814     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:45:19.559976     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:45:19.960702     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m19s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:45:19.960743     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:45:29.960970     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:45:30.460482     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m8s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:45:30.460515     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:45:40.460752     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:45:40.857234     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m58s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:45:40.857268     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:45:50.857439     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:45:51.261233     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m48s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:45:51.261272     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:46:01.261560     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:46:01.659082     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m37s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:46:01.659119     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:46:11.659395     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:46:12.065842     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m27s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:46:12.065876     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:46:22.066089     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:46:22.497938     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m16s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:46:22.497979     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:46:32.498224     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:46:32.968597     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m6s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:46:32.968655     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:46:42.968987     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:46:43.357765     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m55s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:46:43.357807     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:46:53.358040     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:46:53.792857     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m45s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:46:53.792898     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:47:03.793065     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:47:04.202268     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m35s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:47:04.203283     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:47:14.208689     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:47:14.679441     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m24s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:47:14.679484     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:47:24.681099     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:47:25.097596     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m14s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:47:25.097634     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:47:35.097859     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:47:35.561607     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m3s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:47:35.561639     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:47:45.561799     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:47:45.979256     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m53s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:47:45.979294     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:47:55.979529     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:47:56.497561     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m42s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:47:56.497591     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:48:06.497822     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:48:06.858324     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:48:06.858354     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:48:16.858617     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:48:17.259796     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m22s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:48:17.259849     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:48:27.260080     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:48:27.659557     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m11s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:48:27.659607     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:48:37.660498     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:48:38.060004     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m1s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:48:38.060036     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:48:48.060291     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:48:48.464353     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:48:48.464384     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:48:58.464554     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:48:58.858381     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (40s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:48:58.858417     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:49:08.859755     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:49:09.267404     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (30s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:49:09.267446     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:49:19.267689     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:49:19.659575     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (19s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:49:19.659615     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 14:49:29.659765     233 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 14:49:30.058570     233 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 14:49:30.058605     233 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)

error running tasks: deadline exceeded executing task StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce. Example error: error creating GCS bucket ACL for gs://k8s-kops-gce for user-169433848209-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
2020/02/18 14:49:40 process.go:155: Step '/tmp/kops936269785/kops update cluster e2e-kops-gce-canary.k8s.local --yes' finished in 10m4.334558209s
2020/02/18 14:49:40 process.go:153: Running: kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller
2020/02/18 14:49:40 process.go:153: Running: /tmp/kops936269785/kops export kubecfg e2e-kops-gce-canary.k8s.local
I0218 14:49:40.394116     250 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 14:49:40.394210     250 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 14:49:40.723883     250 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
... skipping 3 lines ...
I0218 14:49:41.309296     276 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 14:49:41.309376     276 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 14:49:41.616944     276 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
I0218 14:49:41.875763     276 gce.go:82] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b]
2020/02/18 14:49:44 process.go:155: Step '/tmp/kops936269785/kops toolbox dump --name e2e-kops-gce-canary.k8s.local -ojson' finished in 2.762811082s
2020/02/18 14:49:44 process.go:153: Running: kubectl get nodes -ojson
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 14:50:25 process.go:155: Step 'kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller' finished in 45.24744573s
2020/02/18 14:50:25 kubernetes.go:117: kubectl get pods failed: error during kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller: exit status 1
Unable to connect to the server: net/http: TLS handshake timeout
2020/02/18 14:50:36 process.go:155: Step 'kubectl get nodes -ojson' finished in 52.260101313s
2020/02/18 14:50:36 kubernetes.go:35: kubectl get nodes failed: error during kubectl get nodes -ojson: exit status 1
2020/02/18 14:50:36 dump.go:92: Failed to get nodes for dumping via kubectl: error during kubectl get nodes -ojson: exit status 1
2020/02/18 14:50:36 dump.go:126: dumping node not registered in kubernetes: 35.223.89.41
2020/02/18 14:50:36 dump.go:160: Dumping node 35.223.89.41
2020/02/18 14:50:36 dump.go:399: Running SSH command: sudo journalctl --output=short-precise -k
2020/02/18 14:50:36 dump.go:399: Running SSH command: sudo journalctl --output=short-precise
2020/02/18 14:50:37 dump.go:399: Running SSH command: sudo systemctl list-units -t service --no-pager --no-legend --all
2020/02/18 14:50:37 dump.go:399: Running SSH command: sudo journalctl --output=cat -u kubelet.service
... skipping 127 lines ...
InstanceTemplate:nodes-e2e-kops-gce-canary-1m0s02-1582036787	ok
Deleted kubectl config for e2e-kops-gce-canary.k8s.local

Deleted cluster: "e2e-kops-gce-canary.k8s.local"
2020/02/18 14:52:34 process.go:155: Step '/tmp/kops936269785/kops delete cluster e2e-kops-gce-canary.k8s.local --yes' finished in 1m54.050069848s
2020/02/18 14:52:34 process.go:96: Saved XML output to /logs/artifacts/junit_runner.xml.
2020/02/18 14:52:34 main.go:316: Something went wrong: starting e2e cluster: kops update cluster failed: error during /tmp/kops936269785/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
Traceback (most recent call last):
  File "/workspace/scenarios/kubernetes_e2e.py", line 779, in <module>
    main(parse_args())
  File "/workspace/scenarios/kubernetes_e2e.py", line 627, in main
    mode.start(runner_args)
  File "/workspace/scenarios/kubernetes_e2e.py", line 262, in start
... skipping 9 lines ...