This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 5 succeeded
Started2020-02-18 05:29
Elapsed13m39s
Revision
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/b4e72452-1922-4259-b54d-a8f04652356f/targets/test'}}
resultstorehttps://source.cloud.google.com/results/invocations/b4e72452-1922-4259-b54d-a8f04652356f/targets/test
job-versionv1.18.0-alpha.5.178+5bd719b6a6f6ea
revisionv1.18.0-alpha.5.178+5bd719b6a6f6ea

Test Failures


Up 10m9s

kops update cluster failed: error during /tmp/kops404192694/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 5 Passed Tests

Error lines from build-log.txt

Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
fatal: not a git repository (or any of the parent directories): .git
+ /workspace/scenarios/kubernetes_e2e.py --cluster=e2e-kops-gce-canary.k8s.local --deployment=kops --extract=ci/latest --ginkgo-parallel=30 --kops-priority-path=/workspace/kubernetes/platforms/linux/amd64 --kops-version=https://storage.googleapis.com/kops-ci/bin/latest-ci-updown-green.txt --kops-zones=us-central1-c --provider=gce '--test_args=--ginkgo.skip=\[Slow\]|\[Serial\]|\[Disruptive\]|\[Flaky\]|\[Feature:.+\]|\[HPA\]|Dashboard|Services.*functioning.*NodePort' --timeout=120m
starts with local mode
Environment:
ARTIFACTS=/logs/artifacts
BAZEL_REMOTE_CACHE_ENABLED=false
BAZEL_VERSION=0.23.2
... skipping 479 lines ...
I0218 05:30:03.690633     236 vfs_castore.go:675] Issuing new certificate: "apiserver-aggregator-ca"
I0218 05:30:03.751330     236 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-events"
I0218 05:30:03.778801     236 vfs_castore.go:675] Issuing new certificate: "etcd-clients-ca"
I0218 05:30:03.842354     236 vfs_castore.go:675] Issuing new certificate: "ca"
I0218 05:30:03.948862     236 vfs_castore.go:675] Issuing new certificate: "etcd-peers-ca-main"
I0218 05:30:04.430614     236 vfs_castore.go:675] Issuing new certificate: "etcd-manager-ca-main"
W0218 05:30:11.339780     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m51s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:30:11.339880     236 executor.go:103] Tasks: 36 done / 64 total; 26 can run
I0218 05:30:11.445444     236 instancetemplate.go:223] We should be using NVME for GCE
I0218 05:30:11.448068     236 instancetemplate.go:223] We should be using NVME for GCE
I0218 05:30:11.449297     236 instancetemplate.go:223] We should be using NVME for GCE
I0218 05:30:11.529223     236 instancetemplate.go:223] We should be using NVME for GCE
I0218 05:30:11.686227     236 vfs_castore.go:675] Issuing new certificate: "kops"
... skipping 3 lines ...
I0218 05:30:12.066951     236 vfs_castore.go:675] Issuing new certificate: "kubelet-api"
I0218 05:30:12.078963     236 vfs_castore.go:675] Issuing new certificate: "kubecfg"
I0218 05:30:12.169098     236 vfs_castore.go:675] Issuing new certificate: "kube-proxy"
I0218 05:30:12.308692     236 vfs_castore.go:675] Issuing new certificate: "kube-scheduler"
I0218 05:30:12.410934     236 vfs_castore.go:675] Issuing new certificate: "master"
I0218 05:30:12.431278     236 vfs_castore.go:675] Issuing new certificate: "apiserver-proxy-client"
W0218 05:30:18.350971     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m44s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:30:18.351022     236 executor.go:103] Tasks: 61 done / 64 total; 3 can run
W0218 05:30:30.016726     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m33s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:30:30.016769     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:30:30.359526     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:30:30.359585     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:30:40.359884     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:30:40.905610     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m22s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:30:40.905646     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:30:50.905904     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:30:51.561250     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m11s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:30:51.561281     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:31:01.561570     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:31:02.100436     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (9m0s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:31:02.100474     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:31:12.100788     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:31:12.460293     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:31:12.460330     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:31:22.460686     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:31:22.861995     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m40s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:31:22.862038     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:31:32.862318     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:31:33.371374     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:31:33.371411     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:31:43.371706     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:31:43.758236     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m19s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:31:43.758269     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:31:53.758636     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:31:54.167070     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (8m8s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:31:54.167108     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:32:04.167411     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:32:04.662283     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m58s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:32:04.662323     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:32:14.662637     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:32:15.061996     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m48s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:32:15.062029     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:32:25.062323     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:32:25.462652     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m37s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:32:25.462688     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:32:35.462896     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:32:35.959655     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m27s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:32:35.959700     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:32:45.960012     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:32:46.364113     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m16s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:32:46.364150     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:32:56.364438     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:32:57.367690     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7m5s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:32:57.367727     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:33:07.367973     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:33:07.767171     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m55s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:33:07.767202     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:33:17.767532     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:33:18.165575     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m44s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:33:18.165602     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:33:28.165927     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:33:28.563983     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m34s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:33:28.564021     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:33:38.564389     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:33:39.161282     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m23s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:33:39.161312     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:33:49.161539     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:33:49.661108     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m13s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:33:49.661146     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:33:59.661375     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:34:00.061644     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (6m3s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:34:00.061675     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:34:10.061917     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:34:10.503777     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m52s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:34:10.503814     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:34:20.503988     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:34:20.957967     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m42s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:34:20.958006     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:34:30.958293     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:34:31.358532     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m31s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:34:31.358574     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:34:41.358817     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:34:41.757831     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m21s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:34:41.757879     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:34:51.758141     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:34:52.158960     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m10s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:34:52.158990     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:35:02.159294     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:35:02.559186     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (5m0s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:35:02.559221     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:35:12.559507     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:35:12.962271     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:35:12.962308     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:35:22.962593     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:35:23.358478     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m39s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:35:23.358518     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:35:33.358805     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:35:33.758124     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:35:33.758165     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:35:43.758479     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:35:44.160182     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m18s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:35:44.160268     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:35:54.160731     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:35:54.595377     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (4m8s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:35:54.595412     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:36:04.595685     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:36:04.961478     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m58s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:36:04.961511     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:36:14.961825     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:36:15.557458     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m47s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:36:15.557501     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:36:25.557802     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:36:25.965493     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m37s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:36:25.965532     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:36:35.965815     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:36:36.359397     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m26s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:36:36.359433     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:36:46.359704     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:36:46.759902     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m16s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:36:46.759949     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:36:56.760244     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:36:57.162422     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (3m5s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:36:57.162467     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:37:07.162722     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:37:07.559589     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m55s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:37:07.559621     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:37:17.559886     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:37:17.960984     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m45s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:37:17.961017     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:37:27.961303     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:37:28.362864     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m34s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:37:28.362900     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:37:38.363163     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:37:38.757382     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m24s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:37:38.757414     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:37:48.757670     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:37:49.257830     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m13s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:37:49.257858     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:37:59.258106     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:37:59.658711     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (2m3s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:37:59.658751     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:38:09.659033     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:38:10.059862     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m53s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:38:10.059893     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:38:20.060130     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:38:20.561846     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m42s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:38:20.561885     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:38:30.562192     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:38:30.961146     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m32s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:38:30.961187     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:38:40.961492     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:38:41.361603     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m21s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:38:41.361655     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:38:51.361896     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:38:51.861449     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m11s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:38:51.861484     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:39:01.861708     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:39:02.260269     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (1m0s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:39:02.260297     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:39:12.260750     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:39:12.657931     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (50s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:39:12.657962     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:39:22.658239     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:39:23.068122     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (40s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:39:23.068151     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:39:33.068826     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:39:33.497016     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (29s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:39:33.497057     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:39:43.497310     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:39:45.161512     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (17s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:39:45.161550     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)
I0218 05:39:55.161864     236 executor.go:103] Tasks: 63 done / 64 total; 1 can run
W0218 05:39:55.764816     236 executor.go:128] error running task "StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce" (7s remaining to succeed): error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
I0218 05:39:55.764847     236 executor.go:143] No progress made, sleeping before retrying 1 failed task(s)

error running tasks: deadline exceeded executing task StorageBucketAcl/serviceaccount-backup-readwrite-k8s-kops-gce. Example error: error creating GCS bucket ACL for gs://k8s-kops-gce for user-24765830345-compute@developer.gserviceaccount.com as WRITER: googleapi: Error 400: An access control list can contain at most 100 entries., tooManyAccessControlEntries
2020/02/18 05:40:05 process.go:155: Step '/tmp/kops404192694/kops update cluster e2e-kops-gce-canary.k8s.local --yes' finished in 10m5.754068081s
2020/02/18 05:40:05 process.go:153: Running: kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller
2020/02/18 05:40:05 process.go:153: Running: /tmp/kops404192694/kops export kubecfg e2e-kops-gce-canary.k8s.local
I0218 05:40:05.826818     256 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 05:40:05.826908     256 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 05:40:06.040860     256 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
... skipping 3 lines ...
I0218 05:40:06.663551     281 featureflag.go:150] FeatureFlag "AlphaAllowGCE"=true
I0218 05:40:06.663635     281 featureflag.go:150] FeatureFlag "SpecOverrideFlag"=true
I0218 05:40:06.841676     281 gce_cloud.go:123] Will load GOOGLE_APPLICATION_CREDENTIALS from /etc/service-account/service-account.json
I0218 05:40:07.083901     281 gce.go:82] Scanning zones: [us-central1-c us-central1-a us-central1-f us-central1-b]
2020/02/18 05:40:09 process.go:155: Step '/tmp/kops404192694/kops toolbox dump --name e2e-kops-gce-canary.k8s.local -ojson' finished in 2.743316139s
2020/02/18 05:40:09 process.go:153: Running: kubectl get nodes -ojson
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 05:40:50 process.go:155: Step 'kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller' finished in 45.159151406s
2020/02/18 05:40:50 kubernetes.go:117: kubectl get pods failed: error during kubectl -n kube-system get pods -ojson -l k8s-app=kops-controller: exit status 1
Error from server (InternalError): an error on the server ("") has prevented the request from succeeding
2020/02/18 05:41:00 process.go:155: Step 'kubectl get nodes -ojson' finished in 50.668349427s
2020/02/18 05:41:00 kubernetes.go:35: kubectl get nodes failed: error during kubectl get nodes -ojson: exit status 1
2020/02/18 05:41:00 dump.go:92: Failed to get nodes for dumping via kubectl: error during kubectl get nodes -ojson: exit status 1
2020/02/18 05:41:00 dump.go:126: dumping node not registered in kubernetes: 35.188.64.33
2020/02/18 05:41:00 dump.go:160: Dumping node 35.188.64.33
2020/02/18 05:41:00 dump.go:399: Running SSH command: sudo journalctl --output=short-precise -k
2020/02/18 05:41:00 dump.go:399: Running SSH command: sudo journalctl --output=short-precise
2020/02/18 05:41:00 dump.go:399: Running SSH command: sudo systemctl list-units -t service --no-pager --no-legend --all
2020/02/18 05:41:00 dump.go:399: Running SSH command: sudo journalctl --output=cat -u kubelet.service
... skipping 127 lines ...
TargetPool:api-e2e-kops-gce-canary-k8s-local	ok
Deleted kubectl config for e2e-kops-gce-canary.k8s.local

Deleted cluster: "e2e-kops-gce-canary.k8s.local"
2020/02/18 05:43:07 process.go:155: Step '/tmp/kops404192694/kops delete cluster e2e-kops-gce-canary.k8s.local --yes' finished in 2m4.22118082s
2020/02/18 05:43:07 process.go:96: Saved XML output to /logs/artifacts/junit_runner.xml.
2020/02/18 05:43:07 main.go:316: Something went wrong: starting e2e cluster: kops update cluster failed: error during /tmp/kops404192694/kops update cluster e2e-kops-gce-canary.k8s.local --yes: exit status 1
Traceback (most recent call last):
  File "/workspace/scenarios/kubernetes_e2e.py", line 779, in <module>
    main(parse_args())
  File "/workspace/scenarios/kubernetes_e2e.py", line 627, in main
    mode.start(runner_args)
  File "/workspace/scenarios/kubernetes_e2e.py", line 262, in start
... skipping 9 lines ...