ci-kubernetes-e2e-gke-regional-slow #1173978923264905216
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 1 failed / 6 succeeded |
| Started | |
| Elapsed | 20m57s |
| Revision | |
| Builder | gke-prow-ssd-pool-1a225945-d0kf |
| links | {u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/405db3ac-9489-431c-bcfa-6beb5944244b/targets/test'}} |
| pod | 04876241-d95e-11e9-b0f7-b204a12bbfd6 |
| resultstore | https://source.cloud.google.com/results/invocations/405db3ac-9489-431c-bcfa-6beb5944244b/targets/test |
| infra-commit | bb5822c56 |
| job-version | v1.17.0-alpha.0.1491+3a19f1e80b172d |
| pod | 04876241-d95e-11e9-b0f7-b204a12bbfd6 |
| revision | v1.17.0-alpha.0.1491+3a19f1e80b172d |
error creating cluster: error during gcloud container clusters create --quiet --project=k8s-jkns-gke-ubuntu-1-6-reboot --region=us-central1 --machine-type=n1-standard-2 --image-type=gci --num-nodes=3 --network=bootstrap-e2e --cluster-version=1.17.0-alpha.0.1491+3a19f1e80b172d bootstrap-e2e: exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
Deferred TearDown
DumpClusterLogs (--up failed)
Extract
TearDown Previous
Timeout
listResources Before
... skipping 12 lines ... I0917 15:16:15.651] process 45 exited with code 0 after 0.0m I0917 15:16:15.652] Will upload results to gs://kubernetes-jenkins/logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com I0917 15:16:15.652] Root: /workspace I0917 15:16:15.652] cd to /workspace I0917 15:16:15.652] Configure environment... I0917 15:16:15.653] Call: git show -s --format=format:%ct HEAD W0917 15:16:15.657] fatal: Not a git repository (or any of the parent directories): .git I0917 15:16:15.658] process 57 exited with code 128 after 0.0m W0917 15:16:15.658] Unable to print commit date for HEAD I0917 15:16:15.658] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W0917 15:16:16.176] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com] I0917 15:16:16.558] process 58 exited with code 0 after 0.0m I0917 15:16:16.558] Call: gcloud config get-value account ... skipping 423 lines ... W0917 15:18:37.591] WARNING: Currently VPC-native is not the default mode during cluster creation. In the future, this will become the default mode and can be disabled using `--no-enable-ip-alias` flag. Use `--[no-]enable-ip-alias` flag to suppress this warning. W0917 15:18:37.592] WARNING: Starting in 1.12, default node pools in new clusters will have their legacy Compute Engine instance metadata endpoints disabled by default. To create a cluster with legacy instance metadata endpoints disabled in the default node pool, run `clusters create` with the flag `--metadata disable-legacy-endpoints=true`. W0917 15:18:37.592] WARNING: Your Pod address range (`--cluster-ipv4-cidr`) can accommodate at most 1008 node(s). W0917 15:18:37.593] This will disable the autorepair feature for nodes. Please see https://cloud.google.com/kubernetes-engine/docs/node-auto-repair for more information on node autorepairs. W0917 15:18:42.571] Creating cluster bootstrap-e2e in us-central1... W0917 15:29:31.825] .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. W0917 15:29:31.949] ERROR: (gcloud.container.clusters.create) Operation [<Operation W0917 15:29:31.950] clusterConditions: [] W0917 15:29:31.950] detail: u'All cluster resources were brought up, but the cluster API is reporting that: component "kube-apiserver" from endpoint "gke-75ea251a490bff9fe446-1e82" is unhealthy.' W0917 15:29:31.950] endTime: u'2019-09-17T15:29:27.945572615Z' W0917 15:29:31.950] name: u'operation-1568733522509-227e168b' W0917 15:29:31.951] nodepoolConditions: [] W0917 15:29:31.951] operationType: OperationTypeValueValuesEnum(CREATE_CLUSTER, 1) W0917 15:29:31.951] selfLink: u'https://test-container.sandbox.googleapis.com/v1/projects/417760766889/locations/us-central1/operations/operation-1568733522509-227e168b' W0917 15:29:31.951] startTime: u'2019-09-17T15:18:42.509538858Z' W0917 15:29:31.951] status: StatusValueValuesEnum(DONE, 3) W0917 15:29:31.952] statusMessage: u'All cluster resources were brought up, but the cluster API is reporting that: component "kube-apiserver" from endpoint "gke-75ea251a490bff9fe446-1e82" is unhealthy.' W0917 15:29:31.952] targetLink: u'https://test-container.sandbox.googleapis.com/v1/projects/417760766889/locations/us-central1/clusters/bootstrap-e2e' W0917 15:29:31.953] zone: u'us-central1'>] finished with error: All cluster resources were brought up, but the cluster API is reporting that: component "kube-apiserver" from endpoint "gke-75ea251a490bff9fe446-1e82" is unhealthy. W0917 15:29:32.035] 2019/09/17 15:29:32 process.go:155: Step 'gcloud container clusters create --quiet --project=k8s-jkns-gke-ubuntu-1-6-reboot --region=us-central1 --machine-type=n1-standard-2 --image-type=gci --num-nodes=3 --network=bootstrap-e2e --cluster-version=1.17.0-alpha.0.1491+3a19f1e80b172d bootstrap-e2e' finished in 10m54.869472648s W0917 15:29:32.743] 2019/09/17 15:29:32 process.go:153: Running: bash -c W0917 15:29:32.744] function log_dump_custom_get_instances() { W0917 15:29:32.744] if [[ $1 == "master" ]]; then W0917 15:29:32.744] return 0 W0917 15:29:32.745] fi ... skipping 13 lines ... I0917 15:29:32.905] No masters found? I0917 15:29:32.906] Dumping logs from nodes locally to '/workspace/_artifacts' I0917 15:29:32.906] Dumping logs for nodes provided by log_dump_custom_get_instances() function W0917 15:29:34.709] WARNING: --filter : operator evaluation is changing for consistency across Google APIs. metadata.created-by:*zones/us-central1-a/instanceGroupManagers/gke-bootstrap-e2e-default-pool-3e03a215-grp currently matches but will not match in the near future. Run `gcloud topic filters` for details. I0917 15:30:35.246] Changing logfiles to be world-readable for download I0917 15:30:35.318] Changing logfiles to be world-readable for download W0917 15:30:35.982] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:36.030] ERROR: (gcloud.compute.ssh) could not parse resource [] I0917 15:30:36.197] Changing logfiles to be world-readable for download I0917 15:30:36.858] Changing logfiles to be world-readable for download W0917 15:30:36.958] ERROR: (gcloud.compute.ssh) could not parse resource [] I0917 15:30:37.305] Changing logfiles to be world-readable for download W0917 15:30:37.720] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:38.146] ERROR: (gcloud.compute.ssh) could not parse resource [] I0917 15:30:38.505] Changing logfiles to be world-readable for download I0917 15:30:38.651] Changing logfiles to be world-readable for download I0917 15:30:38.654] Changing logfiles to be world-readable for download I0917 15:30:38.694] Changing logfiles to be world-readable for download W0917 15:30:39.386] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:39.439] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:39.515] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:39.539] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:41.825] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:41.883] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:42.572] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:43.382] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:43.819] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:45.198] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:45.273] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:45.291] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:45.357] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:47.451] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:47.518] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:48.185] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:48.994] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:49.468] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:51.062] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:51.073] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:51.230] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:51.250] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:53.091] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:53.146] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:53.801] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:54.767] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:55.219] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:56.825] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:56.838] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:56.967] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:56.969] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:58.732] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:58.789] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:30:59.510] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:31:00.539] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:31:00.926] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:31:02.539] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:31:02.551] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:31:02.684] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:31:02.731] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:31:04.387] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:31:04.436] ERROR: (gcloud.compute.ssh) could not parse resource [] I0917 15:31:04.537] Copying 'kern.log kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov docker/log kubelet.log supervisor/supervisord.log supervisor/kubelet-stdout.log supervisor/kubelet-stderr.log supervisor/docker-stdout.log supervisor/docker-stderr.log' from gke-bootstrap-e2e-default-pool-3e03a215-dhv8 I0917 15:31:04.537] Copying 'kern.log kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov docker/log kubelet.log supervisor/supervisord.log supervisor/kubelet-stdout.log supervisor/kubelet-stderr.log supervisor/docker-stdout.log supervisor/docker-stderr.log' from gke-bootstrap-e2e-default-pool-b3faac17-lcmw W0917 15:31:05.084] ERROR: (gcloud.compute.instances.get-serial-port-output) could not parse resource [] W0917 15:31:05.085] ERROR: (gcloud.compute.instances.get-serial-port-output) could not parse resource [] W0917 15:31:05.225] ERROR: (gcloud.compute.ssh) could not parse resource [] I0917 15:31:05.326] Copying 'kern.log kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov docker/log kubelet.log supervisor/supervisord.log supervisor/kubelet-stdout.log supervisor/kubelet-stderr.log supervisor/docker-stdout.log supervisor/docker-stderr.log' from gke-bootstrap-e2e-default-pool-2f2dfb9e-3mjr W0917 15:31:05.780] ERROR: (gcloud.compute.scp) could not parse resource [] W0917 15:31:05.812] ERROR: (gcloud.compute.scp) could not parse resource [] W0917 15:31:05.906] ERROR: (gcloud.compute.instances.get-serial-port-output) could not parse resource [] W0917 15:31:06.238] ERROR: (gcloud.compute.ssh) could not parse resource [] I0917 15:31:06.339] Copying 'kern.log kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov docker/log kubelet.log supervisor/supervisord.log supervisor/kubelet-stdout.log supervisor/kubelet-stderr.log supervisor/docker-stdout.log supervisor/docker-stderr.log' from gke-bootstrap-e2e-default-pool-3e03a215-ss5c W0917 15:31:06.677] ERROR: (gcloud.compute.scp) could not parse resource [] W0917 15:31:06.679] ERROR: (gcloud.compute.ssh) could not parse resource [] I0917 15:31:06.780] Copying 'kern.log kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov docker/log kubelet.log supervisor/supervisord.log supervisor/kubelet-stdout.log supervisor/kubelet-stderr.log supervisor/docker-stdout.log supervisor/docker-stderr.log' from gke-bootstrap-e2e-default-pool-2f2dfb9e-gnms W0917 15:31:07.022] ERROR: (gcloud.compute.instances.get-serial-port-output) could not parse resource [] W0917 15:31:07.328] ERROR: (gcloud.compute.instances.get-serial-port-output) could not parse resource [] W0917 15:31:07.667] ERROR: (gcloud.compute.scp) could not parse resource [] W0917 15:31:08.003] ERROR: (gcloud.compute.scp) could not parse resource [] W0917 15:31:08.275] ERROR: (gcloud.compute.ssh) could not parse resource [] I0917 15:31:08.376] Copying 'kern.log kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov docker/log kubelet.log supervisor/supervisord.log supervisor/kubelet-stdout.log supervisor/kubelet-stderr.log supervisor/docker-stdout.log supervisor/docker-stderr.log' from gke-bootstrap-e2e-default-pool-2f2dfb9e-w1vj W0917 15:31:08.477] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:31:08.478] ERROR: (gcloud.compute.ssh) could not parse resource [] W0917 15:31:08.568] ERROR: (gcloud.compute.ssh) could not parse resource [] I0917 15:31:08.669] Copying 'kern.log kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov docker/log kubelet.log supervisor/supervisord.log supervisor/kubelet-stdout.log supervisor/kubelet-stderr.log supervisor/docker-stdout.log supervisor/docker-stderr.log' from gke-bootstrap-e2e-default-pool-3e03a215-m357 I0917 15:31:08.670] Copying 'kern.log kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov docker/log kubelet.log supervisor/supervisord.log supervisor/kubelet-stdout.log supervisor/kubelet-stderr.log supervisor/docker-stdout.log supervisor/docker-stderr.log' from gke-bootstrap-e2e-default-pool-b3faac17-062g I0917 15:31:08.670] Copying 'kern.log kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov docker/log kubelet.log supervisor/supervisord.log supervisor/kubelet-stdout.log supervisor/kubelet-stderr.log supervisor/docker-stdout.log supervisor/docker-stderr.log' from gke-bootstrap-e2e-default-pool-b3faac17-ng17 W0917 15:31:09.064] ERROR: (gcloud.compute.instances.get-serial-port-output) could not parse resource [] W0917 15:31:09.114] ERROR: (gcloud.compute.instances.get-serial-port-output) could not parse resource [] W0917 15:31:09.199] ERROR: (gcloud.compute.instances.get-serial-port-output) could not parse resource [] W0917 15:31:09.450] ERROR: (gcloud.compute.instances.get-serial-port-output) could not parse resource [] W0917 15:31:10.063] ERROR: (gcloud.compute.scp) could not parse resource [] W0917 15:31:10.067] ERROR: (gcloud.compute.scp) could not parse resource [] W0917 15:31:10.189] ERROR: (gcloud.compute.scp) could not parse resource [] W0917 15:31:10.355] ERROR: (gcloud.compute.scp) could not parse resource [] W0917 15:31:10.447] Project: k8s-jkns-gke-ubuntu-1-6-reboot W0917 15:31:10.448] Network Project: k8s-jkns-gke-ubuntu-1-6-reboot W0917 15:31:10.448] Zone: W0917 15:31:13.339] INSTANCE_GROUPS= W0917 15:31:13.339] NODE_NAMES= W0917 15:31:13.339] 2019/09/17 15:31:13 process.go:155: Step 'bash -c ... skipping 21 lines ... W0917 15:35:58.519] 2019/09/17 15:35:58 process.go:155: Step 'gcloud compute firewall-rules describe e2e-ports-3e03a215 --project=k8s-jkns-gke-ubuntu-1-6-reboot --format=value(name)' finished in 2.2678203s W0917 15:35:58.520] 2019/09/17 15:35:58 gke.go:631: Found no rules for firewall 'e2e-ports-3e03a215', assuming resources are clean W0917 15:36:00.031] 2019/09/17 15:36:00 process.go:153: Running: gcloud compute networks delete -q bootstrap-e2e --project=k8s-jkns-gke-ubuntu-1-6-reboot W0917 15:36:59.727] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gke-ubuntu-1-6-reboot/global/networks/bootstrap-e2e]. W0917 15:36:59.823] 2019/09/17 15:36:59 process.go:155: Step 'gcloud compute networks delete -q bootstrap-e2e --project=k8s-jkns-gke-ubuntu-1-6-reboot' finished in 59.791969555s W0917 15:36:59.825] 2019/09/17 15:36:59 process.go:96: Saved XML output to /workspace/_artifacts/junit_runner.xml. W0917 15:37:03.173] 2019/09/17 15:37:03 main.go:319: Something went wrong: starting e2e cluster: error creating cluster: error during gcloud container clusters create --quiet --project=k8s-jkns-gke-ubuntu-1-6-reboot --region=us-central1 --machine-type=n1-standard-2 --image-type=gci --num-nodes=3 --network=bootstrap-e2e --cluster-version=1.17.0-alpha.0.1491+3a19f1e80b172d bootstrap-e2e: exit status 1 W0917 15:37:03.175] Traceback (most recent call last): W0917 15:37:03.175] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 778, in <module> W0917 15:37:03.177] main(parse_args()) W0917 15:37:03.178] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 626, in main W0917 15:37:03.178] mode.start(runner_args) W0917 15:37:03.178] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 262, in start W0917 15:37:03.178] check_env(env, self.command, *args) W0917 15:37:03.179] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 111, in check_env W0917 15:37:03.179] subprocess.check_call(cmd, env=env) W0917 15:37:03.180] File "/usr/lib/python2.7/subprocess.py", line 186, in check_call W0917 15:37:03.180] raise CalledProcessError(retcode, cmd) W0917 15:37:03.180] subprocess.CalledProcessError: Command '('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--up', '--down', '--test', '--deployment=gke', '--provider=gke', '--cluster=bootstrap-e2e', '--gcp-network=bootstrap-e2e', '--check-leaked-resources', '--extract=ci/latest', '--gcp-cloud-sdk=gs://cloud-sdk-testing/ci/staging', '--gcp-node-image=gci', '--gcp-region=us-central1', '--ginkgo-parallel', '--gke-environment=test', '--test_args=--gce-multizone=true --gce-multimaster=true --ginkgo.focus=\\[Slow\\] --ginkgo.skip=\\[Serial\\]|\\[Disruptive\\]|\\[Flaky\\]|\\[Feature:.+\\] --minStartupPods=8', '--timeout=150m')' returned non-zero exit status 1 E0917 15:37:03.188] Command failed I0917 15:37:03.189] process 260 exited with code 1 after 20.7m E0917 15:37:03.189] FAIL: ci-kubernetes-e2e-gke-regional-slow I0917 15:37:03.189] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W0917 15:37:03.756] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com] I0917 15:37:03.807] process 3784 exited with code 0 after 0.0m I0917 15:37:03.807] Call: gcloud config get-value account I0917 15:37:04.162] process 3796 exited with code 0 after 0.0m I0917 15:37:04.163] Will upload results to gs://kubernetes-jenkins/logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com I0917 15:37:04.164] Upload result and artifacts... I0917 15:37:04.164] Gubernator results at https://gubernator.k8s.io/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gke-regional-slow/1173978923264905216 I0917 15:37:04.164] Call: gsutil ls gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gke-regional-slow/1173978923264905216/artifacts W0917 15:37:05.249] CommandException: One or more URLs matched no objects. E0917 15:37:05.369] Command failed I0917 15:37:05.370] process 3808 exited with code 1 after 0.0m W0917 15:37:05.370] Remote dir gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gke-regional-slow/1173978923264905216/artifacts not exist yet I0917 15:37:05.370] Call: gsutil -m -q -o GSUtil:use_magicfile=True cp -r -c -z log,txt,xml /workspace/_artifacts gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gke-regional-slow/1173978923264905216/artifacts I0917 15:37:07.547] process 3950 exited with code 0 after 0.0m I0917 15:37:07.548] Call: git rev-parse HEAD W0917 15:37:07.575] fatal: Not a git repository (or any of the parent directories): .git E0917 15:37:07.576] Command failed I0917 15:37:07.576] process 4501 exited with code 128 after 0.0m I0917 15:37:07.577] Call: git rev-parse HEAD I0917 15:37:07.589] process 4502 exited with code 0 after 0.0m I0917 15:37:07.590] Call: gsutil stat gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gke-regional-slow/jobResultsCache.json I0917 15:37:08.734] process 4503 exited with code 0 after 0.0m I0917 15:37:08.735] Call: gsutil -q cat 'gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gke-regional-slow/jobResultsCache.json#1568730999616693' ... skipping 8 lines ...