ci-kubernetes-e2e-gke-device-plugin-gpu-p100-stable2 #1191777363164139522
Recent runs || View in Spyglass
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 1 failed / 6 succeeded |
| Started | |
| Elapsed | 4m8s |
| Revision | |
| Builder | gke-prow-ssd-pool-1a225945-jhsp |
| links | {u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/849fa135-2856-4273-9242-02dafcc1db1f/targets/test'}} |
| pod | 22d2ec73-fff6-11e9-bda4-f2679650cd82 |
| resultstore | https://source.cloud.google.com/results/invocations/849fa135-2856-4273-9242-02dafcc1db1f/targets/test |
| infra-commit | 65c35174a |
| job-version | v1.15.6-beta.0.16+670c7810991876 |
| pod | 22d2ec73-fff6-11e9-bda4-f2679650cd82 |
| revision | v1.15.6-beta.0.16+670c7810991876 |
error creating cluster: error during gcloud container clusters create --accelerator=type=nvidia-tesla-p100,count=2 --project=k8s-jkns-e2e-gce-gpus --zone=us-west1-b --machine-type=n1-standard-2 --image-type=gci --num-nodes=3 --network=bootstrap-e2e --cluster-version=1.15.6-beta.0.16+670c7810991876 bootstrap-e2e: exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
Deferred TearDown
DumpClusterLogs (--up failed)
Extract
TearDown Previous
Timeout
listResources Before
... skipping 15 lines ... I1105 18:01:29.853] process 45 exited with code 0 after 0.0m I1105 18:01:29.853] Will upload results to gs://kubernetes-jenkins/logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com I1105 18:01:29.854] Root: /workspace I1105 18:01:29.854] cd to /workspace I1105 18:01:29.854] Configure environment... I1105 18:01:29.855] Call: git show -s --format=format:%ct HEAD W1105 18:01:29.873] fatal: not a git repository (or any of the parent directories): .git I1105 18:01:29.875] process 57 exited with code 128 after 0.0m W1105 18:01:29.877] Unable to print commit date for HEAD I1105 18:01:29.879] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W1105 18:01:32.378] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com] I1105 18:01:32.664] process 58 exited with code 0 after 0.0m I1105 18:01:32.666] Call: gcloud config get-value account ... skipping 425 lines ... W1105 18:04:32.635] WARNING: In November 2019, node auto-upgrade will be enabled by default for newly created clusters and node pools. To disable it, use the `--no-enable-autoupgrade` flag. W1105 18:04:32.636] WARNING: Currently VPC-native is not the default mode during cluster creation. In the future, this will become the default mode and can be disabled using `--no-enable-ip-alias` flag. Use `--[no-]enable-ip-alias` flag to suppress this warning. W1105 18:04:32.639] WARNING: Starting in 1.12, default node pools in new clusters will have their legacy Compute Engine instance metadata endpoints disabled by default. To create a cluster with legacy instance metadata endpoints disabled in the default node pool, run `clusters create` with the flag `--metadata disable-legacy-endpoints=true`. W1105 18:04:32.640] WARNING: Your Pod address range (`--cluster-ipv4-cidr`) can accommodate at most 1008 node(s). W1105 18:04:32.641] This will disable the autorepair feature for nodes. Please see https://cloud.google.com/kubernetes-engine/docs/node-auto-repair for more information on node autorepairs. W1105 18:04:32.642] Machines with GPUs have certain limitations which may affect your workflow. Learn more at https://cloud.google.com/kubernetes-engine/docs/how-to/gpus W1105 18:05:19.220] ERROR: (gcloud.container.clusters.create) ResponseError: code=500, message=Internal error encountered. W1105 18:05:19.302] 2019/11/05 18:05:19 process.go:155: Step 'gcloud container clusters create --accelerator=type=nvidia-tesla-p100,count=2 --project=k8s-jkns-e2e-gce-gpus --zone=us-west1-b --machine-type=n1-standard-2 --image-type=gci --num-nodes=3 --network=bootstrap-e2e --cluster-version=1.15.6-beta.0.16+670c7810991876 bootstrap-e2e' finished in 47.429138802s W1105 18:05:21.134] 2019/11/05 18:05:21 process.go:96: Saved XML output to /workspace/_artifacts/junit_runner.xml. W1105 18:05:26.370] 2019/11/05 18:05:26 main.go:319: Something went wrong: starting e2e cluster: error creating cluster: error during gcloud container clusters create --accelerator=type=nvidia-tesla-p100,count=2 --project=k8s-jkns-e2e-gce-gpus --zone=us-west1-b --machine-type=n1-standard-2 --image-type=gci --num-nodes=3 --network=bootstrap-e2e --cluster-version=1.15.6-beta.0.16+670c7810991876 bootstrap-e2e: exit status 1 W1105 18:05:26.374] Traceback (most recent call last): W1105 18:05:26.375] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 778, in <module> W1105 18:05:26.375] main(parse_args()) W1105 18:05:26.376] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 626, in main W1105 18:05:26.376] mode.start(runner_args) W1105 18:05:26.376] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 262, in start W1105 18:05:26.377] check_env(env, self.command, *args) W1105 18:05:26.377] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 111, in check_env W1105 18:05:26.377] subprocess.check_call(cmd, env=env) W1105 18:05:26.378] File "/usr/lib/python2.7/subprocess.py", line 190, in check_call W1105 18:05:26.378] raise CalledProcessError(retcode, cmd) W1105 18:05:26.379] subprocess.CalledProcessError: Command '('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--up', '--down', '--test', '--deployment=gke', '--provider=gke', '--cluster=bootstrap-e2e', '--gcp-network=bootstrap-e2e', '--check-leaked-resources', '--extract=ci/k8s-stable2', '--gcp-cloud-sdk=gs://cloud-sdk-testing/ci/staging', '--gcp-node-image=gci', '--gcp-project-type=gpu-project', '--gcp-zone=us-west1-b', '--gke-create-command=container clusters create --accelerator=type=nvidia-tesla-p100,count=2', '--gke-environment=test', '--test_args=--ginkgo.focus=\\[Feature:GPUDevicePlugin\\] --minStartupPods=8', '--timeout=180m')' returned non-zero exit status 1 E1105 18:05:26.387] Command failed I1105 18:05:26.387] process 262 exited with code 1 after 3.8m E1105 18:05:26.387] FAIL: ci-kubernetes-e2e-gke-device-plugin-gpu-p100-stable2 I1105 18:05:26.388] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W1105 18:05:26.977] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com] I1105 18:05:27.063] process 1357 exited with code 0 after 0.0m I1105 18:05:27.063] Call: gcloud config get-value account I1105 18:05:27.438] process 1369 exited with code 0 after 0.0m I1105 18:05:27.439] Will upload results to gs://kubernetes-jenkins/logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com I1105 18:05:27.439] Upload result and artifacts... I1105 18:05:27.439] Gubernator results at https://gubernator.k8s.io/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gke-device-plugin-gpu-p100-stable2/1191777363164139522 I1105 18:05:27.439] Call: gsutil ls gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gke-device-plugin-gpu-p100-stable2/1191777363164139522/artifacts W1105 18:05:28.515] CommandException: One or more URLs matched no objects. E1105 18:05:28.691] Command failed I1105 18:05:28.692] process 1381 exited with code 1 after 0.0m W1105 18:05:28.692] Remote dir gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gke-device-plugin-gpu-p100-stable2/1191777363164139522/artifacts not exist yet I1105 18:05:28.693] Call: gsutil -m -q -o GSUtil:use_magicfile=True cp -r -c -z log,txt,xml /workspace/_artifacts gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gke-device-plugin-gpu-p100-stable2/1191777363164139522/artifacts I1105 18:05:30.639] process 1525 exited with code 0 after 0.0m I1105 18:05:30.640] Call: git rev-parse HEAD W1105 18:05:30.646] fatal: not a git repository (or any of the parent directories): .git E1105 18:05:30.648] Command failed I1105 18:05:30.649] process 2051 exited with code 128 after 0.0m I1105 18:05:30.649] Call: git rev-parse HEAD I1105 18:05:30.659] process 2052 exited with code 0 after 0.0m I1105 18:05:30.660] Call: gsutil stat gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gke-device-plugin-gpu-p100-stable2/jobResultsCache.json I1105 18:05:31.954] process 2053 exited with code 0 after 0.0m I1105 18:05:31.955] Call: gsutil -q cat 'gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gke-device-plugin-gpu-p100-stable2/jobResultsCache.json#1572933847193739' ... skipping 8 lines ...