This job view page is being replaced by Spyglass soon. Check out the new job view.
PRhongye-sun: upgrade backend image versions
ResultFAILURE
Tests 0 failed / 0 succeeded
Started2019-08-22 19:05
Elapsed25m44s
Revision2c7deec262e4dfb31c5160c5425743993d2eb0f1
Refs 1918

No Test Failures!


Error lines from build-log.txt

... skipping 78 lines ...
NAME               LOCATION    MASTER_VERSION  MASTER_IP       MACHINE_TYPE   NODE_VERSION   NUM_NODES  STATUS
e2e-2c7deec-25740  us-east1-b  1.12.8-gke.10   35.196.248.115  n1-standard-8  1.12.8-gke.10  2          RUNNING
++ gcloud container clusters get-credentials e2e-2c7deec-25740
Fetching cluster endpoint and auth data.
kubeconfig entry generated for e2e-2c7deec-25740.
++ kubectl delete namespace kubeflow --wait
Error from server (NotFound): namespaces "kubeflow" not found
++ echo 'No need to delete kubeflow namespace. It doesn'\''t exist.'
No need to delete kubeflow namespace. It doesn't exist.
++ kubectl create namespace kubeflow --dry-run -o yaml
++ kubectl apply -f -
namespace/kubeflow created
++ '[' -z ']'
... skipping 78 lines ...
++ echo 'build docker images workflow submitted successfully'
build docker images workflow submitted successfully
++ source /home/prow/go/src/github.com/kubeflow/pipelines/test/check-argo-status.sh
+++ set -ex
+++ ARTIFACT_DIR=/workspace/_artifacts
+++ WORKFLOW_COMPLETE_KEYWORD=completed=true
+++ WORKFLOW_FAILED_KEYWORD=phase=Failed
++++ expr 1800 / 20
+++ PULL_ARGO_WORKFLOW_STATUS_MAX_ATTEMPT=90
+++ echo 'check status of argo workflow build-images-8lsxm....'
check status of argo workflow build-images-8lsxm....
++++ seq 1 90
+++ for i in $(seq 1 ${PULL_ARGO_WORKFLOW_STATUS_MAX_ATTEMPT})
... skipping 1242 lines ...
+ echo 'test workflow submitted successfully'
test workflow submitted successfully
+ source /home/prow/go/src/github.com/kubeflow/pipelines/test/check-argo-status.sh
++ set -ex
++ ARTIFACT_DIR=/workspace/_artifacts
++ WORKFLOW_COMPLETE_KEYWORD=completed=true
++ WORKFLOW_FAILED_KEYWORD=phase=Failed
+++ expr 1800 / 20
++ PULL_ARGO_WORKFLOW_STATUS_MAX_ATTEMPT=90
++ echo 'check status of argo workflow integration-test-4fhf9....'
check status of argo workflow integration-test-4fhf9....
+++ seq 1 90
++ for i in $(seq 1 ${PULL_ARGO_WORKFLOW_STATUS_MAX_ATTEMPT})
... skipping 276 lines ...
integration-test-4fhf9   6m    workflows.argoproj.io/phase=Running
Sleep for 20 seconds...
++ sleep 20
++ for i in $(seq 1 ${PULL_ARGO_WORKFLOW_STATUS_MAX_ATTEMPT})
+++ kubectl get workflow integration-test-4fhf9 -n kubeflow --show-labels
++ WORKFLOW_STATUS='NAME                     AGE   LABELS
integration-test-4fhf9   6m    workflows.argoproj.io/completed=true,workflows.argoproj.io/phase=Failed'
++ grep completed=true
++ echo NAME AGE LABELS integration-test-4fhf9 6m workflows.argoproj.io/completed=true,workflows.argoproj.io/phase=Failed
NAME AGE LABELS integration-test-4fhf9 6m workflows.argoproj.io/completed=true,workflows.argoproj.io/phase=Failed
++ s=0
++ break
++ [[ 0 != 0 ]]
++ echo 'Argo workflow finished.'
Argo workflow finished.
++ [[ ! -z e2e_test ]]
... skipping 2 lines ...
++ mkdir -p /workspace/_artifacts
++ gsutil cp -r 'gs://ml-pipeline-test/2c7deec262e4dfb31c5160c5425743993d2eb0f1/e2e_test/*' /workspace/_artifacts
Copying gs://ml-pipeline-test/2c7deec262e4dfb31c5160c5425743993d2eb0f1/e2e_test/source_code_af456bcc61f00fad4cb44bca09a088551040d243_2019-08-22_12-05-11_PDT.tar.gz...
/ [0 files][    0.0 B/ 22.6 MiB]                                                
-
- [1 files][ 22.6 MiB/ 22.6 MiB]                                                
Operation completed over 1 objects/22.6 MiB.                                     
++ [[ NAME                     AGE   LABELS
integration-test-4fhf9   6m    workflows.argoproj.io/completed=true,workflows.argoproj.io/phase=Failed = *\p\h\a\s\e\=\F\a\i\l\e\d* ]]
++ echo 'Test workflow failed.'
Test workflow failed.
++ echo '=========Argo Workflow Logs========='
=========Argo Workflow Logs=========
++ argo logs -w integration-test-4fhf9 -n kubeflow
build-api-integration-test-image:	+ DOCKER_FILE=Dockerfile
build-api-integration-test-image:	+ '[' --image-build-context-gcs-uri '!=' '' ']'
build-api-integration-test-image:	+ case $1 in
... skipping 2380 lines ...
run-initialization-tests:	go: downloading github.com/PuerkitoBio/urlesc v0.0.0-20170810143723-de5bf2ad4578
run-initialization-tests:	go: downloading github.com/json-iterator/go v0.0.0-20180701071628-ab8a2e0c74be
run-initialization-tests:	go: downloading github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd
run-initialization-tests:	go: downloading github.com/modern-go/reflect2 v0.0.0-20180701023420-4b7aa43c6742
run-initialization-tests:	=== RUN   TestInitialization
run-initialization-tests:	=== RUN   TestInitialization/TestInitialization
run-initialization-tests:	panic: runtime error: index out of range [recovered]
run-initialization-tests:		panic: runtime error: index out of range
run-initialization-tests:	goroutine 50 [running]:
run-initialization-tests:	testing.tRunner.func1(0xc000094300)
run-initialization-tests:		/usr/local/go/src/testing/testing.go:792 +0x387
run-initialization-tests:	panic(0x12837c0, 0x209aca0)
run-initialization-tests:		/usr/local/go/src/runtime/panic.go:513 +0x1b9
run-initialization-tests:	github.com/kubeflow/pipelines/backend/test/initialization.(*InitializationTest).TestInitialization(0xc000230900)
... skipping 5 lines ...
run-initialization-tests:	github.com/stretchr/testify/suite.Run.func2(0xc000094300)
run-initialization-tests:		/go/pkg/mod/github.com/stretchr/testify@v1.2.2/suite/suite.go:102 +0x2b7
run-initialization-tests:	testing.tRunner(0xc000094300, 0xc000483300)
run-initialization-tests:		/usr/local/go/src/testing/testing.go:827 +0xbf
run-initialization-tests:	created by testing.(*T).Run
run-initialization-tests:		/usr/local/go/src/testing/testing.go:878 +0x35c
run-initialization-tests:	FAIL	github.com/kubeflow/pipelines/backend/test/initialization	32.073s'
++ echo ====================================
====================================
++ argo get integration-test-4fhf9 -n kubeflow
Name:                integration-test-4fhf9
Namespace:           kubeflow
ServiceAccount:      test-runner
Status:              Failed
Message:             child 'integration-test-4fhf9-2532368089' failed
Created:             Thu Aug 22 19:24:00 +0000 (6 minutes ago)
Started:             Thu Aug 22 19:24:08 +0000 (6 minutes ago)
Finished:            Thu Aug 22 19:30:34 +0000 (15 seconds ago)
Duration:            6 minutes 26 seconds
Parameters:          
  image-build-context-gcs-uri: gs://ml-pipeline-test/2c7deec262e4dfb31c5160c5425743993d2eb0f1/e2e_test/source_code_af456bcc61f00fad4cb44bca09a088551040d243_2019-08-22_12-05-11_PDT.tar.gz
... skipping 5 lines ...
  api-integration-test-image-suffix: api_integration_test
  frontend-integration-tests-image-suffix: frontend-integration-tests
  basic-e2e-tests-image-suffix: basic-e2e-tests
  namespace:         kubeflow

STEP                                           PODNAME                            DURATION  MESSAGE
 โœ– integration-test-4fhf9                                                                   child 'integration-test-4fhf9-2532368089' failed
 โ”œ-ยท-โœ” build-api-integration-test-image        integration-test-4fhf9-2300141315  2m        
 | โ”œ-โœ” build-frontend-integration-tests-image  integration-test-4fhf9-3655141030  1m        
 | โ”œ-โœ” build-initialization-test-image         integration-test-4fhf9-1245890416  2m        
 | โ””-โœ” build-basic-e2e-tests-image             integration-test-4fhf9-1351851826  3m        
 โ””---โœ– run-initialization-tests                integration-test-4fhf9-2532368089  2m        failed with exit code 1
++ exit 1
[test-timing] It took 6m48.867s.
+ clean_up
+ set +e
+ echo 'Status of pods before clean up:'
Status of pods before clean up:
... skipping 17 lines ...
kubeflow      build-images-8lsxm-3760405372                                 0/3     Completed          0          20m
kubeflow      build-images-8lsxm-4129345982                                 0/3     Completed          0          20m
kubeflow      build-images-8lsxm-683167820                                  0/3     Completed          0          20m
kubeflow      integration-test-4fhf9-1245890416                             0/3     Completed          0          6m41s
kubeflow      integration-test-4fhf9-1351851826                             0/3     Completed          0          6m41s
kubeflow      integration-test-4fhf9-2300141315                             0/3     Completed          0          6m41s
kubeflow      integration-test-4fhf9-2532368089                             0/2     Error              0          2m41s
kubeflow      integration-test-4fhf9-3655141030                             0/3     Completed          0          6m41s
kubeflow      minio-5b47456cbf-jzkdp                                        1/1     Running            0          6m51s
kubeflow      ml-pipeline-7cdf996695-m78nq                                  1/1     Running            0          6m51s
kubeflow      ml-pipeline-persistenceagent-6c77b57fbd-drp6f                 1/1     Running            0          6m51s
kubeflow      ml-pipeline-scheduledworkflow-58869bbdbd-547fp                1/1     Running            0          6m51s
kubeflow      ml-pipeline-ui-7dff674bc7-gm9w9                               1/1     Running            0          6m50s
... skipping 11 lines ...