This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 0 failed / 0 succeeded
Started2020-07-01 17:33
Elapsed1h11m
Revision131be234675035684c767e9cb766cee8d12071fe
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/b870759e-16ca-431b-913d-11a2de194bff/targets/test'}}
resultstorehttps://source.cloud.google.com/results/invocations/b870759e-16ca-431b-913d-11a2de194bff/targets/test

No Test Failures!


Error lines from build-log.txt

... skipping 977 lines ...
NAME               LOCATION    MASTER_VERSION  MASTER_IP       MACHINE_TYPE   NODE_VERSION    NUM_NODES  STATUS
e2e-131be23-25882  us-east1-b  1.14.10-gke.42  35.196.245.235  e2-standard-8  1.14.10-gke.42  2          RUNNING
++ gcloud container clusters get-credentials e2e-131be23-25882
Fetching cluster endpoint and auth data.
kubeconfig entry generated for e2e-131be23-25882.
++ kubectl delete namespace kubeflow --wait
Error from server (NotFound): namespaces "kubeflow" not found
++ echo 'No need to delete kubeflow namespace. It doesn'\''t exist.'
No need to delete kubeflow namespace. It doesn't exist.
++ kubectl create namespace kubeflow --dry-run -o yaml
++ kubectl apply -f -
W0701 18:11:46.303516    1809 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client.
namespace/kubeflow created
... skipping 518 lines ...
Step #1 - "verify":     title: Database password (Managed storage only)
Step #1 - "verify":     x-google-marketplace:
Step #1 - "verify":       type: MASKED_FIELD
Step #1 - "verify":     description: |-
Step #1 - "verify":       The database password to use when connecting to the Cloud SQL instance.
Step #1 - "verify":       If you leave this field empty, the deployment will try to connect to the instance without providing a password.
Step #1 - "verify":       This will fail if a password is required for the username you provided.
Step #1 - "verify":   managedstorage.databaseNamePrefix:
Step #1 - "verify":     type: string
Step #1 - "verify":     title: Database name prefix (Managed storage only)
Step #1 - "verify":     description: |-
Step #1 - "verify":       The prefix of the database name. Kubeflow Pipelines will create two databases,
Step #1 - "verify":       [prefix]_pipeline and [prefix]_metadata.
... skipping 590 lines ...
Step #1 - "verify": Using /opt/kubectl/1.14/kubectl (server=1.14)
Step #1 - "verify": Using /opt/kubectl/1.14/kubectl (server=1.14)
Step #1 - "verify": Using /opt/kubectl/1.14/kubectl (server=1.14)
Step #1 - "verify": Using /opt/kubectl/1.14/kubectl (server=1.14)
Step #1 - "verify": Using /opt/kubectl/1.14/kubectl (server=1.14)
Step #1 - "verify": Using /opt/kubectl/1.14/kubectl (server=1.14)
Step #1 - "verify": Elapsed 1s
Elapsed 5s
Elapsed 10s
Elapsed 14s
Elapsed 19s
Elapsed 23s
Elapsed 28s
Elapsed 32s
Elapsed 36s
Elapsed 41s
Elapsed 45s
Elapsed 50s
Elapsed 54s
Elapsed 59s
Elapsed 63s
Elapsed 68s
Elapsed 72s
Elapsed 76s
Elapsed 81s
Elapsed 85s
Elapsed 90s
Elapsed 94s
Elapsed 99s
Elapsed 103s
Elapsed 107s
Elapsed 112s
Elapsed 116s
Elapsed 121s
Elapsed 125s
Elapsed 130s
Elapsed 134s
Elapsed 138s
Elapsed 143s
Elapsed 147s
Elapsed 152s
Elapsed 156s
Elapsed 161s
Elapsed 165s
Elapsed 169s
Elapsed 174s
Elapsed 178s
Elapsed 183s
Elapsed 187s
Elapsed 192s
Elapsed 196s
Elapsed 200s
Elapsed 205s
Elapsed 209s
Elapsed 214s
Elapsed 218s
Elapsed 223s
Elapsed 227s
Elapsed 231s
Elapsed 236s
Elapsed 240s
Elapsed 245s
Elapsed 249s
Elapsed 254s
Elapsed 258s
Elapsed 263s
Elapsed 267s
Elapsed 271s
Elapsed 276s
Elapsed 280s
Elapsed 285s
Elapsed 289s
Elapsed 293s
Elapsed 298s
Elapsed 302s
Elapsed 307s
Elapsed 311s
Elapsed 316s
Elapsed 320s
Elapsed 324s
Elapsed 329s
Elapsed 333s
Elapsed 338s
Elapsed 342s
Elapsed 347s
Elapsed 351s
Elapsed 355s
Elapsed 360s
Elapsed 364s
Elapsed 369s
Elapsed 373s
Elapsed 378s
Elapsed 382s
Elapsed 387s
Elapsed 391s
Elapsed 395s
Elapsed 400s
Elapsed 404s
Elapsed 409s
Elapsed 413s
Elapsed 418s
Elapsed 422s
Elapsed 426s
Elapsed 431s
Elapsed 435s
Elapsed 440s
Elapsed 444s
Elapsed 448s
Elapsed 453s
Elapsed 457s
Elapsed 462s
Elapsed 466s
Elapsed 471s
Elapsed 475s
Elapsed 479s
Elapsed 484s
Elapsed 488s
Elapsed 493s
Elapsed 497s
Elapsed 502s
Elapsed 506s
Elapsed 510s
Elapsed 515s
Elapsed 519s
Elapsed 524s
Elapsed 528s
Elapsed 533s
Elapsed 537s
Elapsed 541s
Elapsed 546s
Elapsed 550s
Elapsed 555s
Elapsed 559s
Elapsed 564s
Elapsed 568s
Elapsed 572s
Elapsed 577s
Elapsed 581s
Elapsed 586s
Elapsed 590s
Elapsed 595s
Elapsed 599s
Elapsed 604s
Elapsed 608s
Elapsed 613s
Elapsed 617s
Elapsed 621s
Elapsed 626s
Elapsed 630s
Elapsed 635s
Elapsed 639s
Elapsed 644s
Elapsed 648s
Elapsed 653s
Elapsed 657s
Elapsed 661s
Elapsed 666s
Elapsed 670s
Elapsed 675s
Elapsed 679s
Elapsed 684s
Elapsed 688s
Elapsed 692s
Elapsed 697s
Elapsed 701s
Elapsed 706s
Elapsed 710s
Elapsed 715s
Elapsed 719s
Elapsed 723s
Elapsed 728s
Elapsed 732s
Elapsed 737s
Elapsed 741s
Elapsed 746s
Elapsed 750s
Elapsed 754s
Elapsed 759s
Elapsed 763s
Elapsed 768s
Elapsed 772s
Elapsed 777s
Elapsed 781s
Elapsed 786s
Elapsed 790s
Elapsed 794s
Elapsed 799s
Elapsed 803s
Elapsed 808s
Elapsed 812s
Elapsed 817s
Elapsed 821s
Elapsed 825s
Elapsed 830s
Elapsed 834s
Elapsed 839s
Elapsed 843s
Elapsed 848s
Elapsed 852s
Elapsed 856s
Elapsed 861s
Elapsed 865s
Elapsed 870s
Elapsed 874s
Elapsed 879s
Elapsed 883s
Elapsed 888s
Elapsed 892s
Elapsed 896s
Elapsed 901s
Elapsed 905s
Elapsed 910s
Elapsed 914s
Elapsed 919s
Elapsed 923s
Elapsed 927s
Elapsed 932s
Elapsed 936s
Elapsed 941s
Elapsed 945s
Elapsed 950s
Elapsed 954s
Elapsed 959s
Elapsed 963s
Elapsed 967s
Elapsed 972s
Elapsed 976s
Elapsed 981s
Elapsed 985s
Elapsed 990s
Elapsed 994s
Elapsed 998s
Elapsed 1003s
Elapsed 1007s
Elapsed 1012s
Elapsed 1016s
Elapsed 1021s
Elapsed 1025s
Elapsed 1030s
Elapsed 1034s
Elapsed 1038s
Elapsed 1043s
Elapsed 1047s
Elapsed 1052s
Elapsed 1056s
Elapsed 1061s
Elapsed 1065s
Elapsed 1069s
Elapsed 1074s
Elapsed 1078s
Elapsed 1083s
Elapsed 1087s
Elapsed 1092s
Elapsed 1096s
Elapsed 1100s
Elapsed 1105s
Elapsed 1109s
Elapsed 1114s
Elapsed 1118s
Elapsed 1123s
Elapsed 1127s
Elapsed 1131s
Elapsed 1136s
Elapsed 1140s
Elapsed 1145s
Elapsed 1149s
Elapsed 1154s
Elapsed 1158s
Elapsed 1163s
Elapsed 1167s
Elapsed 1171s
Elapsed 1176s
Elapsed 1180s
Elapsed 1185s
Elapsed 1189s
Elapsed 1194s
Elapsed 1198s
Elapsed 1203s
Elapsed 1207s
Elapsed 1212s
Elapsed 1216s
Elapsed 1220s
Elapsed 1225s
Elapsed 1229s
Elapsed 1234s
Elapsed 1238s
Elapsed 1243s
Elapsed 1247s
Elapsed 1252s
Elapsed 1256s
Elapsed 1260s
Elapsed 1265s
Elapsed 1269s
Elapsed 1274s
Elapsed 1278s
Elapsed 1283s
Elapsed 1287s
Elapsed 1291s
Elapsed 1296s
Elapsed 1300s
Elapsed 1305s
Elapsed 1309s
Elapsed 1314s
Elapsed 1318s
Elapsed 1323s
Elapsed 1327s
Elapsed 1332s
Elapsed 1336s
Elapsed 1340s
Elapsed 1345s
Elapsed 1349s
Elapsed 1354s
Elapsed 1358s
Elapsed 1363s
Elapsed 1367s
Elapsed 1371s
Elapsed 1376s
Elapsed 1380s
Elapsed 1385s
Elapsed 1389s
Elapsed 1394s
Elapsed 1398s
Elapsed 1403s
Elapsed 1407s
Elapsed 1412s
Elapsed 1416s
Elapsed 1420s
Elapsed 1425s
Elapsed 1429s
Elapsed 1434s
Elapsed 1438s
Elapsed 1443s
Elapsed 1447s
Elapsed 1452s
Elapsed 1456s
Elapsed 1460s
Elapsed 1465s
Elapsed 1469s
Elapsed 1474s
Elapsed 1478s
Elapsed 1483s
Elapsed 1487s
Elapsed 1491s
Elapsed 1496s
Elapsed 1500s
Elapsed 1505s
Elapsed 1509s
Elapsed 1514s
Elapsed 1518s
Elapsed 1523s
Elapsed 1527s
Elapsed 1531s
Elapsed 1536s
Elapsed 1540s
Elapsed 1545s
Elapsed 1549s
Elapsed 1554s
Elapsed 1558s
Elapsed 1563s
Elapsed 1567s
Elapsed 1571s
Elapsed 1576s
Elapsed 1580s
Elapsed 1585s
Elapsed 1589s
Elapsed 1594s
Elapsed 1598s
Elapsed 1602s
Elapsed 1607s
Elapsed 1611s
Elapsed 1616s
Elapsed 1620s
Elapsed 1625s
Elapsed 1629s
Elapsed 1634s
Elapsed 1638s
Elapsed 1642s
Elapsed 1647s
Elapsed 1651s
Elapsed 1656s
Elapsed 1660s
Elapsed 1665s
Elapsed 1669s
Elapsed 1673s
Elapsed 1678s
Elapsed 1682s
Elapsed 1687s
Elapsed 1691s
Elapsed 1696s
Elapsed 1700s
Elapsed 1705s
Elapsed 1709s
Elapsed 1713s
Elapsed 1718s
Elapsed 1722s
Elapsed 1727s
Elapsed 1731s
Elapsed 1736s
Elapsed 1740s
Elapsed 1744s
Elapsed 1749s
Elapsed 1753s
Elapsed 1758s
Elapsed 1762s
Elapsed 1767s
Elapsed 1771s
Elapsed 1775s
Elapsed 1780s
Elapsed 1784s
Elapsed 1789s
Elapsed 1793s
Elapsed 1798s
Elapsed 1802s
ERROR Deployer job timeout
Step #1 - "verify": INFO cleaning all resources.
Step #1 - "verify": INFO Collecting events for namespace "apptest-esgax77k"
Step #1 - "verify": Using /opt/kubectl/1.14/kubectl (server=1.14)
Step #1 - "verify": LAST SEEN   TYPE      REASON                   OBJECT                                                  MESSAGE
Step #1 - "verify": 30m         Normal    Scheduled                pod/apptest-esgax77k-deployer-qxjf8                     Successfully assigned apptest-esgax77k/apptest-esgax77k-deployer-qxjf8 to gke-hosted-verify-test-default-pool-53177527-rcfl
Step #1 - "verify": 30m         Normal    Pulling                  pod/apptest-esgax77k-deployer-qxjf8                     Pulling image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/deployer:1.0.0-dev.2"
Step #1 - "verify": 29m         Normal    Pulled                   pod/apptest-esgax77k-deployer-qxjf8                     Successfully pulled image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/deployer:1.0.0-dev.2"
Step #1 - "verify": 29m         Normal    Created                  pod/apptest-esgax77k-deployer-qxjf8                     Created container deployer
Step #1 - "verify": 29m         Normal    Started                  pod/apptest-esgax77k-deployer-qxjf8                     Started container deployer
Step #1 - "verify": 30m         Normal    SuccessfulCreate         job/apptest-esgax77k-deployer                           Created pod: apptest-esgax77k-deployer-qxjf8
Step #1 - "verify": 29m         Normal    Scheduled                pod/cache-deployer-deployment-794d45b985-gpdjn          Successfully assigned apptest-esgax77k/cache-deployer-deployment-794d45b985-gpdjn to gke-hosted-verify-test-default-pool-53177527-rcfl
Step #1 - "verify": 27m         Normal    Pulling                  pod/cache-deployer-deployment-794d45b985-gpdjn          Pulling image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/cachedeployer:0.5.1"
Step #1 - "verify": 27m         Warning   Failed                   pod/cache-deployer-deployment-794d45b985-gpdjn          Failed to pull image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/cachedeployer:0.5.1": rpc error: code = Unknown desc = Error response from daemon: manifest for gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/cachedeployer:0.5.1 not found
Step #1 - "verify": 27m         Warning   Failed                   pod/cache-deployer-deployment-794d45b985-gpdjn          Error: ErrImagePull
Step #1 - "verify": 4m17s       Normal    BackOff                  pod/cache-deployer-deployment-794d45b985-gpdjn          Back-off pulling image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/cachedeployer:0.5.1"
Step #1 - "verify": 9m15s       Warning   Failed                   pod/cache-deployer-deployment-794d45b985-gpdjn          Error: ImagePullBackOff
Step #1 - "verify": 29m         Normal    SuccessfulCreate         replicaset/cache-deployer-deployment-794d45b985         Created pod: cache-deployer-deployment-794d45b985-gpdjn
Step #1 - "verify": 29m         Normal    ScalingReplicaSet        deployment/cache-deployer-deployment                    Scaled up replica set cache-deployer-deployment-794d45b985 to 1
Step #1 - "verify": 29m         Normal    Scheduled                pod/cache-server-589bf448cf-fkc5f                       Successfully assigned apptest-esgax77k/cache-server-589bf448cf-fkc5f to gke-hosted-verify-test-default-pool-53177527-dkq2
Step #1 - "verify": 2m45s       Warning   FailedMount              pod/cache-server-589bf448cf-fkc5f                       MountVolume.SetUp failed for volume "webhook-tls-certs" : secret "webhook-server-tls" not found
Step #1 - "verify": 6m51s       Warning   FailedMount              pod/cache-server-589bf448cf-fkc5f                       Unable to mount volumes for pod "cache-server-589bf448cf-fkc5f_apptest-esgax77k(bacb57a3-bbc6-11ea-b70f-42010a800202)": timeout expired waiting for volumes to attach or mount for pod "apptest-esgax77k"/"cache-server-589bf448cf-fkc5f". list of unmounted volumes=[webhook-tls-certs]. list of unattached volumes=[webhook-tls-certs kubeflow-pipelines-cache-token-qthw7]
Step #1 - "verify": 29m         Normal    SuccessfulCreate         replicaset/cache-server-589bf448cf                      Created pod: cache-server-589bf448cf-fkc5f
Step #1 - "verify": 29m         Normal    ScalingReplicaSet        deployment/cache-server                                 Scaled up replica set cache-server-589bf448cf to 1
Step #1 - "verify": 29m         Normal    Scheduled                pod/metadata-envoy-8448c4dc75-sq28k                     Successfully assigned apptest-esgax77k/metadata-envoy-8448c4dc75-sq28k to gke-hosted-verify-test-default-pool-53177527-7rzm
Step #1 - "verify": 27m         Normal    Pulling                  pod/metadata-envoy-8448c4dc75-sq28k                     Pulling image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/metadataenvoy:0.5.1"
Step #1 - "verify": 27m         Warning   Failed                   pod/metadata-envoy-8448c4dc75-sq28k                     Failed to pull image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/metadataenvoy:0.5.1": rpc error: code = Unknown desc = Error response from daemon: manifest for gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/metadataenvoy:0.5.1 not found
Step #1 - "verify": 27m         Warning   Failed                   pod/metadata-envoy-8448c4dc75-sq28k                     Error: ErrImagePull
Step #1 - "verify": 27m         Normal    BackOff                  pod/metadata-envoy-8448c4dc75-sq28k                     Back-off pulling image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/metadataenvoy:0.5.1"
Step #1 - "verify": 4m13s       Warning   Failed                   pod/metadata-envoy-8448c4dc75-sq28k                     Error: ImagePullBackOff
Step #1 - "verify": 29m         Normal    SuccessfulCreate         replicaset/metadata-envoy-8448c4dc75                    Created pod: metadata-envoy-8448c4dc75-sq28k
Step #1 - "verify": 29m         Normal    ScalingReplicaSet        deployment/metadata-envoy                               Scaled up replica set metadata-envoy-8448c4dc75 to 1
Step #1 - "verify": 29m         Normal    Scheduled                pod/metadata-grpc-deployment-868bb87449-b2n9x           Successfully assigned apptest-esgax77k/metadata-grpc-deployment-868bb87449-b2n9x to gke-hosted-verify-test-default-pool-53177527-dkq2
Step #1 - "verify": 27m         Normal    Pulling                  pod/metadata-grpc-deployment-868bb87449-b2n9x           Pulling image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/metadataserver:0.5.1"
Step #1 - "verify": 27m         Warning   Failed                   pod/metadata-grpc-deployment-868bb87449-b2n9x           Failed to pull image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/metadataserver:0.5.1": rpc error: code = Unknown desc = Error response from daemon: manifest for gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/metadataserver:0.5.1 not found
Step #1 - "verify": 27m         Warning   Failed                   pod/metadata-grpc-deployment-868bb87449-b2n9x           Error: ErrImagePull
Step #1 - "verify": 9m13s       Normal    BackOff                  pod/metadata-grpc-deployment-868bb87449-b2n9x           Back-off pulling image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/metadataserver:0.5.1"
Step #1 - "verify": 4m11s       Warning   Failed                   pod/metadata-grpc-deployment-868bb87449-b2n9x           Error: ImagePullBackOff
Step #1 - "verify": 29m         Normal    SuccessfulCreate         replicaset/metadata-grpc-deployment-868bb87449          Created pod: metadata-grpc-deployment-868bb87449-b2n9x
Step #1 - "verify": 29m         Normal    ScalingReplicaSet        deployment/metadata-grpc-deployment                     Scaled up replica set metadata-grpc-deployment-868bb87449 to 1
Step #1 - "verify": 29m         Normal    Scheduled                pod/metadata-writer-669b8d6985-4tw6z                    Successfully assigned apptest-esgax77k/metadata-writer-669b8d6985-4tw6z to gke-hosted-verify-test-default-pool-53177527-rcfl
Step #1 - "verify": 27m         Normal    Pulling                  pod/metadata-writer-669b8d6985-4tw6z                    Pulling image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/metadatawriter:0.5.1"
Step #1 - "verify": 27m         Warning   Failed                   pod/metadata-writer-669b8d6985-4tw6z                    Failed to pull image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/metadatawriter:0.5.1": rpc error: code = Unknown desc = Error response from daemon: manifest for gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/metadatawriter:0.5.1 not found
Step #1 - "verify": 27m         Warning   Failed                   pod/metadata-writer-669b8d6985-4tw6z                    Error: ErrImagePull
Step #1 - "verify": 4m11s       Normal    BackOff                  pod/metadata-writer-669b8d6985-4tw6z                    Back-off pulling image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/metadatawriter:0.5.1"
Step #1 - "verify": 9m12s       Warning   Failed                   pod/metadata-writer-669b8d6985-4tw6z                    Error: ImagePullBackOff
Step #1 - "verify": 29m         Normal    SuccessfulCreate         replicaset/metadata-writer-669b8d6985                   Created pod: metadata-writer-669b8d6985-4tw6z
Step #1 - "verify": 29m         Normal    ScalingReplicaSet        deployment/metadata-writer                              Scaled up replica set metadata-writer-669b8d6985 to 1
Step #1 - "verify": 29m         Warning   FailedScheduling         pod/minio-59cdd69487-27ggc                              pod has unbound immediate PersistentVolumeClaims (repeated 3 times)
Step #1 - "verify": 29m         Normal    Scheduled                pod/minio-59cdd69487-27ggc                              Successfully assigned apptest-esgax77k/minio-59cdd69487-27ggc to gke-hosted-verify-test-default-pool-53177527-rcfl
Step #1 - "verify": 29m         Normal    SuccessfulAttachVolume   pod/minio-59cdd69487-27ggc                              AttachVolume.Attach succeeded for volume "pvc-bb7abc2e-bbc6-11ea-b70f-42010a800202"
Step #1 - "verify": 27m         Normal    Pulling                  pod/minio-59cdd69487-27ggc                              Pulling image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/minio:0.5.1"
Step #1 - "verify": 27m         Warning   Failed                   pod/minio-59cdd69487-27ggc                              Failed to pull image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/minio:0.5.1": rpc error: code = Unknown desc = Error response from daemon: manifest for gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/minio:0.5.1 not found
Step #1 - "verify": 27m         Warning   Failed                   pod/minio-59cdd69487-27ggc                              Error: ErrImagePull
Step #1 - "verify": 4m1s        Normal    BackOff                  pod/minio-59cdd69487-27ggc                              Back-off pulling image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/minio:0.5.1"
Step #1 - "verify": 8m53s       Warning   Failed                   pod/minio-59cdd69487-27ggc                              Error: ImagePullBackOff
Step #1 - "verify": 29m         Normal    SuccessfulCreate         replicaset/minio-59cdd69487                             Created pod: minio-59cdd69487-27ggc
Step #1 - "verify": 29m         Normal    ProvisioningSucceeded    persistentvolumeclaim/minio-pvc                         Successfully provisioned volume pvc-bb7abc2e-bbc6-11ea-b70f-42010a800202 using kubernetes.io/gce-pd
Step #1 - "verify": 29m         Normal    ScalingReplicaSet        deployment/minio                                        Scaled up replica set minio-59cdd69487 to 1
Step #1 - "verify": 29m         Normal    Scheduled                pod/ml-pipeline-66cd8fbf5-p7m4s                         Successfully assigned apptest-esgax77k/ml-pipeline-66cd8fbf5-p7m4s to gke-hosted-verify-test-default-pool-53177527-7rzm
Step #1 - "verify": 27m         Normal    Pulling                  pod/ml-pipeline-66cd8fbf5-p7m4s                         Pulling image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/apiserver:0.5.1"
Step #1 - "verify": 27m         Warning   Failed                   pod/ml-pipeline-66cd8fbf5-p7m4s                         Failed to pull image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/apiserver:0.5.1": rpc error: code = Unknown desc = Error response from daemon: manifest for gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/apiserver:0.5.1 not found
Step #1 - "verify": 27m         Warning   Failed                   pod/ml-pipeline-66cd8fbf5-p7m4s                         Error: ErrImagePull
Step #1 - "verify": 14m         Normal    BackOff                  pod/ml-pipeline-66cd8fbf5-p7m4s                         Back-off pulling image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/apiserver:0.5.1"
Step #1 - "verify": 4m6s        Warning   Failed                   pod/ml-pipeline-66cd8fbf5-p7m4s                         Error: ImagePullBackOff
Step #1 - "verify": 29m         Normal    SuccessfulCreate         replicaset/ml-pipeline-66cd8fbf5                        Created pod: ml-pipeline-66cd8fbf5-p7m4s
Step #1 - "verify": 29m         Normal    Scheduled                pod/ml-pipeline-persistenceagent-74794dbcc-g57t8        Successfully assigned apptest-esgax77k/ml-pipeline-persistenceagent-74794dbcc-g57t8 to gke-hosted-verify-test-default-pool-53177527-rcfl
Step #1 - "verify": 27m         Normal    Pulling                  pod/ml-pipeline-persistenceagent-74794dbcc-g57t8        Pulling image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/persistenceagent:0.5.1"
Step #1 - "verify": 27m         Warning   Failed                   pod/ml-pipeline-persistenceagent-74794dbcc-g57t8        Failed to pull image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/persistenceagent:0.5.1": rpc error: code = Unknown desc = Error response from daemon: manifest for gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/persistenceagent:0.5.1 not found
Step #1 - "verify": 27m         Warning   Failed                   pod/ml-pipeline-persistenceagent-74794dbcc-g57t8        Error: ErrImagePull
Step #1 - "verify": 27m         Normal    BackOff                  pod/ml-pipeline-persistenceagent-74794dbcc-g57t8        Back-off pulling image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/persistenceagent:0.5.1"
Step #1 - "verify": 4m11s       Warning   Failed                   pod/ml-pipeline-persistenceagent-74794dbcc-g57t8        Error: ImagePullBackOff
Step #1 - "verify": 29m         Normal    SuccessfulCreate         replicaset/ml-pipeline-persistenceagent-74794dbcc       Created pod: ml-pipeline-persistenceagent-74794dbcc-g57t8
Step #1 - "verify": 29m         Normal    ScalingReplicaSet        deployment/ml-pipeline-persistenceagent                 Scaled up replica set ml-pipeline-persistenceagent-74794dbcc to 1
Step #1 - "verify": 29m         Normal    Scheduled                pod/ml-pipeline-scheduledworkflow-755bdf7fdf-8flfd      Successfully assigned apptest-esgax77k/ml-pipeline-scheduledworkflow-755bdf7fdf-8flfd to gke-hosted-verify-test-default-pool-53177527-dkq2
Step #1 - "verify": 27m         Normal    Pulling                  pod/ml-pipeline-scheduledworkflow-755bdf7fdf-8flfd      Pulling image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/scheduledworkflow:0.5.1"
Step #1 - "verify": 27m         Warning   Failed                   pod/ml-pipeline-scheduledworkflow-755bdf7fdf-8flfd      Failed to pull image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/scheduledworkflow:0.5.1": rpc error: code = Unknown desc = Error response from daemon: manifest for gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/scheduledworkflow:0.5.1 not found
Step #1 - "verify": 27m         Warning   Failed                   pod/ml-pipeline-scheduledworkflow-755bdf7fdf-8flfd      Error: ErrImagePull
Step #1 - "verify": 24m         Normal    BackOff                  pod/ml-pipeline-scheduledworkflow-755bdf7fdf-8flfd      Back-off pulling image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/scheduledworkflow:0.5.1"
Step #1 - "verify": 4m3s        Warning   Failed                   pod/ml-pipeline-scheduledworkflow-755bdf7fdf-8flfd      Error: ImagePullBackOff
Step #1 - "verify": 29m         Normal    SuccessfulCreate         replicaset/ml-pipeline-scheduledworkflow-755bdf7fdf     Created pod: ml-pipeline-scheduledworkflow-755bdf7fdf-8flfd
Step #1 - "verify": 29m         Normal    ScalingReplicaSet        deployment/ml-pipeline-scheduledworkflow                Scaled up replica set ml-pipeline-scheduledworkflow-755bdf7fdf to 1
Step #1 - "verify": 29m         Normal    Scheduled                pod/ml-pipeline-ui-7d568678f9-6m5sk                     Successfully assigned apptest-esgax77k/ml-pipeline-ui-7d568678f9-6m5sk to gke-hosted-verify-test-default-pool-53177527-dkq2
Step #1 - "verify": 27m         Normal    Pulling                  pod/ml-pipeline-ui-7d568678f9-6m5sk                     Pulling image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/frontend:0.5.1"
Step #1 - "verify": 27m         Warning   Failed                   pod/ml-pipeline-ui-7d568678f9-6m5sk                     Failed to pull image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/frontend:0.5.1": rpc error: code = Unknown desc = Error response from daemon: manifest for gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/frontend:0.5.1 not found
Step #1 - "verify": 27m         Warning   Failed                   pod/ml-pipeline-ui-7d568678f9-6m5sk                     Error: ErrImagePull
Step #1 - "verify": 9m9s        Normal    BackOff                  pod/ml-pipeline-ui-7d568678f9-6m5sk                     Back-off pulling image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/frontend:0.5.1"
Step #1 - "verify": 4m13s       Warning   Failed                   pod/ml-pipeline-ui-7d568678f9-6m5sk                     Error: ImagePullBackOff
Step #1 - "verify": 29m         Normal    SuccessfulCreate         replicaset/ml-pipeline-ui-7d568678f9                    Created pod: ml-pipeline-ui-7d568678f9-6m5sk
Step #1 - "verify": 29m         Normal    ScalingReplicaSet        deployment/ml-pipeline-ui                               Scaled up replica set ml-pipeline-ui-7d568678f9 to 1
Step #1 - "verify": 29m         Normal    Scheduled                pod/ml-pipeline-viewer-crd-fd6cb7d9c-hsb2x              Successfully assigned apptest-esgax77k/ml-pipeline-viewer-crd-fd6cb7d9c-hsb2x to gke-hosted-verify-test-default-pool-53177527-rcfl
Step #1 - "verify": 27m         Normal    Pulling                  pod/ml-pipeline-viewer-crd-fd6cb7d9c-hsb2x              Pulling image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/viewercrd:0.5.1"
Step #1 - "verify": 27m         Warning   Failed                   pod/ml-pipeline-viewer-crd-fd6cb7d9c-hsb2x              Failed to pull image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/viewercrd:0.5.1": rpc error: code = Unknown desc = Error response from daemon: manifest for gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/viewercrd:0.5.1 not found
Step #1 - "verify": 27m         Warning   Failed                   pod/ml-pipeline-viewer-crd-fd6cb7d9c-hsb2x              Error: ErrImagePull
Step #1 - "verify": 14m         Normal    BackOff                  pod/ml-pipeline-viewer-crd-fd6cb7d9c-hsb2x              Back-off pulling image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/viewercrd:0.5.1"
Step #1 - "verify": 4m10s       Warning   Failed                   pod/ml-pipeline-viewer-crd-fd6cb7d9c-hsb2x              Error: ImagePullBackOff
Step #1 - "verify": 29m         Normal    SuccessfulCreate         replicaset/ml-pipeline-viewer-crd-fd6cb7d9c             Created pod: ml-pipeline-viewer-crd-fd6cb7d9c-hsb2x
Step #1 - "verify": 29m         Normal    ScalingReplicaSet        deployment/ml-pipeline-viewer-crd                       Scaled up replica set ml-pipeline-viewer-crd-fd6cb7d9c to 1
Step #1 - "verify": 29m         Normal    Scheduled                pod/ml-pipeline-visualizationserver-5ff985d597-552vj    Successfully assigned apptest-esgax77k/ml-pipeline-visualizationserver-5ff985d597-552vj to gke-hosted-verify-test-default-pool-53177527-dkq2
Step #1 - "verify": 27m         Normal    Pulling                  pod/ml-pipeline-visualizationserver-5ff985d597-552vj    Pulling image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/visualizationserver:0.5.1"
Step #1 - "verify": 27m         Warning   Failed                   pod/ml-pipeline-visualizationserver-5ff985d597-552vj    Failed to pull image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/visualizationserver:0.5.1": rpc error: code = Unknown desc = Error response from daemon: manifest for gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/visualizationserver:0.5.1 not found
Step #1 - "verify": 27m         Warning   Failed                   pod/ml-pipeline-visualizationserver-5ff985d597-552vj    Error: ErrImagePull
Step #1 - "verify": 27m         Normal    BackOff                  pod/ml-pipeline-visualizationserver-5ff985d597-552vj    Back-off pulling image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/visualizationserver:0.5.1"
Step #1 - "verify": 4m4s        Warning   Failed                   pod/ml-pipeline-visualizationserver-5ff985d597-552vj    Error: ImagePullBackOff
Step #1 - "verify": 29m         Normal    SuccessfulCreate         replicaset/ml-pipeline-visualizationserver-5ff985d597   Created pod: ml-pipeline-visualizationserver-5ff985d597-552vj
Step #1 - "verify": 29m         Normal    ScalingReplicaSet        deployment/ml-pipeline-visualizationserver              Scaled up replica set ml-pipeline-visualizationserver-5ff985d597 to 1
Step #1 - "verify": 29m         Normal    ScalingReplicaSet        deployment/ml-pipeline                                  Scaled up replica set ml-pipeline-66cd8fbf5 to 1
Step #1 - "verify": 29m         Warning   FailedScheduling         pod/mysql-7cd88b7dd4-mkw2n                              pod has unbound immediate PersistentVolumeClaims (repeated 3 times)
Step #1 - "verify": 29m         Normal    Scheduled                pod/mysql-7cd88b7dd4-mkw2n                              Successfully assigned apptest-esgax77k/mysql-7cd88b7dd4-mkw2n to gke-hosted-verify-test-default-pool-53177527-7rzm
Step #1 - "verify": 29m         Normal    SuccessfulAttachVolume   pod/mysql-7cd88b7dd4-mkw2n                              AttachVolume.Attach succeeded for volume "pvc-bb884367-bbc6-11ea-b70f-42010a800202"
Step #1 - "verify": 27m         Normal    Pulling                  pod/mysql-7cd88b7dd4-mkw2n                              Pulling image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/mysql:0.5.1"
Step #1 - "verify": 27m         Warning   Failed                   pod/mysql-7cd88b7dd4-mkw2n                              Failed to pull image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/mysql:0.5.1": rpc error: code = Unknown desc = Error response from daemon: manifest for gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/mysql:0.5.1 not found
Step #1 - "verify": 27m         Warning   Failed                   pod/mysql-7cd88b7dd4-mkw2n                              Error: ErrImagePull
Step #1 - "verify": 18m         Normal    BackOff                  pod/mysql-7cd88b7dd4-mkw2n                              Back-off pulling image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/mysql:0.5.1"
Step #1 - "verify": 3m51s       Warning   Failed                   pod/mysql-7cd88b7dd4-mkw2n                              Error: ImagePullBackOff
Step #1 - "verify": 29m         Normal    SuccessfulCreate         replicaset/mysql-7cd88b7dd4                             Created pod: mysql-7cd88b7dd4-mkw2n
Step #1 - "verify": 29m         Normal    ProvisioningSucceeded    persistentvolumeclaim/mysql-pv-claim                    Successfully provisioned volume pvc-bb884367-bbc6-11ea-b70f-42010a800202 using kubernetes.io/gce-pd
Step #1 - "verify": 29m         Normal    ScalingReplicaSet        deployment/mysql                                        Scaled up replica set mysql-7cd88b7dd4 to 1
Step #1 - "verify": 29m         Normal    Scheduled                pod/proxy-agent-6d65f46459-k5rjn                        Successfully assigned apptest-esgax77k/proxy-agent-6d65f46459-k5rjn to gke-hosted-verify-test-default-pool-53177527-rcfl
Step #1 - "verify": 27m         Normal    Pulling                  pod/proxy-agent-6d65f46459-k5rjn                        Pulling image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/proxyagent:0.5.1"
Step #1 - "verify": 27m         Warning   Failed                   pod/proxy-agent-6d65f46459-k5rjn                        Failed to pull image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/proxyagent:0.5.1": rpc error: code = Unknown desc = Error response from daemon: manifest for gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/proxyagent:0.5.1 not found
Step #1 - "verify": 27m         Warning   Failed                   pod/proxy-agent-6d65f46459-k5rjn                        Error: ErrImagePull
Step #1 - "verify": 14m         Normal    BackOff                  pod/proxy-agent-6d65f46459-k5rjn                        Back-off pulling image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/proxyagent:0.5.1"
Step #1 - "verify": 4m4s        Warning   Failed                   pod/proxy-agent-6d65f46459-k5rjn                        Error: ImagePullBackOff
Step #1 - "verify": 29m         Normal    SuccessfulCreate         replicaset/proxy-agent-6d65f46459                       Created pod: proxy-agent-6d65f46459-k5rjn
Step #1 - "verify": 29m         Normal    ScalingReplicaSet        deployment/proxy-agent                                  Scaled up replica set proxy-agent-6d65f46459 to 1
Step #1 - "verify": 29m         Normal    Scheduled                pod/workflow-controller-7547f68476-qgz26                Successfully assigned apptest-esgax77k/workflow-controller-7547f68476-qgz26 to gke-hosted-verify-test-default-pool-53177527-rcfl
Step #1 - "verify": 27m         Normal    Pulling                  pod/workflow-controller-7547f68476-qgz26                Pulling image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/argoworkflowcontroller:0.5.1"
Step #1 - "verify": 27m         Warning   Failed                   pod/workflow-controller-7547f68476-qgz26                Failed to pull image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/argoworkflowcontroller:0.5.1": rpc error: code = Unknown desc = Error response from daemon: manifest for gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/argoworkflowcontroller:0.5.1 not found
Step #1 - "verify": 27m         Warning   Failed                   pod/workflow-controller-7547f68476-qgz26                Error: ErrImagePull
Step #1 - "verify": 24m         Normal    BackOff                  pod/workflow-controller-7547f68476-qgz26                Back-off pulling image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/argoworkflowcontroller:0.5.1"
Step #1 - "verify": 4m11s       Warning   Failed                   pod/workflow-controller-7547f68476-qgz26                Error: ImagePullBackOff
Step #1 - "verify": 29m         Normal    SuccessfulCreate         replicaset/workflow-controller-7547f68476               Created pod: workflow-controller-7547f68476-qgz26
Step #1 - "verify": 29m         Normal    ScalingReplicaSet        deployment/workflow-controller                          Scaled up replica set workflow-controller-7547f68476 to 1
Step #1 - "verify": Using /opt/kubectl/1.14/kubectl (server=1.14)
Step #1 - "verify": INFO Collecting logs for deployer
Step #1 - "verify": Using /opt/kubectl/1.14/kubectl (server=1.14)
Step #1 - "verify":   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
Step #1 - "verify":                                  Dload  Upload   Total   Spent    Left  Speed
Step #1 - "verify": 
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100    16  100    16    0     0    242      0 --:--:-- --:--:-- --:--:--   250
Step #1 - "verify": Using /opt/kubectl/1.14/kubectl (server=1.14)
Step #1 - "verify": Error from server (NotFound): configmaps "gcp-default-config" not found
Step #1 - "verify": Using /opt/kubectl/1.14/kubectl (server=1.14)
Step #1 - "verify": configmap/gcp-default-config created
Step #1 - "verify": init_action done
Step #1 - "verify": + trap handle_failure EXIT
Step #1 - "verify": + LOG_SMOKE_TEST=SMOKE_TEST
Step #1 - "verify": + test_schema=/data-test/schema.yaml
... skipping 326 lines ...
Step #1 - "verify": + patch_assembly_phase.sh --status=Success
Step #1 - "verify": + for i in "$@"
Step #1 - "verify": + case $i in
Step #1 - "verify": + status=Success
Step #1 - "verify": + shift
Step #1 - "verify": + [[ -z Success ]]
Step #1 - "verify": + [[ Success =~ ^(Pending|Success|Failed)$ ]]
Step #1 - "verify": + [[ -z apptest-esgax77k ]]
Step #1 - "verify": + [[ -z apptest-esgax77k ]]
Step #1 - "verify": + echo 'Marking deployment of application "apptest-esgax77k" as "Success".'
Step #1 - "verify": + [[ Success == \S\u\c\c\e\s\s ]]
Step #1 - "verify": Marking deployment of application "apptest-esgax77k" as "Success".
Step #1 - "verify": ++ print_published_version.py --empty_if_not_supported
... skipping 5467 lines ...
Step #1 - "verify": kind: List
Step #1 - "verify": metadata:
Step #1 - "verify":   resourceVersion: ""
Step #1 - "verify":   selfLink: ""
Step #1 - "verify": Using /opt/kubectl/1.14/kubectl (server=1.14)
Step #1 - "verify": namespace "apptest-esgax77k" deleted
Step #1 - "verify": === ERROR SUMMARY ===
Step #1 - "verify": ERROR Deployer job timeout
Step #1 - "verify": 
Step #1 - "verify": Error events found in namespace "apptest-esgax77k"
Step #1 - "verify": LAST SEEN   TYPE      REASON             OBJECT                                                 MESSAGE
Step #1 - "verify": 27m         Warning   Failed             pod/cache-deployer-deployment-794d45b985-gpdjn         Failed to pull image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/cachedeployer:0.5.1": rpc error: code = Unknown desc = Error response from daemon: manifest for gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/cachedeployer:0.5.1 not found
Step #1 - "verify": 27m         Warning   Failed             pod/cache-deployer-deployment-794d45b985-gpdjn         Error: ErrImagePull
Step #1 - "verify": 9m16s       Warning   Failed             pod/cache-deployer-deployment-794d45b985-gpdjn         Error: ImagePullBackOff
Step #1 - "verify": 2m46s       Warning   FailedMount        pod/cache-server-589bf448cf-fkc5f                      MountVolume.SetUp failed for volume "webhook-tls-certs" : secret "webhook-server-tls" not found
Step #1 - "verify": 6m52s       Warning   FailedMount        pod/cache-server-589bf448cf-fkc5f                      Unable to mount volumes for pod "cache-server-589bf448cf-fkc5f_apptest-esgax77k(bacb57a3-bbc6-11ea-b70f-42010a800202)": timeout expired waiting for volumes to attach or mount for pod "apptest-esgax77k"/"cache-server-589bf448cf-fkc5f". list of unmounted volumes=[webhook-tls-certs]. list of unattached volumes=[webhook-tls-certs kubeflow-pipelines-cache-token-qthw7]
Step #1 - "verify": 27m         Warning   Failed             pod/metadata-envoy-8448c4dc75-sq28k                    Failed to pull image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/metadataenvoy:0.5.1": rpc error: code = Unknown desc = Error response from daemon: manifest for gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/metadataenvoy:0.5.1 not found
Step #1 - "verify": 27m         Warning   Failed             pod/metadata-envoy-8448c4dc75-sq28k                    Error: ErrImagePull
Step #1 - "verify": 4m14s       Warning   Failed             pod/metadata-envoy-8448c4dc75-sq28k                    Error: ImagePullBackOff
Step #1 - "verify": 27m         Warning   Failed             pod/metadata-grpc-deployment-868bb87449-b2n9x          Failed to pull image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/metadataserver:0.5.1": rpc error: code = Unknown desc = Error response from daemon: manifest for gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/metadataserver:0.5.1 not found
Step #1 - "verify": 27m         Warning   Failed             pod/metadata-grpc-deployment-868bb87449-b2n9x          Error: ErrImagePull
Step #1 - "verify": 4m12s       Warning   Failed             pod/metadata-grpc-deployment-868bb87449-b2n9x          Error: ImagePullBackOff
Step #1 - "verify": 27m         Warning   Failed             pod/metadata-writer-669b8d6985-4tw6z                   Failed to pull image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/metadatawriter:0.5.1": rpc error: code = Unknown desc = Error response from daemon: manifest for gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/metadatawriter:0.5.1 not found
Step #1 - "verify": 27m         Warning   Failed             pod/metadata-writer-669b8d6985-4tw6z                   Error: ErrImagePull
Step #1 - "verify": 9m13s       Warning   Failed             pod/metadata-writer-669b8d6985-4tw6z                   Error: ImagePullBackOff
Step #1 - "verify": 29m         Warning   FailedScheduling   pod/minio-59cdd69487-27ggc                             pod has unbound immediate PersistentVolumeClaims (repeated 3 times)
Step #1 - "verify": 27m         Warning   Failed             pod/minio-59cdd69487-27ggc                             Failed to pull image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/minio:0.5.1": rpc error: code = Unknown desc = Error response from daemon: manifest for gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/minio:0.5.1 not found
Step #1 - "verify": 27m         Warning   Failed             pod/minio-59cdd69487-27ggc                             Error: ErrImagePull
Step #1 - "verify": 8m54s       Warning   Failed             pod/minio-59cdd69487-27ggc                             Error: ImagePullBackOff
Step #1 - "verify": 27m         Warning   Failed             pod/ml-pipeline-66cd8fbf5-p7m4s                        Failed to pull image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/apiserver:0.5.1": rpc error: code = Unknown desc = Error response from daemon: manifest for gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/apiserver:0.5.1 not found
Step #1 - "verify": 27m         Warning   Failed             pod/ml-pipeline-66cd8fbf5-p7m4s                        Error: ErrImagePull
Step #1 - "verify": 4m7s        Warning   Failed             pod/ml-pipeline-66cd8fbf5-p7m4s                        Error: ImagePullBackOff
Step #1 - "verify": 27m         Warning   Failed             pod/ml-pipeline-persistenceagent-74794dbcc-g57t8       Failed to pull image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/persistenceagent:0.5.1": rpc error: code = Unknown desc = Error response from daemon: manifest for gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/persistenceagent:0.5.1 not found
Step #1 - "verify": 27m         Warning   Failed             pod/ml-pipeline-persistenceagent-74794dbcc-g57t8       Error: ErrImagePull
Step #1 - "verify": 4m12s       Warning   Failed             pod/ml-pipeline-persistenceagent-74794dbcc-g57t8       Error: ImagePullBackOff
Step #1 - "verify": 27m         Warning   Failed             pod/ml-pipeline-scheduledworkflow-755bdf7fdf-8flfd     Failed to pull image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/scheduledworkflow:0.5.1": rpc error: code = Unknown desc = Error response from daemon: manifest for gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/scheduledworkflow:0.5.1 not found
Step #1 - "verify": 27m         Warning   Failed             pod/ml-pipeline-scheduledworkflow-755bdf7fdf-8flfd     Error: ErrImagePull
Step #1 - "verify": 4m4s        Warning   Failed             pod/ml-pipeline-scheduledworkflow-755bdf7fdf-8flfd     Error: ImagePullBackOff
Step #1 - "verify": 27m         Warning   Failed             pod/ml-pipeline-ui-7d568678f9-6m5sk                    Failed to pull image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/frontend:0.5.1": rpc error: code = Unknown desc = Error response from daemon: manifest for gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/frontend:0.5.1 not found
Step #1 - "verify": 27m         Warning   Failed             pod/ml-pipeline-ui-7d568678f9-6m5sk                    Error: ErrImagePull
Step #1 - "verify": 4m14s       Warning   Failed             pod/ml-pipeline-ui-7d568678f9-6m5sk                    Error: ImagePullBackOff
Step #1 - "verify": 27m         Warning   Failed             pod/ml-pipeline-viewer-crd-fd6cb7d9c-hsb2x             Failed to pull image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/viewercrd:0.5.1": rpc error: code = Unknown desc = Error response from daemon: manifest for gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/viewercrd:0.5.1 not found
Step #1 - "verify": 27m         Warning   Failed             pod/ml-pipeline-viewer-crd-fd6cb7d9c-hsb2x             Error: ErrImagePull
Step #1 - "verify": 4m11s       Warning   Failed             pod/ml-pipeline-viewer-crd-fd6cb7d9c-hsb2x             Error: ImagePullBackOff
Step #1 - "verify": 27m         Warning   Failed             pod/ml-pipeline-visualizationserver-5ff985d597-552vj   Failed to pull image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/visualizationserver:0.5.1": rpc error: code = Unknown desc = Error response from daemon: manifest for gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/visualizationserver:0.5.1 not found
Step #1 - "verify": 27m         Warning   Failed             pod/ml-pipeline-visualizationserver-5ff985d597-552vj   Error: ErrImagePull
Step #1 - "verify": 4m5s        Warning   Failed             pod/ml-pipeline-visualizationserver-5ff985d597-552vj   Error: ImagePullBackOff
Step #1 - "verify": 29m         Warning   FailedScheduling   pod/mysql-7cd88b7dd4-mkw2n                             pod has unbound immediate PersistentVolumeClaims (repeated 3 times)
Step #1 - "verify": 27m         Warning   Failed             pod/mysql-7cd88b7dd4-mkw2n                             Failed to pull image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/mysql:0.5.1": rpc error: code = Unknown desc = Error response from daemon: manifest for gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/mysql:0.5.1 not found
Step #1 - "verify": 27m         Warning   Failed             pod/mysql-7cd88b7dd4-mkw2n                             Error: ErrImagePull
Step #1 - "verify": 3m52s       Warning   Failed             pod/mysql-7cd88b7dd4-mkw2n                             Error: ImagePullBackOff
Step #1 ERROR: (gcloud.builds.submit) build 8d91c1f7-ec94-4083-9524-85be0e603404 completed with status "FAILURE"
- "verify": 27m         Warning   Failed             pod/proxy-agent-6d65f46459-k5rjn                       Failed to pull image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/proxyagent:0.5.1": rpc error: code = Unknown desc = Error response from daemon: manifest for gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/proxyagent:0.5.1 not found
Step #1 - "verify": 27m         Warning   Failed             pod/proxy-agent-6d65f46459-k5rjn                       Error: ErrImagePull
Step #1 - "verify": 4m5s        Warning   Failed             pod/proxy-agent-6d65f46459-k5rjn                       Error: ImagePullBackOff
Step #1 - "verify": 27m         Warning   Failed             pod/workflow-controller-7547f68476-qgz26               Failed to pull image "gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/argoworkflowcontroller:0.5.1": rpc error: code = Unknown desc = Error response from daemon: manifest for gcr.io/ml-pipeline-test/hosted/131be234675035684c767e9cb766cee8d12071fe/argoworkflowcontroller:0.5.1 not found
Step #1 - "verify": 27m         Warning   Failed             pod/workflow-controller-7547f68476-qgz26               Error: ErrImagePull
Step #1 - "verify": 4m12s       Warning   Failed             pod/workflow-controller-7547f68476-qgz26               Error: ImagePullBackOff
Step #1 - "verify": =====================
Step #1 - "verify": 
Step #1 - "verify": === VERIFICATION STATUS ===
Step #1 - "verify": FAILED
Step #1 - "verify": ===========================
Finished Step #1 - "verify"
ERROR
ERROR: build step 1 "gcr.io/cloud-marketplace-tools/k8s/dev:latest" failed: step exited with non-zero status: 1
--------------------------------------------------------------------------------

+ clean_up
+ set +e
+ set +x
Status of pods before clean up:
... skipping 19 lines ...