This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 3 failed / 10 succeeded
Started2019-04-26 08:02
Elapsed12h46m
Revision
Buildergke-prow-containerd-pool-99179761-vgkl
pod83ac10db-67f9-11e9-9018-0a580a6c084c
infra-commitc7710404c
job-versionv1.15.0-alpha.1.409+1c5eed4233d694
pod83ac10db-67f9-11e9-9018-0a580a6c084c
repok8s.io/kubernetes
repo-commit47c03403b85d3fcda338202d2a2afab06ba49226
repos{u'k8s.io/kubernetes': u'master', u'k8s.io/perf-tests': u'master'}
revisionv1.15.0-alpha.1.409+1c5eed4233d694

Test Failures


ClusterLoaderV2 11h37m

error during /go/src/k8s.io/perf-tests/run-e2e.sh cluster-loader2 --nodes=5000 --provider=gce --report-dir=/workspace/_artifacts --testconfig=testing/density/config.yaml --testconfig=testing/load/config.yaml --testoverrides=./testing/density/5000_nodes/override.yaml --enable-prometheus-server=false: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


ClusterLoaderV2 testing/density/config.yaml 1h55m

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=ClusterLoaderV2\stesting\/density\/config\.yaml$'
:0
[measurement call PodStartupLatency - PodStartupLatency error: pod startup: too high latency 50th percentile: 6.97197603s
measurement call APIResponsiveness - APIResponsiveness error: top latency metric: there should be no high-latency requests, but: [got: {Resource:pods Subresource: Verb:LIST Scope:cluster Latency:{Perc50:3.303506s Perc90:10.323622s Perc99:15.095571s} Count:4449}; expected perc99 <= 10s got: {Resource:leases Subresource: Verb:GET Scope:namespace Latency:{Perc50:6.853ms Perc90:617.546ms Perc99:2.597131s} Count:3346895}; expected perc99 <= 1s got: {Resource:replicationcontrollers Subresource: Verb:POST Scope:namespace Latency:{Perc50:17.254ms Perc90:817.52ms Perc99:1.832142s} Count:5050}; expected perc99 <= 1s got: {Resource:pods Subresource:binding Verb:POST Scope:namespace Latency:{Perc50:63.399ms Perc90:590.724ms Perc99:1.826289s} Count:155001}; expected perc99 <= 1s got: {Resource:clusterrolebindings Subresource: Verb:POST Scope:cluster Latency:{Perc50:3.58ms Perc90:519.809ms Perc99:1.567012s} Count:114}; expected perc99 <= 1s got: {Resource:leases Subresource: Verb:PUT Scope:namespace Latency:{Perc50:6.021ms Perc90:187.251ms Perc99:1.521529s} Count:3324026}; expected perc99 <= 1s got: {Resource:pods Subresource: Verb:POST Scope:namespace Latency:{Perc50:56.675ms Perc90:542.983ms Perc99:1.515741s} Count:155021}; expected perc99 <= 1s got: {Resource:deployments Subresource:scale Verb:GET Scope:namespace Latency:{Perc50:1.924ms Perc90:14.802ms Perc99:1.432703s} Count:688}; expected perc99 <= 1s got: {Resource:nodes Subresource:status Verb:PATCH Scope:cluster Latency:{Perc50:3.559ms Perc90:333.24ms Perc99:1.394735s} Count:1147293}; expected perc99 <= 1s got: {Resource:namespaces Subresource: Verb:GET Scope:cluster Latency:{Perc50:1.763ms Perc90:342.188ms Perc99:1.236469s} Count:1029}; expected perc99 <= 1s got: {Resource:configmaps Subresource: Verb:GET Scope:namespace Latency:{Perc50:2.451ms Perc90:225.796ms Perc99:1.213297s} Count:6774}; expected perc99 <= 1s got: {Resource:replicationcontrollers Subresource: Verb:GET Scope:namespace Latency:{Perc50:3.266ms Perc90:15.213ms Perc99:1.174032s} Count:154}; expected perc99 <= 1s got: {Resource:configmaps Subresource: Verb:PUT Scope:namespace Latency:{Perc50:2.093ms Perc90:20.802ms Perc99:1.167786s} Count:3195}; expected perc99 <= 1s got: {Resource:endpoints Subresource: Verb:GET Scope:namespace Latency:{Perc50:1.956ms Perc90:224.308ms Perc99:1.143944s} Count:7189}; expected perc99 <= 1s got: {Resource:replicationcontrollers Subresource:status Verb:PUT Scope:namespace Latency:{Perc50:3.032ms Perc90:25.262ms Perc99:1.143106s} Count:17250}; expected perc99 <= 1s got: {Resource:pods Subresource: Verb:GET Scope:namespace Latency:{Perc50:2.038ms Perc90:105.405ms Perc99:1.13012s} Count:1175369}; expected perc99 <= 1s got: {Resource:scalingpolicies Subresource: Verb:GET Scope:namespace Latency:{Perc50:2.3ms Perc90:240.372ms Perc99:1.121695s} Count:113}; expected perc99 <= 1s got: {Resource:services Subresource: Verb:GET Scope:namespace Latency:{Perc50:1.477ms Perc90:9.288ms Perc99:1.05304s} Count:1329}; expected perc99 <= 1s got: {Resource:endpoints Subresource: Verb:PUT Scope:namespace Latency:{Perc50:2.096ms Perc90:18.81ms Perc99:1.036851s} Count:6403}; expected perc99 <= 1s]]
:0
				from junit.xml

Find startup mentions in log files | View test history on testgrid


ClusterLoaderV2 testing/load/config.yaml 9h41m

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=ClusterLoaderV2\stesting\/load\/config\.yaml$'
:0
[measurement call APIResponsiveness - APIResponsiveness error: top latency metric: there should be no high-latency requests, but: [got: {Resource:pods Subresource: Verb:LIST Scope:cluster Latency:{Perc50:7.149802s Perc90:10.784493s Perc99:16.355052s} Count:5137}; expected perc99 <= 10s got: {Resource:leases Subresource: Verb:GET Scope:namespace Latency:{Perc50:5.928ms Perc90:459.992ms Perc99:2.251039s} Count:16994858}; expected perc99 <= 1s got: {Resource:replicationcontrollers Subresource: Verb:DELETE Scope:namespace Latency:{Perc50:4.677ms Perc90:332.124ms Perc99:1.947622s} Count:16400}; expected perc99 <= 1s got: {Resource:clusterrolebindings Subresource: Verb:POST Scope:cluster Latency:{Perc50:3.556ms Perc90:341.812ms Perc99:1.783197s} Count:581}; expected perc99 <= 1s got: {Resource:pods Subresource: Verb:DELETE Scope:namespace Latency:{Perc50:7.156ms Perc90:81.277ms Perc99:1.67956s} Count:333598}; expected perc99 <= 1s got: {Resource:replicationcontrollers Subresource: Verb:GET Scope:namespace Latency:{Perc50:37.465ms Perc90:740.054ms Perc99:1.597651s} Count:19391}; expected perc99 <= 1s got: {Resource:replicationcontrollers Subresource: Verb:PATCH Scope:namespace Latency:{Perc50:6.909ms Perc90:731.448ms Perc99:1.525751s} Count:16400}; expected perc99 <= 1s got: {Resource:leases Subresource: Verb:PUT Scope:namespace Latency:{Perc50:4.467ms Perc90:152.256ms Perc99:1.510743s} Count:16964330}; expected perc99 <= 1s got: {Resource:pods Subresource:binding Verb:POST Scope:namespace Latency:{Perc50:17.921ms Perc90:583.03ms Perc99:1.448924s} Count:166413}; expected perc99 <= 1s got: {Resource:pods Subresource: Verb:POST Scope:namespace Latency:{Perc50:8.317ms Perc90:169.695ms Perc99:1.30408s} Count:166430}; expected perc99 <= 1s got: {Resource:nodes Subresource:status Verb:PATCH Scope:cluster Latency:{Perc50:3.446ms Perc90:290.669ms Perc99:1.289327s} Count:5764778}; expected perc99 <= 1s got: {Resource:secrets Subresource: Verb:GET Scope:namespace Latency:{Perc50:1.88ms Perc90:320.562ms Perc99:1.183423s} Count:116}; expected perc99 <= 1s got: {Resource:configmaps Subresource: Verb:PUT Scope:namespace Latency:{Perc50:2.031ms Perc90:153.476ms Perc99:1.127506s} Count:12689}; expected perc99 <= 1s got: {Resource:configmaps Subresource: Verb:GET Scope:namespace Latency:{Perc50:1.615ms Perc90:233.693ms Perc99:1.127371s} Count:29461}; expected perc99 <= 1s got: {Resource:namespaces Subresource: Verb:GET Scope:cluster Latency:{Perc50:1.551ms Perc90:197.694ms Perc99:1.125289s} Count:5219}; expected perc99 <= 1s got: {Resource:pods Subresource:status Verb:PATCH Scope:namespace Latency:{Perc50:3.101ms Perc90:57.543ms Perc99:1.091754s} Count:904672}; expected perc99 <= 1s got: {Resource:pods Subresource: Verb:GET Scope:namespace Latency:{Perc50:2.721ms Perc90:112.598ms Perc99:1.03369s} Count:1168306}; expected perc99 <= 1s got: {Resource:deployments Subresource:scale Verb:GET Scope:namespace Latency:{Perc50:1.263ms Perc90:12.72ms Perc99:1.012536s} Count:3486}; expected perc99 <= 1s got: {Resource:endpoints Subresource: Verb:GET Scope:namespace Latency:{Perc50:1.397ms Perc90:162.376ms Perc99:1.001134s} Count:37142}; expected perc99 <= 1s]]
:0
				from junit.xml

Filter through log files | View test history on testgrid


Show 10 Passed Tests