ci-kubernetes-kubemark-500-gce #1379390299561791488
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 3 failed / 52 succeeded |
| Started | |
| Elapsed | 1h28m |
| Revision | master |
| job-version | v1.22.0-alpha.0.30+b0abe89ae259d5 |
| kubetest-version | |
| revision | v1.22.0-alpha.0.30+b0abe89ae259d5 |
error during /home/prow/go/src/k8s.io/perf-tests/run-e2e.sh cluster-loader2 --nodes=500 --provider=kubemark --report-dir=/logs/artifacts --testconfig=testing/load/config.yaml --testconfig=testing/access-tokens/config.yaml --testoverrides=./testing/experiments/use_simple_latency_query.yaml --testoverrides=./testing/overrides/kubemark_500_nodes.yaml: exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=ClusterLoaderV2\sload\soverall\s\(testing\/load\/config\.yaml\)$'
:0
[measurement call WaitForControlledPodsRunning - error: [measurement call WaitForControlledPodsRunning - WaitForRunningJobs error: 3 objects timed out: Jobs: test-lvpmhz-2/big-job-0, test-lvpmhz-5/big-job-0, test-lvpmhz-4/big-job-0
measurement call WaitForControlledPodsRunning - WaitForRunningDaemonSets error: 1 objects timed out: DaemonSets: test-lvpmhz-1/daemonset-0
measurement call WaitForControlledPodsRunning - WaitForRunningDeployments error: 7 objects timed out: Deployments: test-lvpmhz-1/big-deployment-1, test-lvpmhz-2/small-deployment-277, test-lvpmhz-5/small-deployment-49, test-lvpmhz-5/big-deployment-1, test-lvpmhz-4/medium-deployment-21, test-lvpmhz-4/medium-deployment-3, test-lvpmhz-5/big-deployment-0]]
:0
from junit.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=ClusterLoaderV2\sload\:\s\[step\:\s20\]\sWaiting\sfor\sobjects\sto\sbecome\sscaled$'
:0
[measurement call WaitForControlledPodsRunning - error: [measurement call WaitForControlledPodsRunning - WaitForRunningJobs error: 3 objects timed out: Jobs: test-lvpmhz-2/big-job-0, test-lvpmhz-5/big-job-0, test-lvpmhz-4/big-job-0
measurement call WaitForControlledPodsRunning - WaitForRunningDaemonSets error: 1 objects timed out: DaemonSets: test-lvpmhz-1/daemonset-0
measurement call WaitForControlledPodsRunning - WaitForRunningDeployments error: 7 objects timed out: Deployments: test-lvpmhz-1/big-deployment-1, test-lvpmhz-2/small-deployment-277, test-lvpmhz-5/small-deployment-49, test-lvpmhz-5/big-deployment-1, test-lvpmhz-4/medium-deployment-21, test-lvpmhz-4/medium-deployment-3, test-lvpmhz-5/big-deployment-0]]
:0
from junit.xml
Filter through log files | View test history on testgrid
Check APIReachability
ClusterLoaderV2 access-tokens overall (testing/access-tokens/config.yaml)
ClusterLoaderV2 access-tokens: [step: 01] Starting measurements
ClusterLoaderV2 access-tokens: [step: 02] Creating ServiceAccounts
ClusterLoaderV2 access-tokens: [step: 03] Creating Tokens
ClusterLoaderV2 access-tokens: [step: 04] Starting measurement for waiting for pods
ClusterLoaderV2 access-tokens: [step: 05] Creating pods
ClusterLoaderV2 access-tokens: [step: 06] Waiting for pods to be running
ClusterLoaderV2 access-tokens: [step: 07] Wait 5min
ClusterLoaderV2 access-tokens: [step: 08] Deleting pods
ClusterLoaderV2 access-tokens: [step: 09] Waiting for pods to be deleted
ClusterLoaderV2 access-tokens: [step: 10] Collecting measurements
ClusterLoaderV2 load: [step: 01] Starting measurements
ClusterLoaderV2 load: [step: 02] Creating k8s services
ClusterLoaderV2 load: [step: 03] Creating PriorityClass for DaemonSets
ClusterLoaderV2 load: [step: 04] Starting measurement for waiting for pods
ClusterLoaderV2 load: [step: 05] Creating objects
ClusterLoaderV2 load: [step: 06] Waiting for pods to be running
ClusterLoaderV2 load: [step: 07] Creating scheduler throughput measurements
ClusterLoaderV2 load: [step: 08] Creating scheduler throughput pods
ClusterLoaderV2 load: [step: 09] Waiting for scheduler throughput pods to be created
ClusterLoaderV2 load: [step: 10] Collecting scheduler throughput measurements
ClusterLoaderV2 load: [step: 11] Deleting scheduler throughput pods
ClusterLoaderV2 load: [step: 12] Waiting for scheduler throughput pods to be deleted
ClusterLoaderV2 load: [step: 13] Starting latency pod measurements
ClusterLoaderV2 load: [step: 14] Creating latency pods
ClusterLoaderV2 load: [step: 15] Waiting for latency pods to be running
ClusterLoaderV2 load: [step: 16] Deleting latency pods
ClusterLoaderV2 load: [step: 17] Waiting for latency pods to be deleted
ClusterLoaderV2 load: [step: 18] Collecting pod startup latency
ClusterLoaderV2 load: [step: 19] Scaling and updating objects
ClusterLoaderV2 load: [step: 21] Deleting objects
ClusterLoaderV2 load: [step: 22] Waiting for pods to be deleted
ClusterLoaderV2 load: [step: 23] Deleting PriorityClass for DaemonSets
ClusterLoaderV2 load: [step: 24] Deleting k8s services
ClusterLoaderV2 load: [step: 25] Collecting measurements
Deferred TearDown
DumpClusterLogs
Extract
IsUp
Kubemark MasterLogDump
Kubemark Overall
Kubemark TearDown
Kubemark TearDown Previous
Kubemark Up
TearDown
TearDown Previous
Timeout
Up
list kubemark nodes
list nodes
test setup