This job view page is being replaced by Spyglass soon. Check out the new job view.
PRwzshiming: Graceful Node Shutdown Based On Pod Priority
ResultABORTED
Tests 0 failed / 32 succeeded
Started2021-10-27 03:53
Elapsed47m8s
Revisionfc22372532794ff965859c6cca17c5dc1b56219d
Refs 102915

No Test Failures!


Show 32 Passed Tests

Error lines from build-log.txt

... skipping 704 lines ...
Looking for address 'e2e-102915-95a39-master-ip'
Looking for address 'e2e-102915-95a39-master-internal-ip'
Using master: e2e-102915-95a39-master (external IP: 104.196.152.215; internal IP: 10.40.0.2)
Waiting up to 300 seconds for cluster initialization.

  This will continually check to see if the API for kubernetes is reachable.
  This may time out if there was some uncaught error during start up.

Kubernetes cluster created.
Cluster "k8s-infra-e2e-boskos-scale-16_e2e-102915-95a39" set.
User "k8s-infra-e2e-boskos-scale-16_e2e-102915-95a39" set.
Context "k8s-infra-e2e-boskos-scale-16_e2e-102915-95a39" created.
Switched to context "k8s-infra-e2e-boskos-scale-16_e2e-102915-95a39".
... skipping 227 lines ...
e2e-102915-95a39-minion-group-zm6s   Ready                         <none>   54s    v1.23.0-alpha.3.570+4417cfa5f149f2
e2e-102915-95a39-minion-group-zr9w   Ready                         <none>   50s    v1.23.0-alpha.3.570+4417cfa5f149f2
e2e-102915-95a39-minion-heapster     Ready                         <none>   81s    v1.23.0-alpha.3.570+4417cfa5f149f2
Warning: v1 ComponentStatus is deprecated in v1.19+
Validate output:
Warning: v1 ComponentStatus is deprecated in v1.19+
NAME                 STATUS    MESSAGE                         ERROR
etcd-1               Healthy   {"health":"true","reason":""}   
etcd-0               Healthy   {"health":"true","reason":""}   
scheduler            Healthy   ok                              
controller-manager   Healthy   ok                              
Cluster validation encountered some problems, but cluster should be in working order
...ignoring non-fatal errors in validate-cluster
Done, listing cluster services:

Kubernetes control plane is running at https://104.196.152.215
GLBCDefaultBackend is running at https://104.196.152.215/api/v1/namespaces/kube-system/services/default-http-backend:http/proxy
CoreDNS is running at https://104.196.152.215/api/v1/namespaces/kube-system/services/kube-dns:dns/proxy
Metrics-server is running at https://104.196.152.215/api/v1/namespaces/kube-system/services/https:metrics-server:/proxy
... skipping 62 lines ...
e1d5f0e5e6d07cac3bca0d5d67e5d06050a6c6ba - Mon Oct 18 07:15:50 2021 (Merge pull request #1914 from mborsz/latency)
c68198dc3f4b54d90c35f4489b5364ea9a68334a - Wed Sep 29 18:58:27 2021 (Adjust Golang scripts to the new k8s.io/release commit)
81568de03c323b1ee1e6e6a4d31f3115fd497290 - Tue Sep 7 12:45:38 2021 (Use the same image in daemonset and pod startup latency)
a81c576d431247523807fd85caa2ce273db5c7f7 - Fri Oct 15 07:50:54 2021 (Merge pull request #1912 from jprzychodzen/fix-automanaged-namespaces)
27635cf6284ce8ff33ffebc329077f1d65b3554a - Wed Oct 13 20:33:17 2021 (Improve handling of automanaged namespaces)
27021223a05be6e9edb845b1ed8edbf57bedb5d9 - Thu Oct 14 10:27:19 2021 (Merge pull request #1913 from jkaniuk/cl2-verbosity2)
48acddc2f5f25c6b1a9f239d81c03000f3d15b44 - Thu Oct 14 08:57:17 2021 (Improve error logging in image preloading)
3eddca84fb36480d2e7d597407a4163034548454 - Thu Oct 14 08:39:19 2021 (Merge pull request #1911 from jkaniuk/cl2-verbosity)
70f63963b12f51e0e1b65814e463194af12ec3d2 - Wed Oct 13 16:38:12 2021 (Allow changing clusterloader2 verbosity in run-e2e.sh)
COMMAND: /home/prow/go/src/k8s.io/perf-tests/clusterloader2 && ./run-e2e.sh --nodes=100 --provider=gce --report-dir=/logs/artifacts --testconfig=testing/load/config.yaml --testoverrides=./testing/experiments/enable_restart_count_check.yaml --testoverrides=./testing/experiments/use_simple_latency_query.yaml --testoverrides=./testing/overrides/load_throughput.yaml
go: downloading k8s.io/client-go v0.18.0
go: downloading gopkg.in/yaml.v2 v2.2.8
go: downloading k8s.io/api v0.18.0
... skipping 273 lines ...
I1027 04:19:30.821807   84458 util.go:85] Not enough active targets (0), expected at least (3), waiting for more to become active...
I1027 04:19:30.997426   84458 util.go:85] Not enough active targets (0), expected at least (6), waiting for more to become active...
I1027 04:19:45.824779   84458 util.go:85] Not enough active targets (0), expected at least (3), waiting for more to become active...
I1027 04:19:46.000406   84458 util.go:85] Not enough active targets (0), expected at least (6), waiting for more to become active...
I1027 04:20:00.848123   84458 util.go:85] Not enough active targets (0), expected at least (3), waiting for more to become active...
I1027 04:20:01.000336   84458 util.go:85] Not enough active targets (0), expected at least (6), waiting for more to become active...
E1027 04:20:01.138441   84458 etcd_metrics.go:147] EtcdMetrics: failed to collect etcd database size
I1027 04:20:15.823879   84458 util.go:93] 2/3 targets are ready, example not ready target: {map[container:dns endpoint:metrics instance:10.64.91.3:8080 job:dns namespace:probes pod:dns-854b7dccbf-8qlpl service:dns] unknown}
I1027 04:20:15.999290   84458 util.go:93] 1/6 targets are ready, example not ready target: {map[container:ping-server endpoint:metrics instance:10.64.96.3:8080 job:ping-server namespace:probes pod:ping-server-596b77b4cb-csv4s service:ping-server] unknown}
I1027 04:20:30.829459   84458 util.go:96] All 3 expected targets are ready
I1027 04:20:30.829520   84458 prometheus_measurement.go:75] SLOMeasurement has started
I1027 04:20:31.004363   84458 util.go:93] 5/6 targets are ready, example not ready target: {map[container:ping-server endpoint:metrics instance:10.64.72.3:8080 job:ping-server namespace:probes pod:ping-server-596b77b4cb-g5w9h service:ping-server] unknown}
I1027 04:20:46.003586   84458 util.go:96] All 6 expected targets are ready
... skipping 28 lines ...
I1027 04:21:00.313106   84458 reflector.go:175] Starting reflector *v1.Pod (0s) from *v1.PodStore: namespace(test-4m2xg9-1), labelSelector(name=small-deployment-64)
I1027 04:21:01.194633   84458 reflector.go:175] Starting reflector *v1.Pod (0s) from *v1.PodStore: namespace(test-4m2xg9-1), labelSelector(name=small-deployment-245)
I1027 04:21:01.545923   84458 reflector.go:175] Starting reflector *v1.Pod (0s) from *v1.PodStore: namespace(test-4m2xg9-1), labelSelector(name=small-deployment-201)
I1027 04:21:01.673158   84458 reflector.go:175] Starting reflector *v1.Pod (0s) from *v1.PodStore: namespace(test-4m2xg9-1), labelSelector(name=small-deployment-82)
I1027 04:21:01.691340   84458 reflector.go:175] Starting reflector *v1.Pod (0s) from *v1.PodStore: namespace(test-4m2xg9-1), labelSelector(name=small-deployment-84)
I1027 04:21:01.714360   84458 reflector.go:175] Starting reflector *v1.Pod (0s) from *v1.PodStore: namespace(test-4m2xg9-1), labelSelector(name=small-deployment-167)
E1027 04:21:01.715882   84458 etcd_metrics.go:147] EtcdMetrics: failed to collect etcd database size
I1027 04:21:02.105011   84458 wait_for_pods.go:96] WaitForControlledPodsRunning: namespace(test-4m2xg9-1), labelSelector(name=small-deployment-36): Pods: 5 out of 5 created, 5 running (5 updated), 0 pending scheduled, 0 not scheduled, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I1027 04:21:02.105192   84458 reflector.go:181] Stopping reflector *v1.Pod (0s) from *v1.PodStore: namespace(test-4m2xg9-1), labelSelector(name=small-deployment-36)
I1027 04:21:02.148016   84458 wait_for_pods.go:96] WaitForControlledPodsRunning: namespace(test-4m2xg9-1), labelSelector(name=small-deployment-241): Pods: 5 out of 5 created, 5 running (5 updated), 0 pending scheduled, 0 not scheduled, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I1027 04:21:02.148191   84458 reflector.go:181] Stopping reflector *v1.Pod (0s) from *v1.PodStore: namespace(test-4m2xg9-1), labelSelector(name=small-deployment-241)
I1027 04:21:02.389962   84458 wait_for_pods.go:96] WaitForControlledPodsRunning: namespace(test-4m2xg9-1), labelSelector(name=small-deployment-89): Pods: 5 out of 5 created, 5 running (5 updated), 0 pending scheduled, 0 not scheduled, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I1027 04:21:02.390224   84458 reflector.go:181] Stopping reflector *v1.Pod (0s) from *v1.PodStore: namespace(test-4m2xg9-1), labelSelector(name=small-deployment-89)
... skipping 396 lines ...
I1027 04:22:01.936566   84458 reflector.go:175] Starting reflector *v1.Pod (0s) from *v1.PodStore: namespace(test-4m2xg9-1), labelSelector(name=small-deployment-117)
I1027 04:22:02.103605   84458 wait_for_pods.go:96] WaitForControlledPodsRunning: namespace(test-4m2xg9-1), labelSelector(name=small-deployment-243): Pods: 5 out of 5 created, 5 running (5 updated), 0 pending scheduled, 0 not scheduled, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I1027 04:22:02.103870   84458 reflector.go:181] Stopping reflector *v1.Pod (0s) from *v1.PodStore: namespace(test-4m2xg9-1), labelSelector(name=small-deployment-243)
I1027 04:22:02.159750   84458 reflector.go:175] Starting reflector *v1.Pod (0s) from *v1.PodStore: namespace(test-4m2xg9-1), labelSelector(name=small-deployment-185)
I1027 04:22:02.161160   84458 wait_for_pods.go:96] WaitForControlledPodsRunning: namespace(test-4m2xg9-1), labelSelector(name=small-deployment-162): Pods: 5 out of 5 created, 5 running (5 updated), 0 pending scheduled, 0 not scheduled, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I1027 04:22:02.161273   84458 reflector.go:181] Stopping reflector *v1.Pod (0s) from *v1.PodStore: namespace(test-4m2xg9-1), labelSelector(name=small-deployment-162)
E1027 04:22:02.247363   84458 etcd_metrics.go:147] EtcdMetrics: failed to collect etcd database size
I1027 04:22:02.739209   84458 wait_for_pods.go:96] WaitForControlledPodsRunning: namespace(test-4m2xg9-1), labelSelector(name=small-deployment-61): Pods: 5 out of 5 created, 5 running (5 updated), 0 pending scheduled, 0 not scheduled, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I1027 04:22:02.739353   84458 reflector.go:181] Stopping reflector *v1.Pod (0s) from *v1.PodStore: namespace(test-4m2xg9-1), labelSelector(name=small-deployment-61)
I1027 04:22:02.857864   84458 wait_for_pods.go:96] WaitForControlledPodsRunning: namespace(test-4m2xg9-1), labelSelector(name=small-deployment-176): Pods: 5 out of 5 created, 5 running (5 updated), 0 pending scheduled, 0 not scheduled, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I1027 04:22:02.858025   84458 reflector.go:181] Stopping reflector *v1.Pod (0s) from *v1.PodStore: namespace(test-4m2xg9-1), labelSelector(name=small-deployment-176)
I1027 04:22:03.178728   84458 reflector.go:175] Starting reflector *v1.Pod (0s) from *v1.PodStore: namespace(test-4m2xg9-1), labelSelector(name=small-deployment-186)
I1027 04:22:03.422283   84458 wait_for_pods.go:96] WaitForControlledPodsRunning: namespace(test-4m2xg9-1), labelSelector(name=medium-deployment-18): Pods: 30 out of 30 created, 30 running (30 updated), 0 pending scheduled, 0 not scheduled, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
... skipping 393 lines ...
I1027 04:23:02.062180   84458 wait_for_pods.go:96] WaitForControlledPodsRunning: namespace(test-4m2xg9-1), labelSelector(name=small-deployment-166): Pods: 5 out of 5 created, 5 running (5 updated), 0 pending scheduled, 0 not scheduled, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I1027 04:23:02.062351   84458 reflector.go:181] Stopping reflector *v1.Pod (0s) from *v1.PodStore: namespace(test-4m2xg9-1), labelSelector(name=small-deployment-166)
I1027 04:23:02.500412   84458 reflector.go:175] Starting reflector <unspecified> (0s) from pkg/mod/k8s.io/client-go@v0.18.0/tools/cache/reflector.go:125
I1027 04:23:02.600457   84458 reflector.go:181] Stopping reflector <unspecified> (0s) from pkg/mod/k8s.io/client-go@v0.18.0/tools/cache/reflector.go:125
I1027 04:23:02.600845   84458 reflector.go:175] Starting reflector <unspecified> (0s) from pkg/mod/k8s.io/client-go@v0.18.0/tools/cache/reflector.go:125
I1027 04:23:02.700956   84458 reflector.go:175] Starting reflector *v1.Pod (0s) from *v1.PodStore: namespace(test-4m2xg9-1), labelSelector(name=daemonset-0)
E1027 04:23:02.804790   84458 etcd_metrics.go:147] EtcdMetrics: failed to collect etcd database size
I1027 04:23:03.102744   84458 wait_for_pods.go:96] WaitForControlledPodsRunning: namespace(test-4m2xg9-1), labelSelector(name=small-deployment-209): Pods: 5 out of 5 created, 5 running (5 updated), 0 pending scheduled, 0 not scheduled, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I1027 04:23:03.102888   84458 reflector.go:181] Stopping reflector *v1.Pod (0s) from *v1.PodStore: namespace(test-4m2xg9-1), labelSelector(name=small-deployment-209)
I1027 04:23:03.521961   84458 wait_for_pods.go:96] WaitForControlledPodsRunning: namespace(test-4m2xg9-1), labelSelector(name=small-deployment-94): Pods: 5 out of 5 created, 5 running (5 updated), 0 pending scheduled, 0 not scheduled, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I1027 04:23:03.522128   84458 reflector.go:181] Stopping reflector *v1.Pod (0s) from *v1.PodStore: namespace(test-4m2xg9-1), labelSelector(name=small-deployment-94)
I1027 04:23:03.672353   84458 reflector.go:175] Starting reflector *v1.Pod (0s) from *v1.PodStore: namespace(test-4m2xg9-1), labelSelector(name=medium-deployment-6)
I1027 04:23:04.214403   84458 reflector.go:175] Starting reflector *v1.Pod (0s) from *v1.PodStore: namespace(test-4m2xg9-1), labelSelector(name=small-deployment-254)
... skipping 290 lines ...
I1027 04:23:57.104467   84458 phase_latency.go:146] PodStartupLatency: perc50: 0s, perc90: 0s, perc99: 0s
I1027 04:23:57.104537   84458 simple_test_executor.go:173] Step "[step: 12] Collecting scheduler throughput measurements" ended
I1027 04:23:57.104558   84458 simple_test_executor.go:145] Step "[step: 13] delete scheduler throughput pods" started
I1027 04:23:57.143106   84458 reflector.go:175] Starting reflector *v1.Pod (0s) from *v1.PodStore: namespace(test-4m2xg9-2), labelSelector(name=scheduler-throughput-deployment-0)
I1027 04:24:02.194507   84458 wait_for_pods.go:96] WaitForControlledPodsRunning: namespace(test-4m2xg9-2), labelSelector(name=scheduler-throughput-deployment-0): Pods: 0 out of 0 created, 0 running (0 updated), 0 pending scheduled, 0 not scheduled, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I1027 04:24:02.194707   84458 reflector.go:181] Stopping reflector *v1.Pod (0s) from *v1.PodStore: namespace(test-4m2xg9-2), labelSelector(name=scheduler-throughput-deployment-0)
E1027 04:24:03.347112   84458 etcd_metrics.go:147] EtcdMetrics: failed to collect etcd database size
I1027 04:24:27.144202   84458 reflector.go:175] Starting reflector *v1.Pod (0s) from *v1.PodStore: namespace(test-4m2xg9-3), labelSelector(name=scheduler-throughput-deployment-0)
I1027 04:24:32.196214   84458 wait_for_pods.go:96] WaitForControlledPodsRunning: namespace(test-4m2xg9-3), labelSelector(name=scheduler-throughput-deployment-0): Pods: 0 out of 0 created, 0 running (0 updated), 0 pending scheduled, 0 not scheduled, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I1027 04:24:32.196388   84458 reflector.go:181] Stopping reflector *v1.Pod (0s) from *v1.PodStore: namespace(test-4m2xg9-3), labelSelector(name=scheduler-throughput-deployment-0)
I1027 04:24:57.144780   84458 reflector.go:175] Starting reflector *v1.Pod (0s) from *v1.PodStore: namespace(test-4m2xg9-4), labelSelector(name=scheduler-throughput-deployment-0)
I1027 04:25:02.196624   84458 wait_for_pods.go:96] WaitForControlledPodsRunning: namespace(test-4m2xg9-4), labelSelector(name=scheduler-throughput-deployment-0): Pods: 0 out of 0 created, 0 running (0 updated), 0 pending scheduled, 0 not scheduled, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I1027 04:25:02.196826   84458 reflector.go:181] Stopping reflector *v1.Pod (0s) from *v1.PodStore: namespace(test-4m2xg9-4), labelSelector(name=scheduler-throughput-deployment-0)
E1027 04:25:03.885805   84458 etcd_metrics.go:147] EtcdMetrics: failed to collect etcd database size
I1027 04:25:27.145518   84458 reflector.go:175] Starting reflector *v1.Pod (0s) from *v1.PodStore: namespace(test-4m2xg9-5), labelSelector(name=scheduler-throughput-deployment-0)
I1027 04:25:32.196333   84458 wait_for_pods.go:96] WaitForControlledPodsRunning: namespace(test-4m2xg9-5), labelSelector(name=scheduler-throughput-deployment-0): Pods: 0 out of 0 created, 0 running (0 updated), 0 pending scheduled, 0 not scheduled, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady 
I1027 04:25:32.196531   84458 reflector.go:181] Stopping reflector *v1.Pod (0s) from *v1.PodStore: namespace(test-4m2xg9-5), labelSelector(name=scheduler-throughput-deployment-0)