This job view page is being replaced by Spyglass soon. Check out the new job view.
PRdimakow: Add missing locks for device-manager in 1.19
ResultFAILURE
Tests 1 failed / 956 succeeded
Started2021-07-14 15:46
Elapsed38m40s
Revision6e340d89497bb60251fd46f1be5f89b5165f5bb0
Refs 103262

Test Failures


//pkg/kubelet/cm/devicemanager:go_default_test 0.00s

bazel test //pkg/kubelet/cm/devicemanager:go_default_test
exec ${PAGER:-/usr/bin/less} "$0" || exit 1
Executing tests from //pkg/kubelet/cm/devicemanager:go_default_test
-----------------------------------------------------------------------------
I0714 16:19:25.169642  241544 device_plugin_stub.go:131] Starting to serve on /tmp/mock.sock
I0714 16:19:25.174060  241544 device_plugin_stub.go:131] Starting to serve on /tmp/mock.sock
I0714 16:19:25.177598  241544 device_plugin_stub.go:227] ListAndWatch
E0714 16:19:25.178818  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin mock with error rpc error: code = Unavailable desc = transport is closing
I0714 16:19:25.180674  241544 device_plugin_stub.go:131] Starting to serve on /tmp/mock.sock
I0714 16:19:25.184432  241544 device_plugin_stub.go:227] ListAndWatch
I0714 16:19:25.185546  241544 device_plugin_stub.go:261] Allocate, &AllocateRequest{ContainerRequests:[]*ContainerAllocateRequest{&ContainerAllocateRequest{DevicesIDs:[ADeviceId],},},}
E0714 16:19:25.186565  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin mock with error rpc error: code = Unavailable desc = transport is closing
I0714 16:19:25.188350  241544 device_plugin_stub.go:131] Starting to serve on /tmp/mock.sock
I0714 16:19:25.190397  241544 device_plugin_stub.go:227] ListAndWatch
I0714 16:19:25.191286  241544 device_plugin_stub.go:248] GetPreferredAllocation, &PreferredAllocationRequest{ContainerRequests:[]*ContainerPreferredAllocationRequest{&ContainerPreferredAllocationRequest{AvailableDeviceIDs:[],MustIncludeDeviceIDs:[],AllocationSize:-1,},},}
E0714 16:19:25.192535  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin mock with error rpc error: code = Unavailable desc = transport is closing
I0714 16:19:25.192669  241544 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0714 16:19:25.193061  241544 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
W0714 16:19:25.193274  241544 manager.go:596] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
I0714 16:19:25.194907  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin990032412/device-plugin.sock
I0714 16:19:25.196035  241544 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
W0714 16:19:25.196203  241544 manager.go:596] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
I0714 16:19:25.197047  241544 plugin_manager.go:114] Starting Kubelet Plugin Manager
I0714 16:19:25.198703  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin547186891/device-plugin.sock
I0714 16:19:25.201244  241544 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
W0714 16:19:25.201511  241544 manager.go:596] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
I0714 16:19:25.203234  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin623954350/device-plugin.sock
I0714 16:19:25.203342  241544 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:19:25.205272  241544 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:19:25.207957  241544 device_plugin_stub.go:227] ListAndWatch
I0714 16:19:25.215769  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin623954350/device-plugin.sock.new
I0714 16:19:25.215880  241544 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:19:25.218254  241544 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:19:25.222126  241544 device_plugin_stub.go:227] ListAndWatch
I0714 16:19:25.227619  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin623954350/device-plugin.sock.third
I0714 16:19:25.227735  241544 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:19:25.229645  241544 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:19:25.232107  241544 device_plugin_stub.go:227] ListAndWatch
E0714 16:19:25.236331  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:19:25.236759  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0714 16:19:25.237163  241544 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
E0714 16:19:25.237194  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0714 16:19:25.239324  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin623954350/device-plugin.sock
I0714 16:19:25.239396  241544 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:19:25.241276  241544 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:19:25.245370  241544 device_plugin_stub.go:227] ListAndWatch
I0714 16:19:25.250828  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin623954350/device-plugin.sock.new
I0714 16:19:25.250894  241544 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:19:25.253013  241544 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:19:25.255557  241544 device_plugin_stub.go:227] ListAndWatch
I0714 16:19:25.260578  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin623954350/device-plugin.sock.third
I0714 16:19:25.260639  241544 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:19:25.262523  241544 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:19:25.266196  241544 device_plugin_stub.go:227] ListAndWatch
E0714 16:19:25.270389  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:19:25.270615  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:19:25.270952  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0714 16:19:25.271249  241544 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0714 16:19:25.273318  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin623954350/device-plugin.sock
I0714 16:19:25.273391  241544 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:19:25.275162  241544 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:19:25.277419  241544 device_plugin_stub.go:227] ListAndWatch
I0714 16:19:25.282436  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin623954350/device-plugin.sock.new
I0714 16:19:25.282500  241544 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:19:25.284273  241544 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:19:25.286748  241544 device_plugin_stub.go:227] ListAndWatch
I0714 16:19:25.293271  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin623954350/device-plugin.sock.third
I0714 16:19:25.293352  241544 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:19:25.295175  241544 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:19:25.297454  241544 device_plugin_stub.go:227] ListAndWatch
E0714 16:19:25.301401  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:19:25.301702  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:19:25.302098  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0714 16:19:25.302514  241544 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0714 16:19:25.304347  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin623954350/device-plugin.sock
I0714 16:19:25.304404  241544 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:19:25.306201  241544 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:19:25.308489  241544 device_plugin_stub.go:227] ListAndWatch
I0714 16:19:25.313383  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin623954350/device-plugin.sock.new
I0714 16:19:25.313444  241544 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:19:25.316687  241544 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:19:25.319188  241544 device_plugin_stub.go:227] ListAndWatch
I0714 16:19:25.324035  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin623954350/device-plugin.sock.third
I0714 16:19:25.324127  241544 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:19:25.325911  241544 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:19:25.328366  241544 device_plugin_stub.go:227] ListAndWatch
E0714 16:19:25.332235  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:19:25.332590  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:19:25.333022  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0714 16:19:25.333754  241544 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
W0714 16:19:25.334028  241544 manager.go:596] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
I0714 16:19:25.334961  241544 plugin_manager.go:114] Starting Kubelet Plugin Manager
I0714 16:19:25.337482  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin650473985/device-plugin.sock
I0714 16:19:25.339443  241544 device_plugin_stub.go:153] GetInfo
E0714 16:19:25.340224  241544 goroutinemap.go:150] Operation for "/tmp/device_plugin650473985/server.sock" failed. No retries permitted until 2021-07-14 16:19:25.840020125 +0000 UTC m=+0.756120013 (durationBeforeRetry 500ms). Error: "RegisterPlugin error -- failed to get plugin info using RPC GetInfo at socket /tmp/device_plugin650473985/server.sock, err: rpc error: code = Unimplemented desc = unknown service pluginregistration.Registration"
I0714 16:19:25.343106  241544 device_plugin_stub.go:227] ListAndWatch
I0714 16:19:25.348380  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin650473985/device-plugin.sock.new
I0714 16:19:26.339265  241544 device_plugin_stub.go:153] GetInfo
E0714 16:19:26.339747  241544 goroutinemap.go:150] Operation for "/tmp/device_plugin650473985/server.sock" failed. No retries permitted until 2021-07-14 16:19:27.339594875 +0000 UTC m=+2.255694748 (durationBeforeRetry 1s). Error: "RegisterPlugin error -- failed to get plugin info using RPC GetInfo at socket /tmp/device_plugin650473985/server.sock, err: rpc error: code = Unimplemented desc = unknown service pluginregistration.Registration"
I0714 16:19:26.343208  241544 device_plugin_stub.go:227] ListAndWatch
I0714 16:19:26.348190  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin650473985/device-plugin.sock.third
I0714 16:19:27.341616  241544 device_plugin_stub.go:153] GetInfo
I0714 16:19:27.345974  241544 device_plugin_stub.go:227] ListAndWatch
E0714 16:19:27.350939  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:19:27.351308  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:19:27.351670  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0714 16:19:27.352801  241544 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
E0714 16:19:27.367260  241544 manager.go:546] unexpected: unhealthyDevices and endpoints are out of sync
I0714 16:19:27.380263  241544 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0714 16:19:27.380508  241544 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 8e0eba7d-5218-45ad-b62a-0f806cd17158 container name:  
I0714 16:19:27.380577  241544 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 8e0eba7d-5218-45ad-b62a-0f806cd17158 container name:  
I0714 16:19:27.384852  241544 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: f13afa70-42fa-4d91-b118-46e1dd331ffd container name:  
I0714 16:19:27.388603  241544 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0714 16:19:27.388845  241544 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 56ea4122-b0ff-4042-b388-62dc181b0909 container name:  69cf03a8-c339-401a-93eb-2931f57a0b17
I0714 16:19:27.391889  241544 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 56ea4122-b0ff-4042-b388-62dc181b0909 container name:  e66b449e-0588-49a1-8f64-868c7bf674bc
I0714 16:19:27.395102  241544 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 56ea4122-b0ff-4042-b388-62dc181b0909 container name:  e981fd5f-8c6e-4846-b73b-8ba65af13a39
I0714 16:19:27.398871  241544 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 56ea4122-b0ff-4042-b388-62dc181b0909 container name:  c4f9a389-528f-444b-a4f6-02d699d381a4
I0714 16:19:27.403880  241544 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0714 16:19:27.404016  241544 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 74192176-6e07-43b8-bb6d-7d51b8000ed1 container name:  
I0714 16:19:27.411357  241544 topology_hints.go:49] [devicemanager] Resource 'testdevice' does not have a topology preference
E0714 16:19:35.198529  241544 goroutinemap.go:150] Operation for "/tmp/device_plugin547186891/server.sock" failed. No retries permitted until 2021-07-14 16:19:35.698386014 +0000 UTC m=+10.614485937 (durationBeforeRetry 500ms). Error: "RegisterPlugin error -- dial failed at socket /tmp/device_plugin547186891/server.sock, err: failed to dial socket /tmp/device_plugin547186891/server.sock, err: context deadline exceeded"
E0714 16:19:35.198794  241544 goroutinemap.go:150] Operation for "/tmp/device_plugin547186891/device-plugin.sock" failed. No retries permitted until 2021-07-14 16:19:35.698662035 +0000 UTC m=+10.614761908 (durationBeforeRetry 500ms). Error: "RegisterPlugin error -- dial failed at socket /tmp/device_plugin547186891/device-plugin.sock, err: failed to dial socket /tmp/device_plugin547186891/device-plugin.sock, err: context deadline exceeded"
Terminated
-- Test timed out at 2021-07-14 16:24:24 UTC --

				from junit_bazel.xml

Filter through log files | View test history on testgrid


Show 956 Passed Tests

Error lines from build-log.txt

+ bazel test --config=unit //... -- -//build/... -//vendor/...
$TEST_TMPDIR defined: output root default is '/bazel-scratch/.cache/bazel' and max_idle_secs default is '15'.
$TEST_TMPDIR defined: output root default is '/bazel-scratch/.cache/bazel' and max_idle_secs default is '15'.
Extracting Bazel installation...
Starting local Bazel server and connecting to it...
WARNING: Download from https://storage.googleapis.com/k8s-bazel-cache/https://github.com/bazelbuild/rules_docker/releases/download/v0.14.4/rules_docker-v0.14.4.tar.gz failed: class com.google.devtools.build.lib.bazel.repository.downloader.UnrecoverableHttpException GET returned 404 Not Found
Loading:  (1 packages loaded)
Loading: 1 packages loaded
Loading: 508 packages loaded
Loading: 1554 packages loaded
    currently loading: vendor/github.com/pquerna/cachecontrol
Loading: 2721 packages loaded
... skipping 6 lines ...
Analyzing: 959 targets (4569 packages loaded, 36132 targets configured)
Analyzing: 959 targets (4572 packages loaded, 36631 targets configured)
Analyzing: 959 targets (4572 packages loaded, 36631 targets configured)
Analyzing: 959 targets (4573 packages loaded, 36754 targets configured)
Analyzing: 959 targets (4573 packages loaded, 36754 targets configured)
Analyzing: 959 targets (4573 packages loaded, 36754 targets configured)
DEBUG: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/bazel_gazelle/internal/go_repository.bzl:189:13: org_golang_x_tools: gazelle: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/cmd/fiximports/testdata/src/old.com/bad/bad.go: error reading go file: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/cmd/fiximports/testdata/src/old.com/bad/bad.go:2:43: expected 'package', found 'EOF'
gazelle: found packages complexnums (complexnums.go) and issue30628 (issue30628.go) in /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/internal/gccgoimporter/testdata
gazelle: found packages issue25301 (issue25301.go) and a (a.go) in /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/internal/gcimporter/testdata
gazelle: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/loader/testdata/badpkgdecl.go: error reading go file: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/loader/testdata/badpkgdecl.go:1:34: expected 'package', found 'EOF'
gazelle: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/packages/packagestest/testdata/groups/two/modules/example.com/extra/geez/help.go: error reading go file: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/packages/packagestest/testdata/groups/two/modules/example.com/extra/geez/help.go:1:16: expected ';', found '.'
gazelle: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/packages/packagestest/testdata/groups/two/modules/example.com/extra/v2/geez/help.go: error reading go file: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/packages/packagestest/testdata/groups/two/modules/example.com/extra/v2/geez/help.go:1:16: expected ';', found '.'
gazelle: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/packages/packagestest/testdata/groups/two/modules/example.com/extra/v2/me.go: error reading go file: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/packages/packagestest/testdata/groups/two/modules/example.com/extra/v2/me.go:1:16: expected ';', found '.'
gazelle: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/packages/packagestest/testdata/groups/two/modules/example.com/extra/yo.go: error reading go file: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/packages/packagestest/testdata/groups/two/modules/example.com/extra/yo.go:1:16: expected ';', found '.'
gazelle: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/packages/packagestest/testdata/groups/two/modules/example.com/tempmod/main.go: error reading go file: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/packages/packagestest/testdata/groups/two/modules/example.com/tempmod/main.go:1:16: expected ';', found '.'
gazelle: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/packages/packagestest/testdata/groups/two/modules/example.com/what@v1.0.0/main.go: error reading go file: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/packages/packagestest/testdata/groups/two/modules/example.com/what@v1.0.0/main.go:1:16: expected ';', found '.'
gazelle: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/packages/packagestest/testdata/groups/two/modules/example.com/what@v1.1.0/main.go: error reading go file: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/packages/packagestest/testdata/groups/two/modules/example.com/what@v1.1.0/main.go:1:16: expected ';', found '.'
gazelle: finding module path for import domain.name/importdecl: go get domain.name/importdecl: module domain.name/importdecl: reading https://proxy.golang.org/domain.name/importdecl/@v/list: 410 Gone
	server response: not found: domain.name/importdecl@latest: unrecognized import path "domain.name/importdecl": https fetch: Get "https://domain.name/importdecl?go-get=1": dial tcp: lookup domain.name on 8.8.8.8:53: no such host
gazelle: finding module path for import old.com/one: go get old.com/one: module old.com/one: reading https://proxy.golang.org/old.com/one/@v/list: 410 Gone
	server response: not found: old.com/one@latest: unrecognized import path "old.com/one": https fetch: Get "http://www.old.com/one?go-get=1": redirected from secure URL https://old.com/one?go-get=1 to insecure URL http://www.old.com/one?go-get=1
gazelle: finding module path for import titanic.biz/bar: go get titanic.biz/bar: module titanic.biz/bar: reading https://proxy.golang.org/titanic.biz/bar/@v/list: 410 Gone
	server response: not found: titanic.biz/bar@latest: unrecognized import path "titanic.biz/bar": reading https://titanic.biz/bar?go-get=1: 403 Forbidden
... skipping 74 lines ...
[11,495 / 11,506] 141 / 959 tests; Testing //cmd/kubeadm/app/phases/certs:go_default_test; 105s processwrapper-sandbox ... (8 actions running)
[12,209 / 12,220] 218 / 959 tests; Testing //pkg/controller/podautoscaler:go_default_test; 13s processwrapper-sandbox ... (8 actions, 7 running)
[13,009 / 13,019] 330 / 959 tests; Testing //staging/src/k8s.io/apiserver/pkg/util/shufflesharding:go_default_test; 86s processwrapper-sandbox ... (8 actions, 7 running)
[14,037 / 14,045] 499 / 959 tests; Testing //pkg/master:go_default_test; 110s processwrapper-sandbox ... (8 actions, 7 running)
[14,739 / 14,750] 625 / 959 tests; Testing //pkg/kubelet/volumemanager/reconciler:go_default_test; 109s processwrapper-sandbox ... (8 actions, 7 running)
[17,147 / 18,467] 774 / 959 tests; Testing //cmd/kubeadm/app/phases/upgrade:go_default_test; 118s processwrapper-sandbox ... (8 actions, 7 running)
FAIL: //pkg/volume/csi:go_default_test (see /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/execroot/io_k8s_kubernetes/bazel-out/k8-fastbuild/testlogs/pkg/volume/csi/go_default_test/test_attempts/attempt_1.log)

FLAKY: //pkg/volume/csi:go_default_test (Summary)
      /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/execroot/io_k8s_kubernetes/bazel-out/k8-fastbuild/testlogs/pkg/volume/csi/go_default_test/test_attempts/attempt_1.log
INFO: From Testing //pkg/volume/csi:go_default_test:
==================== Test output for //pkg/volume/csi:go_default_test:
E0714 16:03:56.519656  183208 csi_plugin.go:200] kubernetes.io/csi: VolumeAttachmentLister not found on AttachDetachVolumeHost
E0714 16:03:56.544298  183208 csi_plugin.go:200] kubernetes.io/csi: VolumeAttachmentLister not found on AttachDetachVolumeHost
E0714 16:03:56.562139  183208 csi_plugin.go:200] kubernetes.io/csi: VolumeAttachmentLister not found on AttachDetachVolumeHost
E0714 16:03:57.582662  183208 csi_plugin.go:200] kubernetes.io/csi: VolumeAttachmentLister not found on AttachDetachVolumeHost
E0714 16:03:58.605197  183208 csi_plugin.go:200] kubernetes.io/csi: VolumeAttachmentLister not found on AttachDetachVolumeHost
E0714 16:03:59.617352  183208 csi_plugin.go:200] kubernetes.io/csi: VolumeAttachmentLister not found on AttachDetachVolumeHost
W0714 16:03:59.631259  183208 csi_attacher.go:497] waitForVolumeAttachDetachInternal received watch error: {ERROR &Status{ListMeta:ListMeta{SelfLink:,ResourceVersion:,Continue:,RemainingItemCount:nil,},Status:Failure,Message:Internal error occurred: we got an error,Reason:InternalError,Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:,Message:we got an error,Field:,},},RetryAfterSeconds:0,UID:,},Code:500,}}
E0714 16:03:59.641572  183208 csi_attacher.go:648] kubernetes.io/csi: attachment for vol02 failed: attacher error
E0714 16:03:59.642553  183208 csi_plugin.go:200] kubernetes.io/csi: VolumeAttachmentLister not found on AttachDetachVolumeHost
E0714 16:04:00.654687  183208 csi_plugin.go:200] kubernetes.io/csi: VolumeAttachmentLister not found on AttachDetachVolumeHost
E0714 16:04:00.665710  183208 csi_attacher.go:67] kubernetes.io/csi: attacher.Attach missing volume.Spec
E0714 16:04:01.668010  183208 csi_plugin.go:200] kubernetes.io/csi: VolumeAttachmentLister not found on AttachDetachVolumeHost
E0714 16:04:01.691084  183208 csi_plugin.go:200] kubernetes.io/csi: VolumeAttachmentLister not found on AttachDetachVolumeHost
E0714 16:04:02.703304  183208 csi_plugin.go:200] kubernetes.io/csi: VolumeAttachmentLister not found on AttachDetachVolumeHost
E0714 16:04:02.725119  183208 csi_attacher.go:648] kubernetes.io/csi: attachment for vol02 failed: attacher error
E0714 16:04:02.728360  183208 csi_plugin.go:200] kubernetes.io/csi: VolumeAttachmentLister not found on AttachDetachVolumeHost
E0714 16:04:02.739797  183208 csi_attacher.go:67] kubernetes.io/csi: attacher.Attach missing volume.Spec
E0714 16:04:03.937043  183208 csi_attacher.go:159] kubernetes.io/csi: attacher.WaitForAttach failed for volume [test-vol] (will continue to try): volumeattachments.storage.k8s.io "csi-5988a16c07b08340b5bb360f76ea9b78d2a5f743091347e7d758253051dc6cad" not found
E0714 16:04:03.952364  183208 csi_attacher.go:159] kubernetes.io/csi: attacher.WaitForAttach failed for volume [test-vol] (will continue to try): volumeattachments.storage.k8s.io "csi-ab8900c0d8292f96727112f37503cdbaa8eeaf33a5e66e72ae2f71de80370bfd" not found
E0714 16:04:04.066096  183208 csi_attacher.go:159] kubernetes.io/csi: attacher.WaitForAttach failed for volume [test-vol] (will continue to try): volumeattachments.storage.k8s.io "csi-fc1b3cde1442bf6cfe265647fbbc1ae0ade3490a32e8bbc35e864ee0624cb4c1" not found
E0714 16:04:04.235788  183208 csi_attacher.go:159] kubernetes.io/csi: attacher.WaitForAttach failed for volume [test-vol] (will continue to try): volumeattachments.storage.k8s.io "csi-e68c8204528444bf471bab48cb29196e6b9ca3ccfd041ad54e1947a551b106a6" not found
E0714 16:04:04.237260  183208 csi_plugin.go:200] kubernetes.io/csi: VolumeAttachmentLister not found on AttachDetachVolumeHost
E0714 16:04:04.252539  183208 csi_plugin.go:200] kubernetes.io/csi: VolumeAttachmentLister not found on AttachDetachVolumeHost
E0714 16:04:04.264096  183208 csi_attacher.go:648] kubernetes.io/csi: attachment for test-vol-1 failed: missing volume
E0714 16:04:04.264990  183208 csi_plugin.go:200] kubernetes.io/csi: VolumeAttachmentLister not found on AttachDetachVolumeHost
E0714 16:04:04.283527  183208 csi_plugin.go:200] kubernetes.io/csi: VolumeAttachmentLister not found on AttachDetachVolumeHost
E0714 16:04:04.300304  183208 csi_attacher.go:648] kubernetes.io/csi: attachment for test-vol-3 failed: missing volume
E0714 16:04:04.301315  183208 csi_plugin.go:200] kubernetes.io/csi: VolumeAttachmentLister not found on AttachDetachVolumeHost
E0714 16:04:04.362704  183208 csi_attacher.go:501] kubernetes.io/csi: attachdetacher.WaitForDetach timeout after 50ms [volume=test-vol-4; attachment.ID=csi-4127852aea9ea70617885d8caf5918859f1b8337a850eeb4a8bcdf8d78ac32bf]
E0714 16:04:04.520269  183208 csi_attacher.go:182] kubernetes.io/csi: attacher.VolumesAreAttached failed to get CSIPersistentVolumeSource: unexpected api.CSIVolumeSource found in volume.Spec
E0714 16:04:04.536367  183208 csi_attacher.go:182] kubernetes.io/csi: attacher.VolumesAreAttached failed to get CSIPersistentVolumeSource: unexpected api.CSIVolumeSource found in volume.Spec
E0714 16:04:04.536634  183208 csi_attacher.go:182] kubernetes.io/csi: attacher.VolumesAreAttached failed to get CSIPersistentVolumeSource: unexpected api.CSIVolumeSource found in volume.Spec
E0714 16:04:04.541772  183208 csi_plugin.go:200] kubernetes.io/csi: VolumeAttachmentLister not found on AttachDetachVolumeHost
E0714 16:04:04.554317  183208 csi_plugin.go:200] kubernetes.io/csi: VolumeAttachmentLister not found on AttachDetachVolumeHost
E0714 16:04:04.566789  183208 csi_plugin.go:200] kubernetes.io/csi: VolumeAttachmentLister not found on AttachDetachVolumeHost
E0714 16:04:04.581069  183208 csi_plugin.go:200] kubernetes.io/csi: VolumeAttachmentLister not found on AttachDetachVolumeHost
E0714 16:04:04.594205  183208 csi_plugin.go:200] kubernetes.io/csi: VolumeAttachmentLister not found on AttachDetachVolumeHost
W0714 16:04:04.608296  183208 csi_attacher.go:497] waitForVolumeAttachDetachInternal received watch error: {ERROR &Status{ListMeta:ListMeta{SelfLink:,ResourceVersion:,Continue:,RemainingItemCount:nil,},Status:Failure,Message:Internal error occurred: we got an error,Reason:InternalError,Details:&StatusDetails{Name:,Group:,Kind:,Causes:[]StatusCause{StatusCause{Type:,Message:we got an error,Field:,},},RetryAfterSeconds:0,UID:,},Code:500,}}
E0714 16:05:56.573956  183208 csi_attacher.go:501] kubernetes.io/csi: attachdetacher.WaitForDetach timeout after 2m0s [volume=vol01; attachment.ID=csi-75f1d3164ac9ae6f73784b2ed6b77839daf5b01a8dd52e787c8769b6fdb1b8ec]
E0714 16:05:57.594587  183208 csi_attacher.go:501] kubernetes.io/csi: attachdetacher.WaitForDetach timeout after 2m0s [volume=vol02; attachment.ID=csi-93a719c06ece6dffcafd3e401069edd2d8d49d7e22785029f2abea58f193f0bb]
E0714 16:05:58.619978  183208 csi_attacher.go:501] kubernetes.io/csi: attachdetacher.WaitForDetach timeout after 2m0s [volume=vol02; attachment.ID=csi-cad5d366e9d018c22553557296636318d4a3d2026611b6ebaa5ab7789ebc7dbb]
E0714 16:06:04.608378  183208 csi_attacher.go:501] kubernetes.io/csi: attachdetacher.WaitForDetach timeout after 2m0s [volume=vol-005; attachment.ID=csi-ff7c66116653c8ed666005fee0f5d218a8e5cb7c3c566f8cf6bd9b0a81fb670f]
E0714 16:06:04.626848  183208 csi_plugin.go:200] kubernetes.io/csi: VolumeAttachmentLister not found on AttachDetachVolumeHost
E0714 16:06:04.640216  183208 csi_plugin.go:200] kubernetes.io/csi: VolumeAttachmentLister not found on AttachDetachVolumeHost
... skipping 10 lines ...
E0714 16:06:04.785811  183208 csi_plugin.go:200] kubernetes.io/csi: VolumeAttachmentLister not found on AttachDetachVolumeHost
E0714 16:06:04.801282  183208 csi_plugin.go:200] kubernetes.io/csi: VolumeAttachmentLister not found on AttachDetachVolumeHost
E0714 16:06:04.820527  183208 csi_plugin.go:200] kubernetes.io/csi: VolumeAttachmentLister not found on AttachDetachVolumeHost
E0714 16:06:04.842788  183208 csi_plugin.go:200] kubernetes.io/csi: VolumeAttachmentLister not found on AttachDetachVolumeHost
I0714 16:06:04.857442  183208 csi_attacher.go:337] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice...
E0714 16:06:04.858930  183208 csi_plugin.go:200] kubernetes.io/csi: VolumeAttachmentLister not found on AttachDetachVolumeHost
E0714 16:06:04.908328  183208 csi_attacher.go:518] kubernetes.io/csi: UnmountDevice failed to load volume data file [/tmp/csi-test606889601/plugins/csi/pv/test-pv-name]: kubernetes.io/csi: failed to open volume data file [/tmp/csi-test606889601/plugins/csi/pv/test-pv-name/vol_data.json]: open /tmp/csi-test606889601/plugins/csi/pv/test-pv-name/vol_data.json: no such file or directory
E0714 16:06:04.922492  183208 csi_attacher.go:518] kubernetes.io/csi: UnmountDevice failed to load volume data file [/tmp/csi-test324022252/plugins/csi/pv/test-pv-name]: kubernetes.io/csi: failed to parse volume data file [/tmp/csi-test324022252/plugins/csi/pv/test-pv-name/vol_data.json]: invalid character '}' after object key
E0714 16:06:04.938855  183208 csi_attacher.go:518] kubernetes.io/csi: UnmountDevice failed to load volume data file [/tmp/csi-test548286555/plugins/csi/pv/test-pv-name]: kubernetes.io/csi: failed to open volume data file [/tmp/csi-test548286555/plugins/csi/pv/test-pv-name/vol_data.json]: open /tmp/csi-test548286555/plugins/csi/pv/test-pv-name/vol_data.json: no such file or directory
E0714 16:06:04.939077  183208 csi_attacher.go:523] kubernetes.io/csi: attacher.UnmountDevice failed to get driver and volume name from device mount path: kubernetes.io/csi: getDriverAndVolNameFromDeviceMountPath failed, VolumeHandle empty
E0714 16:06:04.952418  183208 csi_attacher.go:518] kubernetes.io/csi: UnmountDevice failed to load volume data file [/tmp/csi-test091138558/plugins/csi/pv/test-pv-name]: kubernetes.io/csi: failed to open volume data file [/tmp/csi-test091138558/plugins/csi/pv/test-pv-name/vol_data.json]: open /tmp/csi-test091138558/plugins/csi/pv/test-pv-name/vol_data.json: no such file or directory
E0714 16:06:04.952676  183208 csi_attacher.go:523] kubernetes.io/csi: attacher.UnmountDevice failed to get driver and volume name from device mount path: persistentvolumes "test-pv-name" not found
I0714 16:06:04.970797  183208 csi_attacher.go:544] kubernetes.io/csi: attacher.UnmountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping UnmountDevice...
W0714 16:06:04.973084  183208 feature_gate.go:235] Setting GA feature gate CSIBlockVolume=true. It will be removed in a future release.
W0714 16:06:04.993180  183208 feature_gate.go:235] Setting GA feature gate CSIBlockVolume=true. It will be removed in a future release.
W0714 16:06:04.993840  183208 feature_gate.go:235] Setting GA feature gate CSIBlockVolume=true. It will be removed in a future release.
W0714 16:06:05.113645  183208 feature_gate.go:235] Setting GA feature gate CSIBlockVolume=true. It will be removed in a future release.
W0714 16:06:05.117895  183208 feature_gate.go:235] Setting GA feature gate CSIBlockVolume=true. It will be removed in a future release.
... skipping 9 lines ...
W0714 16:06:05.222357  183208 feature_gate.go:235] Setting GA feature gate CSIBlockVolume=true. It will be removed in a future release.
W0714 16:06:05.237265  183208 feature_gate.go:235] Setting GA feature gate CSIBlockVolume=true. It will be removed in a future release.
W0714 16:06:05.238159  183208 feature_gate.go:235] Setting GA feature gate CSIBlockVolume=true. It will be removed in a future release.
W0714 16:06:05.253981  183208 feature_gate.go:235] Setting GA feature gate CSIBlockVolume=true. It will be removed in a future release.
W0714 16:06:05.254797  183208 feature_gate.go:235] Setting GA feature gate CSIBlockVolume=true. It will be removed in a future release.
W0714 16:06:05.280054  183208 feature_gate.go:235] Setting GA feature gate CSIBlockVolume=true. It will be removed in a future release.
W0714 16:06:05.280828  183208 csi_client.go:164] Error calling CSI NodeGetInfo(): grpc error
I0714 16:06:05.903674  183208 mount_linux.go:366] Disk "/fake/device" appears to be unformatted, attempting to format as type: "testfs" with options: [/fake/device]
I0714 16:06:05.903857  183208 mount_linux.go:376] Disk successfully formatted (mkfs): testfs - /fake/device /tmp/csi-test262972027/pods/test-pod/volumes/kubernetes.io~csi/test-pv/mount
W0714 16:06:05.906408  183208 feature_gate.go:235] Setting GA feature gate CSIBlockVolume=true. It will be removed in a future release.
W0714 16:06:05.918226  183208 feature_gate.go:235] Setting GA feature gate CSIBlockVolume=true. It will be removed in a future release.
W0714 16:06:05.918840  183208 feature_gate.go:235] Setting GA feature gate CSIBlockVolume=true. It will be removed in a future release.
W0714 16:06:05.931603  183208 feature_gate.go:235] Setting GA feature gate CSIBlockVolume=true. It will be removed in a future release.
... skipping 49 lines ...
I0714 16:06:06.746054  183208 csi_plugin.go:99] kubernetes.io/csi: Trying to validate a new CSI Driver with name: test.plugin endpoint: /var/log/kubelet/plugins_registry/myplugin/csi.sock versions: 
I0714 16:06:06.746165  183208 csi_plugin.go:99] kubernetes.io/csi: Trying to validate a new CSI Driver with name: test.plugin endpoint: /var/log/kubelet/plugins_registry/myplugin/csi.sock versions: var,boo,foo
I0714 16:06:06.746957  183208 csi_plugin.go:99] kubernetes.io/csi: Trying to validate a new CSI Driver with name: test.plugin2 endpoint: /var/log/kubelet/plugins_registry/myplugin/csi.sock versions: v1.0.0
I0714 16:06:06.747396  183208 csi_plugin.go:99] kubernetes.io/csi: Trying to validate a new CSI Driver with name: test.plugin endpoint: /var/log/kubelet/plugins_registry/myplugin/csi.sock versions: v1.0.0
I0714 16:06:06.747770  183208 csi_plugin.go:99] kubernetes.io/csi: Trying to validate a new CSI Driver with name: test.plugin endpoint: /var/log/kubelet/plugins_registry/myplugin/csi.sock versions: v1.0.1
E0714 16:06:06.830448  183208 csi_attacher.go:633] kubernetes.io/csi: VolumeAttachment [vol2] has been deleted, will not continue to wait for attachment
--- FAIL: TestCSI_VolumeAll (0.22s)
    --- FAIL: TestCSI_VolumeAll/PersistentVolume_with_driver_info (0.02s)
        csi_test.go:273: csiTest.VolumeAll starting...
        csi_test.go:277: csiTest.VolumeAll Attaching volume...
        csi_test.go:297: csiTest.VolumeAll attacher.Attach starting
        csi_attacher_test.go:97: attachment found on try 0, stopping wait...
        csi_attacher_test.go:101: stopped waiting for attachment
        csi_attacher_test.go:107: updating attachment csi-cded3b60ea6080900744c7a7bc4056ba1b782e6bac83c891b49977cc537663ad with attach status {true map[] nil nil}
... skipping 17 lines ...
        csi_client_test.go:266: calling fake.NodeGetCapabilities for NodeSupportsStageUnstage...
        csi_client_test.go:234: calling fake.NodeUnstageVolume...
        csi_test.go:532: csiTest.VolumeAll deviceUmounter.UnmountDevice done OK for path /tmp/csi-test751753762/plugins/kubernetes.io/csi/pv/pv2/globalmount
        csi_test.go:539: csiTest.VolumeAll Detaching volume...
        csi_test.go:558: csiTest.VolumeAll preparing detacher.Detach...
        csi_test.go:568: csiTest.VolumeAll detacher.Detach succeeded for volume simple-driver^vol2
        csi_test.go:310: csiTest.VolumeAll attacher.Attach failed: volume attachment has been deleted
FAIL
================================================================================
[18,911 / 18,922] 875 / 959 tests; Testing //cmd/kubeadm/app/phases/kubeconfig:go_default_test; 23s processwrapper-sandbox ... (8 actions, 7 running)
[19,280 / 19,281] 958 / 959 tests; Testing //pkg/kubelet/cm/devicemanager:go_default_test; 175s processwrapper-sandbox
[19,280 / 19,281] 958 / 959 tests; Testing //pkg/kubelet/cm/devicemanager:go_default_test; 87s processwrapper-sandbox
[19,280 / 19,281] 958 / 959 tests; Testing //pkg/kubelet/cm/devicemanager:go_default_test; 33s processwrapper-sandbox

... skipping 3 lines ...
      /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/execroot/io_k8s_kubernetes/bazel-out/k8-fastbuild/testlogs/pkg/kubelet/cm/devicemanager/go_default_test/test_attempts/attempt_2.log
INFO: From Testing //pkg/kubelet/cm/devicemanager:go_default_test:
==================== Test output for //pkg/kubelet/cm/devicemanager:go_default_test:
I0714 16:08:55.166758  238596 device_plugin_stub.go:131] Starting to serve on /tmp/mock.sock
I0714 16:08:55.171587  238596 device_plugin_stub.go:131] Starting to serve on /tmp/mock.sock
I0714 16:08:55.176305  238596 device_plugin_stub.go:227] ListAndWatch
E0714 16:08:55.177657  238596 endpoint.go:107] listAndWatch ended unexpectedly for device plugin mock with error rpc error: code = Unavailable desc = transport is closing
I0714 16:08:55.182265  238596 device_plugin_stub.go:131] Starting to serve on /tmp/mock.sock
I0714 16:08:55.188902  238596 device_plugin_stub.go:227] ListAndWatch
I0714 16:08:55.192106  238596 device_plugin_stub.go:261] Allocate, &AllocateRequest{ContainerRequests:[]*ContainerAllocateRequest{&ContainerAllocateRequest{DevicesIDs:[ADeviceId],},},}
E0714 16:08:55.193436  238596 endpoint.go:107] listAndWatch ended unexpectedly for device plugin mock with error rpc error: code = Unavailable desc = transport is closing
I0714 16:08:55.195448  238596 device_plugin_stub.go:131] Starting to serve on /tmp/mock.sock
I0714 16:08:55.198190  238596 device_plugin_stub.go:227] ListAndWatch
I0714 16:08:55.199122  238596 device_plugin_stub.go:248] GetPreferredAllocation, &PreferredAllocationRequest{ContainerRequests:[]*ContainerPreferredAllocationRequest{&ContainerPreferredAllocationRequest{AvailableDeviceIDs:[],MustIncludeDeviceIDs:[],AllocationSize:-1,},},}
E0714 16:08:55.200055  238596 endpoint.go:107] listAndWatch ended unexpectedly for device plugin mock with error rpc error: code = Unavailable desc = transport is closing
I0714 16:08:55.200268  238596 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0714 16:08:55.200658  238596 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
W0714 16:08:55.200944  238596 manager.go:596] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
I0714 16:08:55.202841  238596 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin665234687/device-plugin.sock
I0714 16:08:55.203802  238596 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
W0714 16:08:55.204007  238596 manager.go:596] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
I0714 16:08:55.205254  238596 plugin_manager.go:114] Starting Kubelet Plugin Manager
I0714 16:08:55.207255  238596 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin586333778/device-plugin.sock
I0714 16:08:55.208272  238596 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
W0714 16:08:55.208762  238596 manager.go:596] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
I0714 16:08:55.211935  238596 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin560757641/device-plugin.sock
I0714 16:08:55.212014  238596 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:08:55.216352  238596 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:08:55.219922  238596 device_plugin_stub.go:227] ListAndWatch
I0714 16:08:55.246888  238596 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin560757641/device-plugin.sock.new
I0714 16:08:55.246984  238596 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:08:55.249539  238596 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:08:55.253386  238596 device_plugin_stub.go:227] ListAndWatch
I0714 16:08:55.267689  238596 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin560757641/device-plugin.sock.third
I0714 16:08:55.268020  238596 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:08:55.272358  238596 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:08:55.278830  238596 device_plugin_stub.go:227] ListAndWatch
E0714 16:08:55.288745  238596 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:08:55.289241  238596 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0714 16:08:55.289685  238596 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0714 16:08:55.293469  238596 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin560757641/device-plugin.sock
I0714 16:08:55.293555  238596 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
E0714 16:08:55.295343  238596 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0714 16:08:55.297190  238596 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:08:55.304333  238596 device_plugin_stub.go:227] ListAndWatch
I0714 16:08:55.313201  238596 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin560757641/device-plugin.sock.new
I0714 16:08:55.313293  238596 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:08:55.315661  238596 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:08:55.326211  238596 device_plugin_stub.go:227] ListAndWatch
I0714 16:08:55.336002  238596 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin560757641/device-plugin.sock.third
I0714 16:08:55.336096  238596 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:08:55.338239  238596 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:08:55.341314  238596 device_plugin_stub.go:227] ListAndWatch
E0714 16:08:55.348524  238596 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:08:55.348855  238596 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0714 16:08:55.350178  238596 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
E0714 16:08:55.350468  238596 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0714 16:08:55.353846  238596 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin560757641/device-plugin.sock
I0714 16:08:55.353919  238596 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:08:55.356092  238596 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:08:55.364558  238596 device_plugin_stub.go:227] ListAndWatch
I0714 16:08:55.371208  238596 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin560757641/device-plugin.sock.new
I0714 16:08:55.371308  238596 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:08:55.374652  238596 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:08:55.381167  238596 device_plugin_stub.go:227] ListAndWatch
I0714 16:08:55.392031  238596 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin560757641/device-plugin.sock.third
I0714 16:08:55.392131  238596 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:08:55.394272  238596 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:08:55.406139  238596 device_plugin_stub.go:227] ListAndWatch
E0714 16:08:55.411331  238596 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:08:55.412585  238596 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0714 16:08:55.412892  238596 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
E0714 16:08:55.413247  238596 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0714 16:08:55.418218  238596 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin560757641/device-plugin.sock
I0714 16:08:55.418312  238596 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:08:55.420431  238596 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:08:55.423481  238596 device_plugin_stub.go:227] ListAndWatch
I0714 16:08:55.432748  238596 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin560757641/device-plugin.sock.new
I0714 16:08:55.432842  238596 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:08:55.434989  238596 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:08:55.438147  238596 device_plugin_stub.go:227] ListAndWatch
I0714 16:08:55.446358  238596 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin560757641/device-plugin.sock.third
I0714 16:08:55.446456  238596 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:08:55.448752  238596 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:08:55.453077  238596 device_plugin_stub.go:227] ListAndWatch
E0714 16:08:55.458848  238596 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:08:55.459258  238596 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:08:55.459904  238596 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0714 16:08:55.460177  238596 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
W0714 16:08:55.460391  238596 manager.go:596] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
I0714 16:08:55.462416  238596 plugin_manager.go:114] Starting Kubelet Plugin Manager
I0714 16:08:55.462663  238596 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin969482352/device-plugin.sock
I0714 16:08:55.472056  238596 device_plugin_stub.go:153] GetInfo
E0714 16:08:55.472915  238596 goroutinemap.go:150] Operation for "/tmp/device_plugin969482352/server.sock" failed. No retries permitted until 2021-07-14 16:08:55.972736574 +0000 UTC m=+0.927296590 (durationBeforeRetry 500ms). Error: "RegisterPlugin error -- failed to get plugin info using RPC GetInfo at socket /tmp/device_plugin969482352/server.sock, err: rpc error: code = Unimplemented desc = unknown service pluginregistration.Registration"
I0714 16:08:55.478954  238596 device_plugin_stub.go:227] ListAndWatch
I0714 16:08:55.486280  238596 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin969482352/device-plugin.sock.new
I0714 16:08:56.466685  238596 device_plugin_stub.go:153] GetInfo
E0714 16:08:56.467751  238596 goroutinemap.go:150] Operation for "/tmp/device_plugin969482352/server.sock" failed. No retries permitted until 2021-07-14 16:08:57.467556661 +0000 UTC m=+2.422116680 (durationBeforeRetry 1s). Error: "RegisterPlugin error -- failed to get plugin info using RPC GetInfo at socket /tmp/device_plugin969482352/server.sock, err: rpc error: code = Unimplemented desc = unknown service pluginregistration.Registration"
I0714 16:08:56.472576  238596 device_plugin_stub.go:227] ListAndWatch
I0714 16:08:56.489897  238596 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin969482352/device-plugin.sock.third
I0714 16:08:57.468000  238596 device_plugin_stub.go:153] GetInfo
I0714 16:08:57.474300  238596 device_plugin_stub.go:227] ListAndWatch
E0714 16:08:57.493480  238596 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:08:57.494701  238596 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:08:57.495141  238596 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0714 16:08:57.496270  238596 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
E0714 16:08:57.512846  238596 manager.go:546] unexpected: unhealthyDevices and endpoints are out of sync
I0714 16:08:57.528555  238596 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0714 16:08:57.528792  238596 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 99c3bcae-2931-4939-8075-95443292be1f container name:  
I0714 16:08:57.528892  238596 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 99c3bcae-2931-4939-8075-95443292be1f container name:  
I0714 16:08:57.533286  238596 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 88239d46-806d-4f0d-8e97-159aac0b83ae container name:  
... skipping 2 lines ...
I0714 16:08:57.543144  238596 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: be1d4cc1-b2d3-45bd-adf3-e003dce258e6 container name:  10ed0a2b-4d37-43e2-a4d9-66d3bf8629ab
I0714 16:08:57.547522  238596 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: be1d4cc1-b2d3-45bd-adf3-e003dce258e6 container name:  858aa35c-9c30-4034-884a-15727e7d56b3
I0714 16:08:57.551764  238596 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: be1d4cc1-b2d3-45bd-adf3-e003dce258e6 container name:  0ce840fd-6009-4a71-a7d0-a7699b2672ea
I0714 16:08:57.558794  238596 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0714 16:08:57.558926  238596 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 13bb9149-0517-4ff6-9992-7741a230f84b container name:  
I0714 16:08:57.567206  238596 topology_hints.go:49] [devicemanager] Resource 'testdevice' does not have a topology preference
E0714 16:09:05.208888  238596 goroutinemap.go:150] Operation for "/tmp/device_plugin586333778/device-plugin.sock" failed. No retries permitted until 2021-07-14 16:09:05.708695376 +0000 UTC m=+10.663255436 (durationBeforeRetry 500ms). Error: "RegisterPlugin error -- dial failed at socket /tmp/device_plugin586333778/device-plugin.sock, err: failed to dial socket /tmp/device_plugin586333778/device-plugin.sock, err: context deadline exceeded"
E0714 16:09:05.210360  238596 goroutinemap.go:150] Operation for "/tmp/device_plugin586333778/server.sock" failed. No retries permitted until 2021-07-14 16:09:05.710194409 +0000 UTC m=+10.664754437 (durationBeforeRetry 500ms). Error: "RegisterPlugin error -- dial failed at socket /tmp/device_plugin586333778/server.sock, err: failed to dial socket /tmp/device_plugin586333778/server.sock, err: context deadline exceeded"
Terminated
-- Test timed out at 2021-07-14 16:13:54 UTC --
================================================================================
==================== Test output for //pkg/kubelet/cm/devicemanager:go_default_test:
I0714 16:14:10.202245  241486 device_plugin_stub.go:131] Starting to serve on /tmp/mock.sock
I0714 16:14:10.207056  241486 device_plugin_stub.go:131] Starting to serve on /tmp/mock.sock
I0714 16:14:10.211265  241486 device_plugin_stub.go:227] ListAndWatch
E0714 16:14:10.213053  241486 endpoint.go:107] listAndWatch ended unexpectedly for device plugin mock with error rpc error: code = Unavailable desc = transport is closing
I0714 16:14:10.214973  241486 device_plugin_stub.go:131] Starting to serve on /tmp/mock.sock
I0714 16:14:10.219818  241486 device_plugin_stub.go:227] ListAndWatch
I0714 16:14:10.221190  241486 device_plugin_stub.go:261] Allocate, &AllocateRequest{ContainerRequests:[]*ContainerAllocateRequest{&ContainerAllocateRequest{DevicesIDs:[ADeviceId],},},}
E0714 16:14:10.222326  241486 endpoint.go:107] listAndWatch ended unexpectedly for device plugin mock with error rpc error: code = Unavailable desc = transport is closing
I0714 16:14:10.224764  241486 device_plugin_stub.go:131] Starting to serve on /tmp/mock.sock
I0714 16:14:10.227212  241486 device_plugin_stub.go:227] ListAndWatch
I0714 16:14:10.228329  241486 device_plugin_stub.go:248] GetPreferredAllocation, &PreferredAllocationRequest{ContainerRequests:[]*ContainerPreferredAllocationRequest{&ContainerPreferredAllocationRequest{AvailableDeviceIDs:[],MustIncludeDeviceIDs:[],AllocationSize:-1,},},}
E0714 16:14:10.229353  241486 endpoint.go:107] listAndWatch ended unexpectedly for device plugin mock with error rpc error: code = Unavailable desc = transport is closing
I0714 16:14:10.229829  241486 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0714 16:14:10.230384  241486 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
W0714 16:14:10.230750  241486 manager.go:596] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
I0714 16:14:10.233867  241486 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin782231302/device-plugin.sock
I0714 16:14:10.234730  241486 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
W0714 16:14:10.235132  241486 manager.go:596] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
I0714 16:14:10.236203  241486 plugin_manager.go:114] Starting Kubelet Plugin Manager
I0714 16:14:10.239168  241486 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin135280813/device-plugin.sock
I0714 16:14:10.241230  241486 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
W0714 16:14:10.241429  241486 manager.go:596] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
I0714 16:14:10.243025  241486 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin972302888/device-plugin.sock
I0714 16:14:10.243087  241486 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:14:10.244840  241486 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:14:10.247948  241486 device_plugin_stub.go:227] ListAndWatch
I0714 16:14:10.256158  241486 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin972302888/device-plugin.sock.new
I0714 16:14:10.256242  241486 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:14:10.258838  241486 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:14:10.264043  241486 device_plugin_stub.go:227] ListAndWatch
I0714 16:14:10.270092  241486 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin972302888/device-plugin.sock.third
I0714 16:14:10.270163  241486 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:14:10.272261  241486 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:14:10.274967  241486 device_plugin_stub.go:227] ListAndWatch
E0714 16:14:10.279046  241486 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:14:10.279534  241486 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:14:10.279831  241486 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0714 16:14:10.280106  241486 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0714 16:14:10.282654  241486 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin972302888/device-plugin.sock
I0714 16:14:10.282717  241486 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:14:10.284519  241486 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:14:10.289433  241486 device_plugin_stub.go:227] ListAndWatch
I0714 16:14:10.294581  241486 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin972302888/device-plugin.sock.new
I0714 16:14:10.294648  241486 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:14:10.296602  241486 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:14:10.299268  241486 device_plugin_stub.go:227] ListAndWatch
I0714 16:14:10.304970  241486 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin972302888/device-plugin.sock.third
I0714 16:14:10.305056  241486 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:14:10.306973  241486 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:14:10.311038  241486 device_plugin_stub.go:227] ListAndWatch
E0714 16:14:10.316409  241486 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:14:10.316545  241486 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0714 16:14:10.317103  241486 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
E0714 16:14:10.317133  241486 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0714 16:14:10.319499  241486 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin972302888/device-plugin.sock
I0714 16:14:10.319559  241486 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:14:10.321269  241486 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:14:10.323669  241486 device_plugin_stub.go:227] ListAndWatch
I0714 16:14:10.329077  241486 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin972302888/device-plugin.sock.new
I0714 16:14:10.329154  241486 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:14:10.330989  241486 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:14:10.333908  241486 device_plugin_stub.go:227] ListAndWatch
I0714 16:14:10.340525  241486 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin972302888/device-plugin.sock.third
I0714 16:14:10.340614  241486 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:14:10.343414  241486 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:14:10.348044  241486 device_plugin_stub.go:227] ListAndWatch
E0714 16:14:10.352345  241486 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:14:10.352577  241486 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:14:10.353139  241486 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0714 16:14:10.353234  241486 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0714 16:14:10.355530  241486 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin972302888/device-plugin.sock
I0714 16:14:10.355612  241486 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:14:10.357566  241486 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:14:10.360089  241486 device_plugin_stub.go:227] ListAndWatch
I0714 16:14:10.364833  241486 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin972302888/device-plugin.sock.new
I0714 16:14:10.364912  241486 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:14:10.366891  241486 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:14:10.369532  241486 device_plugin_stub.go:227] ListAndWatch
I0714 16:14:10.374604  241486 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin972302888/device-plugin.sock.third
I0714 16:14:10.374671  241486 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:14:10.378363  241486 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:14:10.380741  241486 device_plugin_stub.go:227] ListAndWatch
E0714 16:14:10.384890  241486 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:14:10.385270  241486 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:14:10.385606  241486 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0714 16:14:10.386370  241486 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
W0714 16:14:10.386589  241486 manager.go:596] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
I0714 16:14:10.387541  241486 plugin_manager.go:114] Starting Kubelet Plugin Manager
I0714 16:14:10.388603  241486 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin693098643/device-plugin.sock
I0714 16:14:10.390345  241486 device_plugin_stub.go:153] GetInfo
E0714 16:14:10.391323  241486 goroutinemap.go:150] Operation for "/tmp/device_plugin693098643/server.sock" failed. No retries permitted until 2021-07-14 16:14:10.891162752 +0000 UTC m=+0.799414698 (durationBeforeRetry 500ms). Error: "RegisterPlugin error -- failed to get plugin info using RPC GetInfo at socket /tmp/device_plugin693098643/server.sock, err: rpc error: code = Unimplemented desc = unknown service pluginregistration.Registration"
I0714 16:14:10.394546  241486 device_plugin_stub.go:227] ListAndWatch
I0714 16:14:10.400425  241486 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin693098643/device-plugin.sock.new
I0714 16:14:11.391256  241486 device_plugin_stub.go:153] GetInfo
E0714 16:14:11.392051  241486 goroutinemap.go:150] Operation for "/tmp/device_plugin693098643/server.sock" failed. No retries permitted until 2021-07-14 16:14:12.391898015 +0000 UTC m=+2.300149920 (durationBeforeRetry 1s). Error: "RegisterPlugin error -- failed to get plugin info using RPC GetInfo at socket /tmp/device_plugin693098643/server.sock, err: rpc error: code = Unimplemented desc = unknown service pluginregistration.Registration"
I0714 16:14:11.395036  241486 device_plugin_stub.go:227] ListAndWatch
I0714 16:14:11.401075  241486 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin693098643/device-plugin.sock.third
I0714 16:14:12.392695  241486 device_plugin_stub.go:153] GetInfo
I0714 16:14:12.398832  241486 device_plugin_stub.go:227] ListAndWatch
E0714 16:14:12.404664  241486 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:14:12.404945  241486 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:14:12.405558  241486 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0714 16:14:12.406173  241486 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
E0714 16:14:12.420673  241486 manager.go:546] unexpected: unhealthyDevices and endpoints are out of sync
I0714 16:14:12.433393  241486 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0714 16:14:12.433645  241486 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 509dab20-632e-4ac7-9155-b62764a3758e container name:  
I0714 16:14:12.433728  241486 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 509dab20-632e-4ac7-9155-b62764a3758e container name:  
I0714 16:14:12.437451  241486 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 2549d22e-58de-42c1-8936-b9272363ab84 container name:  
... skipping 2 lines ...
I0714 16:14:12.444905  241486 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 2f678ee6-a141-49ce-a52a-aeed7278f817 container name:  e665f5ab-11ca-4c6f-99e9-44c36c0a24a5
I0714 16:14:12.448381  241486 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 2f678ee6-a141-49ce-a52a-aeed7278f817 container name:  d5eeabdf-1221-41a8-ba54-159d36549c3c
I0714 16:14:12.452073  241486 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 2f678ee6-a141-49ce-a52a-aeed7278f817 container name:  5ce4ebda-91b9-453d-bf49-90efcd107cbb
I0714 16:14:12.456936  241486 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0714 16:14:12.457084  241486 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: aa25cec6-e404-47e8-8215-79187b52662a container name:  
I0714 16:14:12.464654  241486 topology_hints.go:49] [devicemanager] Resource 'testdevice' does not have a topology preference
E0714 16:14:20.238527  241486 goroutinemap.go:150] Operation for "/tmp/device_plugin135280813/device-plugin.sock" failed. No retries permitted until 2021-07-14 16:14:20.738398469 +0000 UTC m=+10.646650372 (durationBeforeRetry 500ms). Error: "RegisterPlugin error -- dial failed at socket /tmp/device_plugin135280813/device-plugin.sock, err: failed to dial socket /tmp/device_plugin135280813/device-plugin.sock, err: context deadline exceeded"
E0714 16:14:20.239019  241486 goroutinemap.go:150] Operation for "/tmp/device_plugin135280813/server.sock" failed. No retries permitted until 2021-07-14 16:14:20.73886531 +0000 UTC m=+10.647117210 (durationBeforeRetry 500ms). Error: "RegisterPlugin error -- dial failed at socket /tmp/device_plugin135280813/server.sock, err: failed to dial socket /tmp/device_plugin135280813/server.sock, err: context deadline exceeded"
Terminated
-- Test timed out at 2021-07-14 16:19:09 UTC --
================================================================================
==================== Test output for //pkg/kubelet/cm/devicemanager:go_default_test:
I0714 16:19:25.169642  241544 device_plugin_stub.go:131] Starting to serve on /tmp/mock.sock
I0714 16:19:25.174060  241544 device_plugin_stub.go:131] Starting to serve on /tmp/mock.sock
I0714 16:19:25.177598  241544 device_plugin_stub.go:227] ListAndWatch
E0714 16:19:25.178818  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin mock with error rpc error: code = Unavailable desc = transport is closing
I0714 16:19:25.180674  241544 device_plugin_stub.go:131] Starting to serve on /tmp/mock.sock
I0714 16:19:25.184432  241544 device_plugin_stub.go:227] ListAndWatch
I0714 16:19:25.185546  241544 device_plugin_stub.go:261] Allocate, &AllocateRequest{ContainerRequests:[]*ContainerAllocateRequest{&ContainerAllocateRequest{DevicesIDs:[ADeviceId],},},}
E0714 16:19:25.186565  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin mock with error rpc error: code = Unavailable desc = transport is closing
I0714 16:19:25.188350  241544 device_plugin_stub.go:131] Starting to serve on /tmp/mock.sock
I0714 16:19:25.190397  241544 device_plugin_stub.go:227] ListAndWatch
I0714 16:19:25.191286  241544 device_plugin_stub.go:248] GetPreferredAllocation, &PreferredAllocationRequest{ContainerRequests:[]*ContainerPreferredAllocationRequest{&ContainerPreferredAllocationRequest{AvailableDeviceIDs:[],MustIncludeDeviceIDs:[],AllocationSize:-1,},},}
E0714 16:19:25.192535  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin mock with error rpc error: code = Unavailable desc = transport is closing
I0714 16:19:25.192669  241544 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0714 16:19:25.193061  241544 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
W0714 16:19:25.193274  241544 manager.go:596] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
I0714 16:19:25.194907  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin990032412/device-plugin.sock
I0714 16:19:25.196035  241544 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
W0714 16:19:25.196203  241544 manager.go:596] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
I0714 16:19:25.197047  241544 plugin_manager.go:114] Starting Kubelet Plugin Manager
I0714 16:19:25.198703  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin547186891/device-plugin.sock
I0714 16:19:25.201244  241544 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
W0714 16:19:25.201511  241544 manager.go:596] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
I0714 16:19:25.203234  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin623954350/device-plugin.sock
I0714 16:19:25.203342  241544 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:19:25.205272  241544 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:19:25.207957  241544 device_plugin_stub.go:227] ListAndWatch
I0714 16:19:25.215769  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin623954350/device-plugin.sock.new
I0714 16:19:25.215880  241544 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:19:25.218254  241544 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:19:25.222126  241544 device_plugin_stub.go:227] ListAndWatch
I0714 16:19:25.227619  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin623954350/device-plugin.sock.third
I0714 16:19:25.227735  241544 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:19:25.229645  241544 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:19:25.232107  241544 device_plugin_stub.go:227] ListAndWatch
E0714 16:19:25.236331  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:19:25.236759  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0714 16:19:25.237163  241544 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
E0714 16:19:25.237194  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0714 16:19:25.239324  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin623954350/device-plugin.sock
I0714 16:19:25.239396  241544 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:19:25.241276  241544 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:19:25.245370  241544 device_plugin_stub.go:227] ListAndWatch
I0714 16:19:25.250828  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin623954350/device-plugin.sock.new
I0714 16:19:25.250894  241544 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:19:25.253013  241544 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:19:25.255557  241544 device_plugin_stub.go:227] ListAndWatch
I0714 16:19:25.260578  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin623954350/device-plugin.sock.third
I0714 16:19:25.260639  241544 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:19:25.262523  241544 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:19:25.266196  241544 device_plugin_stub.go:227] ListAndWatch
E0714 16:19:25.270389  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:19:25.270615  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:19:25.270952  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0714 16:19:25.271249  241544 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0714 16:19:25.273318  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin623954350/device-plugin.sock
I0714 16:19:25.273391  241544 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:19:25.275162  241544 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:19:25.277419  241544 device_plugin_stub.go:227] ListAndWatch
I0714 16:19:25.282436  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin623954350/device-plugin.sock.new
I0714 16:19:25.282500  241544 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:19:25.284273  241544 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:19:25.286748  241544 device_plugin_stub.go:227] ListAndWatch
I0714 16:19:25.293271  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin623954350/device-plugin.sock.third
I0714 16:19:25.293352  241544 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:19:25.295175  241544 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:19:25.297454  241544 device_plugin_stub.go:227] ListAndWatch
E0714 16:19:25.301401  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:19:25.301702  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:19:25.302098  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0714 16:19:25.302514  241544 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0714 16:19:25.304347  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin623954350/device-plugin.sock
I0714 16:19:25.304404  241544 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:19:25.306201  241544 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:19:25.308489  241544 device_plugin_stub.go:227] ListAndWatch
I0714 16:19:25.313383  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin623954350/device-plugin.sock.new
I0714 16:19:25.313444  241544 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:19:25.316687  241544 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:19:25.319188  241544 device_plugin_stub.go:227] ListAndWatch
I0714 16:19:25.324035  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin623954350/device-plugin.sock.third
I0714 16:19:25.324127  241544 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0714 16:19:25.325911  241544 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0714 16:19:25.328366  241544 device_plugin_stub.go:227] ListAndWatch
E0714 16:19:25.332235  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:19:25.332590  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:19:25.333022  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0714 16:19:25.333754  241544 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
W0714 16:19:25.334028  241544 manager.go:596] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
I0714 16:19:25.334961  241544 plugin_manager.go:114] Starting Kubelet Plugin Manager
I0714 16:19:25.337482  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin650473985/device-plugin.sock
I0714 16:19:25.339443  241544 device_plugin_stub.go:153] GetInfo
E0714 16:19:25.340224  241544 goroutinemap.go:150] Operation for "/tmp/device_plugin650473985/server.sock" failed. No retries permitted until 2021-07-14 16:19:25.840020125 +0000 UTC m=+0.756120013 (durationBeforeRetry 500ms). Error: "RegisterPlugin error -- failed to get plugin info using RPC GetInfo at socket /tmp/device_plugin650473985/server.sock, err: rpc error: code = Unimplemented desc = unknown service pluginregistration.Registration"
I0714 16:19:25.343106  241544 device_plugin_stub.go:227] ListAndWatch
I0714 16:19:25.348380  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin650473985/device-plugin.sock.new
I0714 16:19:26.339265  241544 device_plugin_stub.go:153] GetInfo
E0714 16:19:26.339747  241544 goroutinemap.go:150] Operation for "/tmp/device_plugin650473985/server.sock" failed. No retries permitted until 2021-07-14 16:19:27.339594875 +0000 UTC m=+2.255694748 (durationBeforeRetry 1s). Error: "RegisterPlugin error -- failed to get plugin info using RPC GetInfo at socket /tmp/device_plugin650473985/server.sock, err: rpc error: code = Unimplemented desc = unknown service pluginregistration.Registration"
I0714 16:19:26.343208  241544 device_plugin_stub.go:227] ListAndWatch
I0714 16:19:26.348190  241544 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin650473985/device-plugin.sock.third
I0714 16:19:27.341616  241544 device_plugin_stub.go:153] GetInfo
I0714 16:19:27.345974  241544 device_plugin_stub.go:227] ListAndWatch
E0714 16:19:27.350939  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:19:27.351308  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0714 16:19:27.351670  241544 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0714 16:19:27.352801  241544 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
E0714 16:19:27.367260  241544 manager.go:546] unexpected: unhealthyDevices and endpoints are out of sync
I0714 16:19:27.380263  241544 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0714 16:19:27.380508  241544 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 8e0eba7d-5218-45ad-b62a-0f806cd17158 container name:  
I0714 16:19:27.380577  241544 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 8e0eba7d-5218-45ad-b62a-0f806cd17158 container name:  
I0714 16:19:27.384852  241544 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: f13afa70-42fa-4d91-b118-46e1dd331ffd container name:  
... skipping 2 lines ...
I0714 16:19:27.391889  241544 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 56ea4122-b0ff-4042-b388-62dc181b0909 container name:  e66b449e-0588-49a1-8f64-868c7bf674bc
I0714 16:19:27.395102  241544 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 56ea4122-b0ff-4042-b388-62dc181b0909 container name:  e981fd5f-8c6e-4846-b73b-8ba65af13a39
I0714 16:19:27.398871  241544 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 56ea4122-b0ff-4042-b388-62dc181b0909 container name:  c4f9a389-528f-444b-a4f6-02d699d381a4
I0714 16:19:27.403880  241544 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0714 16:19:27.404016  241544 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 74192176-6e07-43b8-bb6d-7d51b8000ed1 container name:  
I0714 16:19:27.411357  241544 topology_hints.go:49] [devicemanager] Resource 'testdevice' does not have a topology preference
E0714 16:19:35.198529  241544 goroutinemap.go:150] Operation for "/tmp/device_plugin547186891/server.sock" failed. No retries permitted until 2021-07-14 16:19:35.698386014 +0000 UTC m=+10.614485937 (durationBeforeRetry 500ms). Error: "RegisterPlugin error -- dial failed at socket /tmp/device_plugin547186891/server.sock, err: failed to dial socket /tmp/device_plugin547186891/server.sock, err: context deadline exceeded"
E0714 16:19:35.198794  241544 goroutinemap.go:150] Operation for "/tmp/device_plugin547186891/device-plugin.sock" failed. No retries permitted until 2021-07-14 16:19:35.698662035 +0000 UTC m=+10.614761908 (durationBeforeRetry 500ms). Error: "RegisterPlugin error -- dial failed at socket /tmp/device_plugin547186891/device-plugin.sock, err: failed to dial socket /tmp/device_plugin547186891/device-plugin.sock, err: context deadline exceeded"
Terminated
-- Test timed out at 2021-07-14 16:24:24 UTC --
================================================================================
INFO: Elapsed time: 2289.798s, Critical Path: 1027.44s
INFO: 17357 processes: 17357 processwrapper-sandbox.
INFO: Build completed, 1 test FAILED, 19281 total actions
//cluster:common_test                                                    PASSED in 0.2s
//cluster:kube-util_test                                                 PASSED in 0.0s
//cluster/gce/cos:go_default_test                                        PASSED in 3.5s
//cluster/gce/custom:go_default_test                                     PASSED in 5.3s
//cluster/gce/gci:go_default_test                                        PASSED in 6.9s
//cluster/gce/ubuntu:go_default_test                                     PASSED in 4.8s
... skipping 945 lines ...
//test/list:go_default_test                                              PASSED in 0.2s
//test/typecheck:go_default_test                                         PASSED in 15.2s
//test/utils/image:go_default_test                                       PASSED in 0.1s
//third_party/forked/golang/expansion:go_default_test                    PASSED in 0.3s
//third_party/forked/golang/reflect:go_default_test                      PASSED in 0.1s
//third_party/forked/gonum/graph/simple:go_default_test                  PASSED in 0.1s
//pkg/volume/csi:go_default_test                                          FLAKY, failed in 1 out of 2 in 131.1s
  Stats over 2 runs: max = 131.1s, min = 130.6s, avg = 130.8s, dev = 0.2s
  /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/execroot/io_k8s_kubernetes/bazel-out/k8-fastbuild/testlogs/pkg/volume/csi/go_default_test/test_attempts/attempt_1.log
//pkg/kubelet/cm/devicemanager:go_default_test                          TIMEOUT in 3 out of 3 in 315.0s
  Stats over 3 runs: max = 315.0s, min = 315.0s, avg = 315.0s, dev = 0.0s
  /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/execroot/io_k8s_kubernetes/bazel-out/k8-fastbuild/testlogs/pkg/kubelet/cm/devicemanager/go_default_test/test.log
  /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/execroot/io_k8s_kubernetes/bazel-out/k8-fastbuild/testlogs/pkg/kubelet/cm/devicemanager/go_default_test/test_attempts/attempt_1.log
  /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/execroot/io_k8s_kubernetes/bazel-out/k8-fastbuild/testlogs/pkg/kubelet/cm/devicemanager/go_default_test/test_attempts/attempt_2.log

Executed 959 out of 959 tests: 958 tests pass and 1 fails locally.
There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are.
INFO: Build completed, 1 test FAILED, 19281 total actions
+ ../test-infra/hack/coalesce.py
+ exit 3