This job view page is being replaced by Spyglass soon. Check out the new job view.
PRdimakow: Add missing locks for device-manager in 1.19
ResultFAILURE
Tests 1 failed / 956 succeeded
Started2021-07-15 14:51
Elapsed30m9s
Revisiona5bc0bbf20d6aed568561979b88d8075f5313787
Refs 103262

Test Failures


//pkg/kubelet/cm/devicemanager:go_default_test 0.00s

bazel test //pkg/kubelet/cm/devicemanager:go_default_test
exec ${PAGER:-/usr/bin/less} "$0" || exit 1
Executing tests from //pkg/kubelet/cm/devicemanager:go_default_test
-----------------------------------------------------------------------------
I0715 15:16:22.953807  241453 device_plugin_stub.go:131] Starting to serve on /tmp/mock.sock
I0715 15:16:22.957232  241453 device_plugin_stub.go:131] Starting to serve on /tmp/mock.sock
I0715 15:16:22.960679  241453 device_plugin_stub.go:227] ListAndWatch
E0715 15:16:22.961912  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin mock with error rpc error: code = Unavailable desc = transport is closing
I0715 15:16:22.964630  241453 device_plugin_stub.go:131] Starting to serve on /tmp/mock.sock
I0715 15:16:22.967335  241453 device_plugin_stub.go:227] ListAndWatch
I0715 15:16:22.968531  241453 device_plugin_stub.go:261] Allocate, &AllocateRequest{ContainerRequests:[]*ContainerAllocateRequest{&ContainerAllocateRequest{DevicesIDs:[ADeviceId],},},}
E0715 15:16:22.969547  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin mock with error rpc error: code = Unavailable desc = transport is closing
I0715 15:16:22.970969  241453 device_plugin_stub.go:131] Starting to serve on /tmp/mock.sock
I0715 15:16:22.972971  241453 device_plugin_stub.go:227] ListAndWatch
I0715 15:16:22.973860  241453 device_plugin_stub.go:248] GetPreferredAllocation, &PreferredAllocationRequest{ContainerRequests:[]*ContainerPreferredAllocationRequest{&ContainerPreferredAllocationRequest{AvailableDeviceIDs:[],MustIncludeDeviceIDs:[],AllocationSize:-1,},},}
E0715 15:16:22.974715  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin mock with error rpc error: code = Unavailable desc = transport is closing
I0715 15:16:22.974946  241453 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0715 15:16:22.975312  241453 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
W0715 15:16:22.975501  241453 manager.go:596] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
I0715 15:16:22.977430  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin552288033/device-plugin.sock
I0715 15:16:22.978177  241453 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
W0715 15:16:22.978442  241453 manager.go:596] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
I0715 15:16:22.979311  241453 plugin_manager.go:114] Starting Kubelet Plugin Manager
I0715 15:16:22.981936  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin365564940/device-plugin.sock
I0715 15:16:22.983689  241453 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
W0715 15:16:22.983890  241453 manager.go:596] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
I0715 15:16:22.985337  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin503996923/device-plugin.sock
I0715 15:16:22.985401  241453 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:16:22.987128  241453 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:16:22.989892  241453 device_plugin_stub.go:227] ListAndWatch
I0715 15:16:22.996352  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin503996923/device-plugin.sock.new
I0715 15:16:22.996412  241453 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:16:22.999250  241453 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:16:23.001672  241453 device_plugin_stub.go:227] ListAndWatch
I0715 15:16:23.006331  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin503996923/device-plugin.sock.third
I0715 15:16:23.006399  241453 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:16:23.008052  241453 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:16:23.010431  241453 device_plugin_stub.go:227] ListAndWatch
E0715 15:16:23.013800  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0715 15:16:23.014058  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0715 15:16:23.014650  241453 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
E0715 15:16:23.014669  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0715 15:16:23.016521  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin503996923/device-plugin.sock
I0715 15:16:23.016607  241453 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:16:23.019407  241453 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:16:23.021665  241453 device_plugin_stub.go:227] ListAndWatch
I0715 15:16:23.026016  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin503996923/device-plugin.sock.new
I0715 15:16:23.026067  241453 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:16:23.027819  241453 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:16:23.030128  241453 device_plugin_stub.go:227] ListAndWatch
I0715 15:16:23.034291  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin503996923/device-plugin.sock.third
I0715 15:16:23.034342  241453 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:16:23.036437  241453 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:16:23.039869  241453 device_plugin_stub.go:227] ListAndWatch
E0715 15:16:23.043183  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0715 15:16:23.043802  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0715 15:16:23.043939  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0715 15:16:23.044071  241453 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0715 15:16:23.045776  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin503996923/device-plugin.sock
I0715 15:16:23.045827  241453 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:16:23.047895  241453 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:16:23.050303  241453 device_plugin_stub.go:227] ListAndWatch
I0715 15:16:23.054665  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin503996923/device-plugin.sock.new
I0715 15:16:23.054736  241453 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:16:23.056280  241453 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:16:23.059471  241453 device_plugin_stub.go:227] ListAndWatch
I0715 15:16:23.063884  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin503996923/device-plugin.sock.third
I0715 15:16:23.063938  241453 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:16:23.065394  241453 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:16:23.067608  241453 device_plugin_stub.go:227] ListAndWatch
E0715 15:16:23.071149  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0715 15:16:23.071226  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0715 15:16:23.071789  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0715 15:16:23.071848  241453 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0715 15:16:23.073561  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin503996923/device-plugin.sock
I0715 15:16:23.073642  241453 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:16:23.075350  241453 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:16:23.078786  241453 device_plugin_stub.go:227] ListAndWatch
I0715 15:16:23.082875  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin503996923/device-plugin.sock.new
I0715 15:16:23.082941  241453 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:16:23.084620  241453 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:16:23.086690  241453 device_plugin_stub.go:227] ListAndWatch
I0715 15:16:23.090668  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin503996923/device-plugin.sock.third
I0715 15:16:23.090730  241453 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:16:23.092376  241453 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:16:23.095858  241453 device_plugin_stub.go:227] ListAndWatch
E0715 15:16:23.099209  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0715 15:16:23.099520  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0715 15:16:23.100046  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0715 15:16:23.100513  241453 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
W0715 15:16:23.100675  241453 manager.go:596] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
I0715 15:16:23.101332  241453 plugin_manager.go:114] Starting Kubelet Plugin Manager
I0715 15:16:23.102525  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin281450778/device-plugin.sock
I0715 15:16:23.104101  241453 device_plugin_stub.go:153] GetInfo
E0715 15:16:23.104455  241453 goroutinemap.go:150] Operation for "/tmp/device_plugin281450778/server.sock" failed. No retries permitted until 2021-07-15 15:16:23.604263372 +0000 UTC m=+0.726839149 (durationBeforeRetry 500ms). Error: "RegisterPlugin error -- failed to get plugin info using RPC GetInfo at socket /tmp/device_plugin281450778/server.sock, err: rpc error: code = Unimplemented desc = unknown service pluginregistration.Registration"
I0715 15:16:23.107315  241453 device_plugin_stub.go:227] ListAndWatch
I0715 15:16:23.111494  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin281450778/device-plugin.sock.new
I0715 15:16:24.106177  241453 device_plugin_stub.go:153] GetInfo
E0715 15:16:24.107214  241453 goroutinemap.go:150] Operation for "/tmp/device_plugin281450778/server.sock" failed. No retries permitted until 2021-07-15 15:16:25.107100363 +0000 UTC m=+2.229676153 (durationBeforeRetry 1s). Error: "RegisterPlugin error -- failed to get plugin info using RPC GetInfo at socket /tmp/device_plugin281450778/server.sock, err: rpc error: code = Unimplemented desc = unknown service pluginregistration.Registration"
I0715 15:16:24.109949  241453 device_plugin_stub.go:227] ListAndWatch
I0715 15:16:24.114688  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin281450778/device-plugin.sock.third
I0715 15:16:25.105459  241453 device_plugin_stub.go:153] GetInfo
I0715 15:16:25.109581  241453 device_plugin_stub.go:227] ListAndWatch
E0715 15:16:25.114031  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0715 15:16:25.114149  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0715 15:16:25.114592  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0715 15:16:25.115447  241453 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
E0715 15:16:25.127692  241453 manager.go:546] unexpected: unhealthyDevices and endpoints are out of sync
I0715 15:16:25.140277  241453 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0715 15:16:25.140507  241453 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 63a636f4-37db-4ec2-9018-ab16b77c9c06 container name:  
I0715 15:16:25.140584  241453 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 63a636f4-37db-4ec2-9018-ab16b77c9c06 container name:  
I0715 15:16:25.143794  241453 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 6e43fcdb-9663-4664-a525-6ec76d942343 container name:  
I0715 15:16:25.147005  241453 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0715 15:16:25.147149  241453 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: ceafaa68-7cfb-4e0f-9d96-f437333ab263 container name:  21d607a6-4861-4661-b8a8-9200a8c7f174
I0715 15:16:25.149791  241453 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: ceafaa68-7cfb-4e0f-9d96-f437333ab263 container name:  37415cbc-753b-40b9-811e-cca6275af825
I0715 15:16:25.152566  241453 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: ceafaa68-7cfb-4e0f-9d96-f437333ab263 container name:  d6917494-631b-4f0e-aee5-c154333cfa3b
I0715 15:16:25.155453  241453 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: ceafaa68-7cfb-4e0f-9d96-f437333ab263 container name:  6ae8b93c-a1a5-405d-a728-9899fa32a38e
I0715 15:16:25.159645  241453 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0715 15:16:25.159745  241453 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 1cb19f9c-1508-4f89-963c-648320d8f315 container name:  
I0715 15:16:25.165879  241453 topology_hints.go:49] [devicemanager] Resource 'testdevice' does not have a topology preference
E0715 15:16:32.981808  241453 goroutinemap.go:150] Operation for "/tmp/device_plugin365564940/device-plugin.sock" failed. No retries permitted until 2021-07-15 15:16:33.481587777 +0000 UTC m=+10.604163580 (durationBeforeRetry 500ms). Error: "RegisterPlugin error -- dial failed at socket /tmp/device_plugin365564940/device-plugin.sock, err: failed to dial socket /tmp/device_plugin365564940/device-plugin.sock, err: context deadline exceeded"
E0715 15:16:32.982225  241453 goroutinemap.go:150] Operation for "/tmp/device_plugin365564940/server.sock" failed. No retries permitted until 2021-07-15 15:16:33.482111453 +0000 UTC m=+10.604687237 (durationBeforeRetry 500ms). Error: "RegisterPlugin error -- dial failed at socket /tmp/device_plugin365564940/server.sock, err: failed to dial socket /tmp/device_plugin365564940/server.sock, err: context deadline exceeded"
Terminated
-- Test timed out at 2021-07-15 15:21:22 UTC --

				from junit_bazel.xml

Filter through log files | View test history on testgrid


Show 956 Passed Tests

Error lines from build-log.txt

+ bazel test --config=unit //... -- -//build/... -//vendor/...
$TEST_TMPDIR defined: output root default is '/bazel-scratch/.cache/bazel' and max_idle_secs default is '15'.
$TEST_TMPDIR defined: output root default is '/bazel-scratch/.cache/bazel' and max_idle_secs default is '15'.
Extracting Bazel installation...
Starting local Bazel server and connecting to it...
WARNING: Download from https://storage.googleapis.com/k8s-bazel-cache/https://github.com/bazelbuild/rules_docker/releases/download/v0.14.4/rules_docker-v0.14.4.tar.gz failed: class com.google.devtools.build.lib.bazel.repository.downloader.UnrecoverableHttpException GET returned 404 Not Found
Loading:  (1 packages loaded)
Loading: 1 packages loaded
Loading: 615 packages loaded
    currently loading: build ... (2 packages)
Loading: 1656 packages loaded
    currently loading: build ... (13 packages)
... skipping 4 lines ...
Analyzing: 959 targets (4556 packages loaded, 29053 targets configured)
Analyzing: 959 targets (4556 packages loaded, 29053 targets configured)
Analyzing: 959 targets (4571 packages loaded, 36540 targets configured)
Analyzing: 959 targets (4572 packages loaded, 36631 targets configured)
Analyzing: 959 targets (4573 packages loaded, 36754 targets configured)
Analyzing: 959 targets (4573 packages loaded, 36754 targets configured)
DEBUG: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/bazel_gazelle/internal/go_repository.bzl:189:13: org_golang_x_tools: gazelle: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/cmd/fiximports/testdata/src/old.com/bad/bad.go: error reading go file: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/cmd/fiximports/testdata/src/old.com/bad/bad.go:2:43: expected 'package', found 'EOF'
gazelle: found packages escapeinfo (escapeinfo.go) and issue31540 (issue31540.go) in /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/internal/gccgoimporter/testdata
gazelle: found packages a (a.go) and b (b.go) in /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/internal/gcimporter/testdata
gazelle: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/loader/testdata/badpkgdecl.go: error reading go file: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/loader/testdata/badpkgdecl.go:1:34: expected 'package', found 'EOF'
gazelle: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/packages/packagestest/testdata/groups/two/modules/example.com/extra/geez/help.go: error reading go file: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/packages/packagestest/testdata/groups/two/modules/example.com/extra/geez/help.go:1:16: expected ';', found '.'
gazelle: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/packages/packagestest/testdata/groups/two/modules/example.com/extra/v2/geez/help.go: error reading go file: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/packages/packagestest/testdata/groups/two/modules/example.com/extra/v2/geez/help.go:1:16: expected ';', found '.'
gazelle: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/packages/packagestest/testdata/groups/two/modules/example.com/extra/v2/me.go: error reading go file: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/packages/packagestest/testdata/groups/two/modules/example.com/extra/v2/me.go:1:16: expected ';', found '.'
gazelle: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/packages/packagestest/testdata/groups/two/modules/example.com/extra/yo.go: error reading go file: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/packages/packagestest/testdata/groups/two/modules/example.com/extra/yo.go:1:16: expected ';', found '.'
gazelle: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/packages/packagestest/testdata/groups/two/modules/example.com/tempmod/main.go: error reading go file: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/packages/packagestest/testdata/groups/two/modules/example.com/tempmod/main.go:1:16: expected ';', found '.'
gazelle: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/packages/packagestest/testdata/groups/two/modules/example.com/what@v1.0.0/main.go: error reading go file: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/packages/packagestest/testdata/groups/two/modules/example.com/what@v1.0.0/main.go:1:16: expected ';', found '.'
gazelle: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/packages/packagestest/testdata/groups/two/modules/example.com/what@v1.1.0/main.go: error reading go file: /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/external/org_golang_x_tools/go/packages/packagestest/testdata/groups/two/modules/example.com/what@v1.1.0/main.go:1:16: expected ';', found '.'
gazelle: finding module path for import domain.name/importdecl: go get domain.name/importdecl: module domain.name/importdecl: reading https://proxy.golang.org/domain.name/importdecl/@v/list: 410 Gone
	server response: not found: domain.name/importdecl@latest: unrecognized import path "domain.name/importdecl": https fetch: Get "https://domain.name/importdecl?go-get=1": dial tcp: lookup domain.name on 8.8.8.8:53: no such host
gazelle: finding module path for import old.com/one: go get old.com/one: module old.com/one: reading https://proxy.golang.org/old.com/one/@v/list: 410 Gone
	server response: not found: old.com/one@latest: unrecognized import path "old.com/one": https fetch: Get "http://www.old.com/one?go-get=1": redirected from secure URL https://old.com/one?go-get=1 to insecure URL http://www.old.com/one?go-get=1
gazelle: finding module path for import titanic.biz/bar: go get titanic.biz/bar: module titanic.biz/bar: reading https://proxy.golang.org/titanic.biz/bar/@v/list: 410 Gone
	server response: not found: titanic.biz/bar@latest: unrecognized import path "titanic.biz/bar": reading https://titanic.biz/bar?go-get=1: 403 Forbidden
... skipping 88 lines ...
      /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/execroot/io_k8s_kubernetes/bazel-out/k8-fastbuild/testlogs/pkg/kubelet/cm/devicemanager/go_default_test/test_attempts/attempt_2.log
INFO: From Testing //pkg/kubelet/cm/devicemanager:go_default_test:
==================== Test output for //pkg/kubelet/cm/devicemanager:go_default_test:
I0715 15:05:52.823585  176449 device_plugin_stub.go:131] Starting to serve on /tmp/mock.sock
I0715 15:05:52.827865  176449 device_plugin_stub.go:131] Starting to serve on /tmp/mock.sock
I0715 15:05:52.831527  176449 device_plugin_stub.go:227] ListAndWatch
E0715 15:05:52.832816  176449 endpoint.go:107] listAndWatch ended unexpectedly for device plugin mock with error rpc error: code = Canceled desc = grpc: the client connection is closing
I0715 15:05:52.835481  176449 device_plugin_stub.go:131] Starting to serve on /tmp/mock.sock
I0715 15:05:52.838481  176449 device_plugin_stub.go:227] ListAndWatch
I0715 15:05:52.839707  176449 device_plugin_stub.go:261] Allocate, &AllocateRequest{ContainerRequests:[]*ContainerAllocateRequest{&ContainerAllocateRequest{DevicesIDs:[ADeviceId],},},}
E0715 15:05:52.840696  176449 endpoint.go:107] listAndWatch ended unexpectedly for device plugin mock with error rpc error: code = Unavailable desc = transport is closing
I0715 15:05:52.842571  176449 device_plugin_stub.go:131] Starting to serve on /tmp/mock.sock
I0715 15:05:52.844858  176449 device_plugin_stub.go:227] ListAndWatch
I0715 15:05:52.845800  176449 device_plugin_stub.go:248] GetPreferredAllocation, &PreferredAllocationRequest{ContainerRequests:[]*ContainerPreferredAllocationRequest{&ContainerPreferredAllocationRequest{AvailableDeviceIDs:[],MustIncludeDeviceIDs:[],AllocationSize:-1,},},}
E0715 15:05:52.846776  176449 endpoint.go:107] listAndWatch ended unexpectedly for device plugin mock with error rpc error: code = Unavailable desc = transport is closing
I0715 15:05:52.847154  176449 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0715 15:05:52.847523  176449 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
W0715 15:05:52.847793  176449 manager.go:596] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
I0715 15:05:52.849945  176449 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin478633980/device-plugin.sock
I0715 15:05:52.851035  176449 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
W0715 15:05:52.851208  176449 manager.go:596] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
I0715 15:05:52.852306  176449 plugin_manager.go:114] Starting Kubelet Plugin Manager
I0715 15:05:52.876296  176449 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin280892203/device-plugin.sock
I0715 15:05:52.876763  176449 device_plugin_stub.go:153] GetInfo
E0715 15:05:52.877549  176449 goroutinemap.go:150] Operation for "/tmp/device_plugin280892203/device-plugin.sock" failed. No retries permitted until 2021-07-15 15:05:53.377357934 +0000 UTC m=+0.666787124 (durationBeforeRetry 500ms). Error: "RegisterPlugin error -- failed to get plugin info using RPC GetInfo at socket /tmp/device_plugin280892203/device-plugin.sock, err: rpc error: code = Unavailable desc = transport is closing"
I0715 15:05:52.878492  176449 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
W0715 15:05:52.878926  176449 manager.go:596] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
I0715 15:05:52.881114  176449 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin716328078/device-plugin.sock
I0715 15:05:52.881177  176449 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
E0715 15:05:52.881768  176449 goroutinemap.go:150] Operation for "/tmp/device_plugin280892203/server.sock" failed. No retries permitted until 2021-07-15 15:05:53.381601476 +0000 UTC m=+0.671030644 (durationBeforeRetry 500ms). Error: "RegisterPlugin error -- failed to get plugin info using RPC GetInfo at socket /tmp/device_plugin280892203/server.sock, err: rpc error: code = Unavailable desc = transport is closing"
I0715 15:05:52.883619  176449 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:05:52.887082  176449 device_plugin_stub.go:227] ListAndWatch
I0715 15:05:52.989110  176449 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin716328078/device-plugin.sock.new
I0715 15:05:52.989198  176449 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:05:52.991382  176449 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:05:52.994714  176449 device_plugin_stub.go:227] ListAndWatch
I0715 15:05:53.196688  176449 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin716328078/device-plugin.sock.third
I0715 15:05:53.196772  176449 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:05:53.198787  176449 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:05:53.201652  176449 device_plugin_stub.go:227] ListAndWatch
E0715 15:05:53.376651  176449 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0715 15:05:53.376765  176449 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
E0715 15:05:53.377159  176449 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0715 15:05:53.377413  176449 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0715 15:05:53.379101  176449 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin716328078/device-plugin.sock
I0715 15:05:53.379175  176449 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:05:53.380996  176449 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:05:53.384389  176449 device_plugin_stub.go:227] ListAndWatch
I0715 15:05:53.570719  176449 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin716328078/device-plugin.sock.new
I0715 15:05:53.570825  176449 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:05:53.573644  176449 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:05:53.577963  176449 device_plugin_stub.go:227] ListAndWatch
I0715 15:05:53.587975  176449 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin716328078/device-plugin.sock.third
I0715 15:05:53.588047  176449 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:05:53.592906  176449 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:05:53.596395  176449 device_plugin_stub.go:227] ListAndWatch
E0715 15:05:53.601384  176449 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0715 15:05:53.601516  176449 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0715 15:05:53.602394  176449 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
E0715 15:05:53.602857  176449 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0715 15:05:53.604799  176449 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin716328078/device-plugin.sock
I0715 15:05:53.604872  176449 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:05:53.606534  176449 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:05:53.608938  176449 device_plugin_stub.go:227] ListAndWatch
I0715 15:05:53.613175  176449 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin716328078/device-plugin.sock.new
I0715 15:05:53.613257  176449 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:05:53.615449  176449 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:05:53.617921  176449 device_plugin_stub.go:227] ListAndWatch
I0715 15:05:53.622057  176449 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin716328078/device-plugin.sock.third
I0715 15:05:53.622126  176449 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:05:53.624554  176449 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:05:53.630135  176449 device_plugin_stub.go:227] ListAndWatch
E0715 15:05:53.633958  176449 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0715 15:05:53.634609  176449 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Canceled desc = grpc: the client connection is closing
I0715 15:05:53.634736  176449 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
E0715 15:05:53.634756  176449 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0715 15:05:53.637850  176449 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin716328078/device-plugin.sock
I0715 15:05:53.637910  176449 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:05:53.640326  176449 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:05:53.643932  176449 device_plugin_stub.go:227] ListAndWatch
I0715 15:05:53.648794  176449 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin716328078/device-plugin.sock.new
I0715 15:05:53.648852  176449 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:05:53.650701  176449 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:05:53.653783  176449 device_plugin_stub.go:227] ListAndWatch
I0715 15:05:53.658137  176449 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin716328078/device-plugin.sock.third
I0715 15:05:53.658197  176449 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:05:53.663000  176449 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:05:53.666249  176449 device_plugin_stub.go:227] ListAndWatch
E0715 15:05:53.670163  176449 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Canceled desc = grpc: the client connection is closing
I0715 15:05:53.670867  176449 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
W0715 15:05:53.671024  176449 manager.go:596] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
E0715 15:05:53.671813  176449 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0715 15:05:53.672046  176449 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0715 15:05:53.673406  176449 plugin_manager.go:114] Starting Kubelet Plugin Manager
I0715 15:05:53.678117  176449 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin406187873/device-plugin.sock
I0715 15:05:53.678429  176449 device_plugin_stub.go:153] GetInfo
E0715 15:05:53.679851  176449 goroutinemap.go:150] Operation for "/tmp/device_plugin406187873/server.sock" failed. No retries permitted until 2021-07-15 15:05:54.179703978 +0000 UTC m=+1.469133152 (durationBeforeRetry 500ms). Error: "RegisterPlugin error -- failed to get plugin info using RPC GetInfo at socket /tmp/device_plugin406187873/server.sock, err: rpc error: code = Unimplemented desc = unknown service pluginregistration.Registration"
I0715 15:05:53.682340  176449 device_plugin_stub.go:227] ListAndWatch
I0715 15:05:53.687041  176449 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin406187873/device-plugin.sock.new
E0715 15:05:54.685080  176449 goroutinemap.go:150] Operation for "/tmp/device_plugin406187873/server.sock" failed. No retries permitted until 2021-07-15 15:05:55.684920609 +0000 UTC m=+2.974349778 (durationBeforeRetry 1s). Error: "RegisterPlugin error -- failed to get plugin info using RPC GetInfo at socket /tmp/device_plugin406187873/server.sock, err: rpc error: code = Unimplemented desc = unknown service pluginregistration.Registration"
I0715 15:05:54.692390  176449 device_plugin_stub.go:153] GetInfo
I0715 15:05:54.700080  176449 device_plugin_stub.go:227] ListAndWatch
I0715 15:05:54.715042  176449 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin406187873/device-plugin.sock.third
I0715 15:05:55.677939  176449 device_plugin_stub.go:153] GetInfo
I0715 15:05:55.683093  176449 device_plugin_stub.go:227] ListAndWatch
E0715 15:05:55.692686  176449 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Canceled desc = grpc: the client connection is closing
I0715 15:05:55.693400  176449 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
E0715 15:05:55.694909  176449 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0715 15:05:55.695584  176449 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0715 15:05:55.705911  176449 manager.go:546] unexpected: unhealthyDevices and endpoints are out of sync
I0715 15:05:55.718639  176449 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0715 15:05:55.718840  176449 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: a63200cd-1ce8-491c-8c4b-92cf671190c6 container name:  
I0715 15:05:55.718936  176449 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: a63200cd-1ce8-491c-8c4b-92cf671190c6 container name:  
I0715 15:05:55.722960  176449 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 7b3cd502-cdba-486a-b5bb-67a87a4d8d13 container name:  
I0715 15:05:55.726428  176449 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
... skipping 8 lines ...
-- Test timed out at 2021-07-15 15:10:52 UTC --
================================================================================
==================== Test output for //pkg/kubelet/cm/devicemanager:go_default_test:
I0715 15:11:08.168535  220294 device_plugin_stub.go:131] Starting to serve on /tmp/mock.sock
I0715 15:11:08.179087  220294 device_plugin_stub.go:131] Starting to serve on /tmp/mock.sock
I0715 15:11:08.184011  220294 device_plugin_stub.go:227] ListAndWatch
E0715 15:11:08.185746  220294 endpoint.go:107] listAndWatch ended unexpectedly for device plugin mock with error rpc error: code = Canceled desc = grpc: the client connection is closing
I0715 15:11:08.188731  220294 device_plugin_stub.go:131] Starting to serve on /tmp/mock.sock
I0715 15:11:08.197436  220294 device_plugin_stub.go:227] ListAndWatch
I0715 15:11:08.198841  220294 device_plugin_stub.go:261] Allocate, &AllocateRequest{ContainerRequests:[]*ContainerAllocateRequest{&ContainerAllocateRequest{DevicesIDs:[ADeviceId],},},}
E0715 15:11:08.200138  220294 endpoint.go:107] listAndWatch ended unexpectedly for device plugin mock with error rpc error: code = Canceled desc = grpc: the client connection is closing
I0715 15:11:08.202265  220294 device_plugin_stub.go:131] Starting to serve on /tmp/mock.sock
I0715 15:11:08.204702  220294 device_plugin_stub.go:227] ListAndWatch
I0715 15:11:08.206031  220294 device_plugin_stub.go:248] GetPreferredAllocation, &PreferredAllocationRequest{ContainerRequests:[]*ContainerPreferredAllocationRequest{&ContainerPreferredAllocationRequest{AvailableDeviceIDs:[],MustIncludeDeviceIDs:[],AllocationSize:-1,},},}
E0715 15:11:08.207226  220294 endpoint.go:107] listAndWatch ended unexpectedly for device plugin mock with error rpc error: code = Unavailable desc = transport is closing
I0715 15:11:08.207728  220294 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0715 15:11:08.208237  220294 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
W0715 15:11:08.208648  220294 manager.go:596] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
I0715 15:11:08.211271  220294 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin668415895/device-plugin.sock
I0715 15:11:08.212367  220294 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
W0715 15:11:08.212600  220294 manager.go:596] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
I0715 15:11:08.214357  220294 plugin_manager.go:114] Starting Kubelet Plugin Manager
I0715 15:11:08.225344  220294 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin883369482/device-plugin.sock
I0715 15:11:08.227518  220294 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
W0715 15:11:08.227962  220294 manager.go:596] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
I0715 15:11:08.230337  220294 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin791710689/device-plugin.sock
I0715 15:11:08.230414  220294 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:11:08.247880  220294 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:11:08.252816  220294 device_plugin_stub.go:227] ListAndWatch
I0715 15:11:08.261318  220294 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin791710689/device-plugin.sock.new
I0715 15:11:08.261406  220294 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:11:08.263478  220294 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:11:08.267093  220294 device_plugin_stub.go:227] ListAndWatch
I0715 15:11:08.278985  220294 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin791710689/device-plugin.sock.third
I0715 15:11:08.279070  220294 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:11:08.287196  220294 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:11:08.292541  220294 device_plugin_stub.go:227] ListAndWatch
E0715 15:11:08.307120  220294 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Canceled desc = grpc: the client connection is closing
I0715 15:11:08.307445  220294 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
E0715 15:11:08.310836  220294 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0715 15:11:08.311430  220294 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0715 15:11:08.313699  220294 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin791710689/device-plugin.sock
I0715 15:11:08.313931  220294 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:11:08.316828  220294 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:11:08.320931  220294 device_plugin_stub.go:227] ListAndWatch
I0715 15:11:08.328112  220294 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin791710689/device-plugin.sock.new
I0715 15:11:08.328204  220294 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:11:08.332499  220294 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:11:08.340884  220294 device_plugin_stub.go:227] ListAndWatch
I0715 15:11:08.347290  220294 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin791710689/device-plugin.sock.third
I0715 15:11:08.347365  220294 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:11:08.350592  220294 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:11:08.353711  220294 device_plugin_stub.go:227] ListAndWatch
E0715 15:11:08.359093  220294 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Canceled desc = grpc: the client connection is closing
I0715 15:11:08.359385  220294 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
E0715 15:11:08.360487  220294 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0715 15:11:08.362688  220294 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin791710689/device-plugin.sock
I0715 15:11:08.362767  220294 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
E0715 15:11:08.363353  220294 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0715 15:11:08.365522  220294 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:11:08.369004  220294 device_plugin_stub.go:227] ListAndWatch
I0715 15:11:08.379640  220294 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin791710689/device-plugin.sock.new
I0715 15:11:08.379719  220294 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:11:08.381957  220294 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:11:08.385581  220294 device_plugin_stub.go:227] ListAndWatch
I0715 15:11:08.393108  220294 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin791710689/device-plugin.sock.third
I0715 15:11:08.393180  220294 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:11:08.396584  220294 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:11:08.402688  220294 device_plugin_stub.go:227] ListAndWatch
E0715 15:11:08.408931  220294 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Canceled desc = grpc: the client connection is closing
I0715 15:11:08.409406  220294 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0715 15:11:08.412896  220294 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin791710689/device-plugin.sock
I0715 15:11:08.412971  220294 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
E0715 15:11:08.412925  220294 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0715 15:11:08.415748  220294 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0715 15:11:08.416432  220294 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:11:08.420243  220294 device_plugin_stub.go:227] ListAndWatch
I0715 15:11:08.425999  220294 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin791710689/device-plugin.sock.new
I0715 15:11:08.426075  220294 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:11:08.429806  220294 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:11:08.433239  220294 device_plugin_stub.go:227] ListAndWatch
I0715 15:11:08.438265  220294 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin791710689/device-plugin.sock.third
I0715 15:11:08.438340  220294 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:11:08.440255  220294 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:11:08.443481  220294 device_plugin_stub.go:227] ListAndWatch
E0715 15:11:08.447245  220294 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0715 15:11:08.447769  220294 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0715 15:11:08.448743  220294 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0715 15:11:08.449085  220294 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
W0715 15:11:08.449289  220294 manager.go:596] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
I0715 15:11:08.450345  220294 plugin_manager.go:114] Starting Kubelet Plugin Manager
I0715 15:11:08.452810  220294 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin423770984/device-plugin.sock
I0715 15:11:08.453510  220294 device_plugin_stub.go:153] GetInfo
E0715 15:11:08.453829  220294 goroutinemap.go:150] Operation for "/tmp/device_plugin423770984/server.sock" failed. No retries permitted until 2021-07-15 15:11:08.953683738 +0000 UTC m=+0.909990185 (durationBeforeRetry 500ms). Error: "RegisterPlugin error -- failed to get plugin info using RPC GetInfo at socket /tmp/device_plugin423770984/server.sock, err: rpc error: code = Unimplemented desc = unknown service pluginregistration.Registration"
I0715 15:11:08.468996  220294 device_plugin_stub.go:227] ListAndWatch
I0715 15:11:08.475095  220294 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin423770984/device-plugin.sock.new
I0715 15:11:09.454893  220294 device_plugin_stub.go:153] GetInfo
E0715 15:11:09.458826  220294 goroutinemap.go:150] Operation for "/tmp/device_plugin423770984/server.sock" failed. No retries permitted until 2021-07-15 15:11:10.458669606 +0000 UTC m=+2.414976076 (durationBeforeRetry 1s). Error: "RegisterPlugin error -- failed to get plugin info using RPC GetInfo at socket /tmp/device_plugin423770984/server.sock, err: rpc error: code = Unimplemented desc = unknown service pluginregistration.Registration"
I0715 15:11:09.460400  220294 device_plugin_stub.go:227] ListAndWatch
I0715 15:11:09.465750  220294 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin423770984/device-plugin.sock.third
I0715 15:11:10.454906  220294 device_plugin_stub.go:153] GetInfo
I0715 15:11:10.460014  220294 device_plugin_stub.go:227] ListAndWatch
E0715 15:11:10.464771  220294 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Canceled desc = grpc: the client connection is closing
I0715 15:11:10.465694  220294 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
E0715 15:11:10.466568  220294 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0715 15:11:10.467063  220294 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0715 15:11:10.478493  220294 manager.go:546] unexpected: unhealthyDevices and endpoints are out of sync
I0715 15:11:10.490967  220294 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0715 15:11:10.491159  220294 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 89db45dd-5951-497e-a996-a6b579af4ef6 container name:  
I0715 15:11:10.491266  220294 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 89db45dd-5951-497e-a996-a6b579af4ef6 container name:  
I0715 15:11:10.497711  220294 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 160445ea-38b2-4af7-b346-3b6fea5a5114 container name:  
I0715 15:11:10.502066  220294 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0715 15:11:10.502278  220294 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 97922dc7-6d66-4244-a173-7f2c087bc0cc container name:  2b6696db-9e90-427d-9768-55f030c4e94b
I0715 15:11:10.505439  220294 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 97922dc7-6d66-4244-a173-7f2c087bc0cc container name:  e17ce0b0-08fd-4187-88ad-dabc0dd161cf
I0715 15:11:10.509044  220294 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 97922dc7-6d66-4244-a173-7f2c087bc0cc container name:  d6a5d585-9cff-4aa4-b5c5-7f2756e909af
I0715 15:11:10.512733  220294 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 97922dc7-6d66-4244-a173-7f2c087bc0cc container name:  71e5044c-b3dd-432f-a837-ace47a417818
I0715 15:11:10.518486  220294 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0715 15:11:10.518633  220294 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: c2c063c9-bea0-4322-8390-5756272b2242 container name:  
I0715 15:11:10.526332  220294 topology_hints.go:49] [devicemanager] Resource 'testdevice' does not have a topology preference
E0715 15:11:18.226336  220294 goroutinemap.go:150] Operation for "/tmp/device_plugin883369482/device-plugin.sock" failed. No retries permitted until 2021-07-15 15:11:18.726156539 +0000 UTC m=+10.682462999 (durationBeforeRetry 500ms). Error: "RegisterPlugin error -- dial failed at socket /tmp/device_plugin883369482/device-plugin.sock, err: failed to dial socket /tmp/device_plugin883369482/device-plugin.sock, err: context deadline exceeded"
E0715 15:11:18.226907  220294 goroutinemap.go:150] Operation for "/tmp/device_plugin883369482/server.sock" failed. No retries permitted until 2021-07-15 15:11:18.726761795 +0000 UTC m=+10.683068244 (durationBeforeRetry 500ms). Error: "RegisterPlugin error -- dial failed at socket /tmp/device_plugin883369482/server.sock, err: failed to dial socket /tmp/device_plugin883369482/server.sock, err: context deadline exceeded"
Terminated
-- Test timed out at 2021-07-15 15:16:07 UTC --
================================================================================
==================== Test output for //pkg/kubelet/cm/devicemanager:go_default_test:
I0715 15:16:22.953807  241453 device_plugin_stub.go:131] Starting to serve on /tmp/mock.sock
I0715 15:16:22.957232  241453 device_plugin_stub.go:131] Starting to serve on /tmp/mock.sock
I0715 15:16:22.960679  241453 device_plugin_stub.go:227] ListAndWatch
E0715 15:16:22.961912  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin mock with error rpc error: code = Unavailable desc = transport is closing
I0715 15:16:22.964630  241453 device_plugin_stub.go:131] Starting to serve on /tmp/mock.sock
I0715 15:16:22.967335  241453 device_plugin_stub.go:227] ListAndWatch
I0715 15:16:22.968531  241453 device_plugin_stub.go:261] Allocate, &AllocateRequest{ContainerRequests:[]*ContainerAllocateRequest{&ContainerAllocateRequest{DevicesIDs:[ADeviceId],},},}
E0715 15:16:22.969547  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin mock with error rpc error: code = Unavailable desc = transport is closing
I0715 15:16:22.970969  241453 device_plugin_stub.go:131] Starting to serve on /tmp/mock.sock
I0715 15:16:22.972971  241453 device_plugin_stub.go:227] ListAndWatch
I0715 15:16:22.973860  241453 device_plugin_stub.go:248] GetPreferredAllocation, &PreferredAllocationRequest{ContainerRequests:[]*ContainerPreferredAllocationRequest{&ContainerPreferredAllocationRequest{AvailableDeviceIDs:[],MustIncludeDeviceIDs:[],AllocationSize:-1,},},}
E0715 15:16:22.974715  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin mock with error rpc error: code = Unavailable desc = transport is closing
I0715 15:16:22.974946  241453 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0715 15:16:22.975312  241453 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
W0715 15:16:22.975501  241453 manager.go:596] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
I0715 15:16:22.977430  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin552288033/device-plugin.sock
I0715 15:16:22.978177  241453 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
W0715 15:16:22.978442  241453 manager.go:596] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
I0715 15:16:22.979311  241453 plugin_manager.go:114] Starting Kubelet Plugin Manager
I0715 15:16:22.981936  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin365564940/device-plugin.sock
I0715 15:16:22.983689  241453 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
W0715 15:16:22.983890  241453 manager.go:596] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
I0715 15:16:22.985337  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin503996923/device-plugin.sock
I0715 15:16:22.985401  241453 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:16:22.987128  241453 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:16:22.989892  241453 device_plugin_stub.go:227] ListAndWatch
I0715 15:16:22.996352  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin503996923/device-plugin.sock.new
I0715 15:16:22.996412  241453 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:16:22.999250  241453 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:16:23.001672  241453 device_plugin_stub.go:227] ListAndWatch
I0715 15:16:23.006331  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin503996923/device-plugin.sock.third
I0715 15:16:23.006399  241453 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:16:23.008052  241453 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:16:23.010431  241453 device_plugin_stub.go:227] ListAndWatch
E0715 15:16:23.013800  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0715 15:16:23.014058  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0715 15:16:23.014650  241453 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
E0715 15:16:23.014669  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0715 15:16:23.016521  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin503996923/device-plugin.sock
I0715 15:16:23.016607  241453 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:16:23.019407  241453 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:16:23.021665  241453 device_plugin_stub.go:227] ListAndWatch
I0715 15:16:23.026016  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin503996923/device-plugin.sock.new
I0715 15:16:23.026067  241453 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:16:23.027819  241453 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:16:23.030128  241453 device_plugin_stub.go:227] ListAndWatch
I0715 15:16:23.034291  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin503996923/device-plugin.sock.third
I0715 15:16:23.034342  241453 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:16:23.036437  241453 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:16:23.039869  241453 device_plugin_stub.go:227] ListAndWatch
E0715 15:16:23.043183  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0715 15:16:23.043802  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0715 15:16:23.043939  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0715 15:16:23.044071  241453 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0715 15:16:23.045776  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin503996923/device-plugin.sock
I0715 15:16:23.045827  241453 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:16:23.047895  241453 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:16:23.050303  241453 device_plugin_stub.go:227] ListAndWatch
I0715 15:16:23.054665  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin503996923/device-plugin.sock.new
I0715 15:16:23.054736  241453 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:16:23.056280  241453 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:16:23.059471  241453 device_plugin_stub.go:227] ListAndWatch
I0715 15:16:23.063884  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin503996923/device-plugin.sock.third
I0715 15:16:23.063938  241453 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:16:23.065394  241453 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:16:23.067608  241453 device_plugin_stub.go:227] ListAndWatch
E0715 15:16:23.071149  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0715 15:16:23.071226  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0715 15:16:23.071789  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0715 15:16:23.071848  241453 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0715 15:16:23.073561  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin503996923/device-plugin.sock
I0715 15:16:23.073642  241453 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:16:23.075350  241453 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:16:23.078786  241453 device_plugin_stub.go:227] ListAndWatch
I0715 15:16:23.082875  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin503996923/device-plugin.sock.new
I0715 15:16:23.082941  241453 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:16:23.084620  241453 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:16:23.086690  241453 device_plugin_stub.go:227] ListAndWatch
I0715 15:16:23.090668  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin503996923/device-plugin.sock.third
I0715 15:16:23.090730  241453 device_plugin_stub.go:180] Deprecation file not found. Invoke registration
I0715 15:16:23.092376  241453 manager.go:410] Got registration request from device plugin with resource name "fake-domain/resource"
I0715 15:16:23.095858  241453 device_plugin_stub.go:227] ListAndWatch
E0715 15:16:23.099209  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0715 15:16:23.099520  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0715 15:16:23.100046  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0715 15:16:23.100513  241453 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
W0715 15:16:23.100675  241453 manager.go:596] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
I0715 15:16:23.101332  241453 plugin_manager.go:114] Starting Kubelet Plugin Manager
I0715 15:16:23.102525  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin281450778/device-plugin.sock
I0715 15:16:23.104101  241453 device_plugin_stub.go:153] GetInfo
E0715 15:16:23.104455  241453 goroutinemap.go:150] Operation for "/tmp/device_plugin281450778/server.sock" failed. No retries permitted until 2021-07-15 15:16:23.604263372 +0000 UTC m=+0.726839149 (durationBeforeRetry 500ms). Error: "RegisterPlugin error -- failed to get plugin info using RPC GetInfo at socket /tmp/device_plugin281450778/server.sock, err: rpc error: code = Unimplemented desc = unknown service pluginregistration.Registration"
I0715 15:16:23.107315  241453 device_plugin_stub.go:227] ListAndWatch
I0715 15:16:23.111494  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin281450778/device-plugin.sock.new
I0715 15:16:24.106177  241453 device_plugin_stub.go:153] GetInfo
E0715 15:16:24.107214  241453 goroutinemap.go:150] Operation for "/tmp/device_plugin281450778/server.sock" failed. No retries permitted until 2021-07-15 15:16:25.107100363 +0000 UTC m=+2.229676153 (durationBeforeRetry 1s). Error: "RegisterPlugin error -- failed to get plugin info using RPC GetInfo at socket /tmp/device_plugin281450778/server.sock, err: rpc error: code = Unimplemented desc = unknown service pluginregistration.Registration"
I0715 15:16:24.109949  241453 device_plugin_stub.go:227] ListAndWatch
I0715 15:16:24.114688  241453 device_plugin_stub.go:131] Starting to serve on /tmp/device_plugin281450778/device-plugin.sock.third
I0715 15:16:25.105459  241453 device_plugin_stub.go:153] GetInfo
I0715 15:16:25.109581  241453 device_plugin_stub.go:227] ListAndWatch
E0715 15:16:25.114031  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0715 15:16:25.114149  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
E0715 15:16:25.114592  241453 endpoint.go:107] listAndWatch ended unexpectedly for device plugin fake-domain/resource with error rpc error: code = Unavailable desc = transport is closing
I0715 15:16:25.115447  241453 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
E0715 15:16:25.127692  241453 manager.go:546] unexpected: unhealthyDevices and endpoints are out of sync
I0715 15:16:25.140277  241453 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0715 15:16:25.140507  241453 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 63a636f4-37db-4ec2-9018-ab16b77c9c06 container name:  
I0715 15:16:25.140584  241453 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 63a636f4-37db-4ec2-9018-ab16b77c9c06 container name:  
I0715 15:16:25.143794  241453 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 6e43fcdb-9663-4664-a525-6ec76d942343 container name:  
... skipping 2 lines ...
I0715 15:16:25.149791  241453 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: ceafaa68-7cfb-4e0f-9d96-f437333ab263 container name:  37415cbc-753b-40b9-811e-cca6275af825
I0715 15:16:25.152566  241453 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: ceafaa68-7cfb-4e0f-9d96-f437333ab263 container name:  d6917494-631b-4f0e-aee5-c154333cfa3b
I0715 15:16:25.155453  241453 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: ceafaa68-7cfb-4e0f-9d96-f437333ab263 container name:  6ae8b93c-a1a5-405d-a728-9899fa32a38e
I0715 15:16:25.159645  241453 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager
I0715 15:16:25.159745  241453 fake_topology_manager.go:34] [fake topologymanager] GetAffinity podUID: 1cb19f9c-1508-4f89-963c-648320d8f315 container name:  
I0715 15:16:25.165879  241453 topology_hints.go:49] [devicemanager] Resource 'testdevice' does not have a topology preference
E0715 15:16:32.981808  241453 goroutinemap.go:150] Operation for "/tmp/device_plugin365564940/device-plugin.sock" failed. No retries permitted until 2021-07-15 15:16:33.481587777 +0000 UTC m=+10.604163580 (durationBeforeRetry 500ms). Error: "RegisterPlugin error -- dial failed at socket /tmp/device_plugin365564940/device-plugin.sock, err: failed to dial socket /tmp/device_plugin365564940/device-plugin.sock, err: context deadline exceeded"
E0715 15:16:32.982225  241453 goroutinemap.go:150] Operation for "/tmp/device_plugin365564940/server.sock" failed. No retries permitted until 2021-07-15 15:16:33.482111453 +0000 UTC m=+10.604687237 (durationBeforeRetry 500ms). Error: "RegisterPlugin error -- dial failed at socket /tmp/device_plugin365564940/server.sock, err: failed to dial socket /tmp/device_plugin365564940/server.sock, err: context deadline exceeded"
Terminated
-- Test timed out at 2021-07-15 15:21:22 UTC --
================================================================================
INFO: Elapsed time: 1776.543s, Critical Path: 1020.75s
INFO: 17356 processes: 17356 processwrapper-sandbox.
INFO: Build completed, 1 test FAILED, 19281 total actions
//cluster:common_test                                                    PASSED in 0.1s
//cluster:kube-util_test                                                 PASSED in 0.0s
//cluster/gce/cos:go_default_test                                        PASSED in 4.0s
//cluster/gce/custom:go_default_test                                     PASSED in 2.1s
//cluster/gce/gci:go_default_test                                        PASSED in 1.9s
//cluster/gce/ubuntu:go_default_test                                     PASSED in 2.2s
... skipping 954 lines ...
  /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/execroot/io_k8s_kubernetes/bazel-out/k8-fastbuild/testlogs/pkg/kubelet/cm/devicemanager/go_default_test/test.log
  /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/execroot/io_k8s_kubernetes/bazel-out/k8-fastbuild/testlogs/pkg/kubelet/cm/devicemanager/go_default_test/test_attempts/attempt_1.log
  /bazel-scratch/.cache/bazel/_bazel_root/7989b31489f31aee54f32688da2f0120/execroot/io_k8s_kubernetes/bazel-out/k8-fastbuild/testlogs/pkg/kubelet/cm/devicemanager/go_default_test/test_attempts/attempt_2.log

Executed 959 out of 959 tests: 958 tests pass and 1 fails locally.
There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are.
INFO: Build completed, 1 test FAILED, 19281 total actions
+ ../test-infra/hack/coalesce.py
+ exit 3