go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sImageGCNoEviction\s\[Slow\]\s\[Serial\]\s\[Disruptive\]\[NodeFeature\:Eviction\]\swhen\swe\srun\scontainers\sthat\sshould\scause\sDiskPressure\s\sshould\seventually\sevict\sall\sof\sthe\scorrect\spods$'
[TIMEDOUT] A suite timeout occurred In [AfterEach] at: test/e2e_node/eviction_test.go:620 @ 03/22/23 02:55:32.21 This is the Progress Report generated when the suite timeout occurred: [sig-node] ImageGCNoEviction [Slow] [Serial] [Disruptive][NodeFeature:Eviction] when we run containers that should cause DiskPressure should eventually evict all of the correct pods (Spec Runtime: 6m16.218s) test/e2e_node/eviction_test.go:563 In [AfterEach] (Node Runtime: 59.7s) test/e2e_node/eviction_test.go:620 At [By Step] making sure we have all the required images for testing (Step Runtime: 26.858s) test/e2e_node/eviction_test.go:648 Spec Goroutine goroutine 8145 [semacquire] sync.runtime_Semacquire(0xc001bdf080?) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/runtime/sema.go:62 sync.(*WaitGroup).Wait(0x5ba9cc8?) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/sync/waitgroup.go:116 > k8s.io/kubernetes/test/e2e_node.PrePullAllImages() test/e2e_node/image_list.go:206 > k8s.io/kubernetes/test/e2e_node.runEvictionTest.func1.3.1(...) test/e2e_node/eviction_test.go:625 > k8s.io/kubernetes/test/e2e_node.runEvictionTest.func1.3({0x7f3041625140?, 0xc001955e90}) test/e2e_node/eviction_test.go:649 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x5bb2860?, 0xc001955e90}) vendor/github.com/onsi/ginkgo/v2/internal/node.go:456 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3() vendor/github.com/onsi/ginkgo/v2/internal/suite.go:863 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode vendor/github.com/onsi/ginkgo/v2/internal/suite.go:850 Goroutines of Interest goroutine 1 [chan receive, 60 minutes] testing.(*T).Run(0xc0004836c0, {0x52ff476?, 0x53e765?}, 0x558db68) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/testing/testing.go:1630 testing.runTests.func1(0x88173a0?) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/testing/testing.go:2036 testing.tRunner(0xc0004836c0, 0xc000b91b78) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/testing/testing.go:1576 testing.runTests(0xc0004b8780?, {0x8651d70, 0x1, 0x1}, {0x30?, 0xc0009b2d50?, 0x0?}) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/testing/testing.go:2034 testing.(*M).Run(0xc0004b8780) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/testing/testing.go:1906 > k8s.io/kubernetes/test/e2e_node.TestMain(0xffffffffffffffff?) test/e2e_node/e2e_node_suite_test.go:145 main.main() /tmp/go-build1451623592/b001/_testmain.go:49 goroutine 245 [syscall, 59 minutes] syscall.Syscall6(0x100?, 0xc001403cd8?, 0x6fc80d?, 0x1?, 0x52183e0?, 0xc00058fc70?, 0x47edfe?) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/syscall/syscall_linux.go:91 os.(*Process).blockUntilWaitable(0xc000ce0a80) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/os/wait_waitid.go:32 os.(*Process).wait(0xc000ce0a80) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/os/exec_unix.go:22 os.(*Process).Wait(...) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/os/exec.go:132 os/exec.(*Cmd).Wait(0xc00049b340) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/os/exec/exec.go:890 > k8s.io/kubernetes/test/e2e_node/services.(*server).start.func1() test/e2e_node/services/server.go:166 > k8s.io/kubernetes/test/e2e_node/services.(*server).start test/e2e_node/services/server.go:123 goroutine 8176 [select] k8s.io/kubernetes/vendor/google.golang.org/grpc/internal/transport.(*Stream).waitOnHeader(0xc0011bbc20) vendor/google.golang.org/grpc/internal/transport/transport.go:328 k8s.io/kubernetes/vendor/google.golang.org/grpc/internal/transport.(*Stream).RecvCompress(...) vendor/google.golang.org/grpc/internal/transport/transport.go:343 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc0006ef500, {0x5095200?, 0xc00151a9d8}, 0x7f3040429648?) vendor/google.golang.org/grpc/stream.go:1027 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0x0?) vendor/google.golang.org/grpc/stream.go:881 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc0011bb9e0, 0xc00166b7a8, 0xc00166b778) vendor/google.golang.org/grpc/stream.go:732 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc0011bb9e0, {0x5095200?, 0xc00151a9d8?}) vendor/google.golang.org/grpc/stream.go:880 k8s.io/kubernetes/vendor/google.golang.org/grpc.invoke({0x5ba9d38?, 0xc0011bea20?}, {0x537f859?, 0x4?}, {0x5147c40, 0xc001cb8340}, {0x5095200, 0xc00151a9d8}, 0x0?, {0xc00114f3f0, ...}) vendor/google.golang.org/grpc/call.go:73 k8s.io/kubernetes/vendor/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc.UnaryClientInterceptor.func1({0x5ba9c90, 0xc0004dc6e0}, {0x537f859, 0x22}, {0x5147c40, 0xc001cb8340}, {0x5095200, 0xc00151a9d8}, 0xc001822700, 0x5590080, ...) vendor/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc/interceptor.go:108 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*ClientConn).Invoke(0x7f3040443928?, {0x5ba9c90?, 0xc0004dc6e0?}, {0x537f859?, 0xc001cb8340?}, {0x5147c40?, 0xc001cb8340?}, {0x5095200?, 0xc00151a9d8?}, {0x0, ...}) vendor/google.golang.org/grpc/call.go:35 k8s.io/kubernetes/vendor/k8s.io/cri-api/pkg/apis/runtime/v1.(*imageServiceClient).PullImage(0xc001435860, {0x5ba9c90, 0xc0004dc6e0}, 0x4ae0e00?, {0x0, 0x0, 0x0}) vendor/k8s.io/cri-api/pkg/apis/runtime/v1/api.pb.go:11402 k8s.io/kubernetes/pkg/kubelet/cri/remote.(*remoteImageService).pullImageV1(0xc0014e7a28, {0x5ba9c90, 0xc0004dc6e0}, 0xc001cb8320, 0x0, 0x0) pkg/kubelet/cri/remote/remote_image.go:161 k8s.io/kubernetes/pkg/kubelet/cri/remote.(*remoteImageService).PullImage(0xc0014e7a28?, {0x5ba9cc8?, 0xc0000760a0?}, 0x40aca5?, 0xc000200ea0?, 0xc00166bf48?) pkg/kubelet/cri/remote/remote_image.go:157 > k8s.io/kubernetes/test/e2e_node.(*remotePuller).Pull(0xc00114fb70, {0xc000417640, 0x34}) test/e2e_node/image_list.go:127 > k8s.io/kubernetes/test/e2e_node.PrePullAllImages.func1() test/e2e_node/image_list.go:190 > k8s.io/kubernetes/test/e2e_node.PrePullAllImages test/e2e_node/image_list.go:172 goroutine 8177 [select] k8s.io/kubernetes/vendor/google.golang.org/grpc/internal/transport.(*Stream).waitOnHeader(0xc0011bb8c0) vendor/google.golang.org/grpc/internal/transport/transport.go:328 k8s.io/kubernetes/vendor/google.golang.org/grpc/internal/transport.(*Stream).RecvCompress(...) vendor/google.golang.org/grpc/internal/transport/transport.go:343 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc0006ef200, {0x5095200?, 0xc00151a7c8}, 0x7f3040429648?) vendor/google.golang.org/grpc/stream.go:1027 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0x0?) vendor/google.golang.org/grpc/stream.go:881 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc0011bb680, 0xc0012597a8, 0xc001259778) vendor/google.golang.org/grpc/stream.go:732 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc0011bb680, {0x5095200?, 0xc00151a7c8?}) vendor/google.golang.org/grpc/stream.go:880 k8s.io/kubernetes/vendor/google.golang.org/grpc.invoke({0x5ba9d38?, 0xc0011be630?}, {0x537f859?, 0x4?}, {0x5147c40, 0xc001cb8200}, {0x5095200, 0xc00151a7c8}, 0x0?, {0xc00114f3f0, ...}) vendor/google.golang.org/grpc/call.go:73 k8s.io/kubernetes/vendor/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc.UnaryClientInterceptor.func1({0x5ba9c90, 0xc0004dc190}, {0x537f859, 0x22}, {0x5147c40, 0xc001cb8200}, {0x5095200, 0xc00151a7c8}, 0xc001822700, 0x5590080, ...) vendor/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc/interceptor.go:108 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*ClientConn).Invoke(0x7f3040443928?, {0x5ba9c90?, 0xc0004dc190?}, {0x537f859?, 0xc001cb8200?}, {0x5147c40?, 0xc001cb8200?}, {0x5095200?, 0xc00151a7c8?}, {0x0, ...}) vendor/google.golang.org/grpc/call.go:35 k8s.io/kubernetes/vendor/k8s.io/cri-api/pkg/apis/runtime/v1.(*imageServiceClient).PullImage(0xc001435860, {0x5ba9c90, 0xc0004dc190}, 0x4ae0e00?, {0x0, 0x0, 0x0}) vendor/k8s.io/cri-api/pkg/apis/runtime/v1/api.pb.go:11402 k8s.io/kubernetes/pkg/kubelet/cri/remote.(*remoteImageService).pullImageV1(0xc0014e7a28, {0x5ba9c90, 0xc0004dc190}, 0xc001cb81e0, 0x0, 0x0) pkg/kubelet/cri/remote/remote_image.go:161 k8s.io/kubernetes/pkg/kubelet/cri/remote.(*remoteImageService).PullImage(0xc0014e7a28?, {0x5ba9cc8?, 0xc0000760a0?}, 0x40aca5?, 0xc000200ea0?, 0xc001259f48?) pkg/kubelet/cri/remote/remote_image.go:157 > k8s.io/kubernetes/test/e2e_node.(*remotePuller).Pull(0xc00114fb70, {0xc000417680, 0x34}) test/e2e_node/image_list.go:127 > k8s.io/kubernetes/test/e2e_node.PrePullAllImages.func1() test/e2e_node/image_list.go:190 > k8s.io/kubernetes/test/e2e_node.PrePullAllImages test/e2e_node/image_list.go:172 goroutine 8179 [select] k8s.io/kubernetes/vendor/google.golang.org/grpc/internal/transport.(*Stream).waitOnHeader(0xc0011c10e0) vendor/google.golang.org/grpc/internal/transport/transport.go:328 k8s.io/kubernetes/vendor/google.golang.org/grpc/internal/transport.(*Stream).RecvCompress(...) vendor/google.golang.org/grpc/internal/transport/transport.go:343 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc0011ca480, {0x5095200?, 0xc00151b680}, 0x7f3040429648?) vendor/google.golang.org/grpc/stream.go:1027 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0x0?) vendor/google.golang.org/grpc/stream.go:881 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc0011c0ea0, 0xc0012557a8, 0xc001255778) vendor/google.golang.org/grpc/stream.go:732 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc0011c0ea0, {0x5095200?, 0xc00151b680?}) vendor/google.golang.org/grpc/stream.go:880 k8s.io/kubernetes/vendor/google.golang.org/grpc.invoke({0x5ba9d38?, 0xc0011cc270?}, {0x537f859?, 0x4?}, {0x5147c40, 0xc001cb8ae0}, {0x5095200, 0xc00151b680}, 0x0?, {0xc00114f3f0, ...}) vendor/google.golang.org/grpc/call.go:73 k8s.io/kubernetes/vendor/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc.UnaryClientInterceptor.func1({0x5ba9c90, 0xc000a52140}, {0x537f859, 0x22}, {0x5147c40, 0xc001cb8ae0}, {0x5095200, 0xc00151b680}, 0xc001822700, 0x5590080, ...) vendor/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc/interceptor.go:108 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*ClientConn).Invoke(0x7f3040443928?, {0x5ba9c90?, 0xc000a52140?}, {0x537f859?, 0xc001cb8ae0?}, {0x5147c40?, 0xc001cb8ae0?}, {0x5095200?, 0xc00151b680?}, {0x0, ...}) vendor/google.golang.org/grpc/call.go:35 k8s.io/kubernetes/vendor/k8s.io/cri-api/pkg/apis/runtime/v1.(*imageServiceClient).PullImage(0xc001435860, {0x5ba9c90, 0xc000a52140}, 0x4ae0e00?, {0x0, 0x0, 0x0}) vendor/k8s.io/cri-api/pkg/apis/runtime/v1/api.pb.go:11402 k8s.io/kubernetes/pkg/kubelet/cri/remote.(*remoteImageService).pullImageV1(0xc0014e7a28, {0x5ba9c90, 0xc000a52140}, 0xc001cb8ac0, 0x0, 0x0) pkg/kubelet/cri/remote/remote_image.go:161 k8s.io/kubernetes/pkg/kubelet/cri/remote.(*remoteImageService).PullImage(0xc0014e7a28?, {0x5ba9cc8?, 0xc0000760a0?}, 0x40aca5?, 0xc000200ea0?, 0xc001255f48?) pkg/kubelet/cri/remote/remote_image.go:157 > k8s.io/kubernetes/test/e2e_node.(*remotePuller).Pull(0xc00114fb70, {0xc0006940f0, 0x2b}) test/e2e_node/image_list.go:127 > k8s.io/kubernetes/test/e2e_node.PrePullAllImages.func1() test/e2e_node/image_list.go:190 > k8s.io/kubernetes/test/e2e_node.PrePullAllImages test/e2e_node/image_list.go:172 goroutine 8178 [select] k8s.io/kubernetes/vendor/google.golang.org/grpc/internal/transport.(*Stream).waitOnHeader(0xc0011c0a20) vendor/google.golang.org/grpc/internal/transport/transport.go:328 k8s.io/kubernetes/vendor/google.golang.org/grpc/internal/transport.(*Stream).RecvCompress(...) vendor/google.golang.org/grpc/internal/transport/transport.go:343 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc0004b0840, {0x5095200?, 0xc00151b260}, 0x7f3040429648?) vendor/google.golang.org/grpc/stream.go:1027 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0x0?) vendor/google.golang.org/grpc/stream.go:881 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc0011c07e0, 0xc00166d7a8, 0xc00166d778) vendor/google.golang.org/grpc/stream.go:732 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc0011c07e0, {0x5095200?, 0xc00151b260?}) vendor/google.golang.org/grpc/stream.go:880 k8s.io/kubernetes/vendor/google.golang.org/grpc.invoke({0x5ba9d38?, 0xc0011bfa40?}, {0x537f859?, 0x4?}, {0x5147c40, 0xc001cb8800}, {0x5095200, 0xc00151b260}, 0x0?, {0xc00114f3f0, ...}) vendor/google.golang.org/grpc/call.go:73 k8s.io/kubernetes/vendor/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc.UnaryClientInterceptor.func1({0x5ba9c90, 0xc0004dd680}, {0x537f859, 0x22}, {0x5147c40, 0xc001cb8800}, {0x5095200, 0xc00151b260}, 0xc001822700, 0x5590080, ...) vendor/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc/interceptor.go:108 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*ClientConn).Invoke(0x7f3040443928?, {0x5ba9c90?, 0xc0004dd680?}, {0x537f859?, 0xc001cb8800?}, {0x5147c40?, 0xc001cb8800?}, {0x5095200?, 0xc00151b260?}, {0x0, ...}) vendor/google.golang.org/grpc/call.go:35 k8s.io/kubernetes/vendor/k8s.io/cri-api/pkg/apis/runtime/v1.(*imageServiceClient).PullImage(0xc001435860, {0x5ba9c90, 0xc0004dd680}, 0x4ae0e00?, {0x0, 0x0, 0x0}) vendor/k8s.io/cri-api/pkg/apis/runtime/v1/api.pb.go:11402 k8s.io/kubernetes/pkg/kubelet/cri/remote.(*remoteImageService).pullImageV1(0xc0014e7a28, {0x5ba9c90, 0xc0004dd680}, 0xc001cb87e0, 0x0, 0x0) pkg/kubelet/cri/remote/remote_image.go:161 k8s.io/kubernetes/pkg/kubelet/cri/remote.(*remoteImageService).PullImage(0xc0014e7a28?, {0x5ba9cc8?, 0xc0000760a0?}, 0x40aca5?, 0xc000200ea0?, 0xc00166df48?) pkg/kubelet/cri/remote/remote_image.go:157 > k8s.io/kubernetes/test/e2e_node.(*remotePuller).Pull(0xc00114fb70, {0xc0006909c0, 0x2e}) test/e2e_node/image_list.go:127 > k8s.io/kubernetes/test/e2e_node.PrePullAllImages.func1() test/e2e_node/image_list.go:190 > k8s.io/kubernetes/test/e2e_node.PrePullAllImages test/e2e_node/image_list.go:172 goroutine 8180 [select] k8s.io/kubernetes/vendor/google.golang.org/grpc/internal/transport.(*Stream).waitOnHeader(0xc0011c0360) vendor/google.golang.org/grpc/internal/transport/transport.go:328 k8s.io/kubernetes/vendor/google.golang.org/grpc/internal/transport.(*Stream).RecvCompress(...) vendor/google.golang.org/grpc/internal/transport/transport.go:343 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc0006efb00, {0x5095200?, 0xc00151ae28}, 0x7f3040429648?) vendor/google.golang.org/grpc/stream.go:1027 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0x0?) vendor/google.golang.org/grpc/stream.go:881 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc0011c0120, 0xc0016717a8, 0xc001671778) vendor/google.golang.org/grpc/stream.go:732 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc0011c0120, {0x5095200?, 0xc00151ae28?}) vendor/google.golang.org/grpc/stream.go:880 k8s.io/kubernetes/vendor/google.golang.org/grpc.invoke({0x5ba9d38?, 0xc0011bf230?}, {0x537f859?, 0x4?}, {0x5147c40, 0xc001cb85a0}, {0x5095200, 0xc00151ae28}, 0x0?, {0xc00114f3f0, ...}) vendor/google.golang.org/grpc/call.go:73 k8s.io/kubernetes/vendor/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc.UnaryClientInterceptor.func1({0x5ba9c90, 0xc0004dcff0}, {0x537f859, 0x22}, {0x5147c40, 0xc001cb85a0}, {0x5095200, 0xc00151ae28}, 0xc001822700, 0x5590080, ...) vendor/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc/interceptor.go:108 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*ClientConn).Invoke(0x7f3040443928?, {0x5ba9c90?, 0xc0004dcff0?}, {0x537f859?, 0xc001cb85a0?}, {0x5147c40?, 0xc001cb85a0?}, {0x5095200?, 0xc00151ae28?}, {0x0, ...}) vendor/google.golang.org/grpc/call.go:35 k8s.io/kubernetes/vendor/k8s.io/cri-api/pkg/apis/runtime/v1.(*imageServiceClient).PullImage(0xc001435860, {0x5ba9c90, 0xc0004dcff0}, 0x4ae0e00?, {0x0, 0x0, 0x0}) vendor/k8s.io/cri-api/pkg/apis/runtime/v1/api.pb.go:11402 k8s.io/kubernetes/pkg/kubelet/cri/remote.(*remoteImageService).pullImageV1(0xc0014e7a28, {0x5ba9c90, 0xc0004dcff0}, 0xc001cb8580, 0x0, 0x0) pkg/kubelet/cri/remote/remote_image.go:161 k8s.io/kubernetes/pkg/kubelet/cri/remote.(*remoteImageService).PullImage(0xc0014e7a28?, {0x5ba9cc8?, 0xc0000760a0?}, 0x40aca5?, 0xc000200ea0?, 0xc001671f48?) pkg/kubelet/cri/remote/remote_image.go:157 > k8s.io/kubernetes/test/e2e_node.(*remotePuller).Pull(0xc00114fb70, {0xc0004176c0, 0x3a}) test/e2e_node/image_list.go:127 > k8s.io/kubernetes/test/e2e_node.PrePullAllImages.func1() test/e2e_node/image_list.go:190 > k8s.io/kubernetes/test/e2e_node.PrePullAllImages test/e2e_node/image_list.go:172from junit_fedora01.xml
> Enter [BeforeEach] [sig-node] ImageGCNoEviction [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - set up framework | framework.go:191 @ 03/22/23 02:49:15.992 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/22/23 02:49:15.994 STEP: Building a namespace api object, basename image-gc-eviction-test - test/e2e/framework/framework.go:250 @ 03/22/23 02:49:15.994 Mar 22 02:49:16.001: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] ImageGCNoEviction [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - set up framework | framework.go:191 @ 03/22/23 02:49:16.001 (9ms) > Enter [BeforeEach] [sig-node] ImageGCNoEviction [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - test/e2e/framework/metrics/init/init.go:33 @ 03/22/23 02:49:16.001 < Exit [BeforeEach] [sig-node] ImageGCNoEviction [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - test/e2e/framework/metrics/init/init.go:33 @ 03/22/23 02:49:16.001 (0s) > Enter [BeforeEach] when we run containers that should cause DiskPressure - test/e2e_node/util.go:176 @ 03/22/23 02:49:16.001 STEP: Stopping the kubelet - test/e2e_node/util.go:200 @ 03/22/23 02:49:16.028 Mar 22 02:49:16.059: INFO: Get running kubelet with systemctl: UNIT LOAD ACTIVE SUB DESCRIPTION kubelet-20230322T015518.service loaded active running /tmp/node-e2e-20230322T015518/kubelet --kubeconfig /tmp/node-e2e-20230322T015518/kubeconfig --root-dir /var/lib/kubelet --v 4 --hostname-override tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 --container-runtime-endpoint unix:///var/run/crio/crio.sock --config /tmp/node-e2e-20230322T015518/kubelet-config --cgroup-driver=systemd --cgroups-per-qos=true --cgroup-root=/ --runtime-cgroups=/system.slice/crio.service --kubelet-cgroups=/system.slice/kubelet.service LOAD = Reflects whether the unit definition was properly loaded. ACTIVE = The high-level unit activation state, i.e. generalization of SUB. SUB = The low-level unit activation state, values depend on unit type. 1 loaded units listed. , kubelet-20230322T015518 W0322 02:49:16.133102 2652 util.go:477] Health check on "http://127.0.0.1:10248/healthz" failed, error=Head "http://127.0.0.1:10248/healthz": read tcp 127.0.0.1:34858->127.0.0.1:10248: read: connection reset by peer STEP: Starting the kubelet - test/e2e_node/util.go:216 @ 03/22/23 02:49:16.143 W0322 02:49:16.180319 2652 util.go:477] Health check on "http://127.0.0.1:10248/healthz" failed, error=Head "http://127.0.0.1:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused < Exit [BeforeEach] when we run containers that should cause DiskPressure - test/e2e_node/util.go:176 @ 03/22/23 02:49:21.187 (5.186s) > Enter [BeforeEach] TOP-LEVEL - test/e2e_node/eviction_test.go:549 @ 03/22/23 02:49:21.187 STEP: setting up pods to be used by tests - test/e2e_node/eviction_test.go:555 @ 03/22/23 02:49:51.255 < Exit [BeforeEach] TOP-LEVEL - test/e2e_node/eviction_test.go:549 @ 03/22/23 02:49:53.274 (32.087s) > Enter [It] should eventually evict all of the correct pods - test/e2e_node/eviction_test.go:563 @ 03/22/23 02:49:53.274 STEP: Waiting for node to have NodeCondition: DiskPressure - test/e2e_node/eviction_test.go:564 @ 03/22/23 02:49:53.274 Mar 22 02:49:53.307: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15078293504 Mar 22 02:49:53.307: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15078293504 Mar 22 02:49:55.325: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15078293504 Mar 22 02:49:55.325: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15078293504 Mar 22 02:49:57.344: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15076532224 Mar 22 02:49:57.344: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15076532224 Mar 22 02:49:59.367: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15076532224 Mar 22 02:49:59.367: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15076532224 Mar 22 02:50:01.386: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15076532224 Mar 22 02:50:01.386: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15076532224 Mar 22 02:50:03.404: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15076532224 Mar 22 02:50:03.404: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15076532224 Mar 22 02:50:03.404: INFO: Pod: container-inode-pod Mar 22 02:50:03.404: INFO: --- summary Container: container-inode-container UsedBytes: 0 Mar 22 02:50:05.435: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15076532224 Mar 22 02:50:05.435: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15076532224 Mar 22 02:50:05.435: INFO: Pod: container-inode-pod Mar 22 02:50:05.435: INFO: --- summary Container: container-inode-container UsedBytes: 0 Mar 22 02:50:07.456: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15073435648 Mar 22 02:50:07.456: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15073435648 Mar 22 02:50:07.456: INFO: Pod: container-inode-pod Mar 22 02:50:07.456: INFO: --- summary Container: container-inode-container UsedBytes: 0 Mar 22 02:50:09.472: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15073435648 Mar 22 02:50:09.472: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15073435648 Mar 22 02:50:09.472: INFO: Pod: container-inode-pod Mar 22 02:50:09.472: INFO: --- summary Container: container-inode-container UsedBytes: 0 Mar 22 02:50:11.495: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15073435648 Mar 22 02:50:11.495: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15073435648 Mar 22 02:50:11.495: INFO: Pod: container-inode-pod Mar 22 02:50:11.495: INFO: --- summary Container: container-inode-container UsedBytes: 0 Mar 22 02:50:13.514: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15073435648 Mar 22 02:50:13.514: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15073435648 Mar 22 02:50:13.514: INFO: Pod: container-inode-pod Mar 22 02:50:13.514: INFO: --- summary Container: container-inode-container UsedBytes: 0 Mar 22 02:50:15.533: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15073435648 Mar 22 02:50:15.533: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15073435648 Mar 22 02:50:15.533: INFO: Pod: container-inode-pod Mar 22 02:50:15.533: INFO: --- summary Container: container-inode-container UsedBytes: 0 Mar 22 02:50:17.550: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15174324224 Mar 22 02:50:17.550: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15174324224 Mar 22 02:50:17.550: INFO: Pod: container-inode-pod Mar 22 02:50:17.550: INFO: --- summary Container: container-inode-container UsedBytes: 0 Mar 22 02:50:19.572: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15174324224 Mar 22 02:50:19.572: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15174324224 Mar 22 02:50:19.572: INFO: Pod: container-inode-pod Mar 22 02:50:19.572: INFO: --- summary Container: container-inode-container UsedBytes: 0 Mar 22 02:50:21.592: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15174324224 Mar 22 02:50:21.592: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15174324224 Mar 22 02:50:21.592: INFO: Pod: container-inode-pod Mar 22 02:50:21.592: INFO: --- summary Container: container-inode-container UsedBytes: 0 Mar 22 02:50:23.613: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15174324224 Mar 22 02:50:23.613: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15174324224 Mar 22 02:50:23.613: INFO: Pod: container-inode-pod Mar 22 02:50:23.613: INFO: --- summary Container: container-inode-container UsedBytes: 0 Mar 22 02:50:25.633: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15174324224 Mar 22 02:50:25.633: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15174324224 Mar 22 02:50:25.633: INFO: Pod: container-inode-pod Mar 22 02:50:25.633: INFO: --- summary Container: container-inode-container UsedBytes: 0 Mar 22 02:50:27.667: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15171428352 Mar 22 02:50:27.667: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15171428352 Mar 22 02:50:27.667: INFO: Pod: container-inode-pod Mar 22 02:50:27.667: INFO: --- summary Container: container-inode-container UsedBytes: 0 Mar 22 02:50:29.691: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15171428352 Mar 22 02:50:29.691: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15171428352 Mar 22 02:50:29.692: INFO: Pod: container-inode-pod Mar 22 02:50:29.692: INFO: --- summary Container: container-inode-container UsedBytes: 0 Mar 22 02:50:31.711: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15171428352 Mar 22 02:50:31.711: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15171428352 Mar 22 02:50:31.711: INFO: Pod: container-inode-pod Mar 22 02:50:31.711: INFO: --- summary Container: container-inode-container UsedBytes: 0 Mar 22 02:50:33.725: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15171428352 Mar 22 02:50:33.725: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15171428352 Mar 22 02:50:33.725: INFO: Pod: container-inode-pod Mar 22 02:50:33.725: INFO: --- summary Container: container-inode-container UsedBytes: 0 Mar 22 02:50:35.754: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15171428352 Mar 22 02:50:35.754: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15171428352 Mar 22 02:50:35.754: INFO: Pod: container-inode-pod Mar 22 02:50:35.754: INFO: --- summary Container: container-inode-container UsedBytes: 0 Mar 22 02:50:37.772: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15168315392 Mar 22 02:50:37.772: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15168315392 Mar 22 02:50:37.772: INFO: Pod: container-inode-pod Mar 22 02:50:37.772: INFO: --- summary Container: container-inode-container UsedBytes: 0 Mar 22 02:50:39.790: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15168315392 Mar 22 02:50:39.790: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15168315392 Mar 22 02:50:39.790: INFO: Pod: container-inode-pod Mar 22 02:50:39.790: INFO: --- summary Container: container-inode-container UsedBytes: 0 Mar 22 02:50:41.813: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15168315392 Mar 22 02:50:41.813: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15168315392 Mar 22 02:50:41.813: INFO: Pod: container-inode-pod Mar 22 02:50:41.813: INFO: --- summary Container: container-inode-container UsedBytes: 0 Mar 22 02:50:43.831: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15168315392 Mar 22 02:50:43.831: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15168315392 Mar 22 02:50:43.831: INFO: Pod: container-inode-pod Mar 22 02:50:43.831: INFO: --- summary Container: container-inode-container UsedBytes: 0 Mar 22 02:50:45.851: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15168315392 Mar 22 02:50:45.851: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15168315392 Mar 22 02:50:45.851: INFO: Pod: container-inode-pod Mar 22 02:50:45.851: INFO: --- summary Container: container-inode-container UsedBytes: 0 Mar 22 02:50:47.875: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15165194240 Mar 22 02:50:47.875: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15165194240 Mar 22 02:50:47.875: INFO: Pod: container-inode-pod Mar 22 02:50:47.875: INFO: --- summary Container: container-inode-container UsedBytes: 0 Mar 22 02:50:49.901: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15165194240 Mar 22 02:50:49.901: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15165194240 Mar 22 02:50:49.901: INFO: Pod: container-inode-pod Mar 22 02:50:49.901: INFO: --- summary Container: container-inode-container UsedBytes: 0 Mar 22 02:50:51.936: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15165194240 Mar 22 02:50:51.936: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15165194240 Mar 22 02:50:51.936: INFO: Pod: container-inode-pod Mar 22 02:50:51.936: INFO: --- summary Container: container-inode-container UsedBytes: 0 Mar 22 02:50:53.960: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15165194240 Mar 22 02:50:53.960: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15165194240 Mar 22 02:50:53.960: INFO: Pod: container-inode-pod Mar 22 02:50:53.960: INFO: --- summary Container: container-inode-container UsedBytes: 0 Mar 22 02:50:55.978: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15165194240 Mar 22 02:50:55.978: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15165194240 Mar 22 02:50:55.978: INFO: Pod: container-inode-pod Mar 22 02:50:55.978: INFO: --- summary Container: container-inode-container UsedBytes: 0 Mar 22 02:50:57.995: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15162089472 Mar 22 02:50:57.995: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15162089472 Mar 22 02:50:57.995: INFO: Pod: container-inode-pod Mar 22 02:50:57.995: INFO: --- summary Container: container-inode-container UsedBytes: 0 Mar 22 02:51:00.021: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15162089472 Mar 22 02:51:00.021: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15162089472 Mar 22 02:51:00.021: INFO: Pod: container-inode-pod Mar 22 02:51:00.021: INFO: --- summary Container: container-inode-container UsedBytes: 0 Mar 22 02:51:02.038: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15162089472 Mar 22 02:51:02.038: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15162089472 Mar 22 02:51:02.038: INFO: Pod: container-inode-pod Mar 22 02:51:02.038: INFO: --- summary Container: container-inode-container UsedBytes: 0 Mar 22 02:51:04.063: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15162089472 Mar 22 02:51:04.072: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15162089472 Mar 22 02:51:04.073: INFO: Pod: container-inode-pod Mar 22 02:51:04.073: INFO: --- summary Container: container-inode-container UsedBytes: 0 Mar 22 02:51:06.102: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15162089472 Mar 22 02:51:06.102: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15162089472 Mar 22 02:51:06.102: INFO: Pod: container-inode-pod Mar 22 02:51:06.102: INFO: --- summary Container: container-inode-container UsedBytes: 0 Mar 22 02:51:08.122: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15158980608 Mar 22 02:51:08.122: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15158980608 Mar 22 02:51:08.122: INFO: Pod: container-inode-pod Mar 22 02:51:08.122: INFO: --- summary Container: container-inode-container UsedBytes: 0 Mar 22 02:51:10.139: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15158980608 Mar 22 02:51:10.139: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15158980608 Mar 22 02:51:10.139: INFO: Pod: container-inode-pod Mar 22 02:51:10.139: INFO: --- summary Container: container-inode-container UsedBytes: 1478656 Mar 22 02:51:12.163: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15158980608 Mar 22 02:51:12.163: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15158980608 Mar 22 02:51:12.163: INFO: Pod: container-inode-pod Mar 22 02:51:12.163: INFO: --- summary Container: container-inode-container UsedBytes: 1478656 Mar 22 02:51:14.181: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15158980608 Mar 22 02:51:14.181: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15158980608 Mar 22 02:51:14.181: INFO: Pod: container-inode-pod Mar 22 02:51:14.181: INFO: --- summary Container: container-inode-container UsedBytes: 1478656 Mar 22 02:51:16.216: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15158980608 Mar 22 02:51:16.216: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15158980608 Mar 22 02:51:16.216: INFO: Pod: container-inode-pod Mar 22 02:51:16.216: INFO: --- summary Container: container-inode-container UsedBytes: 1478656 Mar 22 02:51:18.240: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15155830784 Mar 22 02:51:18.240: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15155830784 Mar 22 02:51:18.240: INFO: Pod: container-inode-pod Mar 22 02:51:18.240: INFO: --- summary Container: container-inode-container UsedBytes: 1478656 Mar 22 02:51:20.257: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15155830784 Mar 22 02:51:20.257: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15155830784 Mar 22 02:51:20.257: INFO: Pod: container-inode-pod Mar 22 02:51:20.257: INFO: --- summary Container: container-inode-container UsedBytes: 1478656 Mar 22 02:51:22.278: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15155830784 Mar 22 02:51:22.278: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15155830784 Mar 22 02:51:22.278: INFO: Pod: container-inode-pod Mar 22 02:51:22.278: INFO: --- summary Container: container-inode-container UsedBytes: 1478656 Mar 22 02:51:24.302: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15155830784 Mar 22 02:51:24.302: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15155830784 Mar 22 02:51:24.302: INFO: Pod: container-inode-pod Mar 22 02:51:24.302: INFO: --- summary Container: container-inode-container UsedBytes: 1478656 Mar 22 02:51:26.321: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15155830784 Mar 22 02:51:26.321: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15155830784 Mar 22 02:51:26.321: INFO: Pod: container-inode-pod Mar 22 02:51:26.321: INFO: --- summary Container: container-inode-container UsedBytes: 1478656 Mar 22 02:51:28.349: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15152713728 Mar 22 02:51:28.349: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15152713728 Mar 22 02:51:28.349: INFO: Pod: container-inode-pod Mar 22 02:51:28.349: INFO: --- summary Container: container-inode-container UsedBytes: 1478656 Mar 22 02:51:30.374: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15152713728 Mar 22 02:51:30.374: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15152713728 Mar 22 02:51:30.374: INFO: Pod: container-inode-pod Mar 22 02:51:30.374: INFO: --- summary Container: container-inode-container UsedBytes: 1478656 Mar 22 02:51:32.391: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15152713728 Mar 22 02:51:32.391: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15152713728 Mar 22 02:51:32.391: INFO: Pod: container-inode-pod Mar 22 02:51:32.391: INFO: --- summary Container: container-inode-container UsedBytes: 1478656 Mar 22 02:51:34.411: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15152713728 Mar 22 02:51:34.411: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15152713728 Mar 22 02:51:34.411: INFO: Pod: container-inode-pod Mar 22 02:51:34.411: INFO: --- summary Container: container-inode-container UsedBytes: 1478656 Mar 22 02:51:36.435: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15152713728 Mar 22 02:51:36.435: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15152713728 Mar 22 02:51:36.435: INFO: Pod: container-inode-pod Mar 22 02:51:36.435: INFO: --- summary Container: container-inode-container UsedBytes: 1478656 Mar 22 02:51:38.453: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15149604864 Mar 22 02:51:38.453: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15149604864 Mar 22 02:51:38.453: INFO: Pod: container-inode-pod Mar 22 02:51:38.453: INFO: --- summary Container: container-inode-container UsedBytes: 1478656 Mar 22 02:51:40.480: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15149604864 Mar 22 02:51:40.480: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15149604864 Mar 22 02:51:40.480: INFO: Pod: container-inode-pod Mar 22 02:51:40.480: INFO: --- summary Container: container-inode-container UsedBytes: 1478656 Mar 22 02:51:42.502: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15149604864 Mar 22 02:51:42.502: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15149604864 Mar 22 02:51:42.502: INFO: Pod: container-inode-pod Mar 22 02:51:42.502: INFO: --- summary Container: container-inode-container UsedBytes: 1478656 Mar 22 02:51:44.521: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15149604864 Mar 22 02:51:44.521: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15149604864 Mar 22 02:51:44.521: INFO: Pod: container-inode-pod Mar 22 02:51:44.521: INFO: --- summary Container: container-inode-container UsedBytes: 1478656 Mar 22 02:51:46.540: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15149604864 Mar 22 02:51:46.540: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15149604864 Mar 22 02:51:46.540: INFO: Pod: container-inode-pod Mar 22 02:51:46.540: INFO: --- summary Container: container-inode-container UsedBytes: 1478656 Mar 22 02:51:48.563: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15146455040 Mar 22 02:51:48.563: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15146455040 Mar 22 02:51:48.563: INFO: Pod: container-inode-pod Mar 22 02:51:48.563: INFO: --- summary Container: container-inode-container UsedBytes: 1478656 Mar 22 02:51:50.582: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15146455040 Mar 22 02:51:50.582: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15146455040 Mar 22 02:51:50.582: INFO: Pod: container-inode-pod Mar 22 02:51:50.582: INFO: --- summary Container: container-inode-container UsedBytes: 1478656 Mar 22 02:51:52.601: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15146455040 Mar 22 02:51:52.601: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15146455040 Mar 22 02:51:52.601: INFO: Pod: container-inode-pod Mar 22 02:51:52.601: INFO: --- summary Container: container-inode-container UsedBytes: 1478656 Mar 22 02:51:54.625: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15146455040 Mar 22 02:51:54.625: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15146455040 Mar 22 02:51:54.625: INFO: Pod: container-inode-pod Mar 22 02:51:54.625: INFO: --- summary Container: container-inode-container UsedBytes: 1478656 Mar 22 02:51:56.642: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15146455040 Mar 22 02:51:56.642: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15146455040 Mar 22 02:51:56.642: INFO: Pod: container-inode-pod Mar 22 02:51:56.642: INFO: --- summary Container: container-inode-container UsedBytes: 1478656 Mar 22 02:51:58.660: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15143342080 Mar 22 02:51:58.660: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15143342080 Mar 22 02:51:58.660: INFO: Pod: container-inode-pod Mar 22 02:51:58.660: INFO: --- summary Container: container-inode-container UsedBytes: 1478656 Mar 22 02:52:00.687: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15143342080 Mar 22 02:52:00.687: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15143342080 Mar 22 02:52:00.687: INFO: Pod: container-inode-pod Mar 22 02:52:00.687: INFO: --- summary Container: container-inode-container UsedBytes: 2985984 Mar 22 02:52:02.707: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15143342080 Mar 22 02:52:02.707: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15143342080 Mar 22 02:52:02.707: INFO: Pod: container-inode-pod Mar 22 02:52:02.707: INFO: --- summary Container: container-inode-container UsedBytes: 2985984 Mar 22 02:52:04.734: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15143342080 Mar 22 02:52:04.734: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15143342080 Mar 22 02:52:04.734: INFO: Pod: container-inode-pod Mar 22 02:52:04.734: INFO: --- summary Container: container-inode-container UsedBytes: 2985984 Mar 22 02:52:06.758: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15140229120 Mar 22 02:52:06.758: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15140229120 Mar 22 02:52:06.758: INFO: Pod: container-inode-pod Mar 22 02:52:06.758: INFO: --- summary Container: container-inode-container UsedBytes: 2985984 Mar 22 02:52:08.777: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15140229120 Mar 22 02:52:08.777: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15140229120 Mar 22 02:52:08.777: INFO: Pod: container-inode-pod Mar 22 02:52:08.777: INFO: --- summary Container: container-inode-container UsedBytes: 2985984 Mar 22 02:52:10.797: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15140229120 Mar 22 02:52:10.797: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15140229120 Mar 22 02:52:10.797: INFO: Pod: container-inode-pod Mar 22 02:52:10.797: INFO: --- summary Container: container-inode-container UsedBytes: 2985984 Mar 22 02:52:12.820: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15140229120 Mar 22 02:52:12.820: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15140229120 Mar 22 02:52:12.820: INFO: Pod: container-inode-pod Mar 22 02:52:12.820: INFO: --- summary Container: container-inode-container UsedBytes: 2985984 Mar 22 02:52:14.837: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15140229120 Mar 22 02:52:14.837: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15140229120 Mar 22 02:52:14.837: INFO: Pod: container-inode-pod Mar 22 02:52:14.837: INFO: --- summary Container: container-inode-container UsedBytes: 2985984 Mar 22 02:52:16.857: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15137083392 Mar 22 02:52:16.857: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15137083392 Mar 22 02:52:16.857: INFO: Pod: container-inode-pod Mar 22 02:52:16.857: INFO: --- summary Container: container-inode-container UsedBytes: 2985984 Mar 22 02:52:18.880: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15137083392 Mar 22 02:52:18.880: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15137083392 Mar 22 02:52:18.880: INFO: Pod: container-inode-pod Mar 22 02:52:18.880: INFO: --- summary Container: container-inode-container UsedBytes: 2985984 Mar 22 02:52:20.900: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15137083392 Mar 22 02:52:20.900: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15137083392 Mar 22 02:52:20.900: INFO: Pod: container-inode-pod Mar 22 02:52:20.900: INFO: --- summary Container: container-inode-container UsedBytes: 2985984 Mar 22 02:52:22.918: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15137083392 Mar 22 02:52:22.918: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15137083392 Mar 22 02:52:22.918: INFO: Pod: container-inode-pod Mar 22 02:52:22.918: INFO: --- summary Container: container-inode-container UsedBytes: 2985984 Mar 22 02:52:24.945: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15137083392 Mar 22 02:52:24.945: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15137083392 Mar 22 02:52:24.945: INFO: Pod: container-inode-pod Mar 22 02:52:24.945: INFO: --- summary Container: container-inode-container UsedBytes: 2985984 Mar 22 02:52:26.966: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15133933568 Mar 22 02:52:26.966: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15133933568 Mar 22 02:52:26.966: INFO: Pod: container-inode-pod Mar 22 02:52:26.966: INFO: --- summary Container: container-inode-container UsedBytes: 2985984 Mar 22 02:52:28.994: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15133933568 Mar 22 02:52:28.994: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15133933568 Mar 22 02:52:28.994: INFO: Pod: container-inode-pod Mar 22 02:52:28.994: INFO: --- summary Container: container-inode-container UsedBytes: 2985984 Mar 22 02:52:31.018: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15133933568 Mar 22 02:52:31.018: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15133933568 Mar 22 02:52:31.018: INFO: Pod: container-inode-pod Mar 22 02:52:31.018: INFO: --- summary Container: container-inode-container UsedBytes: 2985984 Mar 22 02:52:33.037: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15133933568 Mar 22 02:52:33.037: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15133933568 Mar 22 02:52:33.037: INFO: Pod: container-inode-pod Mar 22 02:52:33.037: INFO: --- summary Container: container-inode-container UsedBytes: 2985984 Mar 22 02:52:35.057: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15133933568 Mar 22 02:52:35.057: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15133933568 Mar 22 02:52:35.057: INFO: Pod: container-inode-pod Mar 22 02:52:35.057: INFO: --- summary Container: container-inode-container UsedBytes: 2985984 Mar 22 02:52:37.077: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15130849280 Mar 22 02:52:37.077: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15130849280 Mar 22 02:52:37.077: INFO: Pod: container-inode-pod Mar 22 02:52:37.077: INFO: --- summary Container: container-inode-container UsedBytes: 2985984 Mar 22 02:52:39.096: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15130849280 Mar 22 02:52:39.096: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15130849280 Mar 22 02:52:39.096: INFO: Pod: container-inode-pod Mar 22 02:52:39.096: INFO: --- summary Container: container-inode-container UsedBytes: 2985984 Mar 22 02:52:41.114: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15130849280 Mar 22 02:52:41.114: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15130849280 Mar 22 02:52:41.114: INFO: Pod: container-inode-pod Mar 22 02:52:41.114: INFO: --- summary Container: container-inode-container UsedBytes: 2985984 Mar 22 02:52:43.138: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15130849280 Mar 22 02:52:43.138: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15130849280 Mar 22 02:52:43.138: INFO: Pod: container-inode-pod Mar 22 02:52:43.138: INFO: --- summary Container: container-inode-container UsedBytes: 2985984 Mar 22 02:52:45.157: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15130849280 Mar 22 02:52:45.157: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15130849280 Mar 22 02:52:45.157: INFO: Pod: container-inode-pod Mar 22 02:52:45.157: INFO: --- summary Container: container-inode-container UsedBytes: 2985984 Mar 22 02:52:47.179: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15127736320 Mar 22 02:52:47.179: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15127736320 Mar 22 02:52:47.179: INFO: Pod: container-inode-pod Mar 22 02:52:47.179: INFO: --- summary Container: container-inode-container UsedBytes: 2985984 Mar 22 02:52:49.202: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15127736320 Mar 22 02:52:49.202: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15127736320 Mar 22 02:52:49.202: INFO: Pod: container-inode-pod Mar 22 02:52:49.202: INFO: --- summary Container: container-inode-container UsedBytes: 2985984 Mar 22 02:52:51.230: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15127736320 Mar 22 02:52:51.230: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15127736320 Mar 22 02:52:51.231: INFO: Pod: container-inode-pod Mar 22 02:52:51.232: INFO: --- summary Container: container-inode-container UsedBytes: 2985984 Mar 22 02:52:53.263: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15127736320 Mar 22 02:52:53.263: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15127736320 Mar 22 02:52:53.263: INFO: Pod: container-inode-pod Mar 22 02:52:53.263: INFO: --- summary Container: container-inode-container UsedBytes: 2985984 Mar 22 02:52:55.286: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15127736320 Mar 22 02:52:55.286: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15127736320 Mar 22 02:52:55.286: INFO: Pod: container-inode-pod Mar 22 02:52:55.286: INFO: --- summary Container: container-inode-container UsedBytes: 2985984 Mar 22 02:52:57.845: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15124615168 Mar 22 02:52:57.845: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15124615168 Mar 22 02:52:57.845: INFO: Pod: container-inode-pod Mar 22 02:52:57.845: INFO: --- summary Container: container-inode-container UsedBytes: 2985984 Mar 22 02:53:02.137: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15124615168 Mar 22 02:53:02.137: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15124615168 Mar 22 02:53:02.137: INFO: Pod: container-inode-pod Mar 22 02:53:02.137: INFO: --- summary Container: container-inode-container UsedBytes: 2985984 STEP: Waiting for evictions to occur - test/e2e_node/eviction_test.go:573 @ 03/22/23 02:53:02.141 Mar 22 02:53:02.147: INFO: Node has DiskPressure Mar 22 02:53:02.193: INFO: Kubelet Metrics: [] Mar 22 02:53:02.342: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 15124615168 Mar 22 02:53:02.342: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 15124615168 Mar 22 02:53:02.342: INFO: Pod: container-inode-pod Mar 22 02:53:02.342: INFO: --- summary Container: container-inode-container UsedBytes: 2985984 Mar 22 02:53:02.346: INFO: fetching pod container-inode-pod; phase= Running STEP: checking eviction ordering and ensuring important pods don't fail - test/e2e_node/eviction_test.go:700 @ 03/22/23 02:53:02.346 STEP: checking for the expected pod conditions for evicted pods - test/e2e_node/eviction_test.go:587 @ 03/22/23 02:53:02.346 STEP: making sure pressure from test has surfaced before continuing - test/e2e_node/eviction_test.go:593 @ 03/22/23 02:53:02.346 STEP: Waiting for NodeCondition: DiskPressure to no longer exist on the node - test/e2e_node/eviction_test.go:596 @ 03/22/23 02:53:22.346 Mar 22 02:53:22.355: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:22.355: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:22.355: INFO: Pod: container-inode-pod Mar 22 02:53:22.355: INFO: --- summary Container: container-inode-container UsedBytes: 4505600 Mar 22 02:53:22.370: INFO: Kubelet Metrics: [] Mar 22 02:53:24.384: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:24.384: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:24.384: INFO: Pod: container-inode-pod Mar 22 02:53:24.384: INFO: --- summary Container: container-inode-container UsedBytes: 4505600 Mar 22 02:53:24.396: INFO: Kubelet Metrics: [] Mar 22 02:53:26.407: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:26.407: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:26.407: INFO: Pod: container-inode-pod Mar 22 02:53:26.407: INFO: --- summary Container: container-inode-container UsedBytes: 4505600 Mar 22 02:53:26.419: INFO: Kubelet Metrics: [] Mar 22 02:53:28.433: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:28.433: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:28.433: INFO: Pod: container-inode-pod Mar 22 02:53:28.433: INFO: --- summary Container: container-inode-container UsedBytes: 4505600 Mar 22 02:53:28.456: INFO: Kubelet Metrics: [] Mar 22 02:53:30.472: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:30.472: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:30.472: INFO: Pod: container-inode-pod Mar 22 02:53:30.472: INFO: --- summary Container: container-inode-container UsedBytes: 4505600 Mar 22 02:53:30.483: INFO: Kubelet Metrics: [] Mar 22 02:53:32.495: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:32.495: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:32.495: INFO: Pod: container-inode-pod Mar 22 02:53:32.495: INFO: --- summary Container: container-inode-container UsedBytes: 4505600 Mar 22 02:53:32.508: INFO: Kubelet Metrics: [] STEP: checking for stable, pressure-free condition without unexpected pod failures - test/e2e_node/eviction_test.go:606 @ 03/22/23 02:53:32.51 Mar 22 02:53:32.519: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:32.520: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:32.520: INFO: Pod: container-inode-pod Mar 22 02:53:32.520: INFO: --- summary Container: container-inode-container UsedBytes: 4505600 Mar 22 02:53:32.532: INFO: Kubelet Metrics: [] Mar 22 02:53:32.534: INFO: fetching pod container-inode-pod; phase= Running STEP: checking eviction ordering and ensuring important pods don't fail - test/e2e_node/eviction_test.go:700 @ 03/22/23 02:53:32.534 Mar 22 02:53:34.544: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:34.544: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:34.544: INFO: Pod: container-inode-pod Mar 22 02:53:34.544: INFO: --- summary Container: container-inode-container UsedBytes: 4505600 Mar 22 02:53:34.557: INFO: Kubelet Metrics: [] Mar 22 02:53:34.558: INFO: fetching pod container-inode-pod; phase= Running STEP: checking eviction ordering and ensuring important pods don't fail - test/e2e_node/eviction_test.go:700 @ 03/22/23 02:53:34.559 Mar 22 02:53:36.574: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:36.574: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:36.574: INFO: Pod: container-inode-pod Mar 22 02:53:36.574: INFO: --- summary Container: container-inode-container UsedBytes: 4505600 Mar 22 02:53:36.606: INFO: Kubelet Metrics: [] Mar 22 02:53:36.610: INFO: fetching pod container-inode-pod; phase= Running STEP: checking eviction ordering and ensuring important pods don't fail - test/e2e_node/eviction_test.go:700 @ 03/22/23 02:53:36.61 Mar 22 02:53:38.620: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:38.620: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:38.620: INFO: Pod: container-inode-pod Mar 22 02:53:38.620: INFO: --- summary Container: container-inode-container UsedBytes: 4505600 Mar 22 02:53:38.632: INFO: Kubelet Metrics: [] Mar 22 02:53:38.633: INFO: fetching pod container-inode-pod; phase= Running STEP: checking eviction ordering and ensuring important pods don't fail - test/e2e_node/eviction_test.go:700 @ 03/22/23 02:53:38.634 Mar 22 02:53:40.644: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:40.644: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:40.644: INFO: Pod: container-inode-pod Mar 22 02:53:40.644: INFO: --- summary Container: container-inode-container UsedBytes: 4505600 Mar 22 02:53:40.656: INFO: Kubelet Metrics: [] Mar 22 02:53:40.658: INFO: fetching pod container-inode-pod; phase= Running STEP: checking eviction ordering and ensuring important pods don't fail - test/e2e_node/eviction_test.go:700 @ 03/22/23 02:53:40.659 Mar 22 02:53:42.673: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:42.673: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:42.673: INFO: Pod: container-inode-pod Mar 22 02:53:42.673: INFO: --- summary Container: container-inode-container UsedBytes: 4505600 Mar 22 02:53:42.684: INFO: Kubelet Metrics: [] Mar 22 02:53:42.685: INFO: fetching pod container-inode-pod; phase= Running STEP: checking eviction ordering and ensuring important pods don't fail - test/e2e_node/eviction_test.go:700 @ 03/22/23 02:53:42.686 Mar 22 02:53:44.696: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:44.696: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:44.696: INFO: Pod: container-inode-pod Mar 22 02:53:44.696: INFO: --- summary Container: container-inode-container UsedBytes: 4505600 Mar 22 02:53:44.708: INFO: Kubelet Metrics: [] Mar 22 02:53:44.710: INFO: fetching pod container-inode-pod; phase= Running STEP: checking eviction ordering and ensuring important pods don't fail - test/e2e_node/eviction_test.go:700 @ 03/22/23 02:53:44.71 Mar 22 02:53:46.721: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:46.721: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:46.721: INFO: Pod: container-inode-pod Mar 22 02:53:46.721: INFO: --- summary Container: container-inode-container UsedBytes: 4505600 Mar 22 02:53:46.741: INFO: Kubelet Metrics: [] Mar 22 02:53:46.749: INFO: fetching pod container-inode-pod; phase= Running STEP: checking eviction ordering and ensuring important pods don't fail - test/e2e_node/eviction_test.go:700 @ 03/22/23 02:53:46.749 Mar 22 02:53:48.763: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:48.763: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:48.763: INFO: Pod: container-inode-pod Mar 22 02:53:48.763: INFO: --- summary Container: container-inode-container UsedBytes: 4505600 Mar 22 02:53:48.774: INFO: Kubelet Metrics: [] Mar 22 02:53:48.776: INFO: fetching pod container-inode-pod; phase= Running STEP: checking eviction ordering and ensuring important pods don't fail - test/e2e_node/eviction_test.go:700 @ 03/22/23 02:53:48.776 Mar 22 02:53:50.789: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:50.789: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:50.789: INFO: Pod: container-inode-pod Mar 22 02:53:50.789: INFO: --- summary Container: container-inode-container UsedBytes: 4505600 Mar 22 02:53:50.806: INFO: Kubelet Metrics: [] Mar 22 02:53:50.808: INFO: fetching pod container-inode-pod; phase= Running STEP: checking eviction ordering and ensuring important pods don't fail - test/e2e_node/eviction_test.go:700 @ 03/22/23 02:53:50.808 Mar 22 02:53:52.819: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:52.819: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:52.819: INFO: Pod: container-inode-pod Mar 22 02:53:52.819: INFO: --- summary Container: container-inode-container UsedBytes: 4505600 Mar 22 02:53:52.831: INFO: Kubelet Metrics: [] Mar 22 02:53:52.833: INFO: fetching pod container-inode-pod; phase= Running STEP: checking eviction ordering and ensuring important pods don't fail - test/e2e_node/eviction_test.go:700 @ 03/22/23 02:53:52.833 Mar 22 02:53:54.846: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:54.846: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:54.846: INFO: Pod: container-inode-pod Mar 22 02:53:54.846: INFO: --- summary Container: container-inode-container UsedBytes: 4505600 Mar 22 02:53:54.857: INFO: Kubelet Metrics: [] Mar 22 02:53:54.859: INFO: fetching pod container-inode-pod; phase= Running STEP: checking eviction ordering and ensuring important pods don't fail - test/e2e_node/eviction_test.go:700 @ 03/22/23 02:53:54.859 Mar 22 02:53:56.870: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:56.870: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:56.870: INFO: Pod: container-inode-pod Mar 22 02:53:56.870: INFO: --- summary Container: container-inode-container UsedBytes: 4505600 Mar 22 02:53:56.889: INFO: Kubelet Metrics: [] Mar 22 02:53:56.896: INFO: fetching pod container-inode-pod; phase= Running STEP: checking eviction ordering and ensuring important pods don't fail - test/e2e_node/eviction_test.go:700 @ 03/22/23 02:53:56.896 Mar 22 02:53:58.907: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:58.907: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:53:58.907: INFO: Pod: container-inode-pod Mar 22 02:53:58.907: INFO: --- summary Container: container-inode-container UsedBytes: 4919296 Mar 22 02:53:58.919: INFO: Kubelet Metrics: [] Mar 22 02:53:58.920: INFO: fetching pod container-inode-pod; phase= Running STEP: checking eviction ordering and ensuring important pods don't fail - test/e2e_node/eviction_test.go:700 @ 03/22/23 02:53:58.921 Mar 22 02:54:00.934: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:54:00.934: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:54:00.934: INFO: Pod: container-inode-pod Mar 22 02:54:00.934: INFO: --- summary Container: container-inode-container UsedBytes: 4919296 Mar 22 02:54:00.946: INFO: Kubelet Metrics: [] Mar 22 02:54:00.947: INFO: fetching pod container-inode-pod; phase= Running STEP: checking eviction ordering and ensuring important pods don't fail - test/e2e_node/eviction_test.go:700 @ 03/22/23 02:54:00.948 Mar 22 02:54:02.959: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:54:02.959: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:54:02.959: INFO: Pod: container-inode-pod Mar 22 02:54:02.959: INFO: --- summary Container: container-inode-container UsedBytes: 4919296 Mar 22 02:54:02.971: INFO: Kubelet Metrics: [] Mar 22 02:54:02.973: INFO: fetching pod container-inode-pod; phase= Running STEP: checking eviction ordering and ensuring important pods don't fail - test/e2e_node/eviction_test.go:700 @ 03/22/23 02:54:02.973 Mar 22 02:54:04.983: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:54:04.983: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:54:04.983: INFO: Pod: container-inode-pod Mar 22 02:54:04.983: INFO: --- summary Container: container-inode-container UsedBytes: 4919296 Mar 22 02:54:04.995: INFO: Kubelet Metrics: [] Mar 22 02:54:04.997: INFO: fetching pod container-inode-pod; phase= Running STEP: checking eviction ordering and ensuring important pods don't fail - test/e2e_node/eviction_test.go:700 @ 03/22/23 02:54:04.997 Mar 22 02:54:07.010: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:54:07.010: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:54:07.010: INFO: Pod: container-inode-pod Mar 22 02:54:07.010: INFO: --- summary Container: container-inode-container UsedBytes: 4919296 Mar 22 02:54:07.029: INFO: Kubelet Metrics: [] Mar 22 02:54:07.037: INFO: fetching pod container-inode-pod; phase= Running STEP: checking eviction ordering and ensuring important pods don't fail - test/e2e_node/eviction_test.go:700 @ 03/22/23 02:54:07.037 Mar 22 02:54:09.048: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:54:09.048: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:54:09.048: INFO: Pod: container-inode-pod Mar 22 02:54:09.048: INFO: --- summary Container: container-inode-container UsedBytes: 4919296 Mar 22 02:54:09.060: INFO: Kubelet Metrics: [] Mar 22 02:54:09.061: INFO: fetching pod container-inode-pod; phase= Running STEP: checking eviction ordering and ensuring important pods don't fail - test/e2e_node/eviction_test.go:700 @ 03/22/23 02:54:09.061 Mar 22 02:54:11.074: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:54:11.075: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:54:11.075: INFO: Pod: container-inode-pod Mar 22 02:54:11.075: INFO: --- summary Container: container-inode-container UsedBytes: 4919296 Mar 22 02:54:11.090: INFO: Kubelet Metrics: [] Mar 22 02:54:11.096: INFO: fetching pod container-inode-pod; phase= Running STEP: checking eviction ordering and ensuring important pods don't fail - test/e2e_node/eviction_test.go:700 @ 03/22/23 02:54:11.096 Mar 22 02:54:13.111: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:54:13.111: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:54:13.111: INFO: Pod: container-inode-pod Mar 22 02:54:13.111: INFO: --- summary Container: container-inode-container UsedBytes: 4919296 Mar 22 02:54:13.122: INFO: Kubelet Metrics: [] Mar 22 02:54:13.124: INFO: fetching pod container-inode-pod; phase= Running STEP: checking eviction ordering and ensuring important pods don't fail - test/e2e_node/eviction_test.go:700 @ 03/22/23 02:54:13.124 Mar 22 02:54:15.134: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:54:15.134: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:54:15.134: INFO: Pod: container-inode-pod Mar 22 02:54:15.134: INFO: --- summary Container: container-inode-container UsedBytes: 4919296 Mar 22 02:54:15.146: INFO: Kubelet Metrics: [] Mar 22 02:54:15.147: INFO: fetching pod container-inode-pod; phase= Running STEP: checking eviction ordering and ensuring important pods don't fail - test/e2e_node/eviction_test.go:700 @ 03/22/23 02:54:15.147 Mar 22 02:54:17.158: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:54:17.158: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:54:17.158: INFO: Pod: container-inode-pod Mar 22 02:54:17.158: INFO: --- summary Container: container-inode-container UsedBytes: 4919296 Mar 22 02:54:17.178: INFO: Kubelet Metrics: [] Mar 22 02:54:17.185: INFO: fetching pod container-inode-pod; phase= Running STEP: checking eviction ordering and ensuring important pods don't fail - test/e2e_node/eviction_test.go:700 @ 03/22/23 02:54:17.185 Mar 22 02:54:19.198: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:54:19.198: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:54:19.198: INFO: Pod: container-inode-pod Mar 22 02:54:19.198: INFO: --- summary Container: container-inode-container UsedBytes: 4919296 Mar 22 02:54:19.209: INFO: Kubelet Metrics: [] Mar 22 02:54:19.210: INFO: fetching pod container-inode-pod; phase= Running STEP: checking eviction ordering and ensuring important pods don't fail - test/e2e_node/eviction_test.go:700 @ 03/22/23 02:54:19.211 Mar 22 02:54:21.221: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:54:21.221: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:54:21.221: INFO: Pod: container-inode-pod Mar 22 02:54:21.221: INFO: --- summary Container: container-inode-container UsedBytes: 4919296 Mar 22 02:54:21.234: INFO: Kubelet Metrics: [] Mar 22 02:54:21.236: INFO: fetching pod container-inode-pod; phase= Running STEP: checking eviction ordering and ensuring important pods don't fail - test/e2e_node/eviction_test.go:700 @ 03/22/23 02:54:21.236 Mar 22 02:54:23.246: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:54:23.246: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:54:23.246: INFO: Pod: container-inode-pod Mar 22 02:54:23.246: INFO: --- summary Container: container-inode-container UsedBytes: 4919296 Mar 22 02:54:23.257: INFO: Kubelet Metrics: [] Mar 22 02:54:23.259: INFO: fetching pod container-inode-pod; phase= Running STEP: checking eviction ordering and ensuring important pods don't fail - test/e2e_node/eviction_test.go:700 @ 03/22/23 02:54:23.259 Mar 22 02:54:25.273: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:54:25.273: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:54:25.273: INFO: Pod: container-inode-pod Mar 22 02:54:25.273: INFO: --- summary Container: container-inode-container UsedBytes: 4919296 Mar 22 02:54:25.283: INFO: Kubelet Metrics: [] Mar 22 02:54:25.285: INFO: fetching pod container-inode-pod; phase= Running STEP: checking eviction ordering and ensuring important pods don't fail - test/e2e_node/eviction_test.go:700 @ 03/22/23 02:54:25.285 Mar 22 02:54:27.295: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:54:27.295: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:54:27.295: INFO: Pod: container-inode-pod Mar 22 02:54:27.295: INFO: --- summary Container: container-inode-container UsedBytes: 4919296 Mar 22 02:54:27.327: INFO: Kubelet Metrics: [] Mar 22 02:54:27.329: INFO: fetching pod container-inode-pod; phase= Running STEP: checking eviction ordering and ensuring important pods don't fail - test/e2e_node/eviction_test.go:700 @ 03/22/23 02:54:27.329 Mar 22 02:54:29.339: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:54:29.339: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:54:29.339: INFO: Pod: container-inode-pod Mar 22 02:54:29.339: INFO: --- summary Container: container-inode-container UsedBytes: 4919296 Mar 22 02:54:29.351: INFO: Kubelet Metrics: [] Mar 22 02:54:29.352: INFO: fetching pod container-inode-pod; phase= Running STEP: checking eviction ordering and ensuring important pods don't fail - test/e2e_node/eviction_test.go:700 @ 03/22/23 02:54:29.353 Mar 22 02:54:31.367: INFO: imageFsInfo.CapacityBytes: 20869787648, imageFsInfo.AvailableBytes: 18380259328 Mar 22 02:54:31.367: INFO: rootFsInfo.CapacityBytes: 20869787648, rootFsInfo.AvailableBytes: 18380259328 Mar 22 02:54:31.367: INFO: Pod: container-inode-pod Mar 22 02:54:31.367: INFO: --- summary Container: container-inode-container UsedBytes: 4919296 Mar 22 02:54:31.378: INFO: Kubelet Metrics: [] Mar 22 02:54:31.380: INFO: fetching pod container-inode-pod; phase= Running STEP: checking eviction ordering and ensuring important pods don't fail - test/e2e_node/eviction_test.go:700 @ 03/22/23 02:54:31.38 STEP: checking for correctly formatted eviction events - test/e2e_node/eviction_test.go:616 @ 03/22/23 02:54:32.511 < Exit [It] should eventually evict all of the correct pods - test/e2e_node/eviction_test.go:563 @ 03/22/23 02:54:32.511 (4m39.236s) > Enter [AfterEach] TOP-LEVEL - test/e2e_node/eviction_test.go:620 @ 03/22/23 02:54:32.511 STEP: deleting pods - test/e2e_node/eviction_test.go:631 @ 03/22/23 02:54:32.511 STEP: deleting pod: container-inode-pod - test/e2e_node/eviction_test.go:633 @ 03/22/23 02:54:32.511 STEP: making sure NodeCondition DiskPressure no longer exists on the node - test/e2e_node/eviction_test.go:639 @ 03/22/23 02:55:04.563 STEP: making sure we have all the required images for testing - test/e2e_node/eviction_test.go:648 @ 03/22/23 02:55:05.352 I0322 02:55:05.352693 2652 remote_runtime.go:74] "Connecting to runtime service" endpoint="unix:///var/run/crio/crio.sock" I0322 02:55:05.352831 2652 remote_runtime.go:119] "Validating the CRI v1 API runtime version" I0322 02:55:05.361417 2652 remote_runtime.go:126] "Validated CRI v1 runtime API" I0322 02:55:05.361659 2652 remote_image.go:47] "Connecting to image service" endpoint="unix:///var/run/crio/crio.sock" I0322 02:55:05.361937 2652 remote_image.go:91] "Validating the CRI v1 API image version" I0322 02:55:05.364410 2652 remote_image.go:98] "Validated CRI v1 image API" I0322 02:55:05.364678 2652 image_list.go:152] Pre-pulling images with CRI [docker.io/nfvpe/sriov-device-plugin:v3.1 gcr.io/cadvisor/cadvisor:v0.43.0 registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff registry.k8s.io/e2e-test-images/agnhost:2.43 registry.k8s.io/e2e-test-images/busybox:1.29-4 registry.k8s.io/e2e-test-images/httpd:2.4.38-4 registry.k8s.io/e2e-test-images/ipc-utils:1.3 registry.k8s.io/e2e-test-images/nginx:1.14-4 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3 registry.k8s.io/e2e-test-images/nonewprivs:1.3 registry.k8s.io/e2e-test-images/nonroot:1.4 registry.k8s.io/e2e-test-images/perl:5.26 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3 registry.k8s.io/e2e-test-images/volume/gluster:1.3 registry.k8s.io/e2e-test-images/volume/nfs:1.3 registry.k8s.io/etcd:3.5.7-0 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7 registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa registry.k8s.io/pause:3.9 registry.k8s.io/stress:v1] [TIMEDOUT] A suite timeout occurred In [AfterEach] at: test/e2e_node/eviction_test.go:620 @ 03/22/23 02:55:32.21 This is the Progress Report generated when the suite timeout occurred: [sig-node] ImageGCNoEviction [Slow] [Serial] [Disruptive][NodeFeature:Eviction] when we run containers that should cause DiskPressure should eventually evict all of the correct pods (Spec Runtime: 6m16.218s) test/e2e_node/eviction_test.go:563 In [AfterEach] (Node Runtime: 59.7s) test/e2e_node/eviction_test.go:620 At [By Step] making sure we have all the required images for testing (Step Runtime: 26.858s) test/e2e_node/eviction_test.go:648 Spec Goroutine goroutine 8145 [semacquire] sync.runtime_Semacquire(0xc001bdf080?) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/runtime/sema.go:62 sync.(*WaitGroup).Wait(0x5ba9cc8?) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/sync/waitgroup.go:116 > k8s.io/kubernetes/test/e2e_node.PrePullAllImages() test/e2e_node/image_list.go:206 > k8s.io/kubernetes/test/e2e_node.runEvictionTest.func1.3.1(...) test/e2e_node/eviction_test.go:625 > k8s.io/kubernetes/test/e2e_node.runEvictionTest.func1.3({0x7f3041625140?, 0xc001955e90}) test/e2e_node/eviction_test.go:649 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x5bb2860?, 0xc001955e90}) vendor/github.com/onsi/ginkgo/v2/internal/node.go:456 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3() vendor/github.com/onsi/ginkgo/v2/internal/suite.go:863 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode vendor/github.com/onsi/ginkgo/v2/internal/suite.go:850 Goroutines of Interest goroutine 1 [chan receive, 60 minutes] testing.(*T).Run(0xc0004836c0, {0x52ff476?, 0x53e765?}, 0x558db68) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/testing/testing.go:1630 testing.runTests.func1(0x88173a0?) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/testing/testing.go:2036 testing.tRunner(0xc0004836c0, 0xc000b91b78) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/testing/testing.go:1576 testing.runTests(0xc0004b8780?, {0x8651d70, 0x1, 0x1}, {0x30?, 0xc0009b2d50?, 0x0?}) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/testing/testing.go:2034 testing.(*M).Run(0xc0004b8780) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/testing/testing.go:1906 > k8s.io/kubernetes/test/e2e_node.TestMain(0xffffffffffffffff?) test/e2e_node/e2e_node_suite_test.go:145 main.main() /tmp/go-build1451623592/b001/_testmain.go:49 goroutine 245 [syscall, 59 minutes] syscall.Syscall6(0x100?, 0xc001403cd8?, 0x6fc80d?, 0x1?, 0x52183e0?, 0xc00058fc70?, 0x47edfe?) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/syscall/syscall_linux.go:91 os.(*Process).blockUntilWaitable(0xc000ce0a80) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/os/wait_waitid.go:32 os.(*Process).wait(0xc000ce0a80) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/os/exec_unix.go:22 os.(*Process).Wait(...) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/os/exec.go:132 os/exec.(*Cmd).Wait(0xc00049b340) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/os/exec/exec.go:890 > k8s.io/kubernetes/test/e2e_node/services.(*server).start.func1() test/e2e_node/services/server.go:166 > k8s.io/kubernetes/test/e2e_node/services.(*server).start test/e2e_node/services/server.go:123 goroutine 8176 [select] k8s.io/kubernetes/vendor/google.golang.org/grpc/internal/transport.(*Stream).waitOnHeader(0xc0011bbc20) vendor/google.golang.org/grpc/internal/transport/transport.go:328 k8s.io/kubernetes/vendor/google.golang.org/grpc/internal/transport.(*Stream).RecvCompress(...) vendor/google.golang.org/grpc/internal/transport/transport.go:343 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc0006ef500, {0x5095200?, 0xc00151a9d8}, 0x7f3040429648?) vendor/google.golang.org/grpc/stream.go:1027 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0x0?) vendor/google.golang.org/grpc/stream.go:881 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc0011bb9e0, 0xc00166b7a8, 0xc00166b778) vendor/google.golang.org/grpc/stream.go:732 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc0011bb9e0, {0x5095200?, 0xc00151a9d8?}) vendor/google.golang.org/grpc/stream.go:880 k8s.io/kubernetes/vendor/google.golang.org/grpc.invoke({0x5ba9d38?, 0xc0011bea20?}, {0x537f859?, 0x4?}, {0x5147c40, 0xc001cb8340}, {0x5095200, 0xc00151a9d8}, 0x0?, {0xc00114f3f0, ...}) vendor/google.golang.org/grpc/call.go:73 k8s.io/kubernetes/vendor/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc.UnaryClientInterceptor.func1({0x5ba9c90, 0xc0004dc6e0}, {0x537f859, 0x22}, {0x5147c40, 0xc001cb8340}, {0x5095200, 0xc00151a9d8}, 0xc001822700, 0x5590080, ...) vendor/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc/interceptor.go:108 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*ClientConn).Invoke(0x7f3040443928?, {0x5ba9c90?, 0xc0004dc6e0?}, {0x537f859?, 0xc001cb8340?}, {0x5147c40?, 0xc001cb8340?}, {0x5095200?, 0xc00151a9d8?}, {0x0, ...}) vendor/google.golang.org/grpc/call.go:35 k8s.io/kubernetes/vendor/k8s.io/cri-api/pkg/apis/runtime/v1.(*imageServiceClient).PullImage(0xc001435860, {0x5ba9c90, 0xc0004dc6e0}, 0x4ae0e00?, {0x0, 0x0, 0x0}) vendor/k8s.io/cri-api/pkg/apis/runtime/v1/api.pb.go:11402 k8s.io/kubernetes/pkg/kubelet/cri/remote.(*remoteImageService).pullImageV1(0xc0014e7a28, {0x5ba9c90, 0xc0004dc6e0}, 0xc001cb8320, 0x0, 0x0) pkg/kubelet/cri/remote/remote_image.go:161 k8s.io/kubernetes/pkg/kubelet/cri/remote.(*remoteImageService).PullImage(0xc0014e7a28?, {0x5ba9cc8?, 0xc0000760a0?}, 0x40aca5?, 0xc000200ea0?, 0xc00166bf48?) pkg/kubelet/cri/remote/remote_image.go:157 > k8s.io/kubernetes/test/e2e_node.(*remotePuller).Pull(0xc00114fb70, {0xc000417640, 0x34}) test/e2e_node/image_list.go:127 > k8s.io/kubernetes/test/e2e_node.PrePullAllImages.func1() test/e2e_node/image_list.go:190 > k8s.io/kubernetes/test/e2e_node.PrePullAllImages test/e2e_node/image_list.go:172 goroutine 8177 [select] k8s.io/kubernetes/vendor/google.golang.org/grpc/internal/transport.(*Stream).waitOnHeader(0xc0011bb8c0) vendor/google.golang.org/grpc/internal/transport/transport.go:328 k8s.io/kubernetes/vendor/google.golang.org/grpc/internal/transport.(*Stream).RecvCompress(...) vendor/google.golang.org/grpc/internal/transport/transport.go:343 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc0006ef200, {0x5095200?, 0xc00151a7c8}, 0x7f3040429648?) vendor/google.golang.org/grpc/stream.go:1027 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0x0?) vendor/google.golang.org/grpc/stream.go:881 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc0011bb680, 0xc0012597a8, 0xc001259778) vendor/google.golang.org/grpc/stream.go:732 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc0011bb680, {0x5095200?, 0xc00151a7c8?}) vendor/google.golang.org/grpc/stream.go:880 k8s.io/kubernetes/vendor/google.golang.org/grpc.invoke({0x5ba9d38?, 0xc0011be630?}, {0x537f859?, 0x4?}, {0x5147c40, 0xc001cb8200}, {0x5095200, 0xc00151a7c8}, 0x0?, {0xc00114f3f0, ...}) vendor/google.golang.org/grpc/call.go:73 k8s.io/kubernetes/vendor/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc.UnaryClientInterceptor.func1({0x5ba9c90, 0xc0004dc190}, {0x537f859, 0x22}, {0x5147c40, 0xc001cb8200}, {0x5095200, 0xc00151a7c8}, 0xc001822700, 0x5590080, ...) vendor/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc/interceptor.go:108 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*ClientConn).Invoke(0x7f3040443928?, {0x5ba9c90?, 0xc0004dc190?}, {0x537f859?, 0xc001cb8200?}, {0x5147c40?, 0xc001cb8200?}, {0x5095200?, 0xc00151a7c8?}, {0x0, ...}) vendor/google.golang.org/grpc/call.go:35 k8s.io/kubernetes/vendor/k8s.io/cri-api/pkg/apis/runtime/v1.(*imageServiceClient).PullImage(0xc001435860, {0x5ba9c90, 0xc0004dc190}, 0x4ae0e00?, {0x0, 0x0, 0x0}) vendor/k8s.io/cri-api/pkg/apis/runtime/v1/api.pb.go:11402 k8s.io/kubernetes/pkg/kubelet/cri/remote.(*remoteImageService).pullImageV1(0xc0014e7a28, {0x5ba9c90, 0xc0004dc190}, 0xc001cb81e0, 0x0, 0x0) pkg/kubelet/cri/remote/remote_image.go:161 k8s.io/kubernetes/pkg/kubelet/cri/remote.(*remoteImageService).PullImage(0xc0014e7a28?, {0x5ba9cc8?, 0xc0000760a0?}, 0x40aca5?, 0xc000200ea0?, 0xc001259f48?) pkg/kubelet/cri/remote/remote_image.go:157 > k8s.io/kubernetes/test/e2e_node.(*remotePuller).Pull(0xc00114fb70, {0xc000417680, 0x34}) test/e2e_node/image_list.go:127 > k8s.io/kubernetes/test/e2e_node.PrePullAllImages.func1() test/e2e_node/image_list.go:190 > k8s.io/kubernetes/test/e2e_node.PrePullAllImages test/e2e_node/image_list.go:172 goroutine 8179 [select] k8s.io/kubernetes/vendor/google.golang.org/grpc/internal/transport.(*Stream).waitOnHeader(0xc0011c10e0) vendor/google.golang.org/grpc/internal/transport/transport.go:328 k8s.io/kubernetes/vendor/google.golang.org/grpc/internal/transport.(*Stream).RecvCompress(...) vendor/google.golang.org/grpc/internal/transport/transport.go:343 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc0011ca480, {0x5095200?, 0xc00151b680}, 0x7f3040429648?) vendor/google.golang.org/grpc/stream.go:1027 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0x0?) vendor/google.golang.org/grpc/stream.go:881 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc0011c0ea0, 0xc0012557a8, 0xc001255778) vendor/google.golang.org/grpc/stream.go:732 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc0011c0ea0, {0x5095200?, 0xc00151b680?}) vendor/google.golang.org/grpc/stream.go:880 k8s.io/kubernetes/vendor/google.golang.org/grpc.invoke({0x5ba9d38?, 0xc0011cc270?}, {0x537f859?, 0x4?}, {0x5147c40, 0xc001cb8ae0}, {0x5095200, 0xc00151b680}, 0x0?, {0xc00114f3f0, ...}) vendor/google.golang.org/grpc/call.go:73 k8s.io/kubernetes/vendor/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc.UnaryClientInterceptor.func1({0x5ba9c90, 0xc000a52140}, {0x537f859, 0x22}, {0x5147c40, 0xc001cb8ae0}, {0x5095200, 0xc00151b680}, 0xc001822700, 0x5590080, ...) vendor/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc/interceptor.go:108 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*ClientConn).Invoke(0x7f3040443928?, {0x5ba9c90?, 0xc000a52140?}, {0x537f859?, 0xc001cb8ae0?}, {0x5147c40?, 0xc001cb8ae0?}, {0x5095200?, 0xc00151b680?}, {0x0, ...}) vendor/google.golang.org/grpc/call.go:35 k8s.io/kubernetes/vendor/k8s.io/cri-api/pkg/apis/runtime/v1.(*imageServiceClient).PullImage(0xc001435860, {0x5ba9c90, 0xc000a52140}, 0x4ae0e00?, {0x0, 0x0, 0x0}) vendor/k8s.io/cri-api/pkg/apis/runtime/v1/api.pb.go:11402 k8s.io/kubernetes/pkg/kubelet/cri/remote.(*remoteImageService).pullImageV1(0xc0014e7a28, {0x5ba9c90, 0xc000a52140}, 0xc001cb8ac0, 0x0, 0x0) pkg/kubelet/cri/remote/remote_image.go:161 k8s.io/kubernetes/pkg/kubelet/cri/remote.(*remoteImageService).PullImage(0xc0014e7a28?, {0x5ba9cc8?, 0xc0000760a0?}, 0x40aca5?, 0xc000200ea0?, 0xc001255f48?) pkg/kubelet/cri/remote/remote_image.go:157 > k8s.io/kubernetes/test/e2e_node.(*remotePuller).Pull(0xc00114fb70, {0xc0006940f0, 0x2b}) test/e2e_node/image_list.go:127 > k8s.io/kubernetes/test/e2e_node.PrePullAllImages.func1() test/e2e_node/image_list.go:190 > k8s.io/kubernetes/test/e2e_node.PrePullAllImages test/e2e_node/image_list.go:172 goroutine 8178 [select] k8s.io/kubernetes/vendor/google.golang.org/grpc/internal/transport.(*Stream).waitOnHeader(0xc0011c0a20) vendor/google.golang.org/grpc/internal/transport/transport.go:328 k8s.io/kubernetes/vendor/google.golang.org/grpc/internal/transport.(*Stream).RecvCompress(...) vendor/google.golang.org/grpc/internal/transport/transport.go:343 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc0004b0840, {0x5095200?, 0xc00151b260}, 0x7f3040429648?) vendor/google.golang.org/grpc/stream.go:1027 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0x0?) vendor/google.golang.org/grpc/stream.go:881 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc0011c07e0, 0xc00166d7a8, 0xc00166d778) vendor/google.golang.org/grpc/stream.go:732 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc0011c07e0, {0x5095200?, 0xc00151b260?}) vendor/google.golang.org/grpc/stream.go:880 k8s.io/kubernetes/vendor/google.golang.org/grpc.invoke({0x5ba9d38?, 0xc0011bfa40?}, {0x537f859?, 0x4?}, {0x5147c40, 0xc001cb8800}, {0x5095200, 0xc00151b260}, 0x0?, {0xc00114f3f0, ...}) vendor/google.golang.org/grpc/call.go:73 k8s.io/kubernetes/vendor/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc.UnaryClientInterceptor.func1({0x5ba9c90, 0xc0004dd680}, {0x537f859, 0x22}, {0x5147c40, 0xc001cb8800}, {0x5095200, 0xc00151b260}, 0xc001822700, 0x5590080, ...) vendor/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc/interceptor.go:108 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*ClientConn).Invoke(0x7f3040443928?, {0x5ba9c90?, 0xc0004dd680?}, {0x537f859?, 0xc001cb8800?}, {0x5147c40?, 0xc001cb8800?}, {0x5095200?, 0xc00151b260?}, {0x0, ...}) vendor/google.golang.org/grpc/call.go:35 k8s.io/kubernetes/vendor/k8s.io/cri-api/pkg/apis/runtime/v1.(*imageServiceClient).PullImage(0xc001435860, {0x5ba9c90, 0xc0004dd680}, 0x4ae0e00?, {0x0, 0x0, 0x0}) vendor/k8s.io/cri-api/pkg/apis/runtime/v1/api.pb.go:11402 k8s.io/kubernetes/pkg/kubelet/cri/remote.(*remoteImageService).pullImageV1(0xc0014e7a28, {0x5ba9c90, 0xc0004dd680}, 0xc001cb87e0, 0x0, 0x0) pkg/kubelet/cri/remote/remote_image.go:161 k8s.io/kubernetes/pkg/kubelet/cri/remote.(*remoteImageService).PullImage(0xc0014e7a28?, {0x5ba9cc8?, 0xc0000760a0?}, 0x40aca5?, 0xc000200ea0?, 0xc00166df48?) pkg/kubelet/cri/remote/remote_image.go:157 > k8s.io/kubernetes/test/e2e_node.(*remotePuller).Pull(0xc00114fb70, {0xc0006909c0, 0x2e}) test/e2e_node/image_list.go:127 > k8s.io/kubernetes/test/e2e_node.PrePullAllImages.func1() test/e2e_node/image_list.go:190 > k8s.io/kubernetes/test/e2e_node.PrePullAllImages test/e2e_node/image_list.go:172 goroutine 8180 [select] k8s.io/kubernetes/vendor/google.golang.org/grpc/internal/transport.(*Stream).waitOnHeader(0xc0011c0360) vendor/google.golang.org/grpc/internal/transport/transport.go:328 k8s.io/kubernetes/vendor/google.golang.org/grpc/internal/transport.(*Stream).RecvCompress(...) vendor/google.golang.org/grpc/internal/transport/transport.go:343 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc0006efb00, {0x5095200?, 0xc00151ae28}, 0x7f3040429648?) vendor/google.golang.org/grpc/stream.go:1027 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0x0?) vendor/google.golang.org/grpc/stream.go:881 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc0011c0120, 0xc0016717a8, 0xc001671778) vendor/google.golang.org/grpc/stream.go:732 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc0011c0120, {0x5095200?, 0xc00151ae28?}) vendor/google.golang.org/grpc/stream.go:880 k8s.io/kubernetes/vendor/google.golang.org/grpc.invoke({0x5ba9d38?, 0xc0011bf230?}, {0x537f859?, 0x4?}, {0x5147c40, 0xc001cb85a0}, {0x5095200, 0xc00151ae28}, 0x0?, {0xc00114f3f0, ...}) vendor/google.golang.org/grpc/call.go:73 k8s.io/kubernetes/vendor/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc.UnaryClientInterceptor.func1({0x5ba9c90, 0xc0004dcff0}, {0x537f859, 0x22}, {0x5147c40, 0xc001cb85a0}, {0x5095200, 0xc00151ae28}, 0xc001822700, 0x5590080, ...) vendor/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc/interceptor.go:108 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*ClientConn).Invoke(0x7f3040443928?, {0x5ba9c90?, 0xc0004dcff0?}, {0x537f859?, 0xc001cb85a0?}, {0x5147c40?, 0xc001cb85a0?}, {0x5095200?, 0xc00151ae28?}, {0x0, ...}) vendor/google.golang.org/grpc/call.go:35 k8s.io/kubernetes/vendor/k8s.io/cri-api/pkg/apis/runtime/v1.(*imageServiceClient).PullImage(0xc001435860, {0x5ba9c90, 0xc0004dcff0}, 0x4ae0e00?, {0x0, 0x0, 0x0}) vendor/k8s.io/cri-api/pkg/apis/runtime/v1/api.pb.go:11402 k8s.io/kubernetes/pkg/kubelet/cri/remote.(*remoteImageService).pullImageV1(0xc0014e7a28, {0x5ba9c90, 0xc0004dcff0}, 0xc001cb8580, 0x0, 0x0) pkg/kubelet/cri/remote/remote_image.go:161 k8s.io/kubernetes/pkg/kubelet/cri/remote.(*remoteImageService).PullImage(0xc0014e7a28?, {0x5ba9cc8?, 0xc0000760a0?}, 0x40aca5?, 0xc000200ea0?, 0xc001671f48?) pkg/kubelet/cri/remote/remote_image.go:157 > k8s.io/kubernetes/test/e2e_node.(*remotePuller).Pull(0xc00114fb70, {0xc0004176c0, 0x3a}) test/e2e_node/image_list.go:127 > k8s.io/kubernetes/test/e2e_node.PrePullAllImages.func1() test/e2e_node/image_list.go:190 > k8s.io/kubernetes/test/e2e_node.PrePullAllImages test/e2e_node/image_list.go:172 A running node failed to exit in time Ginkgo is moving on but a node has timed out and failed to exit before its grace period elapsed. The node has now leaked and is running in the background. Here's a current progress report: [sig-node] ImageGCNoEviction [Slow] [Serial] [Disruptive][NodeFeature:Eviction] when we run containers that should cause DiskPressure should eventually evict all of the correct pods (Spec Runtime: 6m46.226s) test/e2e_node/eviction_test.go:563 In [AfterEach] (Node Runtime: 1m29.707s) test/e2e_node/eviction_test.go:620 At [By Step] making sure we have all the required images for testing (Step Runtime: 56.866s) test/e2e_node/eviction_test.go:648 Spec Goroutine goroutine 8145 [semacquire] sync.runtime_Semacquire(0xc001bdf080?) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/runtime/sema.go:62 sync.(*WaitGroup).Wait(0x5ba9cc8?) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/sync/waitgroup.go:116 > k8s.io/kubernetes/test/e2e_node.PrePullAllImages() test/e2e_node/image_list.go:206 > k8s.io/kubernetes/test/e2e_node.runEvictionTest.func1.3.1(...) test/e2e_node/eviction_test.go:625 > k8s.io/kubernetes/test/e2e_node.runEvictionTest.func1.3({0x7f3041625140?, 0xc001955e90}) test/e2e_node/eviction_test.go:649 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x5bb2860?, 0xc001955e90}) vendor/github.com/onsi/ginkgo/v2/internal/node.go:456 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3() vendor/github.com/onsi/ginkgo/v2/internal/suite.go:863 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode vendor/github.com/onsi/ginkgo/v2/internal/suite.go:850 Goroutines of Interest goroutine 1 [chan receive, 60 minutes] testing.(*T).Run(0xc0004836c0, {0x52ff476?, 0x53e765?}, 0x558db68) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/testing/testing.go:1630 testing.runTests.func1(0x88173a0?) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/testing/testing.go:2036 testing.tRunner(0xc0004836c0, 0xc000b91b78) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/testing/testing.go:1576 testing.runTests(0xc0004b8780?, {0x8651d70, 0x1, 0x1}, {0x30?, 0xc0009b2d50?, 0x0?}) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/testing/testing.go:2034 testing.(*M).Run(0xc0004b8780) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/testing/testing.go:1906 > k8s.io/kubernetes/test/e2e_node.TestMain(0xffffffffffffffff?) test/e2e_node/e2e_node_suite_test.go:145 main.main() /tmp/go-build1451623592/b001/_testmain.go:49 goroutine 245 [syscall, 60 minutes] syscall.Syscall6(0x100?, 0xc001403cd8?, 0x6fc80d?, 0x1?, 0x52183e0?, 0xc00058fc70?, 0x47edfe?) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/syscall/syscall_linux.go:91 os.(*Process).blockUntilWaitable(0xc000ce0a80) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/os/wait_waitid.go:32 os.(*Process).wait(0xc000ce0a80) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/os/exec_unix.go:22 os.(*Process).Wait(...) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/os/exec.go:132 os/exec.(*Cmd).Wait(0xc00049b340) /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/os/exec/exec.go:890 > k8s.io/kubernetes/test/e2e_node/services.(*server).start.func1() test/e2e_node/services/server.go:166 > k8s.io/kubernetes/test/e2e_node/services.(*server).start test/e2e_node/services/server.go:123 goroutine 8176 [select] k8s.io/kubernetes/vendor/google.golang.org/grpc/internal/transport.(*Stream).waitOnHeader(0xc0012a4240) vendor/google.golang.org/grpc/internal/transport/transport.go:328 k8s.io/kubernetes/vendor/google.golang.org/grpc/internal/transport.(*Stream).RecvCompress(...) vendor/google.golang.org/grpc/internal/transport/transport.go:343 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc0011cb380, {0x5095200?, 0xc00140e060}, 0x7f3040429648?) vendor/google.golang.org/grpc/stream.go:1027 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0x0?) vendor/google.golang.org/grpc/stream.go:881 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc0012a4000, 0xc00166b7a8, 0xc00166b778) vendor/google.golang.org/grpc/stream.go:732 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc0012a4000, {0x5095200?, 0xc00140e060?}) vendor/google.golang.org/grpc/stream.go:880 k8s.io/kubernetes/vendor/google.golang.org/grpc.invoke({0x5ba9d38?, 0xc0011cdcb0?}, {0x537f859?, 0x4?}, {0x5147c40, 0xc0004a78e0}, {0x5095200, 0xc00140e060}, 0x0?, {0xc00114f3f0, ...}) vendor/google.golang.org/grpc/call.go:73 k8s.io/kubernetes/vendor/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc.UnaryClientInterceptor.func1({0x5ba9c90, 0xc0002fa460}, {0x537f859, 0x22}, {0x5147c40, 0xc0004a78e0}, {0x5095200, 0xc00140e060}, 0xc001822700, 0x5590080, ...) vendor/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc/interceptor.go:108 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*ClientConn).Invoke(0x7f304303f248?, {0x5ba9c90?, 0xc0002fa460?}, {0x537f859?, 0xc0004a78e0?}, {0x5147c40?, 0xc0004a78e0?}, {0x5095200?, 0xc00140e060?}, {0x0, ...}) vendor/google.golang.org/grpc/call.go:35 k8s.io/kubernetes/vendor/k8s.io/cri-api/pkg/apis/runtime/v1.(*imageServiceClient).PullImage(0xc001435860, {0x5ba9c90, 0xc0002fa460}, 0x4ae0e00?, {0x0, 0x0, 0x0}) vendor/k8s.io/cri-api/pkg/apis/runtime/v1/api.pb.go:11402 k8s.io/kubernetes/pkg/kubelet/cri/remote.(*remoteImageService).pullImageV1(0xc0014e7a28, {0x5ba9c90, 0xc0002fa460}, 0xc0004a78c0, 0x0, 0x0) pkg/kubelet/cri/remote/remote_image.go:161 k8s.io/kubernetes/pkg/kubelet/cri/remote.(*remoteImageService).PullImage(0xc0014e7a28?, {0x5ba9cc8?, 0xc0000760a0?}, 0x40aca5?, 0xc000200ea0?, 0xc00166bf48?) pkg/kubelet/cri/remote/remote_image.go:157 > k8s.io/kubernetes/test/e2e_node.(*remotePuller).Pull(0xc00114fb70, {0xc000574ac0, 0x32}) test/e2e_node/image_list.go:127 > k8s.io/kubernetes/test/e2e_node.PrePullAllImages.func1() test/e2e_node/image_list.go:190 > k8s.io/kubernetes/test/e2e_node.PrePullAllImages test/e2e_node/image_list.go:172 goroutine 8177 [select] k8s.io/kubernetes/vendor/google.golang.org/grpc/internal/transport.(*Stream).waitOnHeader(0xc0011c1e60) vendor/google.golang.org/grpc/internal/transport/transport.go:328 k8s.io/kubernetes/vendor/google.golang.org/grpc/internal/transport.(*Stream).RecvCompress(...) vendor/google.golang.org/grpc/internal/transport/transport.go:343 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc0011cb080, {0x5095200?, 0xc00151bef0}, 0x7f3040429648?) vendor/google.golang.org/grpc/stream.go:1027 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0x0?) vendor/google.golang.org/grpc/stream.go:881 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc0011c1c20, 0xc0012597a8, 0xc001259778) vendor/google.golang.org/grpc/stream.go:732 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc0011c1c20, {0x5095200?, 0xc00151bef0?}) vendor/google.golang.org/grpc/stream.go:880 k8s.io/kubernetes/vendor/google.golang.org/grpc.invoke({0x5ba9d38?, 0xc0011cda40?}, {0x537f859?, 0x4?}, {0x5147c40, 0xc0004a7780}, {0x5095200, 0xc00151bef0}, 0x0?, {0xc00114f3f0, ...}) vendor/google.golang.org/grpc/call.go:73 k8s.io/kubernetes/vendor/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc.UnaryClientInterceptor.func1({0x5ba9c90, 0xc0002fa0f0}, {0x537f859, 0x22}, {0x5147c40, 0xc0004a7780}, {0x5095200, 0xc00151bef0}, 0xc001822700, 0x5590080, ...) vendor/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc/interceptor.go:108 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*ClientConn).Invoke(0x7f304303f248?, {0x5ba9c90?, 0xc0002fa0f0?}, {0x537f859?, 0xc0004a7780?}, {0x5147c40?, 0xc0004a7780?}, {0x5095200?, 0xc00151bef0?}, {0x0, ...}) vendor/google.golang.org/grpc/call.go:35 k8s.io/kubernetes/vendor/k8s.io/cri-api/pkg/apis/runtime/v1.(*imageServiceClient).PullImage(0xc001435860, {0x5ba9c90, 0xc0002fa0f0}, 0x4ae0e00?, {0x0, 0x0, 0x0}) vendor/k8s.io/cri-api/pkg/apis/runtime/v1/api.pb.go:11402 k8s.io/kubernetes/pkg/kubelet/cri/remote.(*remoteImageService).pullImageV1(0xc0014e7a28, {0x5ba9c90, 0xc0002fa0f0}, 0xc0004a7760, 0x0, 0x0) pkg/kubelet/cri/remote/remote_image.go:161 k8s.io/kubernetes/pkg/kubelet/cri/remote.(*remoteImageService).PullImage(0xc0014e7a28?, {0x5ba9cc8?, 0xc0000760a0?}, 0x40aca5?, 0xc000200ea0?, 0xc001259f48?) pkg/kubelet/cri/remote/remote_image.go:157 > k8s.io/kubernetes/test/e2e_node.(*remotePuller).Pull(0xc00114fb70, {0xc0014d3040, 0x38}) test/e2e_node/image_list.go:127 > k8s.io/kubernetes/test/e2e_node.PrePullAllImages.func1() test/e2e_node/image_list.go:190 > k8s.io/kubernetes/test/e2e_node.PrePullAllImages test/e2e_node/image_list.go:172 goroutine 8179 [select] k8s.io/kubernetes/vendor/google.golang.org/grpc/internal/transport.(*Stream).waitOnHeader(0xc0011c10e0) vendor/google.golang.org/grpc/internal/transport/transport.go:328 k8s.io/kubernetes/vendor/google.golang.org/grpc/internal/transport.(*Stream).RecvCompress(...) vendor/google.golang.org/grpc/internal/transport/transport.go:343 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc0011ca480, {0x5095200?, 0xc00151b680}, 0x7f3040429648?) vendor/google.golang.org/grpc/stream.go:1027 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0x0?) vendor/google.golang.org/grpc/stream.go:881 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc0011c0ea0, 0xc0012557a8, 0xc001255778) vendor/google.golang.org/grpc/stream.go:732 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc0011c0ea0, {0x5095200?, 0xc00151b680?}) vendor/google.golang.org/grpc/stream.go:880 k8s.io/kubernetes/vendor/google.golang.org/grpc.invoke({0x5ba9d38?, 0xc0011cc270?}, {0x537f859?, 0x4?}, {0x5147c40, 0xc001cb8ae0}, {0x5095200, 0xc00151b680}, 0x0?, {0xc00114f3f0, ...}) vendor/google.golang.org/grpc/call.go:73 k8s.io/kubernetes/vendor/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc.UnaryClientInterceptor.func1({0x5ba9c90, 0xc000a52140}, {0x537f859, 0x22}, {0x5147c40, 0xc001cb8ae0}, {0x5095200, 0xc00151b680}, 0xc001822700, 0x5590080, ...) vendor/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc/interceptor.go:108 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*ClientConn).Invoke(0x7f3040443928?, {0x5ba9c90?, 0xc000a52140?}, {0x537f859?, 0xc001cb8ae0?}, {0x5147c40?, 0xc001cb8ae0?}, {0x5095200?, 0xc00151b680?}, {0x0, ...}) vendor/google.golang.org/grpc/call.go:35 k8s.io/kubernetes/vendor/k8s.io/cri-api/pkg/apis/runtime/v1.(*imageServiceClient).PullImage(0xc001435860, {0x5ba9c90, 0xc000a52140}, 0x4ae0e00?, {0x0, 0x0, 0x0}) vendor/k8s.io/cri-api/pkg/apis/runtime/v1/api.pb.go:11402 k8s.io/kubernetes/pkg/kubelet/cri/remote.(*remoteImageService).pullImageV1(0xc0014e7a28, {0x5ba9c90, 0xc000a52140}, 0xc001cb8ac0, 0x0, 0x0) pkg/kubelet/cri/remote/remote_image.go:161 k8s.io/kubernetes/pkg/kubelet/cri/remote.(*remoteImageService).PullImage(0xc0014e7a28?, {0x5ba9cc8?, 0xc0000760a0?}, 0x40aca5?, 0xc000200ea0?, 0xc001255f48?) pkg/kubelet/cri/remote/remote_image.go:157 > k8s.io/kubernetes/test/e2e_node.(*remotePuller).Pull(0xc00114fb70, {0xc0006940f0, 0x2b}) test/e2e_node/image_list.go:127 > k8s.io/kubernetes/test/e2e_node.PrePullAllImages.func1() test/e2e_node/image_list.go:190 > k8s.io/kubernetes/test/e2e_node.PrePullAllImages test/e2e_node/image_list.go:172 goroutine 8178 [select] k8s.io/kubernetes/vendor/google.golang.org/grpc/internal/transport.(*Stream).waitOnHeader(0xc0012a45a0) vendor/google.golang.org/grpc/internal/transport/transport.go:328 k8s.io/kubernetes/vendor/google.golang.org/grpc/internal/transport.(*Stream).RecvCompress(...) vendor/google.golang.org/grpc/internal/transport/transport.go:343 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc0011cb680, {0x5095200?, 0xc00140e198}, 0x7f3040429648?) vendor/google.golang.org/grpc/stream.go:1027 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0x0?) vendor/google.golang.org/grpc/stream.go:881 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc0012a4360, 0xc00166d7a8, 0xc00166d778) vendor/google.golang.org/grpc/stream.go:732 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc0012a4360, {0x5095200?, 0xc00140e198?}) vendor/google.golang.org/grpc/stream.go:880 k8s.io/kubernetes/vendor/google.golang.org/grpc.invoke({0x5ba9d38?, 0xc0011cdf20?}, {0x537f859?, 0x4?}, {0x5147c40, 0xc001c5e0c0}, {0x5095200, 0xc00140e198}, 0x0?, {0xc00114f3f0, ...}) vendor/google.golang.org/grpc/call.go:73 k8s.io/kubernetes/vendor/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc.UnaryClientInterceptor.func1({0x5ba9c90, 0xc0002fa640}, {0x537f859, 0x22}, {0x5147c40, 0xc001c5e0c0}, {0x5095200, 0xc00140e198}, 0xc001822700, 0x5590080, ...) vendor/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc/interceptor.go:108 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*ClientConn).Invoke(0x7f3040445228?, {0x5ba9c90?, 0xc0002fa640?}, {0x537f859?, 0xc001c5e0c0?}, {0x5147c40?, 0xc001c5e0c0?}, {0x5095200?, 0xc00140e198?}, {0x0, ...}) vendor/google.golang.org/grpc/call.go:35 k8s.io/kubernetes/vendor/k8s.io/cri-api/pkg/apis/runtime/v1.(*imageServiceClient).PullImage(0xc001435860, {0x5ba9c90, 0xc0002fa640}, 0x4ae0e00?, {0x0, 0x0, 0x0}) vendor/k8s.io/cri-api/pkg/apis/runtime/v1/api.pb.go:11402 k8s.io/kubernetes/pkg/kubelet/cri/remote.(*remoteImageService).pullImageV1(0xc0014e7a28, {0x5ba9c90, 0xc0002fa640}, 0xc001c5e0a0, 0x0, 0x0) pkg/kubelet/cri/remote/remote_image.go:161 k8s.io/kubernetes/pkg/kubelet/cri/remote.(*remoteImageService).PullImage(0xc0014e7a28?, {0x5ba9cc8?, 0xc0000760a0?}, 0x40aca5?, 0xc000200ea0?, 0xc00166df48?) pkg/kubelet/cri/remote/remote_image.go:157 > k8s.io/kubernetes/test/e2e_node.(*remotePuller).Pull(0xc00114fb70, {0xc000690990, 0x29}) test/e2e_node/image_list.go:127 > k8s.io/kubernetes/test/e2e_node.PrePullAllImages.func1() test/e2e_node/image_list.go:190 > k8s.io/kubernetes/test/e2e_node.PrePullAllImages test/e2e_node/image_list.go:172 goroutine 8180 [select] k8s.io/kubernetes/vendor/google.golang.org/grpc/internal/transport.(*Stream).waitOnHeader(0xc0011c0360) vendor/google.golang.org/grpc/internal/transport/transport.go:328 k8s.io/kubernetes/vendor/google.golang.org/grpc/internal/transport.(*Stream).RecvCompress(...) vendor/google.golang.org/grpc/internal/transport/transport.go:343 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc0006efb00, {0x5095200?, 0xc00151ae28}, 0x7f3040429648?) vendor/google.golang.org/grpc/stream.go:1027 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0x0?) vendor/google.golang.org/grpc/stream.go:881 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc0011c0120, 0xc0016717a8, 0xc001671778) vendor/google.golang.org/grpc/stream.go:732 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc0011c0120, {0x5095200?, 0xc00151ae28?}) vendor/google.golang.org/grpc/stream.go:880 k8s.io/kubernetes/vendor/google.golang.org/grpc.invoke({0x5ba9d38?, 0xc0011bf230?}, {0x537f859?, 0x4?}, {0x5147c40, 0xc001cb85a0}, {0x5095200, 0xc00151ae28}, 0x0?, {0xc00114f3f0, ...}) vendor/google.golang.org/grpc/call.go:73 k8s.io/kubernetes/vendor/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc.UnaryClientInterceptor.func1({0x5ba9c90, 0xc0004dcff0}, {0x537f859, 0x22}, {0x5147c40, 0xc001cb85a0}, {0x5095200, 0xc00151ae28}, 0xc001822700, 0x5590080, ...) vendor/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc/interceptor.go:108 k8s.io/kubernetes/vendor/google.golang.org/grpc.(*ClientConn).Invoke(0x7f3040443928?, {0x5ba9c90?, 0xc0004dcff0?}, {0x537f859?, 0xc001cb85a0?}, {0x5147c40?, 0xc001cb85a0?}, {0x5095200?, 0xc00151ae28?}, {0x0, ...}) vendor/google.golang.org/grpc/call.go:35 k8s.io/kubernetes/vendor/k8s.io/cri-api/pkg/apis/runtime/v1.(*imageServiceClient).PullImage(0xc001435860, {0x5ba9c90, 0xc0004dcff0}, 0x4ae0e00?, {0x0, 0x0, 0x0}) vendor/k8s.io/cri-api/pkg/apis/runtime/v1/api.pb.go:11402 k8s.io/kubernetes/pkg/kubelet/cri/remote.(*remoteImageService).pullImageV1(0xc0014e7a28, {0x5ba9c90, 0xc0004dcff0}, 0xc001cb8580, 0x0, 0x0) pkg/kubelet/cri/remote/remote_image.go:161 k8s.io/kubernetes/pkg/kubelet/cri/remote.(*remoteImageService).PullImage(0xc0014e7a28?, {0x5ba9cc8?, 0xc0000760a0?}, 0x40aca5?, 0xc000200ea0?, 0xc001671f48?) pkg/kubelet/cri/remote/remote_image.go:157 > k8s.io/kubernetes/test/e2e_node.(*remotePuller).Pull(0xc00114fb70, {0xc0004176c0, 0x3a}) test/e2e_node/image_list.go:127 > k8s.io/kubernetes/test/e2e_node.PrePullAllImages.func1() test/e2e_node/image_list.go:190 > k8s.io/kubernetes/test/e2e_node.PrePullAllImages test/e2e_node/image_list.go:172 < Exit [AfterEach] TOP-LEVEL - test/e2e_node/eviction_test.go:620 @ 03/22/23 02:56:02.227 (1m29.717s) > Enter [AfterEach] when we run containers that should cause DiskPressure - test/e2e_node/util.go:190 @ 03/22/23 02:56:02.227 STEP: Stopping the kubelet - test/e2e_node/util.go:200 @ 03/22/23 02:56:02.227 Mar 22 02:56:02.260: INFO: Get running kubelet with systemctl: UNIT LOAD ACTIVE SUB DESCRIPTION kubelet-20230322T015518.service loaded active running /tmp/node-e2e-20230322T015518/kubelet --kubeconfig /tmp/node-e2e-20230322T015518/kubeconfig --root-dir /var/lib/kubelet --v 4 --hostname-override tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 --container-runtime-endpoint unix:///var/run/crio/crio.sock --config /tmp/node-e2e-20230322T015518/kubelet-config --cgroup-driver=systemd --cgroups-per-qos=true --cgroup-root=/ --runtime-cgroups=/system.slice/crio.service --kubelet-cgroups=/system.slice/kubelet.service LOAD = Reflects whether the unit definition was properly loaded. ACTIVE = The high-level unit activation state, i.e. generalization of SUB. SUB = The low-level unit activation state, values depend on unit type. 1 loaded units listed. , kubelet-20230322T015518 W0322 02:56:02.331503 2652 util.go:477] Health check on "http://127.0.0.1:10248/healthz" failed, error=Head "http://127.0.0.1:10248/healthz": read tcp 127.0.0.1:51284->127.0.0.1:10248: read: connection reset by peer STEP: Starting the kubelet - test/e2e_node/util.go:216 @ 03/22/23 02:56:02.343 W0322 02:56:02.385051 2652 util.go:477] Health check on "http://127.0.0.1:10248/healthz" failed, error=Head "http://127.0.0.1:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused < Exit [AfterEach] when we run containers that should cause DiskPressure - test/e2e_node/util.go:190 @ 03/22/23 02:56:07.389 (5.162s) > Enter [AfterEach] [sig-node] ImageGCNoEviction [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - test/e2e/framework/node/init/init.go:33 @ 03/22/23 02:56:07.389 Mar 22 02:56:07.389: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] ImageGCNoEviction [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - test/e2e/framework/node/init/init.go:33 @ 03/22/23 02:56:07.391 (2ms) > Enter [DeferCleanup (Each)] [sig-node] ImageGCNoEviction [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - test/e2e/framework/metrics/init/init.go:35 @ 03/22/23 02:56:07.391 < Exit [DeferCleanup (Each)] [sig-node] ImageGCNoEviction [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - test/e2e/framework/metrics/init/init.go:35 @ 03/22/23 02:56:07.391 (0s) > Enter [DeferCleanup (Each)] [sig-node] ImageGCNoEviction [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - dump namespaces | framework.go:209 @ 03/22/23 02:56:07.391 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/22/23 02:56:07.391 STEP: Collecting events from namespace "image-gc-eviction-test-891". - test/e2e/framework/debug/dump.go:42 @ 03/22/23 02:56:07.391 STEP: Found 4 events. - test/e2e/framework/debug/dump.go:46 @ 03/22/23 02:56:07.395 Mar 22 02:56:07.395: INFO: At 2023-03-22 02:49:51 +0000 UTC - event for container-inode-pod: {kubelet tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 22 02:56:07.395: INFO: At 2023-03-22 02:49:51 +0000 UTC - event for container-inode-pod: {kubelet tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64} Created: Created container container-inode-container Mar 22 02:56:07.395: INFO: At 2023-03-22 02:49:51 +0000 UTC - event for container-inode-pod: {kubelet tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64} Started: Started container container-inode-container Mar 22 02:56:07.395: INFO: At 2023-03-22 02:54:32 +0000 UTC - event for container-inode-pod: {kubelet tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64} Killing: Stopping container container-inode-container Mar 22 02:56:07.397: INFO: POD NODE PHASE GRACE CONDITIONS Mar 22 02:56:07.397: INFO: Mar 22 02:56:07.401: INFO: Logging node info for node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 Mar 22 02:56:07.402: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 25588c6e-2bb2-4dc3-b822-bafb7347205c 1755 0 2023-03-22 01:57:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-22 01:57:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-22 02:56:03 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{},"f:memory":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20869787648 0} {<nil>} 20380652Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3841236992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18782808853 0} {<nil>} 18782808853 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3579092992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-22 02:56:03 +0000 UTC,LastTransitionTime:2023-03-22 02:28:02 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-22 02:56:03 +0000 UTC,LastTransitionTime:2023-03-22 02:53:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-22 02:56:03 +0000 UTC,LastTransitionTime:2023-03-22 01:57:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-22 02:56:03 +0000 UTC,LastTransitionTime:2023-03-22 02:56:03 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.58,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:b01dbd32d4ef230af587a02067933638,SystemUUID:b01dbd32-d4ef-230a-f587-a02067933638,BootID:ccf1dbf6-a36b-4b67-a43b-16a96c36a6ea,KernelVersion:6.1.11-200.fc37.x86_64,OSImage:Fedora CoreOS 37.20230218.3.0,ContainerRuntimeVersion:cri-o://1.26.0,KubeletVersion:v1.27.0-beta.0.56+9c6414cdfe0e29,KubeProxyVersion:v1.27.0-beta.0.56+9c6414cdfe0e29,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 22 02:56:07.402: INFO: Logging kubelet events for node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 Mar 22 02:56:07.405: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 Mar 22 02:56:07.418: INFO: test-admit-pod started at 2023-03-22 02:29:05 +0000 UTC (0+1 container statuses recorded) Mar 22 02:56:07.418: INFO: Container test-admit-pod ready: false, restart count 0 W0322 02:56:07.419606 2652 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 22 02:56:07.446: INFO: Latency metrics for node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/22/23 02:56:07.447 (56ms) < Exit [DeferCleanup (Each)] [sig-node] ImageGCNoEviction [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - dump namespaces | framework.go:209 @ 03/22/23 02:56:07.447 (56ms) > Enter [DeferCleanup (Each)] [sig-node] ImageGCNoEviction [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - tear down framework | framework.go:206 @ 03/22/23 02:56:07.447 STEP: Destroying namespace "image-gc-eviction-test-891" for this suite. - test/e2e/framework/framework.go:351 @ 03/22/23 02:56:07.447 < Exit [DeferCleanup (Each)] [sig-node] ImageGCNoEviction [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - tear down framework | framework.go:206 @ 03/22/23 02:56:07.453 (7ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sPriorityPidEvictionOrdering\s\[Slow\]\s\[Serial\]\s\[Disruptive\]\[NodeFeature\:Eviction\]\swhen\swe\srun\scontainers\sthat\sshould\scause\sPIDPressure\s\sshould\seventually\sevict\sall\sof\sthe\scorrect\spods$'
[FAILED] Timed out after 120.000s. Expected <*errors.errorString | 0xc000f66aa0>: NodeCondition: PIDPressure not encountered { s: "NodeCondition: PIDPressure not encountered", } to be nil In [It] at: test/e2e_node/eviction_test.go:571 @ 03/22/23 02:21:45.193from junit_fedora01.xml
> Enter [BeforeEach] [sig-node] PriorityPidEvictionOrdering [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - set up framework | framework.go:191 @ 03/22/23 02:19:07.954 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/22/23 02:19:07.954 STEP: Building a namespace api object, basename pidpressure-eviction-test - test/e2e/framework/framework.go:250 @ 03/22/23 02:19:07.954 Mar 22 02:19:07.957: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] PriorityPidEvictionOrdering [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - set up framework | framework.go:191 @ 03/22/23 02:19:07.957 (3ms) > Enter [BeforeEach] [sig-node] PriorityPidEvictionOrdering [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - test/e2e/framework/metrics/init/init.go:33 @ 03/22/23 02:19:07.957 < Exit [BeforeEach] [sig-node] PriorityPidEvictionOrdering [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - test/e2e/framework/metrics/init/init.go:33 @ 03/22/23 02:19:07.957 (0s) > Enter [BeforeEach] when we run containers that should cause PIDPressure - test/e2e_node/util.go:176 @ 03/22/23 02:19:07.957 STEP: Stopping the kubelet - test/e2e_node/util.go:200 @ 03/22/23 02:19:07.973 Mar 22 02:19:08.003: INFO: Get running kubelet with systemctl: UNIT LOAD ACTIVE SUB DESCRIPTION kubelet-20230322T015518.service loaded active running /tmp/node-e2e-20230322T015518/kubelet --kubeconfig /tmp/node-e2e-20230322T015518/kubeconfig --root-dir /var/lib/kubelet --v 4 --hostname-override tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 --container-runtime-endpoint unix:///var/run/crio/crio.sock --config /tmp/node-e2e-20230322T015518/kubelet-config --cgroup-driver=systemd --cgroups-per-qos=true --cgroup-root=/ --runtime-cgroups=/system.slice/crio.service --kubelet-cgroups=/system.slice/kubelet.service LOAD = Reflects whether the unit definition was properly loaded. ACTIVE = The high-level unit activation state, i.e. generalization of SUB. SUB = The low-level unit activation state, values depend on unit type. 1 loaded units listed. , kubelet-20230322T015518 W0322 02:19:08.061157 2652 util.go:477] Health check on "http://127.0.0.1:10248/healthz" failed, error=Head "http://127.0.0.1:10248/healthz": read tcp 127.0.0.1:57564->127.0.0.1:10248: read: connection reset by peer STEP: Starting the kubelet - test/e2e_node/util.go:216 @ 03/22/23 02:19:08.069 W0322 02:19:08.107301 2652 util.go:477] Health check on "http://127.0.0.1:10248/healthz" failed, error=Head "http://127.0.0.1:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused < Exit [BeforeEach] when we run containers that should cause PIDPressure - test/e2e_node/util.go:176 @ 03/22/23 02:19:13.111 (5.154s) > Enter [BeforeEach] when we run containers that should cause PIDPressure - test/e2e_node/eviction_test.go:478 @ 03/22/23 02:19:13.111 < Exit [BeforeEach] when we run containers that should cause PIDPressure - test/e2e_node/eviction_test.go:478 @ 03/22/23 02:19:13.114 (4ms) > Enter [BeforeEach] TOP-LEVEL - test/e2e_node/eviction_test.go:549 @ 03/22/23 02:19:13.114 STEP: setting up pods to be used by tests - test/e2e_node/eviction_test.go:555 @ 03/22/23 02:19:43.158 < Exit [BeforeEach] TOP-LEVEL - test/e2e_node/eviction_test.go:549 @ 03/22/23 02:19:45.192 (32.077s) > Enter [It] should eventually evict all of the correct pods - test/e2e_node/eviction_test.go:563 @ 03/22/23 02:19:45.192 STEP: Waiting for node to have NodeCondition: PIDPressure - test/e2e_node/eviction_test.go:564 @ 03/22/23 02:19:45.192 Mar 22 02:19:45.238: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 3885 Mar 22 02:19:47.258: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 4562 Mar 22 02:19:49.271: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 180 Mar 22 02:19:51.288: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 180 Mar 22 02:19:53.301: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 176 Mar 22 02:19:55.316: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 176 Mar 22 02:19:57.337: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 176 Mar 22 02:19:59.353: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 176 Mar 22 02:20:01.367: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 176 Mar 22 02:20:03.385: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 176 Mar 22 02:20:05.399: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 176 Mar 22 02:20:07.413: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 176 Mar 22 02:20:09.428: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 176 Mar 22 02:20:11.443: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 176 Mar 22 02:20:13.458: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 176 Mar 22 02:20:15.474: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 176 Mar 22 02:20:17.488: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 176 Mar 22 02:20:19.502: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 176 Mar 22 02:20:21.520: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 176 Mar 22 02:20:23.533: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 176 Mar 22 02:20:25.548: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 176 Mar 22 02:20:27.573: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 176 Mar 22 02:20:29.587: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 176 Mar 22 02:20:31.602: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 176 Mar 22 02:20:33.618: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 176 Mar 22 02:20:35.633: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 176 Mar 22 02:20:37.647: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 176 Mar 22 02:20:39.664: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 176 Mar 22 02:20:41.686: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 176 Mar 22 02:20:43.701: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 176 Mar 22 02:20:45.720: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 176 Mar 22 02:20:47.734: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 176 Mar 22 02:20:49.748: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 165 Mar 22 02:20:51.770: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 165 Mar 22 02:20:53.785: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 165 Mar 22 02:20:55.800: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 165 Mar 22 02:20:57.818: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 162 Mar 22 02:20:59.831: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 162 Mar 22 02:21:01.847: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 162 Mar 22 02:21:03.864: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 162 Mar 22 02:21:05.879: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 161 Mar 22 02:21:07.893: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 161 Mar 22 02:21:09.910: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 161 Mar 22 02:21:11.924: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 161 Mar 22 02:21:13.939: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 161 Mar 22 02:21:15.955: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 161 Mar 22 02:21:17.972: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 161 Mar 22 02:21:19.990: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 161 Mar 22 02:21:22.006: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 161 Mar 22 02:21:24.019: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 161 Mar 22 02:21:26.032: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 161 Mar 22 02:21:28.048: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 161 Mar 22 02:21:30.061: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 161 Mar 22 02:21:32.075: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 161 Mar 22 02:21:34.092: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 161 Mar 22 02:21:36.106: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 161 Mar 22 02:21:38.121: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 161 Mar 22 02:21:40.137: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 161 Mar 22 02:21:42.151: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 161 Mar 22 02:21:44.164: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 161 [FAILED] Timed out after 120.000s. Expected <*errors.errorString | 0xc000f66aa0>: NodeCondition: PIDPressure not encountered { s: "NodeCondition: PIDPressure not encountered", } to be nil In [It] at: test/e2e_node/eviction_test.go:571 @ 03/22/23 02:21:45.193 < Exit [It] should eventually evict all of the correct pods - test/e2e_node/eviction_test.go:563 @ 03/22/23 02:21:45.193 (2m0.001s) > Enter [AfterEach] TOP-LEVEL - test/e2e_node/eviction_test.go:620 @ 03/22/23 02:21:45.193 STEP: deleting pods - test/e2e_node/eviction_test.go:631 @ 03/22/23 02:21:45.193 STEP: deleting pod: fork-bomb-container-with-low-priority-pod - test/e2e_node/eviction_test.go:633 @ 03/22/23 02:21:45.193 STEP: deleting pod: innocent-pod - test/e2e_node/eviction_test.go:633 @ 03/22/23 02:21:45.199 STEP: deleting pod: fork-bomb-container-with-high-priority-pod - test/e2e_node/eviction_test.go:633 @ 03/22/23 02:22:17.251 STEP: making sure NodeCondition PIDPressure no longer exists on the node - test/e2e_node/eviction_test.go:639 @ 03/22/23 02:22:17.255 STEP: making sure we have all the required images for testing - test/e2e_node/eviction_test.go:648 @ 03/22/23 02:22:17.287 STEP: making sure NodeCondition PIDPressure doesn't exist again after pulling images - test/e2e_node/eviction_test.go:652 @ 03/22/23 02:22:17.287 STEP: making sure we can start a new pod after the test - test/e2e_node/eviction_test.go:660 @ 03/22/23 02:22:17.289 Mar 22 02:22:19.312: INFO: Summary of pod events during the test: I0322 02:22:19.314741 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-7951", Name:"fork-bomb-container-with-high-priority-pod", UID:"130b2276-adad-487a-a708-24468adacfb1", APIVersion:"v1", ResourceVersion:"628", FieldPath:"spec.containers{fork-bomb-container-with-high-priority-container}"}): type: 'Normal' reason: 'Pulled' Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine I0322 02:22:19.314769 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-7951", Name:"fork-bomb-container-with-high-priority-pod", UID:"130b2276-adad-487a-a708-24468adacfb1", APIVersion:"v1", ResourceVersion:"628", FieldPath:"spec.containers{fork-bomb-container-with-high-priority-container}"}): type: 'Normal' reason: 'Created' Created container fork-bomb-container-with-high-priority-container I0322 02:22:19.314782 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-7951", Name:"fork-bomb-container-with-high-priority-pod", UID:"130b2276-adad-487a-a708-24468adacfb1", APIVersion:"v1", ResourceVersion:"628", FieldPath:"spec.containers{fork-bomb-container-with-high-priority-container}"}): type: 'Normal' reason: 'Started' Started container fork-bomb-container-with-high-priority-container I0322 02:22:19.314794 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-7951", Name:"fork-bomb-container-with-low-priority-pod", UID:"4badf1c6-02cc-4544-99d8-f5810c8aec2f", APIVersion:"v1", ResourceVersion:"629", FieldPath:"spec.containers{fork-bomb-container-with-low-priority-container}"}): type: 'Normal' reason: 'Pulled' Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine I0322 02:22:19.314805 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-7951", Name:"fork-bomb-container-with-low-priority-pod", UID:"4badf1c6-02cc-4544-99d8-f5810c8aec2f", APIVersion:"v1", ResourceVersion:"629", FieldPath:"spec.containers{fork-bomb-container-with-low-priority-container}"}): type: 'Normal' reason: 'Created' Created container fork-bomb-container-with-low-priority-container I0322 02:22:19.314816 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-7951", Name:"fork-bomb-container-with-low-priority-pod", UID:"4badf1c6-02cc-4544-99d8-f5810c8aec2f", APIVersion:"v1", ResourceVersion:"629", FieldPath:"spec.containers{fork-bomb-container-with-low-priority-container}"}): type: 'Normal' reason: 'Started' Started container fork-bomb-container-with-low-priority-container I0322 02:22:19.314827 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-7951", Name:"innocent-pod", UID:"6b3dedd1-d46a-47de-90a7-950ef15edf0b", APIVersion:"v1", ResourceVersion:"627", FieldPath:"spec.containers{innocent-container}"}): type: 'Normal' reason: 'Pulled' Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine I0322 02:22:19.314839 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-7951", Name:"innocent-pod", UID:"6b3dedd1-d46a-47de-90a7-950ef15edf0b", APIVersion:"v1", ResourceVersion:"627", FieldPath:"spec.containers{innocent-container}"}): type: 'Normal' reason: 'Created' Created container innocent-container I0322 02:22:19.314850 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-7951", Name:"innocent-pod", UID:"6b3dedd1-d46a-47de-90a7-950ef15edf0b", APIVersion:"v1", ResourceVersion:"627", FieldPath:"spec.containers{innocent-container}"}): type: 'Normal' reason: 'Started' Started container innocent-container I0322 02:22:19.314860 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-7951", Name:"innocent-pod", UID:"6b3dedd1-d46a-47de-90a7-950ef15edf0b", APIVersion:"v1", ResourceVersion:"627", FieldPath:"spec.containers{innocent-container}"}): type: 'Normal' reason: 'Killing' Stopping container innocent-container I0322 02:22:19.314875 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-7951", Name:"test-admit-pod", UID:"128837bd-5e62-44ef-9ee6-bcd556728182", APIVersion:"v1", ResourceVersion:"707", FieldPath:"spec.containers{test-admit-pod}"}): type: 'Normal' reason: 'Pulled' Container image "registry.k8s.io/pause:3.9" already present on machine I0322 02:22:19.314886 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-7951", Name:"test-admit-pod", UID:"128837bd-5e62-44ef-9ee6-bcd556728182", APIVersion:"v1", ResourceVersion:"707", FieldPath:"spec.containers{test-admit-pod}"}): type: 'Normal' reason: 'Created' Created container test-admit-pod I0322 02:22:19.314896 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-7951", Name:"test-admit-pod", UID:"128837bd-5e62-44ef-9ee6-bcd556728182", APIVersion:"v1", ResourceVersion:"707", FieldPath:"spec.containers{test-admit-pod}"}): type: 'Normal' reason: 'Started' Started container test-admit-pod Mar 22 02:22:19.314: INFO: Summary of node events during the test: I0322 02:22:19.320108 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'Starting' Starting kubelet. I0322 02:22:19.320409 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeHasSufficientMemory' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeHasSufficientMemory I0322 02:22:19.320607 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeHasNoDiskPressure' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeHasNoDiskPressure I0322 02:22:19.320797 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeHasSufficientPID' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeHasSufficientPID I0322 02:22:19.320927 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeAllocatableEnforced' Updated Node Allocatable limit across pods I0322 02:22:19.321076 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeReady' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeReady I0322 02:22:19.321206 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'Starting' Starting kubelet. I0322 02:22:19.321347 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeHasSufficientMemory' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeHasSufficientMemory I0322 02:22:19.321498 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeHasNoDiskPressure' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeHasNoDiskPressure I0322 02:22:19.321626 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeHasSufficientPID' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeHasSufficientPID I0322 02:22:19.321771 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeNotReady' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeNotReady I0322 02:22:19.321902 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeAllocatableEnforced' Updated Node Allocatable limit across pods I0322 02:22:19.322057 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeReady' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeReady I0322 02:22:19.322200 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeHasDiskPressure' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeHasDiskPressure I0322 02:22:19.322352 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Warning' reason: 'EvictionThresholdMet' Attempting to reclaim ephemeral-storage I0322 02:22:19.322510 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'Starting' Starting kubelet. I0322 02:22:19.322649 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeHasSufficientMemory' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeHasSufficientMemory I0322 02:22:19.322783 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeHasNoDiskPressure' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeHasNoDiskPressure I0322 02:22:19.322925 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeHasSufficientPID' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeHasSufficientPID I0322 02:22:19.323053 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeNotReady' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeNotReady I0322 02:22:19.323216 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeAllocatableEnforced' Updated Node Allocatable limit across pods I0322 02:22:19.323330 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeReady' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeReady I0322 02:22:19.323464 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'Starting' Starting kubelet. I0322 02:22:19.323578 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeHasSufficientMemory' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeHasSufficientMemory I0322 02:22:19.323693 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeHasNoDiskPressure' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeHasNoDiskPressure I0322 02:22:19.323822 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeHasSufficientPID' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeHasSufficientPID I0322 02:22:19.323936 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeNotReady' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeNotReady I0322 02:22:19.324049 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeAllocatableEnforced' Updated Node Allocatable limit across pods I0322 02:22:19.324166 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeReady' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeReady I0322 02:22:19.324279 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'Starting' Starting kubelet. I0322 02:22:19.324402 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeHasSufficientMemory' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeHasSufficientMemory I0322 02:22:19.324526 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeHasNoDiskPressure' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeHasNoDiskPressure I0322 02:22:19.324680 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeHasSufficientPID' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeHasSufficientPID I0322 02:22:19.324814 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeNotReady' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeNotReady I0322 02:22:19.324948 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeAllocatableEnforced' Updated Node Allocatable limit across pods I0322 02:22:19.325083 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeReady' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeReady I0322 02:22:19.325231 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'Starting' Starting kubelet. I0322 02:22:19.325366 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeHasSufficientMemory' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeHasSufficientMemory I0322 02:22:19.325522 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeHasNoDiskPressure' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeHasNoDiskPressure I0322 02:22:19.325657 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeHasSufficientPID' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeHasSufficientPID I0322 02:22:19.325805 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeAllocatableEnforced' Updated Node Allocatable limit across pods I0322 02:22:19.325919 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-7951", Name:"fork-bomb-container-with-high-priority-pod", UID:"130b2276-adad-487a-a708-24468adacfb1", APIVersion:"v1", ResourceVersion:"628", FieldPath:"spec.containers{fork-bomb-container-with-high-priority-container}"}): type: 'Normal' reason: 'Pulled' Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine I0322 02:22:19.326038 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-7951", Name:"fork-bomb-container-with-high-priority-pod", UID:"130b2276-adad-487a-a708-24468adacfb1", APIVersion:"v1", ResourceVersion:"628", FieldPath:"spec.containers{fork-bomb-container-with-high-priority-container}"}): type: 'Normal' reason: 'Created' Created container fork-bomb-container-with-high-priority-container I0322 02:22:19.326158 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-7951", Name:"fork-bomb-container-with-high-priority-pod", UID:"130b2276-adad-487a-a708-24468adacfb1", APIVersion:"v1", ResourceVersion:"628", FieldPath:"spec.containers{fork-bomb-container-with-high-priority-container}"}): type: 'Normal' reason: 'Started' Started container fork-bomb-container-with-high-priority-container I0322 02:22:19.326278 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-7951", Name:"fork-bomb-container-with-low-priority-pod", UID:"4badf1c6-02cc-4544-99d8-f5810c8aec2f", APIVersion:"v1", ResourceVersion:"629", FieldPath:"spec.containers{fork-bomb-container-with-low-priority-container}"}): type: 'Normal' reason: 'Pulled' Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine I0322 02:22:19.326401 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-7951", Name:"fork-bomb-container-with-low-priority-pod", UID:"4badf1c6-02cc-4544-99d8-f5810c8aec2f", APIVersion:"v1", ResourceVersion:"629", FieldPath:"spec.containers{fork-bomb-container-with-low-priority-container}"}): type: 'Normal' reason: 'Created' Created container fork-bomb-container-with-low-priority-container I0322 02:22:19.326521 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-7951", Name:"fork-bomb-container-with-low-priority-pod", UID:"4badf1c6-02cc-4544-99d8-f5810c8aec2f", APIVersion:"v1", ResourceVersion:"629", FieldPath:"spec.containers{fork-bomb-container-with-low-priority-container}"}): type: 'Normal' reason: 'Started' Started container fork-bomb-container-with-low-priority-container I0322 02:22:19.326638 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-7951", Name:"innocent-pod", UID:"6b3dedd1-d46a-47de-90a7-950ef15edf0b", APIVersion:"v1", ResourceVersion:"627", FieldPath:"spec.containers{innocent-container}"}): type: 'Normal' reason: 'Pulled' Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine I0322 02:22:19.326751 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-7951", Name:"innocent-pod", UID:"6b3dedd1-d46a-47de-90a7-950ef15edf0b", APIVersion:"v1", ResourceVersion:"627", FieldPath:"spec.containers{innocent-container}"}): type: 'Normal' reason: 'Created' Created container innocent-container I0322 02:22:19.326865 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-7951", Name:"innocent-pod", UID:"6b3dedd1-d46a-47de-90a7-950ef15edf0b", APIVersion:"v1", ResourceVersion:"627", FieldPath:"spec.containers{innocent-container}"}): type: 'Normal' reason: 'Started' Started container innocent-container I0322 02:22:19.326981 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-7951", Name:"innocent-pod", UID:"6b3dedd1-d46a-47de-90a7-950ef15edf0b", APIVersion:"v1", ResourceVersion:"627", FieldPath:"spec.containers{innocent-container}"}): type: 'Normal' reason: 'Killing' Stopping container innocent-container I0322 02:22:19.327094 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-7951", Name:"test-admit-pod", UID:"128837bd-5e62-44ef-9ee6-bcd556728182", APIVersion:"v1", ResourceVersion:"707", FieldPath:"spec.containers{test-admit-pod}"}): type: 'Normal' reason: 'Pulled' Container image "registry.k8s.io/pause:3.9" already present on machine I0322 02:22:19.327263 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-7951", Name:"test-admit-pod", UID:"128837bd-5e62-44ef-9ee6-bcd556728182", APIVersion:"v1", ResourceVersion:"707", FieldPath:"spec.containers{test-admit-pod}"}): type: 'Normal' reason: 'Created' Created container test-admit-pod I0322 02:22:19.327412 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-7951", Name:"test-admit-pod", UID:"128837bd-5e62-44ef-9ee6-bcd556728182", APIVersion:"v1", ResourceVersion:"707", FieldPath:"spec.containers{test-admit-pod}"}): type: 'Normal' reason: 'Started' Started container test-admit-pod < Exit [AfterEach] TOP-LEVEL - test/e2e_node/eviction_test.go:620 @ 03/22/23 02:22:19.327 (34.134s) > Enter [AfterEach] when we run containers that should cause PIDPressure - test/e2e_node/util.go:190 @ 03/22/23 02:22:19.327 STEP: Stopping the kubelet - test/e2e_node/util.go:200 @ 03/22/23 02:22:19.327 Mar 22 02:22:19.359: INFO: Get running kubelet with systemctl: UNIT LOAD ACTIVE SUB DESCRIPTION kubelet-20230322T015518.service loaded active running /tmp/node-e2e-20230322T015518/kubelet --kubeconfig /tmp/node-e2e-20230322T015518/kubeconfig --root-dir /var/lib/kubelet --v 4 --hostname-override tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 --container-runtime-endpoint unix:///var/run/crio/crio.sock --config /tmp/node-e2e-20230322T015518/kubelet-config --cgroup-driver=systemd --cgroups-per-qos=true --cgroup-root=/ --runtime-cgroups=/system.slice/crio.service --kubelet-cgroups=/system.slice/kubelet.service LOAD = Reflects whether the unit definition was properly loaded. ACTIVE = The high-level unit activation state, i.e. generalization of SUB. SUB = The low-level unit activation state, values depend on unit type. 1 loaded units listed. , kubelet-20230322T015518 W0322 02:22:19.427959 2652 util.go:477] Health check on "http://127.0.0.1:10248/healthz" failed, error=Head "http://127.0.0.1:10248/healthz": read tcp 127.0.0.1:35006->127.0.0.1:10248: read: connection reset by peer STEP: Starting the kubelet - test/e2e_node/util.go:216 @ 03/22/23 02:22:19.438 W0322 02:22:19.473607 2652 util.go:477] Health check on "http://127.0.0.1:10248/healthz" failed, error=Head "http://127.0.0.1:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused < Exit [AfterEach] when we run containers that should cause PIDPressure - test/e2e_node/util.go:190 @ 03/22/23 02:22:24.477 (5.15s) > Enter [AfterEach] when we run containers that should cause PIDPressure - test/e2e_node/eviction_test.go:482 @ 03/22/23 02:22:24.477 < Exit [AfterEach] when we run containers that should cause PIDPressure - test/e2e_node/eviction_test.go:482 @ 03/22/23 02:22:24.479 (2ms) > Enter [AfterEach] [sig-node] PriorityPidEvictionOrdering [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - test/e2e/framework/node/init/init.go:33 @ 03/22/23 02:22:24.479 Mar 22 02:22:24.479: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] PriorityPidEvictionOrdering [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - test/e2e/framework/node/init/init.go:33 @ 03/22/23 02:22:24.482 (2ms) > Enter [DeferCleanup (Each)] [sig-node] PriorityPidEvictionOrdering [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - test/e2e/framework/metrics/init/init.go:35 @ 03/22/23 02:22:24.482 < Exit [DeferCleanup (Each)] [sig-node] PriorityPidEvictionOrdering [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - test/e2e/framework/metrics/init/init.go:35 @ 03/22/23 02:22:24.482 (0s) > Enter [DeferCleanup (Each)] [sig-node] PriorityPidEvictionOrdering [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - dump namespaces | framework.go:209 @ 03/22/23 02:22:24.482 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/22/23 02:22:24.482 STEP: Collecting events from namespace "pidpressure-eviction-test-7951". - test/e2e/framework/debug/dump.go:42 @ 03/22/23 02:22:24.482 STEP: Found 13 events. - test/e2e/framework/debug/dump.go:46 @ 03/22/23 02:22:24.484 Mar 22 02:22:24.484: INFO: At 2023-03-22 02:19:43 +0000 UTC - event for fork-bomb-container-with-high-priority-pod: {kubelet tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 22 02:22:24.484: INFO: At 2023-03-22 02:19:43 +0000 UTC - event for fork-bomb-container-with-low-priority-pod: {kubelet tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 22 02:22:24.484: INFO: At 2023-03-22 02:19:43 +0000 UTC - event for innocent-pod: {kubelet tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 22 02:22:24.484: INFO: At 2023-03-22 02:19:44 +0000 UTC - event for fork-bomb-container-with-high-priority-pod: {kubelet tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64} Started: Started container fork-bomb-container-with-high-priority-container Mar 22 02:22:24.484: INFO: At 2023-03-22 02:19:44 +0000 UTC - event for fork-bomb-container-with-high-priority-pod: {kubelet tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64} Created: Created container fork-bomb-container-with-high-priority-container Mar 22 02:22:24.484: INFO: At 2023-03-22 02:19:44 +0000 UTC - event for fork-bomb-container-with-low-priority-pod: {kubelet tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64} Created: Created container fork-bomb-container-with-low-priority-container Mar 22 02:22:24.484: INFO: At 2023-03-22 02:19:44 +0000 UTC - event for fork-bomb-container-with-low-priority-pod: {kubelet tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64} Started: Started container fork-bomb-container-with-low-priority-container Mar 22 02:22:24.484: INFO: At 2023-03-22 02:19:44 +0000 UTC - event for innocent-pod: {kubelet tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64} Created: Created container innocent-container Mar 22 02:22:24.484: INFO: At 2023-03-22 02:19:44 +0000 UTC - event for innocent-pod: {kubelet tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64} Started: Started container innocent-container Mar 22 02:22:24.484: INFO: At 2023-03-22 02:21:45 +0000 UTC - event for innocent-pod: {kubelet tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64} Killing: Stopping container innocent-container Mar 22 02:22:24.484: INFO: At 2023-03-22 02:22:17 +0000 UTC - event for test-admit-pod: {kubelet tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64} Pulled: Container image "registry.k8s.io/pause:3.9" already present on machine Mar 22 02:22:24.484: INFO: At 2023-03-22 02:22:17 +0000 UTC - event for test-admit-pod: {kubelet tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64} Created: Created container test-admit-pod Mar 22 02:22:24.484: INFO: At 2023-03-22 02:22:17 +0000 UTC - event for test-admit-pod: {kubelet tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64} Started: Started container test-admit-pod Mar 22 02:22:24.485: INFO: POD NODE PHASE GRACE CONDITIONS Mar 22 02:22:24.485: INFO: test-admit-pod tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-22 02:22:17 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-22 02:22:18 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-22 02:22:18 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-22 02:22:17 +0000 UTC }] Mar 22 02:22:24.485: INFO: Mar 22 02:22:24.495: INFO: Logging node info for node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 Mar 22 02:22:24.497: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 25588c6e-2bb2-4dc3-b822-bafb7347205c 721 0 2023-03-22 01:57:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-22 01:57:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-22 02:22:19 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{},"f:memory":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20869787648 0} {<nil>} 20380652Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3841236992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18782808853 0} {<nil>} 18782808853 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3579092992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-22 02:22:19 +0000 UTC,LastTransitionTime:2023-03-22 01:57:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-22 02:22:19 +0000 UTC,LastTransitionTime:2023-03-22 02:12:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-22 02:22:19 +0000 UTC,LastTransitionTime:2023-03-22 01:57:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-22 02:22:19 +0000 UTC,LastTransitionTime:2023-03-22 02:22:19 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.58,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:b01dbd32d4ef230af587a02067933638,SystemUUID:b01dbd32-d4ef-230a-f587-a02067933638,BootID:ccf1dbf6-a36b-4b67-a43b-16a96c36a6ea,KernelVersion:6.1.11-200.fc37.x86_64,OSImage:Fedora CoreOS 37.20230218.3.0,ContainerRuntimeVersion:cri-o://1.26.0,KubeletVersion:v1.27.0-beta.0.56+9c6414cdfe0e29,KubeProxyVersion:v1.27.0-beta.0.56+9c6414cdfe0e29,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl@sha256:dd475f8a8c579cb78a13f54342e8569e7f925c8b0ba3a5599dbc55c97a4a76f1 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:875791114,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:d7e74e6555abe4b001aadddc248447b472ae35ccbb2c21ca0febace6c4c6d7bb registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:559664987,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster@sha256:c52e01956fec2cf5968b87be8f06ae740ea5d208a3b41fa2c7970b13cc515be5 registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:352430719,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd@sha256:8ae03c7bbd43d5c301eea33a39ac5eda2964f826050cb2ccf3486f18917590c9 registry.k8s.io/etcd:3.5.7-0],SizeBytes:297083935,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:034f77d52166fcacb81d6a6db10a4e24644c241896822e6525925859fec09f47 registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:272589700,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost@sha256:da18b4806cfa370df04f9c3faa7d654a22a80467dc4cab92bd1b22b4abe4d5aa registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:129622797,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd@sha256:21e720a020bf8d492b5dd2fe0f31a5205021176f505ecf35b10177f8bfd68980 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:128894228,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:115035523,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:f941079315f73b182b0f416134253ee87ab51162cbd2e9fcd31bbe726999a977 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:99663088,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:a37ad3a2ccb2b8aa7ced0b7c884888d2cef953cfc9a158e3e8b914d52147091b registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:99661552,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:87971088,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:dfa235c2d64c29405f40489cf631193b27bec6dcf13cfee9824e449f6ddac051 registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:43877486,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:3dd0413e5a78f1c2a6484f168ba3daf23ebb0b1141897237e9559db6c5f7101f registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:41740418,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:25603453,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:19251111,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx@sha256:c42b04e8cf71231fac5dbc833366f7ce2ae78ef8b9df4304fcb83edcd495f69f registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:17244936,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils@sha256:89fe5eb4c180571eb5c4e4179f1e9bc03497b1f50e45e4f720165617a603d737 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:12251265,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs@sha256:f6b1c4aef11b116c2a065ea60ed071a8f205444f1897bed9aa2e98a5d78cbdae registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:7373984,},ContainerImage{Names:[registry.k8s.io/stress@sha256:f00aa1ddc963a3164aef741aab0fc05074ea96de6cd7e0d10077cf98dd72d594 registry.k8s.io/stress:v1],SizeBytes:5502584,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox@sha256:4cdffea536d503c58d7e087bab34a43e63a11dcfa4132b5a1b838885f08fb730 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:1374155,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:1319178,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause@sha256:8d4106c88ec0bd28001e34c975d65175d994072d65341f62a8ab0754b0fafe10 registry.k8s.io/pause:3.9],SizeBytes:750414,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:c2280d2f5f56cf9c9a01bb64b2db4651e35efd6d62a54dcfc12049fe6449c5e4 registry.k8s.io/pause:3.6],SizeBytes:690326,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 22 02:22:24.497: INFO: Logging kubelet events for node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 Mar 22 02:22:24.498: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 Mar 22 02:22:24.500: INFO: test-admit-pod started at 2023-03-22 02:22:17 +0000 UTC (0+1 container statuses recorded) Mar 22 02:22:24.500: INFO: Container test-admit-pod ready: true, restart count 0 W0322 02:22:24.501592 2652 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 22 02:22:24.526: INFO: Latency metrics for node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/22/23 02:22:24.527 (45ms) < Exit [DeferCleanup (Each)] [sig-node] PriorityPidEvictionOrdering [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - dump namespaces | framework.go:209 @ 03/22/23 02:22:24.527 (45ms) > Enter [DeferCleanup (Each)] [sig-node] PriorityPidEvictionOrdering [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - tear down framework | framework.go:206 @ 03/22/23 02:22:24.527 STEP: Destroying namespace "pidpressure-eviction-test-7951" for this suite. - test/e2e/framework/framework.go:351 @ 03/22/23 02:22:24.527 < Exit [DeferCleanup (Each)] [sig-node] PriorityPidEvictionOrdering [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - tear down framework | framework.go:206 @ 03/22/23 02:22:24.53 (3ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sPriorityPidEvictionOrdering\s\[Slow\]\s\[Serial\]\s\[Disruptive\]\[NodeFeature\:Eviction\]\swhen\swe\srun\scontainers\sthat\sshould\scause\sPIDPressure\;\sPodDisruptionConditions\senabled\s\[NodeFeature\:PodDisruptionConditions\]\s\sshould\seventually\sevict\sall\sof\sthe\scorrect\spods$'
[FAILED] Timed out after 120.000s. Expected <*errors.errorString | 0xc00180d250>: NodeCondition: PIDPressure not encountered { s: "NodeCondition: PIDPressure not encountered", } to be nil In [It] at: test/e2e_node/eviction_test.go:571 @ 03/22/23 02:19:00.692from junit_fedora01.xml
> Enter [BeforeEach] [sig-node] PriorityPidEvictionOrdering [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - set up framework | framework.go:191 @ 03/22/23 02:16:23.439 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/22/23 02:16:23.439 STEP: Building a namespace api object, basename pidpressure-eviction-test - test/e2e/framework/framework.go:250 @ 03/22/23 02:16:23.439 Mar 22 02:16:23.443: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] PriorityPidEvictionOrdering [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - set up framework | framework.go:191 @ 03/22/23 02:16:23.443 (4ms) > Enter [BeforeEach] [sig-node] PriorityPidEvictionOrdering [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - test/e2e/framework/metrics/init/init.go:33 @ 03/22/23 02:16:23.443 < Exit [BeforeEach] [sig-node] PriorityPidEvictionOrdering [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - test/e2e/framework/metrics/init/init.go:33 @ 03/22/23 02:16:23.443 (0s) > Enter [BeforeEach] when we run containers that should cause PIDPressure; PodDisruptionConditions enabled [NodeFeature:PodDisruptionConditions] - test/e2e_node/util.go:176 @ 03/22/23 02:16:23.443 STEP: Stopping the kubelet - test/e2e_node/util.go:200 @ 03/22/23 02:16:23.464 Mar 22 02:16:23.493: INFO: Get running kubelet with systemctl: UNIT LOAD ACTIVE SUB DESCRIPTION kubelet-20230322T015518.service loaded active running /tmp/node-e2e-20230322T015518/kubelet --kubeconfig /tmp/node-e2e-20230322T015518/kubeconfig --root-dir /var/lib/kubelet --v 4 --hostname-override tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 --container-runtime-endpoint unix:///var/run/crio/crio.sock --config /tmp/node-e2e-20230322T015518/kubelet-config --cgroup-driver=systemd --cgroups-per-qos=true --cgroup-root=/ --runtime-cgroups=/system.slice/crio.service --kubelet-cgroups=/system.slice/kubelet.service LOAD = Reflects whether the unit definition was properly loaded. ACTIVE = The high-level unit activation state, i.e. generalization of SUB. SUB = The low-level unit activation state, values depend on unit type. 1 loaded units listed. , kubelet-20230322T015518 W0322 02:16:23.550808 2652 util.go:477] Health check on "http://127.0.0.1:10248/healthz" failed, error=Head "http://127.0.0.1:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection reset by peer STEP: Starting the kubelet - test/e2e_node/util.go:216 @ 03/22/23 02:16:23.559 W0322 02:16:23.596026 2652 util.go:477] Health check on "http://127.0.0.1:10248/healthz" failed, error=Head "http://127.0.0.1:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused < Exit [BeforeEach] when we run containers that should cause PIDPressure; PodDisruptionConditions enabled [NodeFeature:PodDisruptionConditions] - test/e2e_node/util.go:176 @ 03/22/23 02:16:28.602 (5.159s) > Enter [BeforeEach] TOP-LEVEL - test/e2e_node/eviction_test.go:549 @ 03/22/23 02:16:28.602 STEP: setting up pods to be used by tests - test/e2e_node/eviction_test.go:555 @ 03/22/23 02:16:58.665 < Exit [BeforeEach] TOP-LEVEL - test/e2e_node/eviction_test.go:549 @ 03/22/23 02:17:00.691 (32.089s) > Enter [It] should eventually evict all of the correct pods - test/e2e_node/eviction_test.go:563 @ 03/22/23 02:17:00.691 STEP: Waiting for node to have NodeCondition: PIDPressure - test/e2e_node/eviction_test.go:564 @ 03/22/23 02:17:00.691 Mar 22 02:17:00.726: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 3398 Mar 22 02:17:02.739: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 172 Mar 22 02:17:04.755: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 173 Mar 22 02:17:06.770: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:17:08.783: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:17:10.796: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:17:12.809: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:17:14.822: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:17:16.835: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:17:18.849: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:17:20.862: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 173 Mar 22 02:17:22.876: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 173 Mar 22 02:17:24.889: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 173 Mar 22 02:17:26.905: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 173 Mar 22 02:17:28.927: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 173 Mar 22 02:17:30.945: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 173 Mar 22 02:17:32.965: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 173 Mar 22 02:17:34.978: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:17:36.994: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:17:39.008: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:17:41.021: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:17:43.036: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:17:45.050: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:17:47.063: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:17:49.079: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:17:51.093: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:17:53.108: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:17:55.122: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:17:57.136: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:17:59.151: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:18:01.167: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:18:03.183: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:18:05.201: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:18:07.213: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:18:09.226: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:18:11.240: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:18:13.252: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:18:15.266: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:18:17.281: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:18:19.294: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:18:21.308: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:18:23.322: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:18:25.338: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:18:27.352: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:18:29.366: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:18:31.378: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:18:33.392: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:18:35.407: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:18:37.420: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:18:39.433: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:18:41.447: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:18:43.467: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:18:45.480: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:18:47.494: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:18:49.507: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:18:51.521: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:18:53.536: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:18:55.549: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:18:57.562: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 Mar 22 02:18:59.587: INFO: Node.Rlimit.MaxPID: 28638, Node.Rlimit.RunningProcesses: 171 [FAILED] Timed out after 120.000s. Expected <*errors.errorString | 0xc00180d250>: NodeCondition: PIDPressure not encountered { s: "NodeCondition: PIDPressure not encountered", } to be nil In [It] at: test/e2e_node/eviction_test.go:571 @ 03/22/23 02:19:00.692 < Exit [It] should eventually evict all of the correct pods - test/e2e_node/eviction_test.go:563 @ 03/22/23 02:19:00.692 (2m0.001s) > Enter [AfterEach] TOP-LEVEL - test/e2e_node/eviction_test.go:620 @ 03/22/23 02:19:00.692 STEP: deleting pods - test/e2e_node/eviction_test.go:631 @ 03/22/23 02:19:00.692 STEP: deleting pod: fork-bomb-container-pod - test/e2e_node/eviction_test.go:633 @ 03/22/23 02:19:00.692 STEP: making sure NodeCondition PIDPressure no longer exists on the node - test/e2e_node/eviction_test.go:639 @ 03/22/23 02:19:00.699 STEP: making sure we have all the required images for testing - test/e2e_node/eviction_test.go:648 @ 03/22/23 02:19:00.732 STEP: making sure NodeCondition PIDPressure doesn't exist again after pulling images - test/e2e_node/eviction_test.go:652 @ 03/22/23 02:19:00.732 STEP: making sure we can start a new pod after the test - test/e2e_node/eviction_test.go:660 @ 03/22/23 02:19:00.734 Mar 22 02:19:02.757: INFO: Summary of pod events during the test: I0322 02:19:02.759400 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-4957", Name:"fork-bomb-container-pod", UID:"dab2f2ec-2595-49a4-aa59-181908567b9c", APIVersion:"v1", ResourceVersion:"529", FieldPath:"spec.containers{fork-bomb-container-container}"}): type: 'Normal' reason: 'Pulled' Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine I0322 02:19:02.759422 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-4957", Name:"fork-bomb-container-pod", UID:"dab2f2ec-2595-49a4-aa59-181908567b9c", APIVersion:"v1", ResourceVersion:"529", FieldPath:"spec.containers{fork-bomb-container-container}"}): type: 'Normal' reason: 'Created' Created container fork-bomb-container-container I0322 02:19:02.759432 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-4957", Name:"fork-bomb-container-pod", UID:"dab2f2ec-2595-49a4-aa59-181908567b9c", APIVersion:"v1", ResourceVersion:"529", FieldPath:"spec.containers{fork-bomb-container-container}"}): type: 'Normal' reason: 'Started' Started container fork-bomb-container-container I0322 02:19:02.759440 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-4957", Name:"test-admit-pod", UID:"5d77c0b8-89d6-4f1b-90a7-7b5d7c475cb9", APIVersion:"v1", ResourceVersion:"575", FieldPath:"spec.containers{test-admit-pod}"}): type: 'Normal' reason: 'Pulled' Container image "registry.k8s.io/pause:3.9" already present on machine I0322 02:19:02.759449 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-4957", Name:"test-admit-pod", UID:"5d77c0b8-89d6-4f1b-90a7-7b5d7c475cb9", APIVersion:"v1", ResourceVersion:"575", FieldPath:"spec.containers{test-admit-pod}"}): type: 'Normal' reason: 'Created' Created container test-admit-pod I0322 02:19:02.759459 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-4957", Name:"test-admit-pod", UID:"5d77c0b8-89d6-4f1b-90a7-7b5d7c475cb9", APIVersion:"v1", ResourceVersion:"575", FieldPath:"spec.containers{test-admit-pod}"}): type: 'Normal' reason: 'Started' Started container test-admit-pod Mar 22 02:19:02.759: INFO: Summary of node events during the test: I0322 02:19:02.767648 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'Starting' Starting kubelet. I0322 02:19:02.767875 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeHasSufficientMemory' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeHasSufficientMemory I0322 02:19:02.768008 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeHasNoDiskPressure' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeHasNoDiskPressure I0322 02:19:02.768152 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeHasSufficientPID' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeHasSufficientPID I0322 02:19:02.768294 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeAllocatableEnforced' Updated Node Allocatable limit across pods I0322 02:19:02.768429 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeReady' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeReady I0322 02:19:02.768538 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'Starting' Starting kubelet. I0322 02:19:02.768644 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeHasSufficientMemory' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeHasSufficientMemory I0322 02:19:02.768754 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeHasNoDiskPressure' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeHasNoDiskPressure I0322 02:19:02.768872 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeHasSufficientPID' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeHasSufficientPID I0322 02:19:02.768974 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeNotReady' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeNotReady I0322 02:19:02.769075 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeAllocatableEnforced' Updated Node Allocatable limit across pods I0322 02:19:02.769181 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeReady' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeReady I0322 02:19:02.769284 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeHasDiskPressure' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeHasDiskPressure I0322 02:19:02.769405 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Warning' reason: 'EvictionThresholdMet' Attempting to reclaim ephemeral-storage I0322 02:19:02.769516 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'Starting' Starting kubelet. I0322 02:19:02.769615 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeHasSufficientMemory' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeHasSufficientMemory I0322 02:19:02.769714 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeHasNoDiskPressure' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeHasNoDiskPressure I0322 02:19:02.769820 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeHasSufficientPID' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeHasSufficientPID I0322 02:19:02.769925 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeNotReady' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeNotReady I0322 02:19:02.770027 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeAllocatableEnforced' Updated Node Allocatable limit across pods I0322 02:19:02.770139 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeReady' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeReady I0322 02:19:02.770249 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'Starting' Starting kubelet. I0322 02:19:02.770351 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeHasSufficientMemory' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeHasSufficientMemory I0322 02:19:02.770465 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeHasNoDiskPressure' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeHasNoDiskPressure I0322 02:19:02.770572 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeHasSufficientPID' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeHasSufficientPID I0322 02:19:02.770681 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeNotReady' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeNotReady I0322 02:19:02.770780 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeAllocatableEnforced' Updated Node Allocatable limit across pods I0322 02:19:02.770886 2652 util.go:244] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", UID:"tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'NodeReady' Node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 status is now: NodeReady I0322 02:19:02.770985 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-4957", Name:"fork-bomb-container-pod", UID:"dab2f2ec-2595-49a4-aa59-181908567b9c", APIVersion:"v1", ResourceVersion:"529", FieldPath:"spec.containers{fork-bomb-container-container}"}): type: 'Normal' reason: 'Pulled' Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine I0322 02:19:02.771098 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-4957", Name:"fork-bomb-container-pod", UID:"dab2f2ec-2595-49a4-aa59-181908567b9c", APIVersion:"v1", ResourceVersion:"529", FieldPath:"spec.containers{fork-bomb-container-container}"}): type: 'Normal' reason: 'Created' Created container fork-bomb-container-container I0322 02:19:02.771203 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-4957", Name:"fork-bomb-container-pod", UID:"dab2f2ec-2595-49a4-aa59-181908567b9c", APIVersion:"v1", ResourceVersion:"529", FieldPath:"spec.containers{fork-bomb-container-container}"}): type: 'Normal' reason: 'Started' Started container fork-bomb-container-container I0322 02:19:02.771309 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-4957", Name:"test-admit-pod", UID:"5d77c0b8-89d6-4f1b-90a7-7b5d7c475cb9", APIVersion:"v1", ResourceVersion:"575", FieldPath:"spec.containers{test-admit-pod}"}): type: 'Normal' reason: 'Pulled' Container image "registry.k8s.io/pause:3.9" already present on machine I0322 02:19:02.771423 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-4957", Name:"test-admit-pod", UID:"5d77c0b8-89d6-4f1b-90a7-7b5d7c475cb9", APIVersion:"v1", ResourceVersion:"575", FieldPath:"spec.containers{test-admit-pod}"}): type: 'Normal' reason: 'Created' Created container test-admit-pod I0322 02:19:02.771528 2652 util.go:244] Event(v1.ObjectReference{Kind:"Pod", Namespace:"pidpressure-eviction-test-4957", Name:"test-admit-pod", UID:"5d77c0b8-89d6-4f1b-90a7-7b5d7c475cb9", APIVersion:"v1", ResourceVersion:"575", FieldPath:"spec.containers{test-admit-pod}"}): type: 'Normal' reason: 'Started' Started container test-admit-pod < Exit [AfterEach] TOP-LEVEL - test/e2e_node/eviction_test.go:620 @ 03/22/23 02:19:02.774 (2.082s) > Enter [AfterEach] when we run containers that should cause PIDPressure; PodDisruptionConditions enabled [NodeFeature:PodDisruptionConditions] - test/e2e_node/util.go:190 @ 03/22/23 02:19:02.774 STEP: Stopping the kubelet - test/e2e_node/util.go:200 @ 03/22/23 02:19:02.774 Mar 22 02:19:02.808: INFO: Get running kubelet with systemctl: UNIT LOAD ACTIVE SUB DESCRIPTION kubelet-20230322T015518.service loaded active running /tmp/node-e2e-20230322T015518/kubelet --kubeconfig /tmp/node-e2e-20230322T015518/kubeconfig --root-dir /var/lib/kubelet --v 4 --hostname-override tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 --container-runtime-endpoint unix:///var/run/crio/crio.sock --config /tmp/node-e2e-20230322T015518/kubelet-config --cgroup-driver=systemd --cgroups-per-qos=true --cgroup-root=/ --runtime-cgroups=/system.slice/crio.service --kubelet-cgroups=/system.slice/kubelet.service LOAD = Reflects whether the unit definition was properly loaded. ACTIVE = The high-level unit activation state, i.e. generalization of SUB. SUB = The low-level unit activation state, values depend on unit type. 1 loaded units listed. , kubelet-20230322T015518 W0322 02:19:02.871342 2652 util.go:477] Health check on "http://127.0.0.1:10248/healthz" failed, error=Head "http://127.0.0.1:10248/healthz": read tcp 127.0.0.1:45980->127.0.0.1:10248: read: connection reset by peer STEP: Starting the kubelet - test/e2e_node/util.go:216 @ 03/22/23 02:19:02.879 W0322 02:19:02.914965 2652 util.go:477] Health check on "http://127.0.0.1:10248/healthz" failed, error=Head "http://127.0.0.1:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused < Exit [AfterEach] when we run containers that should cause PIDPressure; PodDisruptionConditions enabled [NodeFeature:PodDisruptionConditions] - test/e2e_node/util.go:190 @ 03/22/23 02:19:07.918 (5.144s) > Enter [AfterEach] [sig-node] PriorityPidEvictionOrdering [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - test/e2e/framework/node/init/init.go:33 @ 03/22/23 02:19:07.918 Mar 22 02:19:07.918: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] PriorityPidEvictionOrdering [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - test/e2e/framework/node/init/init.go:33 @ 03/22/23 02:19:07.919 (2ms) > Enter [DeferCleanup (Each)] [sig-node] PriorityPidEvictionOrdering [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - test/e2e/framework/metrics/init/init.go:35 @ 03/22/23 02:19:07.919 < Exit [DeferCleanup (Each)] [sig-node] PriorityPidEvictionOrdering [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - test/e2e/framework/metrics/init/init.go:35 @ 03/22/23 02:19:07.919 (0s) > Enter [DeferCleanup (Each)] [sig-node] PriorityPidEvictionOrdering [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - dump namespaces | framework.go:209 @ 03/22/23 02:19:07.919 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/22/23 02:19:07.919 STEP: Collecting events from namespace "pidpressure-eviction-test-4957". - test/e2e/framework/debug/dump.go:42 @ 03/22/23 02:19:07.919 STEP: Found 6 events. - test/e2e/framework/debug/dump.go:46 @ 03/22/23 02:19:07.921 Mar 22 02:19:07.921: INFO: At 2023-03-22 02:16:59 +0000 UTC - event for fork-bomb-container-pod: {kubelet tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 22 02:19:07.921: INFO: At 2023-03-22 02:16:59 +0000 UTC - event for fork-bomb-container-pod: {kubelet tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64} Created: Created container fork-bomb-container-container Mar 22 02:19:07.921: INFO: At 2023-03-22 02:16:59 +0000 UTC - event for fork-bomb-container-pod: {kubelet tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64} Started: Started container fork-bomb-container-container Mar 22 02:19:07.921: INFO: At 2023-03-22 02:19:01 +0000 UTC - event for test-admit-pod: {kubelet tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64} Pulled: Container image "registry.k8s.io/pause:3.9" already present on machine Mar 22 02:19:07.921: INFO: At 2023-03-22 02:19:01 +0000 UTC - event for test-admit-pod: {kubelet tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64} Created: Created container test-admit-pod Mar 22 02:19:07.921: INFO: At 2023-03-22 02:19:01 +0000 UTC - event for test-admit-pod: {kubelet tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64} Started: Started container test-admit-pod Mar 22 02:19:07.922: INFO: POD NODE PHASE GRACE CONDITIONS Mar 22 02:19:07.922: INFO: test-admit-pod tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-22 02:19:00 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-22 02:19:01 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-22 02:19:01 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-22 02:19:00 +0000 UTC }] Mar 22 02:19:07.922: INFO: Mar 22 02:19:07.932: INFO: Logging node info for node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 Mar 22 02:19:07.933: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 25588c6e-2bb2-4dc3-b822-bafb7347205c 590 0 2023-03-22 01:57:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-22 01:57:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-22 02:19:03 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{},"f:memory":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20869787648 0} {<nil>} 20380652Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3841236992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18782808853 0} {<nil>} 18782808853 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3579092992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-22 02:19:03 +0000 UTC,LastTransitionTime:2023-03-22 01:57:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-22 02:19:03 +0000 UTC,LastTransitionTime:2023-03-22 02:12:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-22 02:19:03 +0000 UTC,LastTransitionTime:2023-03-22 01:57:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-22 02:19:03 +0000 UTC,LastTransitionTime:2023-03-22 02:19:03 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.58,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:b01dbd32d4ef230af587a02067933638,SystemUUID:b01dbd32-d4ef-230a-f587-a02067933638,BootID:ccf1dbf6-a36b-4b67-a43b-16a96c36a6ea,KernelVersion:6.1.11-200.fc37.x86_64,OSImage:Fedora CoreOS 37.20230218.3.0,ContainerRuntimeVersion:cri-o://1.26.0,KubeletVersion:v1.27.0-beta.0.56+9c6414cdfe0e29,KubeProxyVersion:v1.27.0-beta.0.56+9c6414cdfe0e29,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl@sha256:dd475f8a8c579cb78a13f54342e8569e7f925c8b0ba3a5599dbc55c97a4a76f1 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:875791114,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:d7e74e6555abe4b001aadddc248447b472ae35ccbb2c21ca0febace6c4c6d7bb registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:559664987,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster@sha256:c52e01956fec2cf5968b87be8f06ae740ea5d208a3b41fa2c7970b13cc515be5 registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:352430719,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd@sha256:8ae03c7bbd43d5c301eea33a39ac5eda2964f826050cb2ccf3486f18917590c9 registry.k8s.io/etcd:3.5.7-0],SizeBytes:297083935,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:034f77d52166fcacb81d6a6db10a4e24644c241896822e6525925859fec09f47 registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:272589700,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost@sha256:da18b4806cfa370df04f9c3faa7d654a22a80467dc4cab92bd1b22b4abe4d5aa registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:129622797,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd@sha256:21e720a020bf8d492b5dd2fe0f31a5205021176f505ecf35b10177f8bfd68980 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:128894228,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:115035523,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:f941079315f73b182b0f416134253ee87ab51162cbd2e9fcd31bbe726999a977 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:99663088,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:a37ad3a2ccb2b8aa7ced0b7c884888d2cef953cfc9a158e3e8b914d52147091b registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:99661552,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:87971088,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:dfa235c2d64c29405f40489cf631193b27bec6dcf13cfee9824e449f6ddac051 registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:43877486,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:3dd0413e5a78f1c2a6484f168ba3daf23ebb0b1141897237e9559db6c5f7101f registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:41740418,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:25603453,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:19251111,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx@sha256:c42b04e8cf71231fac5dbc833366f7ce2ae78ef8b9df4304fcb83edcd495f69f registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:17244936,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils@sha256:89fe5eb4c180571eb5c4e4179f1e9bc03497b1f50e45e4f720165617a603d737 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:12251265,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs@sha256:f6b1c4aef11b116c2a065ea60ed071a8f205444f1897bed9aa2e98a5d78cbdae registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:7373984,},ContainerImage{Names:[registry.k8s.io/stress@sha256:f00aa1ddc963a3164aef741aab0fc05074ea96de6cd7e0d10077cf98dd72d594 registry.k8s.io/stress:v1],SizeBytes:5502584,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox@sha256:4cdffea536d503c58d7e087bab34a43e63a11dcfa4132b5a1b838885f08fb730 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:1374155,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:1319178,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause@sha256:8d4106c88ec0bd28001e34c975d65175d994072d65341f62a8ab0754b0fafe10 registry.k8s.io/pause:3.9],SizeBytes:750414,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:c2280d2f5f56cf9c9a01bb64b2db4651e35efd6d62a54dcfc12049fe6449c5e4 registry.k8s.io/pause:3.6],SizeBytes:690326,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 22 02:19:07.934: INFO: Logging kubelet events for node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 Mar 22 02:19:07.935: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 Mar 22 02:19:07.936: INFO: test-admit-pod started at 2023-03-22 02:19:00 +0000 UTC (0+1 container statuses recorded) Mar 22 02:19:07.936: INFO: Container test-admit-pod ready: true, restart count 0 W0322 02:19:07.937968 2652 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 22 02:19:07.951: INFO: Latency metrics for node tmp-node-e2e-403557c4-fedora-coreos-37-20230218-3-0-gcp-x86-64 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/22/23 02:19:07.952 (32ms) < Exit [DeferCleanup (Each)] [sig-node] PriorityPidEvictionOrdering [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - dump namespaces | framework.go:209 @ 03/22/23 02:19:07.952 (32ms) > Enter [DeferCleanup (Each)] [sig-node] PriorityPidEvictionOrdering [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - tear down framework | framework.go:206 @ 03/22/23 02:19:07.952 STEP: Destroying namespace "pidpressure-eviction-test-4957" for this suite. - test/e2e/framework/framework.go:351 @ 03/22/23 02:19:07.952 < Exit [DeferCleanup (Each)] [sig-node] PriorityPidEvictionOrdering [Slow] [Serial] [Disruptive][NodeFeature:Eviction] - tear down framework | framework.go:206 @ 03/22/23 02:19:07.954 (2ms)
Filter through log files | View test history on testgrid
error during go run /go/src/k8s.io/kubernetes/test/e2e_node/runner/remote/run_remote.go --cleanup -vmodule=*=4 --ssh-env=gce --results-dir=/workspace/_artifacts --project=k8s-jkns-gke-ubuntu-alpha --zone=us-west1-b --ssh-user=core --ssh-key=/workspace/.ssh/google_compute_engine --ginkgo-flags=--nodes=1 --focus="\[NodeFeature:Eviction\]" --test_args=--container-runtime-endpoint=unix:///var/run/crio/crio.sock --container-runtime-process-name=/usr/local/bin/crio --container-runtime-pid-file= --kubelet-flags="--cgroup-driver=systemd --cgroups-per-qos=true --cgroup-root=/ --runtime-cgroups=/system.slice/crio.service --kubelet-cgroups=/system.slice/kubelet.service" --extra-log="{\"name\": \"crio.log\", \"journalctl\": [\"-u\", \"crio\"]}" --test-timeout=5h0m0s --image-config-file=/workspace/test-infra/jobs/e2e_node/crio/latest/image-config-cgrpv1.yaml: exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
E2eNode Suite [It] [sig-node] InodeEviction [Slow] [Serial] [Disruptive][NodeFeature:Eviction] when we run containers that should cause DiskPressure should eventually evict all of the correct pods
E2eNode Suite [It] [sig-node] LocalStorageCapacityIsolationEviction [Slow] [Serial] [Disruptive] [Feature:LocalStorageCapacityIsolation][NodeFeature:Eviction] when we run containers that should cause evictions due to pod local storage violations should eventually evict all of the correct pods
E2eNode Suite [It] [sig-node] LocalStorageCapacityIsolationMemoryBackedVolumeEviction [Slow] [Serial] [Disruptive] [Feature:LocalStorageCapacityIsolation][NodeFeature:Eviction] when we run containers that should cause evictions due to pod local storage violations should eventually evict all of the correct pods
E2eNode Suite [It] [sig-node] LocalStorageSoftEviction [Slow] [Serial] [Disruptive][NodeFeature:Eviction] when we run containers that should cause DiskPressure should eventually evict all of the correct pods
E2eNode Suite [It] [sig-node] PriorityMemoryEvictionOrdering [Slow] [Serial] [Disruptive][NodeFeature:Eviction] when we run containers that should cause MemoryPressure should eventually evict all of the correct pods
E2eNode Suite [SynchronizedAfterSuite]
E2eNode Suite [SynchronizedBeforeSuite]
kubetest Deferred TearDown
kubetest DumpClusterLogs
kubetest GetDeployer
kubetest Prepare
kubetest TearDown
kubetest TearDown Previous
kubetest Timeout
kubetest Up
kubetest test setup
E2eNode Suite [It] [sig-network] Networking Granular Checks: Pods should function for intra-pod communication: http [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-network] Networking Granular Checks: Pods should function for intra-pod communication: sctp [LinuxOnly][Feature:SCTPConnectivity]
E2eNode Suite [It] [sig-network] Networking Granular Checks: Pods should function for intra-pod communication: udp [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-network] Networking Granular Checks: Pods should function for node-pod communication: http [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-network] Networking Granular Checks: Pods should function for node-pod communication: sctp [LinuxOnly][Feature:SCTPConnectivity]
E2eNode Suite [It] [sig-network] Networking Granular Checks: Pods should function for node-pod communication: udp [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] AppArmor [Feature:AppArmor][NodeFeature:AppArmor] when running without AppArmor should reject a pod with an AppArmor profile
E2eNode Suite [It] [sig-node] CPU Manager Metrics [Serial][Feature:CPUManager] when querying /metrics should not report any pinning failures when the cpumanager allocation is expected to succeed
E2eNode Suite [It] [sig-node] CPU Manager Metrics [Serial][Feature:CPUManager] when querying /metrics should report pinning failures when the cpumanager allocation is known to fail
E2eNode Suite [It] [sig-node] CPU Manager Metrics [Serial][Feature:CPUManager] when querying /metrics should report zero pinning counters after a fresh restart
E2eNode Suite [It] [sig-node] CPU Manager [Serial] [Feature:CPUManager] With kubeconfig updated with static CPU Manager policy run the CPU Manager tests should assign CPUs as expected based on the Pod spec
E2eNode Suite [It] [sig-node] CPU Manager [Serial] [Feature:CPUManager] With kubeconfig updated with static CPU Manager policy run the CPU Manager tests should assign CPUs as expected with enhanced policy based on strict SMT alignment
E2eNode Suite [It] [sig-node] Checkpoint Container [NodeFeature:CheckpointContainer] will checkpoint a container out of a pod
E2eNode Suite [It] [sig-node] ConfigMap should be consumable via environment variable [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] ConfigMap should be consumable via the environment [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] ConfigMap should fail to create ConfigMap with empty key [Conformance]
E2eNode Suite [It] [sig-node] ConfigMap should run through a ConfigMap lifecycle [Conformance]
E2eNode Suite [It] [sig-node] ConfigMap should update ConfigMap successfully
E2eNode Suite [It] [sig-node] Container Lifecycle Hook when create a pod with lifecycle hook should execute poststart exec hook properly [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Container Lifecycle Hook when create a pod with lifecycle hook should execute poststart http hook properly [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Container Lifecycle Hook when create a pod with lifecycle hook should execute poststart https hook properly [MinimumKubeletVersion:1.23] [NodeConformance]
E2eNode Suite [It] [sig-node] Container Lifecycle Hook when create a pod with lifecycle hook should execute prestop exec hook properly [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Container Lifecycle Hook when create a pod with lifecycle hook should execute prestop http hook properly [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Container Lifecycle Hook when create a pod with lifecycle hook should execute prestop https hook properly [MinimumKubeletVersion:1.23] [NodeConformance]
E2eNode Suite [It] [sig-node] Container Manager Misc [Serial] Validate OOM score adjustments [NodeFeature:OOMScoreAdj] once the node is setup pod infra containers oom-score-adj should be -998 and best effort container's should be 1000
E2eNode Suite [It] [sig-node] Container Manager Misc [Serial] Validate OOM score adjustments [NodeFeature:OOMScoreAdj] once the node is setup Kubelet's oom-score-adj should be -999
E2eNode Suite [It] [sig-node] Container Manager Misc [Serial] Validate OOM score adjustments [NodeFeature:OOMScoreAdj] once the node is setup burstable container's oom-score-adj should be between [2, 1000)
E2eNode Suite [It] [sig-node] Container Manager Misc [Serial] Validate OOM score adjustments [NodeFeature:OOMScoreAdj] once the node is setup container runtime's oom-score-adj should be -999
E2eNode Suite [It] [sig-node] Container Manager Misc [Serial] Validate OOM score adjustments [NodeFeature:OOMScoreAdj] once the node is setup guaranteed container's oom-score-adj should be -998
E2eNode Suite [It] [sig-node] Container Runtime Conformance Test container runtime conformance blackbox test when running a container with a new image should be able to pull from private registry with credential provider [NodeConformance]
E2eNode Suite [It] [sig-node] Container Runtime blackbox test on terminated container should report termination message as empty when pod succeeds and TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Container Runtime blackbox test on terminated container should report termination message from file when pod succeeds and TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Container Runtime blackbox test on terminated container should report termination message from log output if TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Container Runtime blackbox test on terminated container should report termination message if TerminationMessagePath is set [NodeConformance]
E2eNode Suite [It] [sig-node] Container Runtime blackbox test on terminated container should report termination message if TerminationMessagePath is set as non-root user and at a non-default path [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Container Runtime blackbox test when running a container with a new image should be able to pull from private registry with secret [NodeConformance]
E2eNode Suite [It] [sig-node] Container Runtime blackbox test when running a container with a new image should be able to pull image [NodeConformance]
E2eNode Suite [It] [sig-node] Container Runtime blackbox test when running a container with a new image should not be able to pull from private registry without secret [NodeConformance]
E2eNode Suite [It] [sig-node] Container Runtime blackbox test when running a container with a new image should not be able to pull image from invalid registry [NodeConformance]
E2eNode Suite [It] [sig-node] Container Runtime blackbox test when starting a container that exits should run with the expected status [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] ContainerLogPath [NodeConformance] Pod with a container printed log to stdout should print log to correct cri log path
E2eNode Suite [It] [sig-node] ContainerLogPath [NodeConformance] Pod with a container printed log to stdout should print log to correct log path
E2eNode Suite [It] [sig-node] ContainerLogRotation [Slow] [Serial] [Disruptive] when a container generates a lot of log should be rotated and limited to a fixed amount of files
E2eNode Suite [It] [sig-node] Containers should be able to override the image's default arguments (container cmd) [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Containers should be able to override the image's default command (container entrypoint) [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Containers should be able to override the image's default command and arguments [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Containers should use the image defaults if command and args are blank [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] CriticalPod [Serial] [Disruptive] [NodeFeature:CriticalPod] when we need to admit a critical pod [Flaky] should be able to create and delete a critical pod
E2eNode Suite [It] [sig-node] Deleted pods handling [NodeConformance] Should transition to Failed phase a deleted pod if non-zero exit codes Restart policy Always
E2eNode Suite [It] [sig-node] Deleted pods handling [NodeConformance] Should transition to Failed phase a deleted pod if non-zero exit codes Restart policy Never
E2eNode Suite [It] [sig-node] Deleted pods handling [NodeConformance] Should transition to Failed phase a deleted pod if non-zero exit codes Restart policy OnFailure
E2eNode Suite [It] [sig-node] Deleted pods handling [NodeConformance] Should transition to Failed phase a pod which is deleted while pending
E2eNode Suite [It] [sig-node] Deleted pods handling [NodeConformance] Should transition to Succeeded phase a deleted pod when containers complete with 0 exit code Restart policy Always
E2eNode Suite [It] [sig-node] Deleted pods handling [NodeConformance] Should transition to Succeeded phase a deleted pod when containers complete with 0 exit code Restart policy Never
E2eNode Suite [It] [sig-node] Deleted pods handling [NodeConformance] Should transition to Succeeded phase a deleted pod when containers complete with 0 exit code Restart policy OnFailure
E2eNode Suite [It] [sig-node] Density [Serial] [Slow] create a batch of pods latency/resource should be within limit when create 10 pods with 0s interval
E2eNode Suite [It] [sig-node] Density [Serial] [Slow] create a batch of pods latency/resource should be within limit when create 10 pods with 0s interval [Benchmark][NodeSpecialFeature:Benchmark]
E2eNode Suite [It] [sig-node] Density [Serial] [Slow] create a batch of pods latency/resource should be within limit when create 10 pods with 100ms interval [Benchmark][NodeSpecialFeature:Benchmark]
E2eNode Suite [It] [sig-node] Density [Serial] [Slow] create a batch of pods latency/resource should be within limit when create 10 pods with 300ms interval [Benchmark][NodeSpecialFeature:Benchmark]
E2eNode Suite [It] [sig-node] Density [Serial] [Slow] create a batch of pods latency/resource should be within limit when create 35 pods with 0s interval [Benchmark][NodeSpecialFeature:Benchmark]
E2eNode Suite [It] [sig-node] Density [Serial] [Slow] create a batch of pods latency/resource should be within limit when create 35 pods with 100ms interval [Benchmark][NodeSpecialFeature:Benchmark]
E2eNode Suite [It] [sig-node] Density [Serial] [Slow] create a batch of pods latency/resource should be within limit when create 35 pods with 300ms interval [Benchmark][NodeSpecialFeature:Benchmark]
E2eNode Suite [It] [sig-node] Density [Serial] [Slow] create a batch of pods latency/resource should be within limit when create 90 pods with 0s interval [Benchmark][NodeSpecialFeature:Benchmark]
E2eNode Suite [It] [sig-node] Density [Serial] [Slow] create a batch of pods latency/resource should be within limit when create 90 pods with 100ms interval [Benchmark][NodeSpecialFeature:Benchmark]
E2eNode Suite [It] [sig-node] Density [Serial] [Slow] create a batch of pods latency/resource should be within limit when create 90 pods with 300ms interval [Benchmark][NodeSpecialFeature:Benchmark]
E2eNode Suite [It] [sig-node] Density [Serial] [Slow] create a batch of pods with higher API QPS latency/resource should be within limit when create 90 pods with 0s interval (QPS 60) [Benchmark][NodeSpecialFeature:Benchmark]
E2eNode Suite [It] [sig-node] Density [Serial] [Slow] create a batch of pods with higher API QPS latency/resource should be within limit when create 90 pods with 100ms interval (QPS 60) [Benchmark][NodeSpecialFeature:Benchmark]
E2eNode Suite [It] [sig-node] Density [Serial] [Slow] create a batch of pods with higher API QPS latency/resource should be within limit when create 90 pods with 300ms interval (QPS 60) [Benchmark][NodeSpecialFeature:Benchmark]
E2eNode Suite [It] [sig-node] Density [Serial] [Slow] create a sequence of pods latency/resource should be within limit when create 10 pods with 50 background pods
E2eNode Suite [It] [sig-node] Density [Serial] [Slow] create a sequence of pods latency/resource should be within limit when create 10 pods with 50 background pods [Benchmark][NodeSpeicalFeature:Benchmark]
E2eNode Suite [It] [sig-node] Density [Serial] [Slow] create a sequence of pods latency/resource should be within limit when create 30 pods with 50 background pods [Benchmark][NodeSpeicalFeature:Benchmark]
E2eNode Suite [It] [sig-node] Density [Serial] [Slow] create a sequence of pods latency/resource should be within limit when create 50 pods with 50 background pods [Benchmark][NodeSpeicalFeature:Benchmark]
E2eNode Suite [It] [sig-node] Device Manager [Serial] [Feature:DeviceManager][NodeFeature:DeviceManager] With SRIOV devices in the system should be able to recover V1 (aka pre-1.20) checkpoint data and reject pods before device re-registration
E2eNode Suite [It] [sig-node] Device Manager [Serial] [Feature:DeviceManager][NodeFeature:DeviceManager] With SRIOV devices in the system should be able to recover V1 (aka pre-1.20) checkpoint data and update topology info on device re-registration
E2eNode Suite [It] [sig-node] Device Plugin [Feature:DevicePluginProbe][NodeFeature:DevicePluginProbe][Serial] DevicePlugin [Serial] [Disruptive] Can schedule a pod that requires a device
E2eNode Suite [It] [sig-node] Device Plugin [Feature:DevicePluginProbe][NodeFeature:DevicePluginProbe][Serial] DevicePlugin [Serial] [Disruptive] Keeps device plugin assignments across pod and kubelet restarts
E2eNode Suite [It] [sig-node] Device Plugin [Feature:DevicePluginProbe][NodeFeature:DevicePluginProbe][Serial] DevicePlugin [Serial] [Disruptive] Keeps device plugin assignments after the device plugin has been re-registered
E2eNode Suite [It] [sig-node] Downward API [Serial] [Disruptive] [NodeFeature:DownwardAPIHugePages] Downward API tests for hugepages should provide container's limits.hugepages-<pagesize> and requests.hugepages-<pagesize> as env vars
E2eNode Suite [It] [sig-node] Downward API [Serial] [Disruptive] [NodeFeature:DownwardAPIHugePages] Downward API tests for hugepages should provide default limits.hugepages-<pagesize> from node allocatable
E2eNode Suite [It] [sig-node] Downward API should provide container's limits.cpu/memory and requests.cpu/memory as env vars [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Downward API should provide default limits.cpu/memory from node allocatable [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Downward API should provide host IP and pod IP as an env var if pod uses host network [LinuxOnly]
E2eNode Suite [It] [sig-node] Downward API should provide host IP as an env var [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Downward API should provide pod UID as env vars [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Downward API should provide pod name, namespace and IP address as env vars [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Ephemeral Containers [NodeConformance] will start an ephemeral container in an existing pod [Conformance]
E2eNode Suite [It] [sig-node] GarbageCollect [Serial][NodeFeature:GarbageCollect] Garbage Collection Test: Many Pods with Many Restarting Containers Should eventually garbage collect containers when we exceed the number of dead containers per container
E2eNode Suite [It] [sig-node] GarbageCollect [Serial][NodeFeature:GarbageCollect] Garbage Collection Test: Many Restarting Containers Should eventually garbage collect containers when we exceed the number of dead containers per container
E2eNode Suite [It] [sig-node] GarbageCollect [Serial][NodeFeature:GarbageCollect] Garbage Collection Test: One Non-restarting Container Should eventually garbage collect containers when we exceed the number of dead containers per container
E2eNode Suite [It] [sig-node] GracefulNodeShutdown [Serial] [NodeFeature:GracefulNodeShutdown] [NodeFeature:GracefulNodeShutdownBasedOnPodPriority] graceful node shutdown when PodDisruptionConditions are enabled [NodeFeature:PodDisruptionConditions] should add the DisruptionTarget pod failure condition to the evicted pods
E2eNode Suite [It] [sig-node] GracefulNodeShutdown [Serial] [NodeFeature:GracefulNodeShutdown] [NodeFeature:GracefulNodeShutdownBasedOnPodPriority] when gracefully shutting down after restart dbus, should be able to gracefully shutdown
E2eNode Suite [It] [sig-node] GracefulNodeShutdown [Serial] [NodeFeature:GracefulNodeShutdown] [NodeFeature:GracefulNodeShutdownBasedOnPodPriority] when gracefully shutting down should be able to gracefully shutdown pods with various grace periods
E2eNode Suite [It] [sig-node] GracefulNodeShutdown [Serial] [NodeFeature:GracefulNodeShutdown] [NodeFeature:GracefulNodeShutdownBasedOnPodPriority] when gracefully shutting down should be able to handle a cancelled shutdown
E2eNode Suite [It] [sig-node] GracefulNodeShutdown [Serial] [NodeFeature:GracefulNodeShutdown] [NodeFeature:GracefulNodeShutdownBasedOnPodPriority] when gracefully shutting down with Pod priority should be able to gracefully shutdown pods with various grace periods
E2eNode Suite [It] [sig-node] Hostname of Pod [NodeConformance] a pod configured to set FQDN as hostname will remain in Pending state generating FailedCreatePodSandBox events when the FQDN is longer than 64 bytes
E2eNode Suite [It] [sig-node] Hostname of Pod [NodeConformance] a pod with subdomain field has FQDN, hostname is shortname
E2eNode Suite [It] [sig-node] Hostname of Pod [NodeConformance] a pod with subdomain field has FQDN, when setHostnameAsFQDN is set to true, the FQDN is set as hostname
E2eNode Suite [It] [sig-node] Hostname of Pod [NodeConformance] a pod without FQDN is not affected by SetHostnameAsFQDN field
E2eNode Suite [It] [sig-node] Hostname of Pod [NodeConformance] a pod without subdomain field does not have FQDN
E2eNode Suite [It] [sig-node] HugePages [Serial] [Feature:HugePages][NodeSpecialFeature:HugePages] should add resources for new huge page sizes on kubelet restart
E2eNode Suite [It] [sig-node] HugePages [Serial] [Feature:HugePages][NodeSpecialFeature:HugePages] should remove resources for huge page sizes no longer supported
E2eNode Suite [It] [sig-node] HugePages [Serial] [Feature:HugePages][NodeSpecialFeature:HugePages] when start the pod with the resources requests that contain multiple hugepages resources should set correct hugetlb mount and limit under the container cgroup
E2eNode Suite [It] [sig-node] HugePages [Serial] [Feature:HugePages][NodeSpecialFeature:HugePages] when start the pod with the resources requests that contain only one hugepages resource with the backward compatible API should set correct hugetlb mount and limit under the container cgroup
E2eNode Suite [It] [sig-node] HugePages [Serial] [Feature:HugePages][NodeSpecialFeature:HugePages] when start the pod with the resources requests that contain only one hugepages resource with the new API should set correct hugetlb mount and limit under the container cgroup
E2eNode Suite [It] [sig-node] ImageCredentialProvider [Feature:KubeletCredentialProviders] should be able to create pod with image credentials fetched from external credential provider
E2eNode Suite [It] [sig-node] ImageID [NodeFeature: ImageID] should be set to the manifest digest (from RepoDigests) when available
E2eNode Suite [It] [sig-node] InitContainer [NodeConformance] should invoke init containers on a RestartAlways pod [Conformance]
E2eNode Suite [It] [sig-node] InitContainer [NodeConformance] should invoke init containers on a RestartNever pod [Conformance]
E2eNode Suite [It] [sig-node] InitContainer [NodeConformance] should not start app containers and fail the pod if init containers fail on a RestartNever pod [Conformance]
E2eNode Suite [It] [sig-node] InitContainer [NodeConformance] should not start app containers if init containers fail on a RestartAlways pod [Conformance]
E2eNode Suite [It] [sig-node] Kubelet Cgroup Manager Pod containers [NodeConformance] On scheduling a BestEffort Pod Pod containers should have been created under the BestEffort cgroup
E2eNode Suite [It] [sig-node] Kubelet Cgroup Manager Pod containers [NodeConformance] On scheduling a Burstable Pod Pod containers should have been created under the Burstable cgroup
E2eNode Suite [It] [sig-node] Kubelet Cgroup Manager Pod containers [NodeConformance] On scheduling a Guaranteed Pod Pod containers should have been created under the cgroup-root
E2eNode Suite [It] [sig-node] Kubelet Cgroup Manager QOS containers On enabling QOS cgroup hierarchy Top level QoS containers should have been created [NodeConformance]
E2eNode Suite [It] [sig-node] Kubelet PodOverhead handling [LinuxOnly] PodOverhead cgroup accounting On running pod with PodOverhead defined Pod cgroup should be sum of overhead and resource limits
E2eNode Suite [It] [sig-node] Kubelet Volume Manager Volume Manager On termination of pod with memory backed volume should remove the volume from the node [NodeConformance]
E2eNode Suite [It] [sig-node] Kubelet when scheduling a busybox command in a pod should print the output to logs [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Kubelet when scheduling a busybox command that always fails in a pod should be possible to delete [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Kubelet when scheduling a busybox command that always fails in a pod should have an terminated reason [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Kubelet when scheduling a read only busybox container should not write to root filesystem [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Kubelet when scheduling an agnhost Pod with hostAliases should write entries to /etc/hosts [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] KubeletManagedEtcHosts should test kubelet managed /etc/hosts file [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Lease lease API should be available [Conformance]
E2eNode Suite [It] [sig-node] LocalStorageCapacityIsolationFSQuotaMonitoring [Slow] [Serial] [Disruptive] [Feature:LocalStorageCapacityIsolationQuota][NodeFeature:LSCIQuotaMonitoring] when we run containers that should cause use quotas for LSCI monitoring (quotas enabled: false) should eventually evict all of the correct pods
E2eNode Suite [It] [sig-node] LocalStorageCapacityIsolationFSQuotaMonitoring [Slow] [Serial] [Disruptive] [Feature:LocalStorageCapacityIsolationQuota][NodeFeature:LSCIQuotaMonitoring] when we run containers that should cause use quotas for LSCI monitoring (quotas enabled: true) should eventually evict all of the correct pods
E2eNode Suite [It] [sig-node] LocalStorageEviction [Slow] [Serial] [Disruptive][NodeFeature:Eviction] when we run containers that should cause DiskPressure should eventually evict all of the correct pods
E2eNode Suite [It] [sig-node] Lock contention [Slow] [Disruptive] [NodeSpecialFeature:LockContention] Kubelet should stop when the test acquires the lock on lock file and restart once the lock is released
E2eNode Suite [It] [sig-node] Memory Manager [Disruptive] [Serial] [Feature:MemoryManager] with none policy should not report any memory data during request to pod resources GetAllocatableResources
E2eNode Suite [It] [sig-node] Memory Manager [Disruptive] [Serial] [Feature:MemoryManager] with none policy should not report any memory data during request to pod resources List
E2eNode Suite [It] [sig-node] Memory Manager [Disruptive] [Serial] [Feature:MemoryManager] with none policy should succeed to start the pod
E2eNode Suite [It] [sig-node] Memory Manager [Disruptive] [Serial] [Feature:MemoryManager] with static policy should report memory data during request to pod resources GetAllocatableResources
E2eNode Suite [It] [sig-node] Memory Manager [Disruptive] [Serial] [Feature:MemoryManager] with static policy when guaranteed pod has init and app containers should succeed to start the pod
E2eNode Suite [It] [sig-node] Memory Manager [Disruptive] [Serial] [Feature:MemoryManager] with static policy when guaranteed pod has only app containers should succeed to start the pod
E2eNode Suite [It] [sig-node] Memory Manager [Disruptive] [Serial] [Feature:MemoryManager] with static policy when guaranteed pod memory request is bigger than free memory on each NUMA node should be rejected
E2eNode Suite [It] [sig-node] Memory Manager [Disruptive] [Serial] [Feature:MemoryManager] with static policy when multiple guaranteed pods started should report memory data for each guaranteed pod and container during request to pod resources List
E2eNode Suite [It] [sig-node] Memory Manager [Disruptive] [Serial] [Feature:MemoryManager] with static policy when multiple guaranteed pods started should succeed to start all pods
E2eNode Suite [It] [sig-node] MemoryAllocatableEviction [Slow] [Serial] [Disruptive][NodeFeature:Eviction] when we run containers that should cause MemoryPressure should eventually evict all of the correct pods
E2eNode Suite [It] [sig-node] MirrorPod when create a mirror pod should be recreated when mirror pod forcibly deleted [NodeConformance]
E2eNode Suite [It] [sig-node] MirrorPod when create a mirror pod should be recreated when mirror pod gracefully deleted [NodeConformance]
E2eNode Suite [It] [sig-node] MirrorPod when create a mirror pod should be updated when static pod updated [NodeConformance]
E2eNode Suite [It] [sig-node] MirrorPod when create a mirror pod without changes should successfully recreate when file is removed and recreated [NodeConformance]
E2eNode Suite [It] [sig-node] MirrorPod when recreating a static pod it should launch successfully even if it temporarily failed termination due to volume failing to unmount [NodeConformance] [Serial]
E2eNode Suite [It] [sig-node] MirrorPodWithGracePeriod when create a mirror pod and the container runtime is temporarily down during pod termination [NodeConformance] [Serial] [Disruptive] the mirror pod should terminate successfully
E2eNode Suite [It] [sig-node] MirrorPodWithGracePeriod when create a mirror pod mirror pod termination should satisfy grace period when static pod is deleted [NodeConformance]
E2eNode Suite [It] [sig-node] MirrorPodWithGracePeriod when create a mirror pod mirror pod termination should satisfy grace period when static pod is updated [NodeConformance]
E2eNode Suite [It] [sig-node] MirrorPodWithGracePeriod when create a mirror pod should update a static pod when the static pod is updated multiple times during the graceful termination period [NodeConformance]
E2eNode Suite [It] [sig-node] Node Container Manager [Serial] Validate Node Allocatable [NodeFeature:NodeAllocatable] sets up the node and runs the test
E2eNode Suite [It] [sig-node] Node Performance Testing [Serial] [Slow] Run node performance testing with pre-defined workloads NAS parallel benchmark (NPB) suite - Embarrassingly Parallel (EP) workload
E2eNode Suite [It] [sig-node] Node Performance Testing [Serial] [Slow] Run node performance testing with pre-defined workloads NAS parallel benchmark (NPB) suite - Integer Sort (IS) workload
E2eNode Suite [It] [sig-node] Node Performance Testing [Serial] [Slow] Run node performance testing with pre-defined workloads TensorFlow workload
E2eNode Suite [It] [sig-node] NodeLease NodeLease should have OwnerReferences set
E2eNode Suite [It] [sig-node] NodeLease NodeLease the kubelet should create and update a lease in the kube-node-lease namespace
E2eNode Suite [It] [sig-node] NodeLease NodeLease the kubelet should report node status infrequently
E2eNode Suite [It] [sig-node] NodeProblemDetector [NodeFeature:NodeProblemDetector] [Serial] SystemLogMonitor should generate node condition and events for corresponding errors
E2eNode Suite [It] [sig-node] OOMKiller [LinuxOnly] [NodeConformance] The containers terminated by OOM killer should have the reason set to OOMKilled
E2eNode Suite [It] [sig-node] OSArchLabelReconciliation [Serial] [Slow] [Disruptive] Kubelet should reconcile the OS and Arch labels when restarted
E2eNode Suite [It] [sig-node] OSArchLabelReconciliation [Serial] [Slow] [Disruptive] Kubelet should reconcile the OS and Arch labels when running
E2eNode Suite [It] [sig-node] POD Resources [Serial] [Feature:PodResources][NodeFeature:PodResources] when querying /metrics [NodeConformance] should report the values for the podresources metrics
E2eNode Suite [It] [sig-node] POD Resources [Serial] [Feature:PodResources][NodeFeature:PodResources] with SRIOV devices in the system with CPU manager None policy should return the expected responses
E2eNode Suite [It] [sig-node] POD Resources [Serial] [Feature:PodResources][NodeFeature:PodResources] with SRIOV devices in the system with CPU manager Static policy should return the expected responses
E2eNode Suite [It] [sig-node] POD Resources [Serial] [Feature:PodResources][NodeFeature:PodResources] with a topology-unaware device plugin, which reports resources w/o hardware topology with CPU manager Static policy should return proper podresources the same as before the restart of kubelet
E2eNode Suite [It] [sig-node] POD Resources [Serial] [Feature:PodResources][NodeFeature:PodResources] with the builtin rate limit values should hit throttling when calling podresources List in a tight loop
E2eNode Suite [It] [sig-node] POD Resources [Serial] [Feature:PodResources][NodeFeature:PodResources] without SRIOV devices in the system with CPU manager None policy should return the expected responses
E2eNode Suite [It] [sig-node] POD Resources [Serial] [Feature:PodResources][NodeFeature:PodResources] without SRIOV devices in the system with CPU manager Static policy should return the expected responses
E2eNode Suite [It] [sig-node] POD Resources [Serial] [Feature:PodResources][NodeFeature:PodResources] without SRIOV devices in the system with disabled KubeletPodResourcesGetAllocatable feature gate should return the expected error with the feature gate disabled
E2eNode Suite [It] [sig-node] Pod conditions managed by Kubelet including PodHasNetwork condition [Serial] [Feature:PodHasNetwork] a pod failing to mount volumes and with init containers should report just the scheduled condition set
E2eNode Suite [It] [sig-node] Pod conditions managed by Kubelet including PodHasNetwork condition [Serial] [Feature:PodHasNetwork] a pod failing to mount volumes and without init containers should report scheduled and initialized conditions set
E2eNode Suite [It] [sig-node] Pod conditions managed by Kubelet including PodHasNetwork condition [Serial] [Feature:PodHasNetwork] a pod with init containers should report all conditions set in expected order after the pod is up
E2eNode Suite [It] [sig-node] Pod conditions managed by Kubelet including PodHasNetwork condition [Serial] [Feature:PodHasNetwork] a pod without init containers should report all conditions set in expected order after the pod is up
E2eNode Suite [It] [sig-node] Pod conditions managed by Kubelet without PodHasNetwork condition a pod failing to mount volumes and with init containers should report just the scheduled condition set
E2eNode Suite [It] [sig-node] Pod conditions managed by Kubelet without PodHasNetwork condition a pod failing to mount volumes and without init containers should report scheduled and initialized conditions set
E2eNode Suite [It] [sig-node] Pod conditions managed by Kubelet without PodHasNetwork condition a pod with init containers should report all conditions set in expected order after the pod is up
E2eNode Suite [It] [sig-node] Pod conditions managed by Kubelet without PodHasNetwork condition a pod without init containers should report all conditions set in expected order after the pod is up
E2eNode Suite [It] [sig-node] PodOSRejection [NodeConformance] Kubelet should reject pod when the node OS doesn't match pod's OS
E2eNode Suite [It] [sig-node] PodPidsLimit [Serial] With config updated with pids limits should set pids.max for Pod
E2eNode Suite [It] [sig-node] PodTemplates should delete a collection of pod templates [Conformance]
E2eNode Suite [It] [sig-node] PodTemplates should replace a pod template [Conformance]
E2eNode Suite [It] [sig-node] PodTemplates should run the lifecycle of PodTemplates [Conformance]
E2eNode Suite [It] [sig-node] Pods should allow activeDeadlineSeconds to be updated [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Pods should be submitted and removed [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Pods should be updated [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Pods should cap back-off at MaxContainerBackOff [Slow][NodeConformance]
E2eNode Suite [It] [sig-node] Pods should contain environment variables for services [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Pods should delete a collection of pods [Conformance]
E2eNode Suite [It] [sig-node] Pods should get a host IP [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Pods should have their auto-restart back-off timer reset on image update [Slow][NodeConformance]
E2eNode Suite [It] [sig-node] Pods should patch a pod status [Conformance]
E2eNode Suite [It] [sig-node] Pods should run through the lifecycle of Pods and PodStatus [Conformance]
E2eNode Suite [It] [sig-node] Pods should support pod readiness gates [NodeConformance]
E2eNode Suite [It] [sig-node] Pods should support remote command execution over websockets [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Pods should support retrieving logs from the container over websockets [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] PriorityLocalStorageEvictionOrdering [Slow] [Serial] [Disruptive][NodeFeature:Eviction] when we run containers that should cause DiskPressure should eventually evict all of the correct pods
E2eNode Suite [It] [sig-node] PrivilegedPod [NodeConformance] should enable privileged commands [LinuxOnly]
E2eNode Suite [It] [sig-node] Probing container should *not* be restarted by liveness probe because startup probe delays it
E2eNode Suite [It] [sig-node] Probing container should *not* be restarted with a /healthz http liveness probe [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Probing container should *not* be restarted with a GRPC liveness probe [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Probing container should *not* be restarted with a exec "cat /tmp/health" liveness probe [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Probing container should *not* be restarted with a non-local redirect http liveness probe
E2eNode Suite [It] [sig-node] Probing container should *not* be restarted with a tcp:8080 liveness probe [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Probing container should be ready immediately after startupProbe succeeds
E2eNode Suite [It] [sig-node] Probing container should be restarted by liveness probe after startup probe enables it
E2eNode Suite [It] [sig-node] Probing container should be restarted startup probe fails
E2eNode Suite [It] [sig-node] Probing container should be restarted with a /healthz http liveness probe [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Probing container should be restarted with a GRPC liveness probe [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Probing container should be restarted with a exec "cat /tmp/health" liveness probe [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Probing container should be restarted with a failing exec liveness probe that took longer than the timeout
E2eNode Suite [It] [sig-node] Probing container should be restarted with a local redirect http liveness probe
E2eNode Suite [It] [sig-node] Probing container should be restarted with an exec liveness probe with timeout [MinimumKubeletVersion:1.20] [NodeConformance]
E2eNode Suite [It] [sig-node] Probing container should have monotonically increasing restart count [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Probing container should mark readiness on pods to false and disable liveness probes while pod is in progress of terminating
E2eNode Suite [It] [sig-node] Probing container should mark readiness on pods to false while pod is in progress of terminating when a pod has a readiness probe
E2eNode Suite [It] [sig-node] Probing container should not be ready with an exec readiness probe timeout [MinimumKubeletVersion:1.20] [NodeConformance]
E2eNode Suite [It] [sig-node] Probing container should override timeoutGracePeriodSeconds when LivenessProbe field is set [Feature:ProbeTerminationGracePeriod]
E2eNode Suite [It] [sig-node] Probing container should override timeoutGracePeriodSeconds when StartupProbe field is set [Feature:ProbeTerminationGracePeriod]
E2eNode Suite [It] [sig-node] Probing container with readiness probe should not be ready before initial delay and never restart [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Probing container with readiness probe that fails should never be ready and never restart [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Resource-usage [Serial] [Slow] regular resource usage tracking resource tracking for 0 pods per node [Benchmark]
E2eNode Suite [It] [sig-node] Resource-usage [Serial] [Slow] regular resource usage tracking resource tracking for 10 pods per node
E2eNode Suite [It] [sig-node] Resource-usage [Serial] [Slow] regular resource usage tracking resource tracking for 10 pods per node [Benchmark]
E2eNode Suite [It] [sig-node] Resource-usage [Serial] [Slow] regular resource usage tracking resource tracking for 35 pods per node [Benchmark]
E2eNode Suite [It] [sig-node] Resource-usage [Serial] [Slow] regular resource usage tracking resource tracking for 90 pods per node [Benchmark]
E2eNode Suite [It] [sig-node] ResourceMetricsAPI [NodeFeature:ResourceMetrics] when querying /resource/metrics should report resource usage through the resource metrics api
E2eNode Suite [It] [sig-node] Restart [Serial] [Slow] [Disruptive] Container Runtime Network should recover from ip leak
E2eNode Suite [It] [sig-node] Restart [Serial] [Slow] [Disruptive] Dbus should continue to run pods after a restart
E2eNode Suite [It] [sig-node] Restart [Serial] [Slow] [Disruptive] Kubelet should correctly account for terminated pods after restart
E2eNode Suite [It] [sig-node] RuntimeClass should support RuntimeClasses API operations [Conformance]
E2eNode Suite [It] [sig-node] RuntimeClass should reject a Pod requesting a RuntimeClass with an unconfigured handler [NodeFeature:RuntimeHandler]
E2eNode Suite [It] [sig-node] RuntimeClass should reject a Pod requesting a deleted RuntimeClass [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] RuntimeClass should reject a Pod requesting a non-existent RuntimeClass [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] RuntimeClass should run a Pod requesting a RuntimeClass with a configured handler [NodeFeature:RuntimeHandler]
E2eNode Suite [It] [sig-node] RuntimeClass should schedule a Pod requesting a RuntimeClass and initialize its Overhead [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] RuntimeClass should schedule a Pod requesting a RuntimeClass without PodOverhead [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] SeccompDefault [Serial] [Feature:SeccompDefault] [LinuxOnly] with SeccompDefault enabled should use the default seccomp profile when unspecified
E2eNode Suite [It] [sig-node] SeccompDefault [Serial] [Feature:SeccompDefault] [LinuxOnly] with SeccompDefault enabled should use unconfined when specified
E2eNode Suite [It] [sig-node] Secrets should be consumable from pods in env vars [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Secrets should be consumable via the environment [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Secrets should fail to create secret due to empty secret key [Conformance]
E2eNode Suite [It] [sig-node] Secrets should patch a secret [Conformance]
E2eNode Suite [It] [sig-node] Security Context When creating a container with runAsNonRoot should not run with an explicit root user ID [LinuxOnly]
E2eNode Suite [It] [sig-node] Security Context When creating a container with runAsNonRoot should not run without a specified user ID
E2eNode Suite [It] [sig-node] Security Context When creating a container with runAsNonRoot should run with an explicit non-root user ID [LinuxOnly]
E2eNode Suite [It] [sig-node] Security Context When creating a container with runAsNonRoot should run with an image specified user ID
E2eNode Suite [It] [sig-node] Security Context When creating a container with runAsUser should run the container with uid 0 [LinuxOnly] [NodeConformance]
E2eNode Suite [It] [sig-node] Security Context When creating a container with runAsUser should run the container with uid 65534 [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Security Context When creating a pod with HostUsers must create the user namespace if set to false [LinuxOnly] [Feature:UserNamespacesStatelessPodsSupport]
E2eNode Suite [It] [sig-node] Security Context When creating a pod with HostUsers must not create the user namespace if set to true [LinuxOnly] [Feature:UserNamespacesStatelessPodsSupport]
E2eNode Suite [It] [sig-node] Security Context When creating a pod with HostUsers should mount all volumes with proper permissions with hostUsers=false [LinuxOnly] [Feature:UserNamespacesStatelessPodsSupport]
E2eNode Suite [It] [sig-node] Security Context When creating a pod with HostUsers should set FSGroup to user inside the container with hostUsers=false [LinuxOnly] [Feature:UserNamespacesStatelessPodsSupport]
E2eNode Suite [It] [sig-node] Security Context When creating a pod with privileged should run the container as privileged when true [LinuxOnly] [NodeFeature:HostAccess]
E2eNode Suite [It] [sig-node] Security Context When creating a pod with privileged should run the container as unprivileged when false [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Security Context When creating a pod with readOnlyRootFilesystem should run the container with readonly rootfs when readOnlyRootFilesystem=true [LinuxOnly] [NodeConformance]
E2eNode Suite [It] [sig-node] Security Context When creating a pod with readOnlyRootFilesystem should run the container with writable rootfs when readOnlyRootFilesystem=false [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Security Context [NodeConformance][LinuxOnly] Container PID namespace sharing containers in pods using isolated PID namespaces should all receive PID 1
E2eNode Suite [It] [sig-node] Security Context [NodeConformance][LinuxOnly] Container PID namespace sharing processes in containers sharing a pod namespace should be able to see each other
E2eNode Suite [It] [sig-node] Security Context when creating a pod in the host IPC namespace should not show the shared memory ID in the non-hostIPC containers [NodeFeature:HostAccess]
E2eNode Suite [It] [sig-node] Security Context when creating a pod in the host IPC namespace should show the shared memory ID in the host IPC containers [NodeFeature:HostAccess]
E2eNode Suite [It] [sig-node] Security Context when creating a pod in the host PID namespace should not show its pid in the non-hostpid containers [NodeFeature:HostAccess]
E2eNode Suite [It] [sig-node] Security Context when creating a pod in the host PID namespace should show its pid in the host PID namespace [NodeFeature:HostAccess]
E2eNode Suite [It] [sig-node] Security Context when creating a pod in the host network namespace should listen on same port in the host network containers [NodeFeature:HostAccess]
E2eNode Suite [It] [sig-node] Security Context when creating a pod in the host network namespace shouldn't show the same port in the non-hostnetwork containers [NodeFeature:HostAccess]
E2eNode Suite [It] [sig-node] Security Context when creating containers with AllowPrivilegeEscalation should allow privilege escalation when not explicitly set and uid != 0 [LinuxOnly] [NodeConformance]
E2eNode Suite [It] [sig-node] Security Context when creating containers with AllowPrivilegeEscalation should allow privilege escalation when true [LinuxOnly] [NodeConformance]
E2eNode Suite [It] [sig-node] Security Context when creating containers with AllowPrivilegeEscalation should not allow privilege escalation when false [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Summary API [NodeConformance] when querying /stats/summary should report resource usage through the stats api
E2eNode Suite [It] [sig-node] Sysctls [LinuxOnly] [NodeConformance] should not launch unsafe, but not explicitly enabled sysctls on the node [MinimumKubeletVersion:1.21]
E2eNode Suite [It] [sig-node] Sysctls [LinuxOnly] [NodeConformance] should reject invalid sysctls [MinimumKubeletVersion:1.21] [Conformance]
E2eNode Suite [It] [sig-node] Sysctls [LinuxOnly] [NodeConformance] should support sysctls [MinimumKubeletVersion:1.21] [Conformance]
E2eNode Suite [It] [sig-node] Sysctls [LinuxOnly] [NodeConformance] should support sysctls with slashes as separator [MinimumKubeletVersion:1.23]
E2eNode Suite [It] [sig-node] SystemNodeCriticalPod [Slow] [Serial] [Disruptive] [NodeFeature:SystemNodeCriticalPod] when create a system-node-critical pod should not be evicted upon DiskPressure
E2eNode Suite [It] [sig-node] Topology Manager Metrics [Serial][NodeFeature:TopologyManager] when querying /metrics should not report any admission failures when the topology manager alignment is expected to succeed
E2eNode Suite [It] [sig-node] Topology Manager Metrics [Serial][NodeFeature:TopologyManager] when querying /metrics should report admission failures when the topology manager alignment is known to fail
E2eNode Suite [It] [sig-node] Topology Manager Metrics [Serial][NodeFeature:TopologyManager] when querying /metrics should report zero admission counters after a fresh restart
E2eNode Suite [It] [sig-node] Topology Manager [Serial] [NodeFeature:TopologyManager] With kubeconfig updated to static CPU Manager policy run the Topology Manager tests run Topology Manager node alignment test suite
E2eNode Suite [It] [sig-node] Topology Manager [Serial] [NodeFeature:TopologyManager] With kubeconfig updated to static CPU Manager policy run the Topology Manager tests run Topology Manager policy test suite
E2eNode Suite [It] [sig-node] Topology Manager [Serial] [NodeFeature:TopologyManager] With kubeconfig updated to static CPU Manager policy run the Topology Manager tests run the Topology Manager pod scope alignment test suite
E2eNode Suite [It] [sig-node] Unknown Pods [Serial] [Disruptive] when creating a API pod the api pod should be terminated and cleaned up due to becoming a unknown pod due to being force deleted while kubelet is not running
E2eNode Suite [It] [sig-node] Unknown Pods [Serial] [Disruptive] when creating a mirror pod the static pod should be terminated and cleaned up due to becoming a unknown pod due to being force deleted while kubelet is not running
E2eNode Suite [It] [sig-node] Variable Expansion should allow composing env vars into new env vars [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Variable Expansion should allow substituting values in a container's args [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Variable Expansion should allow substituting values in a container's command [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-node] Variable Expansion should allow substituting values in a volume subpath [Conformance]
E2eNode Suite [It] [sig-node] Variable Expansion should fail substituting values in a volume subpath with absolute path [Slow] [Conformance]
E2eNode Suite [It] [sig-node] Variable Expansion should fail substituting values in a volume subpath with backticks [Slow] [Conformance]
E2eNode Suite [It] [sig-node] Variable Expansion should succeed in writing subpaths in container [Slow] [Conformance]
E2eNode Suite [It] [sig-node] Variable Expansion should verify that a failing subpath expansion can be modified during the lifecycle of a container [Slow] [Conformance]
E2eNode Suite [It] [sig-node] [Feature:StandaloneMode] when creating a static pod the pod should be running
E2eNode Suite [It] [sig-node] [NodeConformance] Containers Lifecycle should launch init container serially before a regular container
E2eNode Suite [It] [sig-node] [NodeConformance] Containers Lifecycle should not launch regular containers if an init container fails
E2eNode Suite [It] [sig-node] [NodeConformance] Containers Lifecycle should not launch second container before PostStart of the first container completed
E2eNode Suite [It] [sig-node] [NodeConformance] Containers Lifecycle should restart failing container when pod restartPolicy is Always
E2eNode Suite [It] [sig-node] [NodeConformance] Containers Lifecycle should run Init container to completion before call to PostStart of regular container
E2eNode Suite [It] [sig-storage] ConfigMap Should fail non-optional pod creation due to configMap object does not exist [Slow]
E2eNode Suite [It] [sig-storage] ConfigMap Should fail non-optional pod creation due to the key in the configMap object does not exist [Slow]
E2eNode Suite [It] [sig-storage] ConfigMap binary data should be reflected in volume [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] ConfigMap optional updates should be reflected in volume [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] ConfigMap should be consumable from pods in volume [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] ConfigMap should be consumable from pods in volume as non-root [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] ConfigMap should be consumable from pods in volume as non-root with FSGroup [LinuxOnly] [NodeFeature:FSGroup]
E2eNode Suite [It] [sig-storage] ConfigMap should be consumable from pods in volume as non-root with defaultMode and fsGroup set [LinuxOnly] [NodeFeature:FSGroup]
E2eNode Suite [It] [sig-storage] ConfigMap should be consumable from pods in volume with defaultMode set [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] ConfigMap should be consumable from pods in volume with mappings [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] ConfigMap should be consumable from pods in volume with mappings and Item mode set [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] ConfigMap should be consumable from pods in volume with mappings as non-root [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] ConfigMap should be consumable from pods in volume with mappings as non-root with FSGroup [LinuxOnly] [NodeFeature:FSGroup]
E2eNode Suite [It] [sig-storage] ConfigMap should be consumable in multiple volumes in the same pod [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] ConfigMap should be immutable if `immutable` field is set [Conformance]
E2eNode Suite [It] [sig-storage] ConfigMap updates should be reflected in volume [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Downward API [Serial] [Disruptive] [Feature:EphemeralStorage] Downward API tests for local ephemeral storage should provide container's limits.ephemeral-storage and requests.ephemeral-storage as env vars
E2eNode Suite [It] [sig-storage] Downward API [Serial] [Disruptive] [Feature:EphemeralStorage] Downward API tests for local ephemeral storage should provide default limits.ephemeral-storage from node allocatable
E2eNode Suite [It] [sig-storage] Downward API volume should provide container's cpu limit [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Downward API volume should provide container's cpu request [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Downward API volume should provide container's memory limit [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Downward API volume should provide container's memory request [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Downward API volume should provide node allocatable (cpu) as default cpu limit if the limit is not set [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Downward API volume should provide node allocatable (memory) as default memory limit if the limit is not set [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Downward API volume should provide podname as non-root with fsgroup [LinuxOnly] [NodeFeature:FSGroup]
E2eNode Suite [It] [sig-storage] Downward API volume should provide podname as non-root with fsgroup and defaultMode [LinuxOnly] [NodeFeature:FSGroup]
E2eNode Suite [It] [sig-storage] Downward API volume should provide podname only [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Downward API volume should set DefaultMode on files [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Downward API volume should set mode on item file [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Downward API volume should update annotations on modification [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Downward API volume should update labels on modification [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] EmptyDir volumes pod should support memory backed volumes of specified size
E2eNode Suite [It] [sig-storage] EmptyDir volumes pod should support shared volumes between containers [Conformance]
E2eNode Suite [It] [sig-storage] EmptyDir volumes should support (non-root,0644,default) [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] EmptyDir volumes should support (non-root,0644,tmpfs) [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] EmptyDir volumes should support (non-root,0666,default) [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] EmptyDir volumes should support (non-root,0666,tmpfs) [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] EmptyDir volumes should support (non-root,0777,default) [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] EmptyDir volumes should support (non-root,0777,tmpfs) [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] EmptyDir volumes should support (root,0644,default) [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] EmptyDir volumes should support (root,0644,tmpfs) [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] EmptyDir volumes should support (root,0666,default) [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] EmptyDir volumes should support (root,0666,tmpfs) [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] EmptyDir volumes should support (root,0777,default) [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] EmptyDir volumes should support (root,0777,tmpfs) [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] EmptyDir volumes volume on default medium should have the correct mode [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] EmptyDir volumes volume on tmpfs should have the correct mode [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] EmptyDir volumes when FSGroup is specified [LinuxOnly] [NodeFeature:FSGroup] files with FSGroup ownership should support (root,0644,tmpfs)
E2eNode Suite [It] [sig-storage] EmptyDir volumes when FSGroup is specified [LinuxOnly] [NodeFeature:FSGroup] new files should be created with FSGroup ownership when container is non-root
E2eNode Suite [It] [sig-storage] EmptyDir volumes when FSGroup is specified [LinuxOnly] [NodeFeature:FSGroup] new files should be created with FSGroup ownership when container is root
E2eNode Suite [It] [sig-storage] EmptyDir volumes when FSGroup is specified [LinuxOnly] [NodeFeature:FSGroup] nonexistent volume subPath should have the correct mode and owner using FSGroup
E2eNode Suite [It] [sig-storage] EmptyDir volumes when FSGroup is specified [LinuxOnly] [NodeFeature:FSGroup] volume on default medium should have the correct mode using FSGroup
E2eNode Suite [It] [sig-storage] EmptyDir volumes when FSGroup is specified [LinuxOnly] [NodeFeature:FSGroup] volume on tmpfs should have the correct mode using FSGroup
E2eNode Suite [It] [sig-storage] HostPath should give a volume the correct mode [LinuxOnly] [NodeConformance]
E2eNode Suite [It] [sig-storage] HostPath should support r/w [NodeConformance]
E2eNode Suite [It] [sig-storage] HostPath should support subPath [NodeConformance]
E2eNode Suite [It] [sig-storage] Projected combined should project all components that make up the projection API [Projection][NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Projected configMap Should fail non-optional pod creation due to configMap object does not exist [Slow]
E2eNode Suite [It] [sig-storage] Projected configMap Should fail non-optional pod creation due to the key in the configMap object does not exist [Slow]
E2eNode Suite [It] [sig-storage] Projected configMap optional updates should be reflected in volume [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Projected configMap should be consumable from pods in volume [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Projected configMap should be consumable from pods in volume as non-root [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Projected configMap should be consumable from pods in volume as non-root with FSGroup [LinuxOnly] [NodeFeature:FSGroup]
E2eNode Suite [It] [sig-storage] Projected configMap should be consumable from pods in volume as non-root with defaultMode and fsGroup set [LinuxOnly] [NodeFeature:FSGroup]
E2eNode Suite [It] [sig-storage] Projected configMap should be consumable from pods in volume with defaultMode set [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Projected configMap should be consumable from pods in volume with mappings [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Projected configMap should be consumable from pods in volume with mappings and Item mode set [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Projected configMap should be consumable from pods in volume with mappings as non-root [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Projected configMap should be consumable from pods in volume with mappings as non-root with FSGroup [LinuxOnly] [NodeFeature:FSGroup]
E2eNode Suite [It] [sig-storage] Projected configMap should be consumable in multiple volumes in the same pod [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Projected configMap updates should be reflected in volume [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Projected downwardAPI should provide container's cpu limit [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Projected downwardAPI should provide container's cpu request [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Projected downwardAPI should provide container's memory limit [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Projected downwardAPI should provide container's memory request [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Projected downwardAPI should provide node allocatable (cpu) as default cpu limit if the limit is not set [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Projected downwardAPI should provide node allocatable (memory) as default memory limit if the limit is not set [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Projected downwardAPI should provide podname as non-root with fsgroup [LinuxOnly] [NodeFeature:FSGroup]
E2eNode Suite [It] [sig-storage] Projected downwardAPI should provide podname as non-root with fsgroup and defaultMode [LinuxOnly] [NodeFeature:FSGroup]
E2eNode Suite [It] [sig-storage] Projected downwardAPI should provide podname only [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Projected downwardAPI should set DefaultMode on files [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Projected downwardAPI should set mode on item file [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Projected downwardAPI should update annotations on modification [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Projected downwardAPI should update labels on modification [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Projected secret Should fail non-optional pod creation due to secret object does not exist [Slow]
E2eNode Suite [It] [sig-storage] Projected secret Should fail non-optional pod creation due to the key in the secret object does not exist [Slow]
E2eNode Suite [It] [sig-storage] Projected secret optional updates should be reflected in volume [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Projected secret should be able to mount in a volume regardless of a different secret existing with same name in different namespace [NodeConformance]
E2eNode Suite [It] [sig-storage] Projected secret should be consumable from pods in volume [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Projected secret should be consumable from pods in volume as non-root with defaultMode and fsGroup set [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Projected secret should be consumable from pods in volume with defaultMode set [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Projected secret should be consumable from pods in volume with mappings [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Projected secret should be consumable from pods in volume with mappings and Item Mode set [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Projected secret should be consumable in multiple volumes in a pod [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Secrets Should fail non-optional pod creation due to secret object does not exist [Slow]
E2eNode Suite [It] [sig-storage] Secrets Should fail non-optional pod creation due to the key in the secret object does not exist [Slow]
E2eNode Suite [It] [sig-storage] Secrets optional updates should be reflected in volume [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Secrets should be able to mount in a volume regardless of a different secret existing with same name in different namespace [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Secrets should be consumable from pods in volume [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Secrets should be consumable from pods in volume as non-root with defaultMode and fsGroup set [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Secrets should be consumable from pods in volume with defaultMode set [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Secrets should be consumable from pods in volume with mappings [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Secrets should be consumable from pods in volume with mappings and Item Mode set [LinuxOnly] [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Secrets should be consumable in multiple volumes in a pod [NodeConformance] [Conformance]
E2eNode Suite [It] [sig-storage] Secrets should be immutable if `immutable` field is set [Conformance]
E2eNode Suite [It] [sig-storage] Volumes NFSv3 should be mountable for NFSv3
E2eNode Suite [It] [sig-storage] Volumes NFSv4 should be mountable for NFSv4