This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 4 failed / 15 succeeded
Started2022-11-19 19:30
Elapsed1h13m
Revision
Builder9a59fe07-6840-11ed-bcbb-8a04251da9db
infra-commita4ef5ddcb
job-versionv1.27.0-alpha.0.32+57eb5d631ccd61
kubetest-versionv20221116-7c85504268
repok8s.io/kubernetes
repo-commit57eb5d631ccd615cd161b6da36afc759af004b93
repos{u'k8s.io/kubernetes': u'master'}
revisionv1.27.0-alpha.0.32+57eb5d631ccd61

Test Failures

E2eNode Suite [It] [sig-node] InodeEviction [Slow] [Serial] [Disruptive][NodeFeature:Eviction] when we run containers that should cause DiskPressure should eventually evict all of the correct pods 4m15s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sInodeEviction\s\[Slow\]\s\[Serial\]\s\[Disruptive\]\[NodeFeature\:Eviction\]\swhen\swe\srun\scontainers\sthat\sshould\scause\sDiskPressure\s\sshould\seventually\sevict\sall\sof\sthe\scorrect\spods$'
test/e2e_node/eviction_test.go:563

------------------------------
This is the Progress Report generated when the timeout occurred:
  [sig-node] InodeEviction [Slow] [Serial] [Disruptive][NodeFeature:Eviction] when we run containers that should cause DiskPressure  should eventually evict all of the correct pods (Spec Runtime: 3m40.166s)
    test/e2e_node/eviction_test.go:563
    In [It] (Node Runtime: 3m1.268s)
      test/e2e_node/eviction_test.go:563
      At [By Step] Waiting for node to have NodeCondition: DiskPressure (Step Runtime: 3m1.268s)
        test/e2e_node/eviction_test.go:564

      Spec Goroutine
      goroutine 7923 [select]
        k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal.(*AsyncAssertion).match(0xc000617a40, {0x637ced8?, 0x94965b0}, 0x1, {0x0, 0x0, 0x0})
          vendor/github.com/onsi/gomega/internal/async_assertion.go:426
        k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal.(*AsyncAssertion).Should(0xc000617a40, {0x637ced8, 0x94965b0}, {0x0, 0x0, 0x0})
          vendor/github.com/onsi/gomega/internal/async_assertion.go:110
      > k8s.io/kubernetes/test/e2e_node.runEvictionTest.func1.2()
          test/e2e_node/eviction_test.go:571
        k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func3({0xc001de3368, 0x1b76080})
          vendor/github.com/onsi/ginkgo/v2/internal/node.go:449
        k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2()
          vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750
        k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode
          vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738

      Goroutines of Interest
      goroutine 1 [chan receive, 60 minutes]
        testing.(*T).Run(0xc00097f520, {0x589af6d?, 0x52fc65?}, 0x5b28708)
          /usr/local/go/src/testing/testing.go:1494
        testing.runTests.func1(0xc00097f520?)
          /usr/local/go/src/testing/testing.go:1846
        testing.tRunner(0xc00097f520, 0xc000bffbc8)
          /usr/local/go/src/testing/testing.go:1446
        testing.runTests(0xc00093fe00?, {0x92a7620, 0x1, 0x1}, {0xc000ddf380?, 0x4d3e5c0?, 0x0?})
          /usr/local/go/src/testing/testing.go:1844
        testing.(*M).Run(0xc00093fe00)
          /usr/local/go/src/testing/testing.go:1726
      > k8s.io/kubernetes/test/e2e_node.TestMain(0xffffffffffffffff?)
          test/e2e_node/e2e_node_suite_test.go:134
        main.main()
          /tmp/go-build3634201998/b001/_testmain.go:49

      goroutine 222 [syscall, 60 minutes]
        syscall.Syscall6(0xc000fd6400?, 0x65?, 0x100?, 0xc0000a9cd8?, 0x6e511d?, 0xc0d66a5cb719158d?, 0xc000fd6400?)
          /usr/local/go/src/syscall/syscall_linux.go:90
        os.(*Process).blockUntilWaitable(0xc000e6fe90)
          /usr/local/go/src/os/wait_waitid.go:32
        os.(*Process).wait(0xc000e6fe90)
          /usr/local/go/src/os/exec_unix.go:22
        os.(*Process).Wait(...)
          /usr/local/go/src/os/exec.go:132
        os/exec.(*Cmd).Wait(0xc0004ddb80)
          /usr/local/go/src/os/exec/exec.go:599
      > k8s.io/kubernetes/test/e2e_node/services.(*server).start.func1()
          test/e2e_node/services/server.go:166
      > k8s.io/kubernetes/test/e2e_node/services.(*server).start
          test/e2e_node/services/server.go:123
------------------------------

There were additional failures detected after the initial failure:
[TIMEDOUT]
Timedout
In [AfterEach] at: test/e2e_node/eviction_test.go:620

This is the Progress Report generated when the timeout occurred:
  [sig-node] InodeEviction [Slow] [Serial] [Disruptive][NodeFeature:Eviction] when we run containers that should cause DiskPressure  should eventually evict all of the correct pods (Spec Runtime: 4m10.238s)
    test/e2e_node/eviction_test.go:563
    In [AfterEach] (Node Runtime: 30.001s)
      test/e2e_node/eviction_test.go:620
      At [By Step] checking eviction ordering and ensuring important pods don't fail (Step Runtime: 2.013s)
        test/e2e_node/eviction_test.go:700

      Spec Goroutine
      goroutine 7923 [runnable]
        k8s.io/kubernetes/vendor/github.com/prometheus/common/expfmt.(*TextParser).readingMetricName(0xc000dc60e0)
          vendor/github.com/prometheus/common/expfmt/text_parse.go:235
        k8s.io/kubernetes/vendor/github.com/prometheus/common/expfmt.(*TextParser).TextToMetricFamilies(0xc000dc60e0, {0x635c9c0?, 0xc001ec9040?})
          vendor/github.com/prometheus/common/expfmt/text_parse.go:102
        k8s.io/kubernetes/vendor/github.com/prometheus/common/expfmt.(*textDecoder).Decode(0xc000dc60d0, 0xc0019609b8)
          vendor/github.com/prometheus/common/expfmt/decode.go:127
        k8s.io/kubernetes/vendor/github.com/prometheus/common/expfmt.(*SampleDecoder).Decode(0xc0019609a0, 0xc000b43278)
          vendor/github.com/prometheus/common/expfmt/decode.go:158
        k8s.io/kubernetes/vendor/k8s.io/component-base/metrics/testutil.ParseMetrics({0xc001bb0000, 0x1edcd}, 0xc000b43328)
          vendor/k8s.io/component-base/metrics/testutil/metrics.go:81
        k8s.io/kubernetes/test/e2e/framework/metrics.parseKubeletMetrics({0xc001bb0000, 0x1edcd})
          test/e2e/framework/metrics/kubelet_metrics.go:87
        k8s.io/kubernetes/test/e2e/framework/metrics.GrabKubeletMetricsWithoutProxy({0xc0020a20c0?, 0x5?}, {0x5890bdf, 0x8})
          test/e2e/framework/metrics/kubelet_metrics.go:82
      > k8s.io/kubernetes/test/e2e_node.logKubeletLatencyMetrics({0xc000b43538, 0x1, 0x589a88d?})
          test/e2e_node/util.go:280
      > k8s.io/kubernetes/test/e2e_node.runEvictionTest.func1.2.2()
          test/e2e_node/eviction_test.go:582
        reflect.Value.call({0x49682a0?, 0xc001ccc200?, 0x60?}, {0x5889234, 0x4}, {0x94965b0, 0x0, 0x0?})
          /usr/local/go/src/reflect/value.go:584
        reflect.Value.Call({0x49682a0?, 0xc001ccc200?, 0x1?}, {0x94965b0?, 0x0?, 0xc0013edc00?})
          /usr/local/go/src/reflect/value.go:368
        k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal.(*AsyncAssertion).buildActualPoller.func3()
          vendor/github.com/onsi/gomega/internal/async_assertion.go:269
        k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal.(*AsyncAssertion).match(0xc0005abdc0, {0x637ced8?, 0x94965b0}, 0x1, {0x0, 0x0, 0x0})
          vendor/github.com/onsi/gomega/internal/async_assertion.go:428
        k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal.(*AsyncAssertion).Should(0xc0005abdc0, {0x637ced8, 0x94965b0}, {0x0, 0x0, 0x0})
          vendor/github.com/onsi/gomega/internal/async_assertion.go:110
      > k8s.io/kubernetes/test/e2e_node.runEvictionTest.func1.2()
          test/e2e_node/eviction_test.go:585
        k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func3({0xc001de3368, 0x1b76080})
          vendor/github.com/onsi/ginkgo/v2/internal/node.go:449
        k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2()
          vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750
        k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode
          vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738

      Goroutines of Interest
      goroutine 1 [chan receive, 60 minutes]
        testing.(*T).Run(0xc00097f520, {0x589af6d?, 0x52fc65?}, 0x5b28708)
          /usr/local/go/src/testing/testing.go:1494
        testing.runTests.func1(0xc00097f520?)
          /usr/local/go/src/testing/testing.go:1846
        testing.tRunner(0xc00097f520, 0xc000bffbc8)
          /usr/local/go/src/testing/testing.go:1446
        testing.runTests(0xc00093fe00?, {0x92a7620, 0x1, 0x1}, {0xc000ddf380?, 0x4d3e5c0?, 0x0?})
          /usr/local/go/src/testing/testing.go:1844
        testing.(*M).Run(0xc00093fe00)
          /usr/local/go/src/testing/testing.go:1726
      > k8s.io/kubernetes/test/e2e_node.TestMain(0xffffffffffffffff?)
          test/e2e_node/e2e_node_suite_test.go:134
        main.main()
          /tmp/go-build3634201998/b001/_testmain.go:49

      goroutine 222 [syscall, 60 minutes]
        syscall.Syscall6(0xc000fd6400?, 0x65?, 0x100?, 0xc0000a9cd8?, 0x6e511d?, 0xc0d66a5cb719158d?, 0xc000fd6400?)
          /usr/local/go/src/syscall/syscall_linux.go:90
        os.(*Process).blockUntilWaitable(0xc000e6fe90)
          /usr/local/go/src/os/wait_waitid.go:32
        os.(*Process).wait(0xc000e6fe90)
          /usr/local/go/src/os/exec_unix.go:22
        os.(*Process).Wait(...)
          /usr/local/go/src/os/exec.go:132
        os/exec.(*Cmd).Wait(0xc0004ddb80)
          /usr/local/go/src/os/exec/exec.go:599
      > k8s.io/kubernetes/test/e2e_node/services.(*server).start.func1()
          test/e2e_node/services/server.go:166
      > k8s.io/kubernetes/test/e2e_node/services.(*server).start
          test/e2e_node/services/server.go:123

      goroutine 8349 [select]
        k8s.io/kubernetes/vendor/golang.org/x/net/http2.(*ClientConn).RoundTrip(0xc000ac8c00, 0xc000de2900)
          vendor/golang.org/x/net/http2/transport.go:1200
        k8s.io/kubernetes/vendor/golang.org/x/net/http2.(*Transport).RoundTripOpt(0xc000e81f00, 0xc000de2900, {0x60?})
          vendor/golang.org/x/net/http2/transport.go:519
        k8s.io/kubernetes/vendor/golang.org/x/net/http2.(*Transport).RoundTrip(...)
          vendor/golang.org/x/net/http2/transport.go:480
        k8s.io/kubernetes/vendor/golang.org/x/net/http2.noDialH2RoundTripper.RoundTrip({0xc001528a00?}, 0xc000de2900?)
          vendor/golang.org/x/net/http2/transport.go:3020
        net/http.(*Transport).roundTrip(0xc001528a00, 0xc000de2900)
          /usr/local/go/src/net/http/transport.go:540
        net/http.(*Transport).RoundTrip(0x529b5c0?, 0xc001959170?)
          /usr/local/go/src/net/http/roundtrip.go:17
        k8s.io/kubernetes/vendor/k8s.io/client-go/transport.(*bearerAuthRoundTripper).RoundTrip(0xc001ff43c0, 0xc000de2700)
          vendor/k8s.io/client-go/transport/round_trippers.go:317
        k8s.io/kubernetes/vendor/k8s.io/client-go/transport.(*userAgentRoundTripper).RoundTrip(0xc0020a0220, 0xc000de2600)
          vendor/k8s.io/client-go/transport/round_trippers.go:168
        net/http.send(0xc000de2600, {0x635bba0, 0xc0020a0220}, {0x5792d20?, 0x1?, 0x0?})
          /usr/local/go/src/net/http/client.go:251
        net/http.(*Client).send(0xc001ff43f0, 0xc000de2600, {0x7f8bb5d7b5b8?, 0x100?, 0x0?})
          /usr/local/go/src/net/http/client.go:175
        net/http.(*Client).do(0xc001ff43f0, 0xc000de2600)
          /usr/local/go/src/net/http/client.go:715
        net/http.(*Client).Do(...)
          /usr/local/go/src/net/http/client.go:581
        k8s.io/kubernetes/vendor/k8s.io/client-go/rest.(*Request).request(0xc000de2400, {0x6393648, 0xc0000780a8}, 0x0?)
          vendor/k8s.io/client-go/rest/request.go:964
        k8s.io/kubernetes/vendor/k8s.io/client-go/rest.(*Request).Do(0xc000de2400, {0x6393648, 0xc0000780a8})
          vendor/k8s.io/client-go/rest/request.go:1005
        k8s.io/kubernetes/vendor/k8s.io/client-go/kubernetes/typed/core/v1.(*pods).List(0xc001a058e0, {0x6393648, 0xc0000780a8}, {{{0x0, 0x0}, {0x0, 0x0}}, {0x0, 0x0}, {0x0, ...}, ...})
          vendor/k8s.io/client-go/kubernetes/typed/core/v1/pod.go:99
        k8s.io/kubernetes/test/e2e/framework/pod.WaitForPodToDisappear.func1()
          test/e2e/framework/pod/wait.go:639
        k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0x51ce91, 0x0})
          vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:222
        k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x6393648?, 0xc0000780a0?}, 0xc0021998b0?)
          vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:235
        k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x6393648, 0xc0000780a0}, 0xc001cee930, 0xc7050a?)
          vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:662
        k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x6393648, 0xc0000780a0}, 0xd8?, 0xc6ef25?, 0x50?)
          vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:596
        k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x6393648, 0xc0000780a0}, 0x1522a05?, 0xc0007e4d28?, 0x4114c7?)
          vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528
        k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x10?, 0x0?, 0x0?)
          vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514
        k8s.io/kubernetes/test/e2e/framework/pod.WaitForPodToDisappear({0x63d4770?, 0xc001825d40}, {0xc001b9e600, 0x18}, {0xc0001344b0, 0x17}, {0x63a2420?, 0x92a6b00}, 0x0?, 0x8bb2c97000)
          test/e2e/framework/pod/wait.go:636
        k8s.io/kubernetes/test/e2e/framework/pod.(*PodClient).DeleteSync(0xc0015b3998, {0xc0001344b0, 0x17}, {{{0x0, 0x0}, {0x0, 0x0}}, 0x0, 0x0, 0x0, ...}, ...)
          test/e2e/framework/pod/pod_client.go:185
      > k8s.io/kubernetes/test/e2e_node.runEvictionTest.func1.3()
          test/e2e_node/eviction_test.go:634
        k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func3({0x97b4ae, 0xc001ba8600})
          vendor/github.com/onsi/ginkgo/v2/internal/node.go:449
        k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2()
          vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750
        k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode
          vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738

				from junit_ubuntu01.xml

Filter through log files | View test history on testgrid

E2eNode Suite [It] [sig-node] LocalStorageSoftEviction [Slow] [Serial] [Disruptive][NodeFeature:Eviction] when we run containers that should cause DiskPressure should eventually evict all of the correct pods 20m15s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sLocalStorageSoftEviction\s\[Slow\]\s\[Serial\]\s\[Disruptive\]\[NodeFeature\:Eviction\]\swhen\swe\srun\scontainers\sthat\sshould\scause\sDiskPressure\s\sshould\seventually\sevict\sall\sof\sthe\scorrect\spods$'
test/e2e_node/eviction_test.go:739
k8s.io/kubernetes/test/e2e_node.verifyEvictionOrdering(0xc000e65c20, {0xc000ddfe30, 0x2, 0xc00159aa80?})
	test/e2e_node/eviction_test.go:739 +0x639
k8s.io/kubernetes/test/e2e_node.runEvictionTest.func1.2.4()
	test/e2e_node/eviction_test.go:613 +0x15e
reflect.Value.call({0x49682a0?, 0xc001ed9cc0?, 0x60?}, {0x5889234, 0x4}, {0x94965b0, 0x0, 0x19?})
	/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x49682a0?, 0xc001ed9cc0?, 0xc000086500?}, {0x94965b0?, 0x41117f?, 0xc001596000?})
	/usr/local/go/src/reflect/value.go:368 +0xbc
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal.(*AsyncAssertion).buildActualPoller.func3()
	vendor/github.com/onsi/gomega/internal/async_assertion.go:269 +0x13a
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal.(*AsyncAssertion).match(0xc001fe97a0, {0x637ced8?, 0x94965b0}, 0x1, {0x0, 0x0, 0x0})
	vendor/github.com/onsi/gomega/internal/async_assertion.go:341 +0x165
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal.(*AsyncAssertion).Should(0xc001fe97a0, {0x637ced8, 0x94965b0}, {0x0, 0x0, 0x0})
	vendor/github.com/onsi/gomega/internal/async_assertion.go:110 +0x8d
k8s.io/kubernetes/test/e2e_node.runEvictionTest.func1.2()
	test/e2e_node/eviction_test.go:614 +0x716
				
				Click to see stdout/stderrfrom junit_ubuntu01.xml

Filter through log files | View test history on testgrid

E2eNode Suite [SynchronizedAfterSuite] 6.39s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[SynchronizedAfterSuite\]$'
test/e2e/framework/pod/pod_client.go:186
k8s.io/kubernetes/test/e2e/framework/pod.(*PodClient).DeleteSync(0xc00150e360, {0xc0001344c8, 0x14}, {{{0x0, 0x0}, {0x0, 0x0}}, 0x0, 0x0, 0x0, ...}, ...)
	test/e2e/framework/pod/pod_client.go:186 +0x2b7
k8s.io/kubernetes/test/e2e_node.runEvictionTest.func1.3()
	test/e2e_node/eviction_test.go:634 +0x845
				
				Click to see stdout/stderrfrom junit_ubuntu01.xml

Filter through log files | View test history on testgrid

kubetest Node Tests 1h11m

error during go run /go/src/k8s.io/kubernetes/test/e2e_node/runner/remote/run_remote.go --cleanup -vmodule=*=4 --ssh-env=gce --results-dir=/workspace/_artifacts --project=k8s-infra-e2e-boskos-105 --zone=us-west1-b --ssh-user=prow --ssh-key=/workspace/.ssh/google_compute_engine --ginkgo-flags=--nodes=1 --focus="\[NodeFeature:Eviction\]" --test_args=--feature-gates=LocalStorageCapacityIsolation=true --container-runtime-endpoint=unix:///run/containerd/containerd.sock --container-runtime-process-name=/usr/bin/containerd --container-runtime-pid-file= --kubelet-flags="--cgroups-per-qos=true --cgroup-root=/ --runtime-cgroups=/system.slice/containerd.service" --extra-log="{\"name\": \"containerd.log\", \"journalctl\": [\"-u\", \"containerd*\"]}" --test-timeout=5h0m0s --image-config-file=/workspace/test-infra/jobs/e2e_node/containerd/image-config-serial.yaml: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid

Show 15 Passed Tests
Show 379 Skipped Tests