This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 2 failed / 15 succeeded
Started2022-11-24 03:09
Elapsed1h12m
Revision
Builder55d56c77-6ba5-11ed-a6da-22215f11743a
infra-commit0915cbf7b
job-versionv1.27.0-alpha.0.44+45279654db87f4
kubetest-versionv20221116-7c85504268
repok8s.io/kubernetes
repo-commit45279654db87f4908911569c07afc42804f0e246
repos{u'k8s.io/kubernetes': u'master'}
revisionv1.27.0-alpha.0.44+45279654db87f4

Test Failures


E2eNode Suite [It] [sig-node] LocalStorageSoftEviction [Slow] [Serial] [Disruptive][NodeFeature:Eviction] when we run containers that should cause DiskPressure should eventually evict all of the correct pods 4m53s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sLocalStorageSoftEviction\s\[Slow\]\s\[Serial\]\s\[Disruptive\]\[NodeFeature\:Eviction\]\swhen\swe\srun\scontainers\sthat\sshould\scause\sDiskPressure\s\sshould\seventually\sevict\sall\sof\sthe\scorrect\spods$'
test/e2e_node/eviction_test.go:563

------------------------------
This is the Progress Report generated when the timeout occurred:
  [sig-node] LocalStorageSoftEviction [Slow] [Serial] [Disruptive][NodeFeature:Eviction] when we run containers that should cause DiskPressure  should eventually evict all of the correct pods (Spec Runtime: 4m17.608s)
    test/e2e_node/eviction_test.go:563
    In [It] (Node Runtime: 3m32.527s)
      test/e2e_node/eviction_test.go:563
      At [By Step] Waiting for node to have NodeCondition: DiskPressure (Step Runtime: 3m32.527s)
        test/e2e_node/eviction_test.go:564

      Spec Goroutine
      goroutine 7909 [select]
        k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal.(*AsyncAssertion).match(0xc0003fbe30, {0x637ced8?, 0x94965b0}, 0x1, {0x0, 0x0, 0x0})
          vendor/github.com/onsi/gomega/internal/async_assertion.go:426
        k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal.(*AsyncAssertion).Should(0xc0003fbe30, {0x637ced8, 0x94965b0}, {0x0, 0x0, 0x0})
          vendor/github.com/onsi/gomega/internal/async_assertion.go:110
      > k8s.io/kubernetes/test/e2e_node.runEvictionTest.func1.2()
          test/e2e_node/eviction_test.go:571
        k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func3({0xc0004e14a0, 0x1b76080})
          vendor/github.com/onsi/ginkgo/v2/internal/node.go:449
        k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2()
          vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750
        k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode
          vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738

      Goroutines of Interest
      goroutine 1 [chan receive, 60 minutes]
        testing.(*T).Run(0xc000772ea0, {0x589af6d?, 0x52fc65?}, 0x5b28708)
          /usr/local/go/src/testing/testing.go:1494
        testing.runTests.func1(0xc000772ea0?)
          /usr/local/go/src/testing/testing.go:1846
        testing.tRunner(0xc000772ea0, 0xc000d3fbc8)
          /usr/local/go/src/testing/testing.go:1446
        testing.runTests(0xc000934b40?, {0x92a7620, 0x1, 0x1}, {0xc000c01920?, 0x4d3e5c0?, 0x0?})
          /usr/local/go/src/testing/testing.go:1844
        testing.(*M).Run(0xc000934b40)
          /usr/local/go/src/testing/testing.go:1726
      > k8s.io/kubernetes/test/e2e_node.TestMain(0xffffffffffffffff?)
          test/e2e_node/e2e_node_suite_test.go:134
        main.main()
          /tmp/go-build3641662931/b001/_testmain.go:49

      goroutine 243 [syscall, 60 minutes]
        syscall.Syscall6(0xc000c9de00?, 0x65?, 0x100?, 0xc0000a4cd8?, 0x6e511d?, 0xc0d7d6a944f888ba?, 0xc000c9de00?)
          /usr/local/go/src/syscall/syscall_linux.go:90
        os.(*Process).blockUntilWaitable(0xc001297890)
          /usr/local/go/src/os/wait_waitid.go:32
        os.(*Process).wait(0xc001297890)
          /usr/local/go/src/os/exec_unix.go:22
        os.(*Process).Wait(...)
          /usr/local/go/src/os/exec.go:132
        os/exec.(*Cmd).Wait(0xc00013b760)
          /usr/local/go/src/os/exec/exec.go:599
      > k8s.io/kubernetes/test/e2e_node/services.(*server).start.func1()
          test/e2e_node/services/server.go:166
      > k8s.io/kubernetes/test/e2e_node/services.(*server).start
          test/e2e_node/services/server.go:123
------------------------------

There were additional failures detected after the initial failure:
[TIMEDOUT]
Timedout
In [AfterEach] at: test/e2e_node/eviction_test.go:620

This is the Progress Report generated when the timeout occurred:
  [sig-node] LocalStorageSoftEviction [Slow] [Serial] [Disruptive][NodeFeature:Eviction] when we run containers that should cause DiskPressure  should eventually evict all of the correct pods (Spec Runtime: 4m47.645s)
    test/e2e_node/eviction_test.go:563
    In [AfterEach] (Node Runtime: 30.001s)
      test/e2e_node/eviction_test.go:620
      At [By Step] deleting pod: container-disk-hog-pod (Step Runtime: 30s)
        test/e2e_node/eviction_test.go:633

      Spec Goroutine
      goroutine 8454 [runnable]
        encoding/json.stateEndValue(0xc001fd64a8, 0x5d?)
          /usr/local/go/src/encoding/json/scanner.go:279
        encoding/json.(*decodeState).skip(0xc001fd6480)
          /usr/local/go/src/encoding/json/decode.go:269
        encoding/json.(*decodeState).value(0xc001fd6480, {0x0?, 0x0?, 0xc001ba2a4b?})
          /usr/local/go/src/encoding/json/decode.go:368
        encoding/json.(*decodeState).object(0xc001fd6480, {0x4888e00?, 0xc00193b680?, 0x0?})
          /usr/local/go/src/encoding/json/decode.go:775
        encoding/json.(*decodeState).value(0xc001fd6480, {0x4888e00?, 0xc00193b680?, 0x90?})
          /usr/local/go/src/encoding/json/decode.go:374
        encoding/json.(*decodeState).unmarshal(0xc001fd6480, {0x4888e00?, 0xc00193b680?})
          /usr/local/go/src/encoding/json/decode.go:181
        encoding/json.Unmarshal({0xc001ba2a00, 0x1b7f, 0x2500}, {0x4888e00, 0xc00193b680})
          /usr/local/go/src/encoding/json/decode.go:108
        k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/runtime/serializer/json.SimpleMetaFactory.Interpret({}, {0xc001ba2a00, 0x1b7f, 0x2500})
          vendor/k8s.io/apimachinery/pkg/runtime/serializer/json/meta.go:55
        k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/runtime/serializer/json.(*Serializer).Decode(0xc0000e6c30, {0xc001ba2a00, 0x1b7f, 0x2500}, 0x0, {0x6368270, 0xc00093a070?})
          vendor/k8s.io/apimachinery/pkg/runtime/serializer/json/json.go:145
        k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/runtime.WithoutVersionDecoder.Decode({{0x635a4c0?, 0xc0000e6c30?}}, {0xc001ba2a00?, 0x0?, 0x0?}, 0x0?, {0x6368270?, 0xc00093a070?})
          vendor/k8s.io/apimachinery/pkg/runtime/helper.go:252
        k8s.io/kubernetes/vendor/k8s.io/client-go/rest.Result.Into({{0xc001ba2a00, 0x1b7f, 0x2500}, {0x0, 0x0, 0x0}, {0xc001b2f9a0, 0x10}, {0x0, 0x0}, ...}, ...)
          vendor/k8s.io/client-go/rest/request.go:1315
        k8s.io/kubernetes/vendor/k8s.io/client-go/kubernetes/typed/core/v1.(*pods).List(0xc00193b320, {0x6393648, 0xc0000780a8}, {{{0x0, 0x0}, {0x0, 0x0}}, {0x0, 0x0}, {0x0, ...}, ...})
          vendor/k8s.io/client-go/kubernetes/typed/core/v1/pod.go:100
        k8s.io/kubernetes/test/e2e/framework/pod.WaitForPodToDisappear.func1()
          test/e2e/framework/pod/wait.go:639
        k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0x51ce91, 0x0})
          vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:222
        k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x6393648?, 0xc0000780a0?}, 0xc0006afb80?)
          vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:235
        k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x6393648, 0xc0000780a0}, 0xc0012c5ea8, 0xc7050a?)
          vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:662
        k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x6393648, 0xc0000780a0}, 0xd8?, 0xc6ef25?, 0x50?)
          vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:596
        k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x6393648, 0xc0000780a0}, 0x1522a05?, 0xc001f2cd28?, 0x4114c7?)
          vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528
        k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x10?, 0x0?, 0x0?)
          vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514
        k8s.io/kubernetes/test/e2e/framework/pod.WaitForPodToDisappear({0x63d4770?, 0xc000cba000}, {0xc0012db780, 0x1f}, {0xc0004e64f8, 0x16}, {0x63a2420?, 0x92a6b00}, 0x0?, 0x8bb2c97000)
          test/e2e/framework/pod/wait.go:636
        k8s.io/kubernetes/test/e2e/framework/pod.(*PodClient).DeleteSync(0xc00207f770, {0xc0004e64f8, 0x16}, {{{0x0, 0x0}, {0x0, 0x0}}, 0x0, 0x0, 0x0, ...}, ...)
          test/e2e/framework/pod/pod_client.go:185
      > k8s.io/kubernetes/test/e2e_node.runEvictionTest.func1.3()
          test/e2e_node/eviction_test.go:634
        k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func3({0x97b4ae, 0xc000e74900})
          vendor/github.com/onsi/ginkgo/v2/internal/node.go:449
        k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2()
          vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750
        k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode
          vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738

      Goroutines of Interest
      goroutine 1 [chan receive, 60 minutes]
        testing.(*T).Run(0xc000772ea0, {0x589af6d?, 0x52fc65?}, 0x5b28708)
          /usr/local/go/src/testing/testing.go:1494
        testing.runTests.func1(0xc000772ea0?)
          /usr/local/go/src/testing/testing.go:1846
        testing.tRunner(0xc000772ea0, 0xc000d3fbc8)
          /usr/local/go/src/testing/testing.go:1446
        testing.runTests(0xc000934b40?, {0x92a7620, 0x1, 0x1}, {0xc000c01920?, 0x4d3e5c0?, 0x0?})
          /usr/local/go/src/testing/testing.go:1844
        testing.(*M).Run(0xc000934b40)
          /usr/local/go/src/testing/testing.go:1726
      > k8s.io/kubernetes/test/e2e_node.TestMain(0xffffffffffffffff?)
          test/e2e_node/e2e_node_suite_test.go:134
        main.main()
          /tmp/go-build3641662931/b001/_testmain.go:49

      goroutine 243 [syscall, 60 minutes]
        syscall.Syscall6(0xc000c9de00?, 0x65?, 0x100?, 0xc0000a4cd8?, 0x6e511d?, 0xc0d7d6a944f888ba?, 0xc000c9de00?)
          /usr/local/go/src/syscall/syscall_linux.go:90
        os.(*Process).blockUntilWaitable(0xc001297890)
          /usr/local/go/src/os/wait_waitid.go:32
        os.(*Process).wait(0xc001297890)
          /usr/local/go/src/os/exec_unix.go:22
        os.(*Process).Wait(...)
          /usr/local/go/src/os/exec.go:132
        os/exec.(*Cmd).Wait(0xc00013b760)
          /usr/local/go/src/os/exec/exec.go:599
      > k8s.io/kubernetes/test/e2e_node/services.(*server).start.func1()
          test/e2e_node/services/server.go:166
      > k8s.io/kubernetes/test/e2e_node/services.(*server).start
          test/e2e_node/services/server.go:123

      goroutine 7909 [sync.Cond.Wait]
        sync.runtime_notifyListWait(0xc001957b48, 0x0)
          /usr/local/go/src/runtime/sema.go:517
        sync.(*Cond).Wait(0x9658c6?)
          /usr/local/go/src/sync/cond.go:70
        k8s.io/kubernetes/vendor/golang.org/x/net/http2.(*pipe).Read(0xc001957b30, {0xc001ba6d5d, 0x6a3, 0x6a3})
          vendor/golang.org/x/net/http2/pipe.go:76
        k8s.io/kubernetes/vendor/golang.org/x/net/http2.transportResponseBody.Read({0xc001bf3bc0?}, {0xc001ba6d5d?, 0xc001fd61b0?, 0xc001f30a60?})
          vendor/golang.org/x/net/http2/transport.go:2439
        io.ReadAll({0x7f0ef4104fb8, 0xc001957b00})
          /usr/local/go/src/io/io.go:661
        k8s.io/kubernetes/vendor/k8s.io/client-go/rest.(*Request).transformResponse(0xc001b76800, 0xc001fd61b0, 0xc001b76a00)
          vendor/k8s.io/client-go/rest/request.go:1040
        k8s.io/kubernetes/vendor/k8s.io/client-go/rest.(*Request).Do.func1(0xc0016cf000?, 0x0?)
          vendor/k8s.io/client-go/rest/request.go:1006
        k8s.io/kubernetes/vendor/k8s.io/client-go/rest.(*Request).request.func3.1(...)
          vendor/k8s.io/client-go/rest/request.go:981
        k8s.io/kubernetes/vendor/k8s.io/client-go/rest.(*Request).request.func3(0xc001fd61b0, 0xc001f30cb0, {0x6395b78?, 0xc0016cf000?}, 0x0?, 0x0?, 0x8?, {0x0?, 0x0?}, 0x5b2d2c0)
          vendor/k8s.io/client-go/rest/request.go:988
        k8s.io/kubernetes/vendor/k8s.io/client-go/rest.(*Request).request(0xc001b76800, {0x6393648, 0xc0000780a8}, 0x0?)
          vendor/k8s.io/client-go/rest/request.go:990
        k8s.io/kubernetes/vendor/k8s.io/client-go/rest.(*Request).Do(0xc001b76800, {0x6393648, 0xc0000780a8})
          vendor/k8s.io/client-go/rest/request.go:1005
        k8s.io/kubernetes/vendor/k8s.io/client-go/kubernetes/typed/core/v1.(*nodes).List(0xc001551440, {0x6393648, 0xc0000780a8}, {{{0x0, 0x0}, {0x0, 0x0}}, {0x0, 0x0}, {0xc001df6948, ...}, ...})
          vendor/k8s.io/client-go/kubernetes/typed/core/v1/node.go:93
        k8s.io/kubernetes/test/e2e/framework/node.waitListSchedulableNodes.func1()
          test/e2e/framework/node/wait.go:179
        k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0x18, 0xc00009a800})
          vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:222
        k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x6393648?, 0xc0000780a0?}, 0xc001f31190?)
          vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:235
        k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x6393648, 0xc0000780a0}, 0xd0?, 0xc6ef25?, 0x28?)
          vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:582
        k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x6393648, 0xc0000780a0}, 0xc001df6918?, 0xc001f31220?, 0x4114c7?)
          vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528
        k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x5949725?, 0x27?, 0x633ec38?)
          vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514
        k8s.io/kubernetes/test/e2e/framework/node.waitListSchedulableNodes({0x63d4770?, 0xc000cba000})
          test/e2e/framework/node/wait.go:178
        k8s.io/kubernetes/test/e2e/framework/node.checkWaitListSchedulableNodes({0x63d4770?, 0xc000cba000?})
          test/e2e/framework/node/wait.go:194
        k8s.io/kubernetes/test/e2e/framework/node.GetReadySchedulableNodes({0x63d4770?, 0xc000cba000?})
          test/e2e/framework/node/resource.go:336
      > k8s.io/kubernetes/test/e2e_node.getLocalNode(0xc001bf38f0?)
          test/e2e_node/util.go:253
      > k8s.io/kubernetes/test/e2e_node.hasNodeCondition(0x0?, {0x589d941, 0xc})
          test/e2e_node/eviction_test.go:826
      > k8s.io/kubernetes/test/e2e_node.runEvictionTest.func1.2.1()
          test/e2e_node/eviction_test.go:567
        reflect.Value.call({0x49682a0?, 0xc001455680?, 0x60?}, {0x5889234, 0x4}, {0x94965b0, 0x0, 0x0?})
          /usr/local/go/src/reflect/value.go:584
        reflect.Value.Call({0x49682a0?, 0xc001455680?, 0x1?}, {0x94965b0?, 0x0?, 0xc00009ac00?})
          /usr/local/go/src/reflect/value.go:368
        k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal.(*AsyncAssertion).buildActualPoller.func3()
          vendor/github.com/onsi/gomega/internal/async_assertion.go:269
        k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal.(*AsyncAssertion).match(0xc0003fbe30, {0x637ced8?, 0x94965b0}, 0x1, {0x0, 0x0, 0x0})
          vendor/github.com/onsi/gomega/internal/async_assertion.go:428
        k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal.(*AsyncAssertion).Should(0xc0003fbe30, {0x637ced8, 0x94965b0}, {0x0, 0x0, 0x0})
          vendor/github.com/onsi/gomega/internal/async_assertion.go:110
      > k8s.io/kubernetes/test/e2e_node.runEvictionTest.func1.2()
          test/e2e_node/eviction_test.go:571
        k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func3({0xc0004e14a0, 0x1b76080})
          vendor/github.com/onsi/ginkgo/v2/internal/node.go:449
        k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2()
          vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750
        k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode
          vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738

				from junit_ubuntu01.xml

Filter through log files | View test history on testgrid


kubetest Node Tests 1h10m

error during go run /go/src/k8s.io/kubernetes/test/e2e_node/runner/remote/run_remote.go --cleanup -vmodule=*=4 --ssh-env=gce --results-dir=/workspace/_artifacts --project=k8s-infra-e2e-boskos-001 --zone=us-west1-b --ssh-user=prow --ssh-key=/workspace/.ssh/google_compute_engine --ginkgo-flags=--nodes=1 --focus="\[NodeFeature:Eviction\]" --test_args=--feature-gates=LocalStorageCapacityIsolation=true --container-runtime-endpoint=unix:///run/containerd/containerd.sock --container-runtime-process-name=/usr/bin/containerd --container-runtime-pid-file= --kubelet-flags="--cgroups-per-qos=true --cgroup-root=/ --runtime-cgroups=/system.slice/containerd.service" --extra-log="{\"name\": \"containerd.log\", \"journalctl\": [\"-u\", \"containerd*\"]}" --test-timeout=5h0m0s --image-config-file=/workspace/test-infra/jobs/e2e_node/containerd/image-config-serial.yaml: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 15 Passed Tests

Show 381 Skipped Tests