This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 5 failed / 1130 succeeded
Started2019-11-30 08:33
Elapsed20h10m
Revision
Buildergke-prow-ssd-pool-1a225945-577q
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/8ae95137-d85e-485d-b375-290638bc8a4e/targets/test'}}
podf9da9cb1-134b-11ea-9409-fa8a1cff7275
resultstorehttps://source.cloud.google.com/results/invocations/8ae95137-d85e-485d-b375-290638bc8a4e/targets/test
infra-commit48349ea19
job-versionv1.15.7-beta.0.5+e79798e593b522
master_os_imagecos-73-11647-163-0
node_os_imagecos-73-11647-163-0
podf9da9cb1-134b-11ea-9409-fa8a1cff7275
revisionv1.15.7-beta.0.5+e79798e593b522

Test Failures


Kubernetes e2e suite [k8s.io] [sig-node] Kubelet [Serial] [Slow] [k8s.io] [sig-node] regular resource usage tracking resource tracking for 0 pods per node 20m11s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-node\]\sKubelet\s\[Serial\]\s\[Slow\]\s\[k8s\.io\]\s\[sig\-node\]\sregular\sresource\susage\stracking\sresource\stracking\sfor\s0\spods\sper\snode$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/kubelet_perf.go:263
Nov 30 19:37:39.143: Memory usage exceeding limits:
 node bootstrap-e2e-minion-group-rk66:
 container "runtime": expected RSS memory (MB) < 131072000; got 157388800
node bootstrap-e2e-minion-group-w84g:
 container "runtime": expected RSS memory (MB) < 131072000; got 189362176
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/kubelet_perf.go:155
				
				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [k8s.io] [sig-node] NodeProblemDetector [DisabledForLargeClusters] should run without error 2m16s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-node\]\sNodeProblemDetector\s\[DisabledForLargeClusters\]\sshould\srun\swithout\serror$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:56
Timed out after 60.001s.
Expected success, but got an error:
    <*errors.errorString | 0xc00b75ef30>: {
        s: "expect event number 1, got 0: [{{ } {bootstrap-e2e-minion-group-lszg.15db90c7723625f1  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-lszg.15db90c7723625f1 d48756fa-0dc0-40ac-be23-696c741ae9cd 150744 0 2019-11-30 20:56:53 +0000 UTC <nil> <nil> map[] map[] [] nil []  []} {Node  bootstrap-e2e-minion-group-lszg bootstrap-e2e-minion-group-lszg   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-lszg} 2019-11-29 07:14:40 +0000 UTC 2019-11-30 20:56:53 +0000 UTC 3 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rk66.15dbfabba2044780  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rk66.15dbfabba2044780 d134aa1a-6641-4587-9778-6bfca9cb1a57 149698 0 2019-11-30 20:16:59 +0000 UTC <nil> <nil> map[] map[] [] nil []  []} {Node  bootstrap-e2e-minion-group-rk66 bootstrap-e2e-minion-group-rk66   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-rk66 status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-rk66} 2019-11-30 15:36:18 +0000 UTC 2019-11-30 20:16:58 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rk66.15dbfabba2048a9e  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rk66.15dbfabba2048a9e c0869b47-f1ff-4d7e-a9ee-137919a3e636 149697 0 2019-11-30 20:16:59 +0000 UTC <nil> <nil> map[] map[] [] nil []  []} {Node  bootstrap-e2e-minion-group-rk66 bootstrap-e2e-minion-group-rk66   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-rk66 status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-rk66} 2019-11-30 15:36:18 +0000 UTC 2019-11-30 20:16:58 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rk66.15dbfabba205161b  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rk66.15dbfabba205161b 79a308ac-a0b6-418f-b980-c9bb62b91c27 149700 0 2019-11-30 20:16:59 +0000 UTC <nil> <nil> map[] map[] [] nil []  []} {Node  bootstrap-e2e-minion-group-rk66 bootstrap-e2e-minion-group-rk66   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-rk66 status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-rk66} 2019-11-30 15:36:18 +0000 UTC 2019-11-30 20:16:58 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rk66.15dbfabbb126b706  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rk66.15dbfabbb126b706 34b22de0-cc7d-4e6b-9547-da21e83ea1e9 149699 0 2019-11-30 20:16:59 +0000 UTC <nil> <nil> map[] map[] [] nil []  []} {Node  bootstrap-e2e-minion-group-rk66 bootstrap-e2e-minion-group-rk66   } NodeReady Node bootstrap-e2e-minion-group-rk66 status is now: NodeReady {kubelet bootstrap-e2e-minion-group-rk66} 2019-11-30 15:36:18 +0000 UTC 2019-11-30 20:16:58 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rk66.15dc0a089d8a2956  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rk66.15dc0a089d8a2956 9bc3b00f-71fd-4d0e-a687-1b2ffbafb937 149694 0 2019-11-30 20:16:41 +0000 UTC <nil> <nil> map[] map[] [] nil []  []} {Node  bootstrap-e2e-minion-group-rk66 43442328-1f2f-4c3e-a8fb-d9cd88480937   } NodeNotReady Node bootstrap-e2e-minion-group-rk66 status is now: NodeNotReady {node-controller } 2019-11-30 20:16:41 +0000 UTC 2019-11-30 20:16:41 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rk66.15dc0c3aabb4a97c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rk66.15dc0c3aabb4a97c 7dfaad86-13e1-403b-8ccf-4ba40714d156 150746 0 2019-11-30 20:56:55 +0000 UTC <nil> <nil> map[] map[] [] nil []  []} {Node  bootstrap-e2e-minion-group-rk66 bootstrap-e2e-minion-group-rk66   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-rk66} 2019-11-30 20:56:55 +0000 UTC 2019-11-30 20:56:55 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rk66.15dc0c3aabb4f778  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rk66.15dc0c3aabb4f778 362fb723-a3e4-4b3e-9dac-ef7758bf960f 150745 0 2019-11-30 20:56:55 +0000 UTC <nil> <nil> map[] map[] [] nil []  []} {Node  bootstrap-e2e-minion-group-rk66 bootstrap-e2e-minion-group-rk66   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-rk66} 2019-11-30 20:56:55 +0000 UTC 2019-11-30 20:56:55 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-w84g.15db90c80a5b3b52  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-w84g.15db90c80a5b3b52 bceae078-d9fe-4357-ba80-a8ab174531da 150747 0 2019-11-30 20:56:58 +0000 UTC <nil> <nil> map[] map[] [] nil []  []} {Node  bootstrap-e2e-minion-group-w84g bootstrap-e2e-minion-group-w84g   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-w84g} 2019-11-29 07:14:43 +0000 UTC 2019-11-30 20:56:58 +0000 UTC 3 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  }]",
    }
    expect event number 1, got 0: [{{ } {bootstrap-e2e-minion-group-lszg.15db90c7723625f1  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-lszg.15db90c7723625f1 d48756fa-0dc0-40ac-be23-696c741ae9cd 150744 0 2019-11-30 20:56:53 +0000 UTC <nil> <nil> map[] map[] [] nil []  []} {Node  bootstrap-e2e-minion-group-lszg bootstrap-e2e-minion-group-lszg   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-lszg} 2019-11-29 07:14:40 +0000 UTC 2019-11-30 20:56:53 +0000 UTC 3 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rk66.15dbfabba2044780  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rk66.15dbfabba2044780 d134aa1a-6641-4587-9778-6bfca9cb1a57 149698 0 2019-11-30 20:16:59 +0000 UTC <nil> <nil> map[] map[] [] nil []  []} {Node  bootstrap-e2e-minion-group-rk66 bootstrap-e2e-minion-group-rk66   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-rk66 status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-rk66} 2019-11-30 15:36:18 +0000 UTC 2019-11-30 20:16:58 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rk66.15dbfabba2048a9e  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rk66.15dbfabba2048a9e c0869b47-f1ff-4d7e-a9ee-137919a3e636 149697 0 2019-11-30 20:16:59 +0000 UTC <nil> <nil> map[] map[] [] nil []  []} {Node  bootstrap-e2e-minion-group-rk66 bootstrap-e2e-minion-group-rk66   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-rk66 status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-rk66} 2019-11-30 15:36:18 +0000 UTC 2019-11-30 20:16:58 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rk66.15dbfabba205161b  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rk66.15dbfabba205161b 79a308ac-a0b6-418f-b980-c9bb62b91c27 149700 0 2019-11-30 20:16:59 +0000 UTC <nil> <nil> map[] map[] [] nil []  []} {Node  bootstrap-e2e-minion-group-rk66 bootstrap-e2e-minion-group-rk66   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-rk66 status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-rk66} 2019-11-30 15:36:18 +0000 UTC 2019-11-30 20:16:58 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rk66.15dbfabbb126b706  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rk66.15dbfabbb126b706 34b22de0-cc7d-4e6b-9547-da21e83ea1e9 149699 0 2019-11-30 20:16:59 +0000 UTC <nil> <nil> map[] map[] [] nil []  []} {Node  bootstrap-e2e-minion-group-rk66 bootstrap-e2e-minion-group-rk66   } NodeReady Node bootstrap-e2e-minion-group-rk66 status is now: NodeReady {kubelet bootstrap-e2e-minion-group-rk66} 2019-11-30 15:36:18 +0000 UTC 2019-11-30 20:16:58 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rk66.15dc0a089d8a2956  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rk66.15dc0a089d8a2956 9bc3b00f-71fd-4d0e-a687-1b2ffbafb937 149694 0 2019-11-30 20:16:41 +0000 UTC <nil> <nil> map[] map[] [] nil []  []} {Node  bootstrap-e2e-minion-group-rk66 43442328-1f2f-4c3e-a8fb-d9cd88480937   } NodeNotReady Node bootstrap-e2e-minion-group-rk66 status is now: NodeNotReady {node-controller } 2019-11-30 20:16:41 +0000 UTC 2019-11-30 20:16:41 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rk66.15dc0c3aabb4a97c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rk66.15dc0c3aabb4a97c 7dfaad86-13e1-403b-8ccf-4ba40714d156 150746 0 2019-11-30 20:56:55 +0000 UTC <nil> <nil> map[] map[] [] nil []  []} {Node  bootstrap-e2e-minion-group-rk66 bootstrap-e2e-minion-group-rk66   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-rk66} 2019-11-30 20:56:55 +0000 UTC 2019-11-30 20:56:55 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rk66.15dc0c3aabb4f778  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rk66.15dc0c3aabb4f778 362fb723-a3e4-4b3e-9dac-ef7758bf960f 150745 0 2019-11-30 20:56:55 +0000 UTC <nil> <nil> map[] map[] [] nil []  []} {Node  bootstrap-e2e-minion-group-rk66 bootstrap-e2e-minion-group-rk66   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-rk66} 2019-11-30 20:56:55 +0000 UTC 2019-11-30 20:56:55 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-w84g.15db90c80a5b3b52  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-w84g.15db90c80a5b3b52 bceae078-d9fe-4357-ba80-a8ab174531da 150747 0 2019-11-30 20:56:58 +0000 UTC <nil> <nil> map[] map[] [] nil []  []} {Node  bootstrap-e2e-minion-group-w84g bootstrap-e2e-minion-group-w84g   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-w84g} 2019-11-29 07:14:43 +0000 UTC 2019-11-30 20:56:58 +0000 UTC 3 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  }]
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:129
				
				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: nfs] [Testpattern: Inline-volume (default fs)] subPath should support restarting containers using directory as subpath [Slow] 7m20s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sIn\-tree\sVolumes\s\[Driver\:\snfs\]\s\[Testpattern\:\sInline\-volume\s\(default\sfs\)\]\ssubPath\sshould\ssupport\srestarting\scontainers\susing\sdirectory\sas\ssubpath\s\[Slow\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:296
Unexpected error:
    <*errors.errorString | 0xc01052f040>: {
        s: "pod \"external-provisioner-nz6mp\" was not deleted: timed out waiting for the condition",
    }
    pod "external-provisioner-nz6mp" was not deleted: timed out waiting for the condition
occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/drivers/in_tree.go:176
				
				Click to see stdout/stderrfrom junit_01.xml

Find external-provisioner-nz6mp mentions in log files | View test history on testgrid


Kubernetes e2e suite [sig-storage] [Serial] Volume metrics should create prometheus metrics for volume provisioning errors [Slow] 2m18s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\s\[Serial\]\sVolume\smetrics\sshould\screate\sprometheus\smetrics\sfor\svolume\sprovisioning\serrors\s\[Slow\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/volume_metrics.go:136
New status count 1 should be more than old count 1 for action volume_provision
Expected
    <int64>: 1
to be >
    <int64>: 1
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/volume_metrics.go:599
				
				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid


Test 20h6m

error during ./hack/ginkgo-e2e.sh --ginkgo.skip=\[Disruptive\]|\[Flaky\]|\[Feature:.+\] --clean-start=true --minStartupPods=8 --report-dir=/workspace/_artifacts --disable-log-dump=true: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 1130 Passed Tests

Show 3285 Skipped Tests