This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 30 failed / 514 succeeded
Started2020-02-04 21:27
Elapsed15h15m
Revision
Buildergke-prow-default-pool-cf4891d4-fcrh
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/b26842dd-1f94-4886-afef-9ed418414504/targets/test'}}
pod07bc3dd2-4795-11ea-b8d7-32e01c04da64
resultstorehttps://source.cloud.google.com/results/invocations/b26842dd-1f94-4886-afef-9ed418414504/targets/test
infra-commit7e8cd997a
job-versionv1.15.10-beta.0.15+e91de4083dbd87
master_os_imagecos-73-11647-163-0
node_os_imagecos-73-11647-163-0
pod07bc3dd2-4795-11ea-b8d7-32e01c04da64
revisionv1.15.10-beta.0.15+e91de4083dbd87

Test Failures


Kubernetes e2e suite [k8s.io] Probing container should *not* be restarted with a non-local redirect http liveness probe 14m8s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sProbing\scontainer\sshould\s\*not\*\sbe\srestarted\swith\sa\snon\-local\sredirect\shttp\sliveness\sprobe$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:151
Feb  5 09:00:48.704: Couldn't delete ns: "container-probe-9362": namespace container-probe-9362 was not deleted with limit: timed out waiting for the condition, namespace is empty but is not yet removed (&errors.errorString{s:"namespace container-probe-9362 was not deleted with limit: timed out waiting for the condition, namespace is empty but is not yet removed"})
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:335
				
				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [sig-apps] Job should run a job to completion when tasks sometimes fail and are not locally restarted 10m15s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-apps\]\sJob\sshould\srun\sa\sjob\sto\scompletion\swhen\stasks\ssometimes\sfail\sand\sare\snot\slocally\srestarted$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:151
Feb  5 11:38:02.574: Couldn't delete ns: "job-7632": namespace job-7632 was not deleted with limit: timed out waiting for the condition, namespace is empty but is not yet removed (&errors.errorString{s:"namespace job-7632 was not deleted with limit: timed out waiting for the condition, namespace is empty but is not yet removed"})
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:335
				
				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [sig-cli] Kubectl client [k8s.io] Kubectl taint [Serial] should remove all the taints with the same key off a node 10m12s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-cli\]\sKubectl\sclient\s\[k8s\.io\]\sKubectl\staint\s\[Serial\]\sshould\sremove\sall\sthe\staints\swith\sthe\ssame\skey\soff\sa\snode$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:151
Feb  5 08:11:11.553: Couldn't delete ns: "kubectl-4364": namespace kubectl-4364 was not deleted with limit: timed out waiting for the condition, namespace is empty but is not yet removed (&errors.errorString{s:"namespace kubectl-4364 was not deleted with limit: timed out waiting for the condition, namespace is empty but is not yet removed"})
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:335
				
				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [sig-cluster-lifecycle] Restart [Disruptive] should restart all nodes and ensure all nodes and pods recover 17m10s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-cluster\-lifecycle\]\sRestart\s\[Disruptive\]\sshould\srestart\sall\snodes\sand\sensure\sall\snodes\sand\spods\srecover$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/restart.go:86
Feb  5 07:40:51.159: At least one pod wasn't running and ready after the restart.
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/restart.go:115
				
				Click to see stdout/stderrfrom junit_01.xml

Find wasnt mentions in log files | View test history on testgrid


Kubernetes e2e suite [sig-cluster-lifecycle] Upgrade [Feature:Upgrade] master upgrade should maintain a functioning cluster [Feature:MasterUpgrade] 22m37s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-cluster\-lifecycle\]\sUpgrade\s\[Feature\:Upgrade\]\smaster\supgrade\sshould\smaintain\sa\sfunctioning\scluster\s\[Feature\:MasterUpgrade\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/cluster_upgrade.go:91
Feb  4 21:47:11.043: Unexpected error:
    <*errors.errorString | 0xc002a899e0>: {
        s: "error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.16.7-beta.0.23+0a70c2fa6d4642]; got error exit status 1, stdout \"Fetching the previously installed CoreDNS version\\n\\n***WARNING***\\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\\nbefore running this script:\\n\\n# example: pin to etcd v3.0.17\\nexport ETCD_IMAGE=3.0.17\\nexport ETCD_VERSION=3.0.17\\n\\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\\n\\n== Pre-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.15.10-beta.0.15+e91de4083dbd87\\\"\\nname: \\\"bootstrap-e2e-minion-group-32cf\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.15.10-beta.0.15+e91de4083dbd87\\\"\\nname: \\\"bootstrap-e2e-minion-group-h1mw\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.15.10-beta.0.15+e91de4083dbd87\\\"\\nname: \\\"bootstrap-e2e-minion-group-t6x3\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.15.10-beta.0.15+e91de4083dbd87\\\"\\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.16.7-beta.0.23+0a70c2fa6d4642/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\\n== Upgrading master environment variables. ==\\n== Waiting for new master to respond to API requests ==\\n......................== Done ==\\nWaiting for CoreDNS to update\\nFetching the latest installed CoreDNS version\\n== Downloading the CoreDNS migration tool ==\\n== Upgrading the CoreDNS ConfigMap ==\\nconfigmap/coredns configured\\n== The CoreDNS Config has been updated ==\\n== Validating cluster post-upgrade ==\\nValidating gce cluster, MULTIZONE=\\nFound 4 node(s).\\nNAME                              STATUS                     ROLES    AGE   VERSION\\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   11m   v1.16.7-beta.0.23+0a70c2fa6d4642\\nbootstrap-e2e-minion-group-32cf   Ready                      <none>   11m   v1.15.10-beta.0.15+e91de4083dbd87\\nbootstrap-e2e-minion-group-h1mw   Ready                      <none>   11m   v1.15.10-beta.0.15+e91de4083dbd87\\nbootstrap-e2e-minion-group-t6x3   Ready                      <none>   11m   v1.15.10-beta.0.15+e91de4083dbd87\\nValidate output:\\nNAME                 AGE\\ncontroller-manager   <unknown>\\nscheduler            <unknown>\\netcd-1               <unknown>\\netcd-0               <unknown>\\n\\x1b[0;32mCluster validation succeeded\\x1b[0m\\n== Post-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.7-beta.0.23+0a70c2fa6d4642\\\"\\nname: \\\"bootstrap-e2e-minion-group-32cf\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.15.10-beta.0.15+e91de4083dbd87\\\"\\nname: \\\"bootstrap-e2e-minion-group-h1mw\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.15.10-beta.0.15+e91de4083dbd87\\\"\\nname: \\\"bootstrap-e2e-minion-group-t6x3\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.15.10-beta.0.15+e91de4083dbd87\\\"\\n\", stderr \"Project: e2e-gce-gci-ci-1-5\\nNetwork Project: e2e-gce-gci-ci-1-5\\nZone: us-west1-b\\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\\nNODE_NAMES=bootstrap-e2e-minion-group-32cf bootstrap-e2e-minion-group-h1mw bootstrap-e2e-minion-group-t6x3\\nTrying to find master named 'bootstrap-e2e-master'\\nLooking for address 'bootstrap-e2e-master-ip'\\nUsing master: bootstrap-e2e-master (external IP: 34.82.143.189; internal IP: (not set))\\nDeleted [https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-1-5/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\\nCreated [https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-1-5/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: Some requests generated warnings:\\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\\n - The resource 'projects/cos-cloud/global/images/cos-73-11647-163-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-73-11647-182-0'.\\n\\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP    STATUS\\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   34.82.143.189  RUNNING\\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\\nProject: e2e-gce-gci-ci-1-5\\nNetwork Project: e2e-gce-gci-ci-1-5\\nZone: us-west1-b\\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\\n\"",
    }
    error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.16.7-beta.0.23+0a70c2fa6d4642]; got error exit status 1, stdout "Fetching the previously installed CoreDNS version\n\n***WARNING***\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\nbefore running this script:\n\n# example: pin to etcd v3.0.17\nexport ETCD_IMAGE=3.0.17\nexport ETCD_VERSION=3.0.17\n\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\n\n== Pre-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.15.10-beta.0.15+e91de4083dbd87\"\nname: \"bootstrap-e2e-minion-group-32cf\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.15.10-beta.0.15+e91de4083dbd87\"\nname: \"bootstrap-e2e-minion-group-h1mw\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.15.10-beta.0.15+e91de4083dbd87\"\nname: \"bootstrap-e2e-minion-group-t6x3\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.15.10-beta.0.15+e91de4083dbd87\"\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.16.7-beta.0.23+0a70c2fa6d4642/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\n== Upgrading master environment variables. ==\n== Waiting for new master to respond to API requests ==\n......................== Done ==\nWaiting for CoreDNS to update\nFetching the latest installed CoreDNS version\n== Downloading the CoreDNS migration tool ==\n== Upgrading the CoreDNS ConfigMap ==\nconfigmap/coredns configured\n== The CoreDNS Config has been updated ==\n== Validating cluster post-upgrade ==\nValidating gce cluster, MULTIZONE=\nFound 4 node(s).\nNAME                              STATUS                     ROLES    AGE   VERSION\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   11m   v1.16.7-beta.0.23+0a70c2fa6d4642\nbootstrap-e2e-minion-group-32cf   Ready                      <none>   11m   v1.15.10-beta.0.15+e91de4083dbd87\nbootstrap-e2e-minion-group-h1mw   Ready                      <none>   11m   v1.15.10-beta.0.15+e91de4083dbd87\nbootstrap-e2e-minion-group-t6x3   Ready                      <none>   11m   v1.15.10-beta.0.15+e91de4083dbd87\nValidate output:\nNAME                 AGE\ncontroller-manager   <unknown>\nscheduler            <unknown>\netcd-1               <unknown>\netcd-0               <unknown>\n\x1b[0;32mCluster validation succeeded\x1b[0m\n== Post-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.7-beta.0.23+0a70c2fa6d4642\"\nname: \"bootstrap-e2e-minion-group-32cf\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.15.10-beta.0.15+e91de4083dbd87\"\nname: \"bootstrap-e2e-minion-group-h1mw\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.15.10-beta.0.15+e91de4083dbd87\"\nname: \"bootstrap-e2e-minion-group-t6x3\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.15.10-beta.0.15+e91de4083dbd87\"\n", stderr "Project: e2e-gce-gci-ci-1-5\nNetwork Project: e2e-gce-gci-ci-1-5\nZone: us-west1-b\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\nNODE_NAMES=bootstrap-e2e-minion-group-32cf bootstrap-e2e-minion-group-h1mw bootstrap-e2e-minion-group-t6x3\nTrying to find master named 'bootstrap-e2e-master'\nLooking for address 'bootstrap-e2e-master-ip'\nUsing master: bootstrap-e2e-master (external IP: 34.82.143.189; internal IP: (not set))\nDeleted [https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-1-5/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\nCreated [https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-1-5/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: Some requests generated warnings:\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\n - The resource 'projects/cos-cloud/global/images/cos-73-11647-163-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-73-11647-182-0'.\n\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP    STATUS\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   34.82.143.189  RUNNING\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\nProject: e2e-gce-gci-ci-1-5\nNetwork Project: e2e-gce-gci-ci-1-5\nZone: us-west1-b\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\n"
occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/cluster_upgrade.go:106