This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 40 succeeded
Started2019-07-17 14:38
Elapsed9m28s
Revision
Buildergke-prow-ssd-pool-1a225945-5wt3
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/bffaf81a-8640-4027-8204-17b2c2f8d211/targets/test'}}
pod7328d3e7-a8a0-11e9-a9b1-1a2b998c5cd0
resultstorehttps://source.cloud.google.com/results/invocations/bffaf81a-8640-4027-8204-17b2c2f8d211/targets/test
infra-commit596505c5e
job-versionv1.12.11-beta.0.1+5f799a487b70ae
pod7328d3e7-a8a0-11e9-a9b1-1a2b998c5cd0
repok8s.io/kubernetes
repo-commit5f799a487b70aea5e298e5f5f1e3bac904b54ef6
repos{u'k8s.io/kubernetes': u'release-1.12', u'github.com/containerd/cri': u'release/1.2'}
revisionv1.12.11-beta.0.1+5f799a487b70ae

Test Failures


Node Tests 8m16s

error during go run /go/src/k8s.io/kubernetes/test/e2e_node/runner/remote/run_remote.go --cleanup --logtostderr --vmodule=*=4 --ssh-env=gce --results-dir=/workspace/_artifacts --project=cri-containerd-node-e2e --zone=us-west1-b --ssh-user=prow --ssh-key=/workspace/.ssh/google_compute_engine --ginkgo-flags=--nodes=8 --focus="\[NodeFeature:.+\]" --skip="\[Flaky\]|\[Serial\]" --flakeAttempts=2 --test_args=--container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --container-runtime-process-name=/home/containerd/usr/local/bin/containerd --container-runtime-pid-file= --kubelet-flags="--cgroups-per-qos=true --cgroup-root=/ --runtime-cgroups=/system.slice/containerd.service" --extra-log="{\"name\": \"containerd.log\", \"journalctl\": [\"-u\", \"containerd\"]}" --test-timeout=1h5m0s --image-config-file=/workspace/test-infra/jobs/e2e_node/containerd/containerd-release-1.2/image-config.yaml: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 40 Passed Tests

Show 243 Skipped Tests

Error lines from build-log.txt

... skipping 169 lines ...
W0717 14:40:15.706]       [Service]
W0717 14:40:15.706]       Type=oneshot
W0717 14:40:15.706]       RemainAfterExit=yes
W0717 14:40:15.706]       ExecStartPre=/bin/mkdir -p /home/containerd
W0717 14:40:15.706]       ExecStartPre=/bin/mount --bind /home/containerd /home/containerd
W0717 14:40:15.707]       ExecStartPre=/bin/mount -o remount,exec /home/containerd
W0717 14:40:15.707]       ExecStartPre=/usr/bin/curl --fail --retry 5 --retry-delay 3 --silent --show-error -H "X-Google-Metadata-Request: True" -o /home/containerd/configure.sh http://metadata.google.internal/computeMetadata/v1/instance/attributes/containerd-configure-sh
W0717 14:40:15.707]       ExecStartPre=/bin/chmod 544 /home/containerd/configure.sh
W0717 14:40:15.707]       ExecStart=/home/containerd/configure.sh
W0717 14:40:15.707] 
W0717 14:40:15.707]       [Install]
W0717 14:40:15.707]       WantedBy=containerd.target
W0717 14:40:15.707] 
... skipping 74 lines ...
W0717 14:40:15.715] # fetch_metadata fetches metadata from GCE metadata server.
W0717 14:40:15.715] # Var set:
W0717 14:40:15.715] # 1. Metadata key: key of the metadata.
W0717 14:40:15.715] fetch_metadata() {
W0717 14:40:15.715]   local -r key=$1
W0717 14:40:15.715]   local -r attributes="http://metadata.google.internal/computeMetadata/v1/instance/attributes"
W0717 14:40:15.715]   if curl --fail --retry 5 --retry-delay 3 --silent --show-error -H "X-Google-Metadata-Request: True" "${attributes}/" | \
W0717 14:40:15.715]     grep -q "^${key}$"; then
W0717 14:40:15.715]     curl --fail --retry 5 --retry-delay 3 --silent --show-error -H "X-Google-Metadata-Request: True" \
W0717 14:40:15.716]       "${attributes}/${key}"
W0717 14:40:15.716]   fi
W0717 14:40:15.716] }
W0717 14:40:15.716] 
W0717 14:40:15.716] # fetch_env fetches environment variables from GCE metadata server
W0717 14:40:15.716] # and generate a env file under ${CONTAINERD_HOME}. It assumes that
... skipping 59 lines ...
W0717 14:40:15.722]     deploy_dir=$(echo "${pull_refs}" | sha1sum | awk '{print $1}')
W0717 14:40:15.722]     deploy_path="${deploy_path}/${deploy_dir}"
W0717 14:40:15.722]   fi
W0717 14:40:15.722] 
W0717 14:40:15.722]   # TODO(random-liu): Put version into the metadata instead of
W0717 14:40:15.722]   # deciding it in cloud init. This may cause issue to reboot test.
W0717 14:40:15.722]   version=$(curl -f --ipv4 --retry 6 --retry-delay 3 --silent --show-error \
W0717 14:40:15.723]     https://storage.googleapis.com/${deploy_path}/latest)
W0717 14:40:15.723] fi
W0717 14:40:15.723] 
W0717 14:40:15.723] TARBALL_GCS_NAME="${pkg_prefix}-${version}.linux-amd64.tar.gz"
W0717 14:40:15.723] # TARBALL_GCS_PATH is the path to download cri-containerd tarball for node e2e.
W0717 14:40:15.723] TARBALL_GCS_PATH="https://storage.googleapis.com/${deploy_path}/${TARBALL_GCS_NAME}"
... skipping 140 lines ...
W0717 14:40:15.739]       [Service]
W0717 14:40:15.739]       Type=oneshot
W0717 14:40:15.739]       RemainAfterExit=yes
W0717 14:40:15.739]       ExecStartPre=/bin/mkdir -p /home/containerd
W0717 14:40:15.739]       ExecStartPre=/bin/mount --bind /home/containerd /home/containerd
W0717 14:40:15.739]       ExecStartPre=/bin/mount -o remount,exec /home/containerd
W0717 14:40:15.739]       ExecStartPre=/usr/bin/curl --fail --retry 5 --retry-delay 3 --silent --show-error -H "X-Google-Metadata-Request: True" -o /home/containerd/configure.sh http://metadata.google.internal/computeMetadata/v1/instance/attributes/containerd-configure-sh
W0717 14:40:15.740]       ExecStartPre=/bin/chmod 544 /home/containerd/configure.sh
W0717 14:40:15.740]       ExecStart=/home/containerd/configure.sh
W0717 14:40:15.740] 
W0717 14:40:15.740]       [Install]
W0717 14:40:15.740]       WantedBy=containerd.target
W0717 14:40:15.740] 
... skipping 74 lines ...
W0717 14:40:15.747] # fetch_metadata fetches metadata from GCE metadata server.
W0717 14:40:15.747] # Var set:
W0717 14:40:15.747] # 1. Metadata key: key of the metadata.
W0717 14:40:15.747] fetch_metadata() {
W0717 14:40:15.747]   local -r key=$1
W0717 14:40:15.748]   local -r attributes="http://metadata.google.internal/computeMetadata/v1/instance/attributes"
W0717 14:40:15.748]   if curl --fail --retry 5 --retry-delay 3 --silent --show-error -H "X-Google-Metadata-Request: True" "${attributes}/" | \
W0717 14:40:15.748]     grep -q "^${key}$"; then
W0717 14:40:15.748]     curl --fail --retry 5 --retry-delay 3 --silent --show-error -H "X-Google-Metadata-Request: True" \
W0717 14:40:15.748]       "${attributes}/${key}"
W0717 14:40:15.748]   fi
W0717 14:40:15.748] }
W0717 14:40:15.748] 
W0717 14:40:15.748] # fetch_env fetches environment variables from GCE metadata server
W0717 14:40:15.748] # and generate a env file under ${CONTAINERD_HOME}. It assumes that
... skipping 59 lines ...
W0717 14:40:15.754]     deploy_dir=$(echo "${pull_refs}" | sha1sum | awk '{print $1}')
W0717 14:40:15.754]     deploy_path="${deploy_path}/${deploy_dir}"
W0717 14:40:15.754]   fi
W0717 14:40:15.754] 
W0717 14:40:15.754]   # TODO(random-liu): Put version into the metadata instead of
W0717 14:40:15.754]   # deciding it in cloud init. This may cause issue to reboot test.
W0717 14:40:15.754]   version=$(curl -f --ipv4 --retry 6 --retry-delay 3 --silent --show-error \
W0717 14:40:15.755]     https://storage.googleapis.com/${deploy_path}/latest)
W0717 14:40:15.755] fi
W0717 14:40:15.755] 
W0717 14:40:15.755] TARBALL_GCS_NAME="${pkg_prefix}-${version}.linux-amd64.tar.gz"
W0717 14:40:15.755] # TARBALL_GCS_PATH is the path to download cri-containerd tarball for node e2e.
W0717 14:40:15.755] TARBALL_GCS_PATH="https://storage.googleapis.com/${deploy_path}/${TARBALL_GCS_NAME}"
... skipping 129 lines ...
W0717 14:44:14.471] I0717 14:44:14.471278    4369 utils.go:82] Configure iptables firewall rules on "tmp-node-e2e-ca7f2a70-ubuntu-gke-1604-xenial-v20170420-1"
W0717 14:44:15.683] I0717 14:44:15.682542    4369 utils.go:117] Killing any existing node processes on "tmp-node-e2e-ca7f2a70-ubuntu-gke-1604-xenial-v20170420-1"
W0717 14:44:15.760] I0717 14:44:15.759595    4369 utils.go:117] Killing any existing node processes on "tmp-node-e2e-ca7f2a70-cos-stable-60-9592-84-0"
W0717 14:44:16.930] I0717 14:44:16.930049    4369 node_e2e.go:164] Starting tests on "tmp-node-e2e-ca7f2a70-ubuntu-gke-1604-xenial-v20170420-1"
W0717 14:44:16.977] I0717 14:44:16.977353    4369 node_e2e.go:108] GCI/COS node and GCI/COS mounter both detected, modifying --experimental-mounter-path accordingly
W0717 14:44:16.978] I0717 14:44:16.977389    4369 node_e2e.go:164] Starting tests on "tmp-node-e2e-ca7f2a70-cos-stable-60-9592-84-0"
W0717 14:44:25.298] I0717 14:44:25.298477    4369 remote.go:197] Test failed unexpectedly. Attempting to retrieving system logs (only works for nodes with journald)
W0717 14:44:25.898] I0717 14:44:25.897578    4369 remote.go:202] Got the system logs from journald; copying it back...
W0717 14:44:26.771] I0717 14:44:26.770388    4369 remote.go:122] Copying test artifacts from "tmp-node-e2e-ca7f2a70-ubuntu-gke-1604-xenial-v20170420-1"
W0717 14:44:27.993] I0717 14:44:27.992687    4369 run_remote.go:717] Deleting instance "tmp-node-e2e-ca7f2a70-ubuntu-gke-1604-xenial-v20170420-1"
I0717 14:44:28.543] 
I0717 14:44:28.544] >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
I0717 14:44:28.544] >                              START TEST                                >
... skipping 46 lines ...
I0717 14:44:28.550] I0717 14:44:21.178194    2848 validators.go:44] Validating package...
I0717 14:44:28.550] PASS
I0717 14:44:28.550] I0717 14:44:21.180761    2785 e2e_node_suite_test.go:149] Pre-pulling images so that they are cached for the tests.
I0717 14:44:28.550] I0717 14:44:21.180807    2785 remote_runtime.go:43] Connecting to runtime service unix:///run/containerd/containerd.sock
I0717 14:44:28.550] I0717 14:44:21.180970    2785 remote_image.go:41] Connecting to image service unix:///run/containerd/containerd.sock
I0717 14:44:28.551] I0717 14:44:21.180999    2785 image_list.go:146] Pre-pulling images with CRI [docker.io/library/busybox:1.29 docker.io/library/nginx:1.14-alpine gcr.io/kubernetes-e2e-test-images/entrypoint-tester:1.0 gcr.io/kubernetes-e2e-test-images/hostexec:1.1 gcr.io/kubernetes-e2e-test-images/ipc-utils:1.0 gcr.io/kubernetes-e2e-test-images/liveness:1.0 gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0 gcr.io/kubernetes-e2e-test-images/mounttest:1.0 gcr.io/kubernetes-e2e-test-images/net:1.0 gcr.io/kubernetes-e2e-test-images/netexec:1.0 gcr.io/kubernetes-e2e-test-images/node-perf/npb-ep-amd64:1.0 gcr.io/kubernetes-e2e-test-images/node-perf/npb-is-amd64:1.0 gcr.io/kubernetes-e2e-test-images/node-perf/tf-wide-deep-amd64:1.0 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0 gcr.io/kubernetes-e2e-test-images/serve-hostname:1.1 gcr.io/kubernetes-e2e-test-images/test-webserver:1.0 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0 google/cadvisor:latest k8s.gcr.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff k8s.gcr.io/node-problem-detector:v0.6.2 k8s.gcr.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa k8s.gcr.io/pause:3.1 k8s.gcr.io/stress:v1]
I0717 14:44:28.551] E0717 14:44:21.181184    2785 remote_image.go:87] ImageStatus "docker.io/library/busybox:1.29" from image service failed: rpc error: code = Unavailable desc = grpc: the connection is unavailable
I0717 14:44:28.552] E0717 14:44:21.181203    2785 remote_image.go:112] PullImage "docker.io/library/busybox:1.29" from image service failed: rpc error: code = Unavailable desc = grpc: the connection is unavailable
I0717 14:44:28.552] W0717 14:44:21.181216    2785 image_list.go:159] Failed to pull docker.io/library/busybox:1.29 as user "root", retrying in 1s (1 of 5): rpc error: code = Unavailable desc = grpc: the connection is unavailable
I0717 14:44:28.552] E0717 14:44:22.181476    2785 remote_image.go:87] ImageStatus "docker.io/library/busybox:1.29" from image service failed: rpc error: code = Unavailable desc = grpc: the connection is unavailable
I0717 14:44:28.552] E0717 14:44:22.181522    2785 remote_image.go:112] PullImage "docker.io/library/busybox:1.29" from image service failed: rpc error: code = Unavailable desc = grpc: the connection is unavailable
I0717 14:44:28.552] W0717 14:44:22.181534    2785 image_list.go:159] Failed to pull docker.io/library/busybox:1.29 as user "root", retrying in 1s (2 of 5): rpc error: code = Unavailable desc = grpc: the connection is unavailable
I0717 14:44:28.553] E0717 14:44:23.181777    2785 remote_image.go:87] ImageStatus "docker.io/library/busybox:1.29" from image service failed: rpc error: code = Unavailable desc = grpc: the connection is unavailable
I0717 14:44:28.553] E0717 14:44:23.181841    2785 remote_image.go:112] PullImage "docker.io/library/busybox:1.29" from image service failed: rpc error: code = Unavailable desc = grpc: the connection is unavailable
I0717 14:44:28.553] W0717 14:44:23.181851    2785 image_list.go:159] Failed to pull docker.io/library/busybox:1.29 as user "root", retrying in 1s (3 of 5): rpc error: code = Unavailable desc = grpc: the connection is unavailable
I0717 14:44:28.553] E0717 14:44:24.182113    2785 remote_image.go:87] ImageStatus "docker.io/library/busybox:1.29" from image service failed: rpc error: code = Unavailable desc = grpc: the connection is unavailable
I0717 14:44:28.554] E0717 14:44:24.182174    2785 remote_image.go:112] PullImage "docker.io/library/busybox:1.29" from image service failed: rpc error: code = Unavailable desc = grpc: the connection is unavailable
I0717 14:44:28.554] W0717 14:44:24.182184    2785 image_list.go:159] Failed to pull docker.io/library/busybox:1.29 as user "root", retrying in 1s (4 of 5): rpc error: code = Unavailable desc = grpc: the connection is unavailable
I0717 14:44:28.554] E0717 14:44:25.182362    2785 remote_image.go:87] ImageStatus "docker.io/library/busybox:1.29" from image service failed: rpc error: code = Unavailable desc = grpc: the connection is unavailable
I0717 14:44:28.554] E0717 14:44:25.182414    2785 remote_image.go:112] PullImage "docker.io/library/busybox:1.29" from image service failed: rpc error: code = Unavailable desc = grpc: the connection is unavailable
I0717 14:44:28.554] W0717 14:44:25.182424    2785 image_list.go:159] Failed to pull docker.io/library/busybox:1.29 as user "root", retrying in 1s (5 of 5): rpc error: code = Unavailable desc = grpc: the connection is unavailable
I0717 14:44:28.555] W0717 14:44:25.182432    2785 image_list.go:163] Could not pre-pull image docker.io/library/busybox:1.29 rpc error: code = Unavailable desc = grpc: the connection is unavailable output: 
I0717 14:44:28.555] 
I0717 14:44:28.555] 
I0717 14:44:28.555] Failure [4.844 seconds]
I0717 14:44:28.555] [BeforeSuite] BeforeSuite 
I0717 14:44:28.555] /go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e_node/e2e_node_suite_test.go:142
I0717 14:44:28.555] 
I0717 14:44:28.555]   Expected error:
I0717 14:44:28.555]       <*status.statusError | 0xc42086b8f0>: {
I0717 14:44:28.555]           Code: 14,
I0717 14:44:28.555]           Message: "grpc: the connection is unavailable",
I0717 14:44:28.556]           Details: nil,
I0717 14:44:28.556]       }
I0717 14:44:28.556]       rpc error: code = Unavailable desc = grpc: the connection is unavailable
I0717 14:44:28.556]   not to have occurred
I0717 14:44:28.556] 
I0717 14:44:28.556]   /go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e_node/e2e_node_suite_test.go:152
I0717 14:44:28.556] ------------------------------
I0717 14:44:28.556] Failure [4.881 seconds]
I0717 14:44:28.556] [BeforeSuite] BeforeSuite 
I0717 14:44:28.556] /go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e_node/e2e_node_suite_test.go:142
I0717 14:44:28.557] 
I0717 14:44:28.557]   BeforeSuite on Node 1 failed
I0717 14:44:28.557] 
I0717 14:44:28.557]   /go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e_node/e2e_node_suite_test.go:142
I0717 14:44:28.557] ------------------------------
I0717 14:44:28.557] Failure [4.834 seconds]
I0717 14:44:28.557] [BeforeSuite] BeforeSuite 
I0717 14:44:28.557] /go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e_node/e2e_node_suite_test.go:142
I0717 14:44:28.557] 
I0717 14:44:28.557]   BeforeSuite on Node 1 failed
I0717 14:44:28.557] 
I0717 14:44:28.558]   /go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e_node/e2e_node_suite_test.go:142
I0717 14:44:28.558] ------------------------------
I0717 14:44:28.558] Failure [4.772 seconds]
I0717 14:44:28.558] [BeforeSuite] BeforeSuite 
I0717 14:44:28.558] /go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e_node/e2e_node_suite_test.go:142
I0717 14:44:28.558] 
I0717 14:44:28.558]   BeforeSuite on Node 1 failed
I0717 14:44:28.558] 
I0717 14:44:28.558]   /go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e_node/e2e_node_suite_test.go:142
I0717 14:44:28.559] ------------------------------
I0717 14:44:28.559] Failure [4.825 seconds]
I0717 14:44:28.559] [BeforeSuite] BeforeSuite 
I0717 14:44:28.559] /go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e_node/e2e_node_suite_test.go:142
I0717 14:44:28.559] 
I0717 14:44:28.559]   BeforeSuite on Node 1 failed
I0717 14:44:28.559] 
I0717 14:44:28.559]   /go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e_node/e2e_node_suite_test.go:142
I0717 14:44:28.559] ------------------------------
I0717 14:44:28.559] Failure [4.879 seconds]
I0717 14:44:28.559] [BeforeSuite] BeforeSuite 
I0717 14:44:28.560] /go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e_node/e2e_node_suite_test.go:142
I0717 14:44:28.560] 
I0717 14:44:28.560]   BeforeSuite on Node 1 failed
I0717 14:44:28.560] 
I0717 14:44:28.560]   /go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e_node/e2e_node_suite_test.go:142
I0717 14:44:28.560] ------------------------------
I0717 14:44:28.560] Failure [4.913 seconds]
I0717 14:44:28.560] [BeforeSuite] BeforeSuite 
I0717 14:44:28.560] /go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e_node/e2e_node_suite_test.go:142
I0717 14:44:28.560] 
I0717 14:44:28.561]   BeforeSuite on Node 1 failed
I0717 14:44:28.561] 
I0717 14:44:28.561]   /go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e_node/e2e_node_suite_test.go:142
I0717 14:44:28.561] ------------------------------
I0717 14:44:28.561] Failure [4.818 seconds]
I0717 14:44:28.561] [BeforeSuite] BeforeSuite 
I0717 14:44:28.561] /go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e_node/e2e_node_suite_test.go:142
I0717 14:44:28.561] 
I0717 14:44:28.561]   BeforeSuite on Node 1 failed
I0717 14:44:28.561] 
I0717 14:44:28.562]   /go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e_node/e2e_node_suite_test.go:142
I0717 14:44:28.562] ------------------------------
I0717 14:44:28.562] I0717 14:44:25.246815    2785 e2e_node_suite_test.go:191] Tests Finished
I0717 14:44:28.562] 
I0717 14:44:28.562] 
I0717 14:44:28.562] Ran 2208 of 0 Specs in 4.928 seconds
I0717 14:44:28.562] FAIL! -- 0 Passed | 2208 Failed | 0 Flaked | 0 Pending | 0 Skipped 
I0717 14:44:28.562] 
I0717 14:44:28.562] Ginkgo ran 1 suite in 7.712009064s
I0717 14:44:28.562] Test Suite Failed
I0717 14:44:28.563] 
I0717 14:44:28.563] Failure Finished Test Suite on Host tmp-node-e2e-ca7f2a70-ubuntu-gke-1604-xenial-v20170420-1
I0717 14:44:28.564] [command [ssh -o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@35.233.146.214 -- sudo sh -c 'cd /tmp/node-e2e-20190717T144404 && timeout -k 30s 3900.000000s ./ginkgo --nodes=8 --focus="\[NodeFeature:.+\]" --skip="\[Flaky\]|\[Serial\]" --flakeAttempts=2 ./e2e_node.test -- --system-spec-name= --system-spec-file= --extra-envs= --logtostderr --v 4 --node-name=tmp-node-e2e-ca7f2a70-ubuntu-gke-1604-xenial-v20170420-1 --report-dir=/tmp/node-e2e-20190717T144404/results --report-prefix=ubuntu --image-description="ubuntu-gke-1604-xenial-v20170420-1" --kubelet-flags=--experimental-kernel-memcg-notification=true --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --container-runtime-process-name=/home/containerd/usr/local/bin/containerd --container-runtime-pid-file= --kubelet-flags="--cgroups-per-qos=true --cgroup-root=/ --runtime-cgroups=/system.slice/containerd.service" --extra-log="{\"name\": \"containerd.log\", \"journalctl\": [\"-u\", \"containerd\"]}"'] failed with error: exit status 1, command [scp -o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine -r prow@35.233.146.214:/tmp/node-e2e-20190717T144404/results/*.log /workspace/_artifacts/tmp-node-e2e-ca7f2a70-ubuntu-gke-1604-xenial-v20170420-1] failed with error: exit status 1]
I0717 14:44:28.564] <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
I0717 14:44:28.564] <                              FINISH TEST                               <
I0717 14:44:28.564] <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
I0717 14:44:28.564] 
W0717 14:47:56.108] I0717 14:47:56.107856    4369 remote.go:122] Copying test artifacts from "tmp-node-e2e-ca7f2a70-cos-stable-60-9592-84-0"
W0717 14:48:00.582] I0717 14:48:00.582009    4369 run_remote.go:717] Deleting instance "tmp-node-e2e-ca7f2a70-cos-stable-60-9592-84-0"
... skipping 134 lines ...
I0717 14:48:01.349] Jul 17 14:45:43.389: INFO: Skipping waiting for service account
I0717 14:48:01.350] [BeforeEach] [k8s.io] Sysctls [NodeFeature:Sysctls]
I0717 14:48:01.350]   /go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/sysctl.go:56
I0717 14:48:01.350] [It] should support sysctls
I0717 14:48:01.350]   /go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/sysctl.go:60
I0717 14:48:01.350] STEP: Creating a pod with the kernel.shm_rmid_forced sysctl
I0717 14:48:01.350] STEP: Watching for error events or started pod
I0717 14:48:01.350] STEP: Waiting for pod completion
I0717 14:48:01.350] STEP: Checking that the pod succeeded
I0717 14:48:01.350] STEP: Getting logs from the pod
I0717 14:48:01.351] STEP: Checking that the sysctl is actually updated
I0717 14:48:01.351] [AfterEach] [k8s.io] Sysctls [NodeFeature:Sysctls]
I0717 14:48:01.351]   /go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:148
... skipping 905 lines ...
I0717 14:48:01.476] Jul 17 14:46:18.812: INFO: Skipping waiting for service account
I0717 14:48:01.476] [BeforeEach] [k8s.io] Sysctls [NodeFeature:Sysctls]
I0717 14:48:01.476]   /go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/sysctl.go:56
I0717 14:48:01.476] [It] should not launch unsafe, but not explicitly enabled sysctls on the node
I0717 14:48:01.476]   /go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/sysctl.go:181
I0717 14:48:01.476] STEP: Creating a pod with a greylisted, but not whitelisted sysctl on the node
I0717 14:48:01.476] STEP: Watching for error events or started pod
I0717 14:48:01.477] STEP: Checking that the pod was rejected
I0717 14:48:01.477] [AfterEach] [k8s.io] Sysctls [NodeFeature:Sysctls]
I0717 14:48:01.477]   /go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:148
I0717 14:48:01.477] Jul 17 14:46:20.821: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
I0717 14:48:01.477] STEP: Destroying namespace "e2e-tests-sysctl-45dl7" for this suite.
I0717 14:48:01.477] Jul 17 14:46:26.853: INFO: Waiting up to 30s for server preferred namespaced resources to be successfully discovered
... skipping 53 lines ...
I0717 14:48:01.484] Jul 17 14:46:21.272: INFO: Skipping waiting for service account
I0717 14:48:01.484] [BeforeEach] [k8s.io] Sysctls [NodeFeature:Sysctls]
I0717 14:48:01.484]   /go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/sysctl.go:56
I0717 14:48:01.484] [It] should support unsafe sysctls which are actually whitelisted
I0717 14:48:01.484]   /go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/sysctl.go:103
I0717 14:48:01.484] STEP: Creating a pod with the kernel.shm_rmid_forced sysctl
I0717 14:48:01.485] STEP: Watching for error events or started pod
I0717 14:48:01.485] STEP: Waiting for pod completion
I0717 14:48:01.485] STEP: Checking that the pod succeeded
I0717 14:48:01.485] STEP: Getting logs from the pod
I0717 14:48:01.485] STEP: Checking that the sysctl is actually updated
I0717 14:48:01.485] [AfterEach] [k8s.io] Sysctls [NodeFeature:Sysctls]
I0717 14:48:01.485]   /go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:148
... skipping 179 lines ...
I0717 14:48:01.509] STEP: Wait for 0 temp events generated
I0717 14:48:01.509] STEP: Wait for 0 total events generated
I0717 14:48:01.509] STEP: Make sure only 0 total events generated
I0717 14:48:01.509] STEP: Make sure node condition "TestCondition" is set
I0717 14:48:01.509] STEP: Make sure node condition "TestCondition" is stable
I0717 14:48:01.509] STEP: should not generate events for too old log
I0717 14:48:01.509] STEP: Inject 3 logs: "temporary error"
I0717 14:48:01.509] STEP: Wait for 0 temp events generated
I0717 14:48:01.509] STEP: Wait for 0 total events generated
I0717 14:48:01.510] STEP: Make sure only 0 total events generated
I0717 14:48:01.510] STEP: Make sure node condition "TestCondition" is set
I0717 14:48:01.510] STEP: Make sure node condition "TestCondition" is stable
I0717 14:48:01.510] STEP: should not change node condition for too old log
I0717 14:48:01.510] STEP: Inject 1 logs: "permanent error 1"
I0717 14:48:01.510] STEP: Wait for 0 temp events generated
I0717 14:48:01.510] STEP: Wait for 0 total events generated
I0717 14:48:01.510] STEP: Make sure only 0 total events generated
I0717 14:48:01.510] STEP: Make sure node condition "TestCondition" is set
I0717 14:48:01.510] STEP: Make sure node condition "TestCondition" is stable
I0717 14:48:01.511] STEP: should generate event for old log within lookback duration
I0717 14:48:01.511] STEP: Inject 3 logs: "temporary error"
I0717 14:48:01.511] STEP: Wait for 3 temp events generated
I0717 14:48:01.511] STEP: Wait for 3 total events generated
I0717 14:48:01.511] STEP: Make sure only 3 total events generated
I0717 14:48:01.511] STEP: Make sure node condition "TestCondition" is set
I0717 14:48:01.511] STEP: Make sure node condition "TestCondition" is stable
I0717 14:48:01.511] STEP: should change node condition for old log within lookback duration
I0717 14:48:01.511] STEP: Inject 1 logs: "permanent error 1"
I0717 14:48:01.512] STEP: Wait for 3 temp events generated
I0717 14:48:01.512] STEP: Wait for 4 total events generated
I0717 14:48:01.512] STEP: Make sure only 4 total events generated
I0717 14:48:01.512] STEP: Make sure node condition "TestCondition" is set
I0717 14:48:01.512] STEP: Make sure node condition "TestCondition" is stable
I0717 14:48:01.512] STEP: should generate event for new log
I0717 14:48:01.512] STEP: Inject 3 logs: "temporary error"
I0717 14:48:01.512] STEP: Wait for 6 temp events generated
I0717 14:48:01.512] STEP: Wait for 7 total events generated
I0717 14:48:01.513] STEP: Make sure only 7 total events generated
I0717 14:48:01.513] STEP: Make sure node condition "TestCondition" is set
I0717 14:48:01.513] STEP: Make sure node condition "TestCondition" is stable
I0717 14:48:01.513] STEP: should not update node condition with the same reason
I0717 14:48:01.513] STEP: Inject 1 logs: "permanent error 1different message"
I0717 14:48:01.513] STEP: Wait for 6 temp events generated
I0717 14:48:01.513] STEP: Wait for 7 total events generated
I0717 14:48:01.513] STEP: Make sure only 7 total events generated
I0717 14:48:01.513] STEP: Make sure node condition "TestCondition" is set
I0717 14:48:01.514] STEP: Make sure node condition "TestCondition" is stable
I0717 14:48:01.514] STEP: should change node condition for new log
I0717 14:48:01.514] STEP: Inject 1 logs: "permanent error 2"
I0717 14:48:01.514] STEP: Wait for 6 temp events generated
I0717 14:48:01.514] STEP: Wait for 8 total events generated
I0717 14:48:01.514] STEP: Make sure only 8 total events generated
I0717 14:48:01.514] STEP: Make sure node condition "TestCondition" is set
I0717 14:48:01.514] STEP: Make sure node condition "TestCondition" is stable
I0717 14:48:01.514] [AfterEach] [k8s.io] SystemLogMonitor
... skipping 22 lines ...
I0717 14:48:01.517]     should generate node condition and events for corresponding errors
I0717 14:48:01.517]     /go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e_node/node_problem_detector_linux.go:245
I0717 14:48:01.517] ------------------------------
I0717 14:48:01.517] I0717 14:47:55.531205    1245 e2e_node_suite_test.go:186] Stopping node services...
I0717 14:48:01.518] I0717 14:47:55.531234    1245 server.go:258] Kill server "services"
I0717 14:48:01.518] I0717 14:47:55.531243    1245 server.go:295] Killing process 1390 (services) with -TERM
I0717 14:48:01.518] E0717 14:47:55.640603    1245 services.go:88] Failed to stop services: error stopping "services": waitid: no child processes
I0717 14:48:01.518] I0717 14:47:55.640621    1245 server.go:258] Kill server "kubelet"
I0717 14:48:01.518] I0717 14:47:55.720625    1245 services.go:145] Fetching log files...
I0717 14:48:01.518] I0717 14:47:55.720694    1245 services.go:154] Get log file "kern.log" with journalctl command [-k].
I0717 14:48:01.518] I0717 14:47:55.757477    1245 services.go:154] Get log file "cloud-init.log" with journalctl command [-u cloud*].
I0717 14:48:01.519] I0717 14:47:55.767707    1245 services.go:154] Get log file "docker.log" with journalctl command [-u docker].
I0717 14:48:01.519] I0717 14:47:55.772391    1245 services.go:154] Get log file "containerd.log" with journalctl command [-u containerd].
I0717 14:48:01.519] I0717 14:47:55.882136    1245 services.go:154] Get log file "kubelet.log" with journalctl command [-u kubelet-20190717T144404.service].
I0717 14:48:01.519] I0717 14:47:56.064007    1245 e2e_node_suite_test.go:191] Tests Finished
I0717 14:48:01.519] 
I0717 14:48:01.519] 
I0717 14:48:01.519] Ran 33 of 276 Specs in 214.300 seconds
I0717 14:48:01.519] SUCCESS! -- 33 Passed | 0 Failed | 0 Flaked | 0 Pending | 243 Skipped 
I0717 14:48:01.519] 
I0717 14:48:01.519] Ginkgo ran 1 suite in 3m38.458931255s
I0717 14:48:01.520] Test Suite Passed
I0717 14:48:01.520] 
I0717 14:48:01.520] Success Finished Test Suite on Host tmp-node-e2e-ca7f2a70-cos-stable-60-9592-84-0
I0717 14:48:01.520] <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
... skipping 5 lines ...
W0717 14:48:01.622] 2019/07/17 14:48:01 process.go:155: Step 'go run /go/src/k8s.io/kubernetes/test/e2e_node/runner/remote/run_remote.go --cleanup --logtostderr --vmodule=*=4 --ssh-env=gce --results-dir=/workspace/_artifacts --project=cri-containerd-node-e2e --zone=us-west1-b --ssh-user=prow --ssh-key=/workspace/.ssh/google_compute_engine --ginkgo-flags=--nodes=8 --focus="\[NodeFeature:.+\]" --skip="\[Flaky\]|\[Serial\]" --flakeAttempts=2 --test_args=--container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --container-runtime-process-name=/home/containerd/usr/local/bin/containerd --container-runtime-pid-file= --kubelet-flags="--cgroups-per-qos=true --cgroup-root=/ --runtime-cgroups=/system.slice/containerd.service" --extra-log="{\"name\": \"containerd.log\", \"journalctl\": [\"-u\", \"containerd\"]}" --test-timeout=1h5m0s --image-config-file=/workspace/test-infra/jobs/e2e_node/containerd/containerd-release-1.2/image-config.yaml' finished in 8m16.526547365s
W0717 14:48:01.622] 2019/07/17 14:48:01 node.go:42: Noop - Node DumpClusterLogs() - /workspace/_artifacts: 
W0717 14:48:01.622] 2019/07/17 14:48:01 node.go:52: Noop - Node Down()
W0717 14:48:01.622] 2019/07/17 14:48:01 process.go:96: Saved XML output to /workspace/_artifacts/junit_runner.xml.
W0717 14:48:01.622] 2019/07/17 14:48:01 process.go:153: Running: bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"
W0717 14:48:01.815] 2019/07/17 14:48:01 process.go:155: Step 'bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"' finished in 209.24334ms
W0717 14:48:01.818] 2019/07/17 14:48:01 main.go:316: Something went wrong: encountered 1 errors: [error during go run /go/src/k8s.io/kubernetes/test/e2e_node/runner/remote/run_remote.go --cleanup --logtostderr --vmodule=*=4 --ssh-env=gce --results-dir=/workspace/_artifacts --project=cri-containerd-node-e2e --zone=us-west1-b --ssh-user=prow --ssh-key=/workspace/.ssh/google_compute_engine --ginkgo-flags=--nodes=8 --focus="\[NodeFeature:.+\]" --skip="\[Flaky\]|\[Serial\]" --flakeAttempts=2 --test_args=--container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --container-runtime-process-name=/home/containerd/usr/local/bin/containerd --container-runtime-pid-file= --kubelet-flags="--cgroups-per-qos=true --cgroup-root=/ --runtime-cgroups=/system.slice/containerd.service" --extra-log="{\"name\": \"containerd.log\", \"journalctl\": [\"-u\", \"containerd\"]}" --test-timeout=1h5m0s --image-config-file=/workspace/test-infra/jobs/e2e_node/containerd/containerd-release-1.2/image-config.yaml: exit status 1]
W0717 14:48:01.821] Traceback (most recent call last):
W0717 14:48:01.821]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 778, in <module>
W0717 14:48:01.821]     main(parse_args())
W0717 14:48:01.822]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 626, in main
W0717 14:48:01.822]     mode.start(runner_args)
W0717 14:48:01.822]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 262, in start
W0717 14:48:01.823]     check_env(env, self.command, *args)
W0717 14:48:01.823]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 111, in check_env
W0717 14:48:01.823]     subprocess.check_call(cmd, env=env)
W0717 14:48:01.823]   File "/usr/lib/python2.7/subprocess.py", line 186, in check_call
W0717 14:48:01.823]     raise CalledProcessError(retcode, cmd)
W0717 14:48:01.825] subprocess.CalledProcessError: Command '('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--up', '--down', '--test', '--deployment=node', '--provider=gce', '--cluster=bootstrap-e2e', '--gcp-network=bootstrap-e2e', '--node-args=--image-config-file=/workspace/test-infra/jobs/e2e_node/containerd/containerd-release-1.2/image-config.yaml', '--gcp-project=cri-containerd-node-e2e', '--gcp-zone=us-west1-b', '--node-test-args=--container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --container-runtime-process-name=/home/containerd/usr/local/bin/containerd --container-runtime-pid-file= --kubelet-flags="--cgroups-per-qos=true --cgroup-root=/ --runtime-cgroups=/system.slice/containerd.service" --extra-log="{\\"name\\": \\"containerd.log\\", \\"journalctl\\": [\\"-u\\", \\"containerd\\"]}"', '--node-tests=true', '--test_args=--nodes=8 --focus="\\[NodeFeature:.+\\]" --skip="\\[Flaky\\]|\\[Serial\\]" --flakeAttempts=2', '--timeout=65m')' returned non-zero exit status 1
E0717 14:48:01.836] Command failed
I0717 14:48:01.836] process 326 exited with code 1 after 8.3m
E0717 14:48:01.836] FAIL: ci-containerd-node-e2e-features-1-2
I0717 14:48:01.837] Call:  gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json
W0717 14:48:02.411] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
I0717 14:48:02.477] process 25383 exited with code 0 after 0.0m
I0717 14:48:02.477] Call:  gcloud config get-value account
I0717 14:48:02.828] process 25395 exited with code 0 after 0.0m
I0717 14:48:02.828] Will upload results to gs://kubernetes-jenkins/logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com
I0717 14:48:02.829] Upload result and artifacts...
I0717 14:48:02.829] Gubernator results at https://gubernator.k8s.io/build/kubernetes-jenkins/logs/ci-containerd-node-e2e-features-1-2/1151501440951259138
I0717 14:48:02.829] Call:  gsutil ls gs://kubernetes-jenkins/logs/ci-containerd-node-e2e-features-1-2/1151501440951259138/artifacts
W0717 14:48:03.965] CommandException: One or more URLs matched no objects.
E0717 14:48:04.101] Command failed
I0717 14:48:04.101] process 25407 exited with code 1 after 0.0m
W0717 14:48:04.101] Remote dir gs://kubernetes-jenkins/logs/ci-containerd-node-e2e-features-1-2/1151501440951259138/artifacts not exist yet
I0717 14:48:04.101] Call:  gsutil -m -q -o GSUtil:use_magicfile=True cp -r -c -z log,txt,xml /workspace/_artifacts gs://kubernetes-jenkins/logs/ci-containerd-node-e2e-features-1-2/1151501440951259138/artifacts
I0717 14:48:06.574] process 25549 exited with code 0 after 0.0m
I0717 14:48:06.575] Call:  git rev-parse HEAD
I0717 14:48:06.579] process 26124 exited with code 0 after 0.0m
... skipping 13 lines ...