This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 6 succeeded
Started2020-02-05 14:15
Elapsed44m55s
Revisionrelease-1.14
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/e1db5030-4fcc-4f5b-9377-48604f32f2f7/targets/test'}}
resultstorehttps://source.cloud.google.com/results/invocations/e1db5030-4fcc-4f5b-9377-48604f32f2f7/targets/test
uploadercrier

Test Failures


task-03-init 5m0s

timeout. task did not completed in less than 5m0s as expected
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 6 Passed Tests

Show 4 Skipped Tests

Error lines from build-log.txt

... skipping 325 lines ...
Created symlink /etc/systemd/system/multi-user.target.wants/kubelet.service → /kind/systemd/kubelet.service.
Created symlink /etc/systemd/system/kubelet.service → /kind/systemd/kubelet.service.
time="14:44:48" level=debug msg="Running: [docker exec kind-build-e50868ba-52c2-4e5b-862a-906f99ecb608 mkdir -p /etc/systemd/system/kubelet.service.d]"
time="14:44:53" level=info msg="Adding /etc/systemd/system/kubelet.service.d/10-kubeadm.conf to the image"
time="14:44:53" level=debug msg="Running: [docker exec kind-build-e50868ba-52c2-4e5b-862a-906f99ecb608 cp /alter/bits/systemd/10-kubeadm.conf /etc/systemd/system/kubelet.service.d/10-kubeadm.conf]"
time="14:44:57" level=debug msg="Running: [docker exec kind-build-e50868ba-52c2-4e5b-862a-906f99ecb608 chown -R root:root /etc/systemd/system/kubelet.service.d/10-kubeadm.conf]"
time="14:45:02" level=debug msg="Running: [docker exec kind-build-e50868ba-52c2-4e5b-862a-906f99ecb608 /bin/sh -c echo \"KUBELET_EXTRA_ARGS=--fail-swap-on=false\" >> /etc/default/kubelet]"
time="14:45:07" level=debug msg="Running: [docker exec kind-build-e50868ba-52c2-4e5b-862a-906f99ecb608 cp /alter/bits/kubeadm /usr/bin/kubeadm]"
time="14:45:15" level=debug msg="Running: [docker exec kind-build-e50868ba-52c2-4e5b-862a-906f99ecb608 chown -R root:root /usr/bin/kubeadm]"
time="14:45:21" level=debug msg="Running: [docker exec kind-build-e50868ba-52c2-4e5b-862a-906f99ecb608 /bin/sh -c which docker || true]"
time="14:45:26" level=info msg="Detected docker as container runtime"
time="14:45:26" level=info msg="Pre loading images ..."
time="14:45:26" level=debug msg="Running: [docker exec kind-build-e50868ba-52c2-4e5b-862a-906f99ecb608 mkdir -p /kind/images]"
... skipping 173 lines ...
kinder-xony-control-plane-1:$ Preparing /kind/kubeadm.conf
time="14:52:39" level=debug msg="Running: /usr/bin/docker [docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}} kinder-xony-control-plane-1]"
time="14:52:40" level=debug msg="Running: [docker exec kinder-xony-control-plane-1 kubeadm version -o=short]"
time="14:52:45" level=debug msg="Preparing kubeadm config v1beta2 (kubeadm version 1.15.10-beta.0.17+2e0c2c47211680)"
time="14:52:45" level=debug msg="Preparing dockerPatch for kubeadm config v1beta2 (kubeadm version 1.15.10-beta.0.17+2e0c2c47211680)"
time="14:52:45" level=debug msg="Preparing automaticCopyCertsPatches for kubeadm config v1beta2 (kubeadm version 1.15.10-beta.0.17+2e0c2c47211680)"
time="14:52:45" level=debug msg="generated config:\napiServer:\n  certSANs:\n  - localhost\n  - 172.17.0.4\napiVersion: kubeadm.k8s.io/v1beta2\nclusterName: kinder-xony\ncontrolPlaneEndpoint: 172.17.0.7:6443\ncontrollerManager:\n  extraArgs:\n    enable-hostpath-provisioner: \"true\"\nkind: ClusterConfiguration\nkubernetesVersion: v1.14.11-beta.1.2+c8b135d0b49c44\nnetworking:\n  podSubnet: 192.168.0.0/16\n  serviceSubnet: \"\"\nscheduler:\n  extraArgs: null\n---\napiVersion: kubeadm.k8s.io/v1beta2\nbootstrapTokens:\n- token: abcdef.0123456789abcdef\ncertificateKey: \"0123456789012345678901234567890123456789012345678901234567890123\"\nkind: InitConfiguration\nlocalAPIEndpoint:\n  advertiseAddress: 172.17.0.4\n  bindPort: 6443\nnodeRegistration:\n  criSocket: /var/run/dockershim.sock\n  kubeletExtraArgs:\n    fail-swap-on: \"false\"\n    node-ip: 172.17.0.4\n---\napiVersion: kubelet.config.k8s.io/v1beta1\nevictionHard:\n  imagefs.available: 0%\n  nodefs.available: 0%\n  nodefs.inodesFree: 0%\nimageGCHighThresholdPercent: 100\nkind: KubeletConfiguration\n---\napiVersion: kubeproxy.config.k8s.io/v1alpha1\nkind: KubeProxyConfiguration\n"
time="14:52:45" level=debug msg="Running: [docker cp /tmp/kinder-xony-control-plane-1-510948045 kinder-xony-control-plane-1:/kind/kubeadm.conf]"

kinder-xony-lb:$ Updating load balancer configuration with 1 control plane backends
time="14:52:49" level=debug msg="Running: /usr/bin/docker [docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}} kinder-xony-control-plane-1]"
time="14:52:50" level=debug msg="Writing loadbalancer config on kinder-xony-lb..."
time="14:52:50" level=debug msg="Running: [docker cp /tmp/kinder-xony-lb-514021832 kinder-xony-lb:/usr/local/etc/haproxy/haproxy.cfg]"
... skipping 32 lines ...
I0205 14:53:07.275952     694 checks.go:382] validating the presence of executable ebtables
I0205 14:53:07.276009     694 checks.go:382] validating the presence of executable ethtool
I0205 14:53:07.276061     694 checks.go:382] validating the presence of executable socat
I0205 14:53:07.276121     694 checks.go:382] validating the presence of executable tc
I0205 14:53:07.276178     694 checks.go:382] validating the presence of executable touch
I0205 14:53:07.276246     694 checks.go:524] running all checks
	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/4.15.0-1044-gke\n", err: exit status 1
I0205 14:53:07.708503     694 checks.go:412] checking whether the given node name is reachable using net.LookupHost
[preflight] The system verification failed. Printing the output from the verification:
KERNEL_VERSION: 4.15.0-1044-gke
DOCKER_VERSION: 18.09.4
DOCKER_GRAPH_DRIVER: overlay2
OS: Linux
CGROUPS_CPU: enabled
CGROUPS_CPUACCT: enabled
... skipping 415 lines ...
I0205 14:57:55.966725    5183 uploadconfig.go:59] Removing APIEndpoint for Node "kinder-xony-control-plane-1"
I0205 14:57:56.025341    5183 round_trippers.go:438] PUT https://172.17.0.7:6443/api/v1/namespaces/kube-system/configmaps/kubeadm-config 200 OK in 57 milliseconds
I0205 14:57:56.028281    5183 removeetcdmember.go:54] [reset] Checking for etcd config
I0205 14:57:56.028440    5183 local.go:88] [etcd] creating etcd client that connects to etcd pods
I0205 14:57:56.064107    5183 round_trippers.go:438] GET https://172.17.0.7:6443/api/v1/namespaces/kube-system/configmaps/kubeadm-config 200 OK in 35 milliseconds
I0205 14:57:56.064662    5183 etcd.go:106] etcd endpoints read from pods: 
W0205 14:57:56.065206    5183 removeetcdmember.go:61] [reset] failed to remove etcd member: error syncing endpoints with etc: etcdclient: no available endpoints
.Please manually remove this etcd member using etcdctl
I0205 14:57:56.065411    5183 cleanupnode.go:58] [reset] Getting init system
[reset] Stopping the kubelet service
[reset] Unmounting mounted directories in "/var/lib/kubelet"
I0205 14:57:56.564186    5183 cleanupnode.go:106] [reset] Executing command "awk '$2 ~ path {print $2}' path=/var/lib/kubelet/ /proc/mounts | xargs -r umount"
I0205 14:57:57.290036    5183 cleanupnode.go:80] [reset] Removing Kubernetes-managed containers
... skipping 26 lines ...
W0205 14:58:54.875834     962 removeetcdmember.go:79] [reset] No kubeadm config, using etcd pod spec to get data directory
I0205 14:58:54.875955     962 cleanupnode.go:58] [reset] Getting init system
[preflight] Running pre-flight checks
[reset] No etcd config found. Assuming external etcd
[reset] Please, manually reset etcd to prevent further issues
[reset] Stopping the kubelet service
E0205 14:58:54.952318     962 cleanupnode.go:100] [reset] Failed to evaluate the "/var/lib/kubelet" directory. Skipping its unmount and cleanup: lstat /var/lib/kubelet: no such file or directory
I0205 14:58:54.952351     962 cleanupnode.go:80] [reset] Removing Kubernetes-managed containers
[reset] Unmounting mounted directories in "/var/lib/kubelet"
I0205 14:58:56.117037     962 cleanupnode.go:88] [reset] Removing contents from the config and pki directories
I0205 14:58:56.117810     962 reset.go:211] [reset] Deleting content of /etc/cni/net.d
I0205 14:58:56.117826     962 reset.go:211] [reset] Deleting content of /var/lib/dockershim
I0205 14:58:56.117862     962 reset.go:211] [reset] Deleting content of /var/run/kubernetes
... skipping 21 lines ...
I0205 14:59:00.521037     966 cleanupnode.go:58] [reset] Getting init system
[preflight] Running pre-flight checks
[reset] No etcd config found. Assuming external etcd
[reset] Please, manually reset etcd to prevent further issues
[reset] Stopping the kubelet service
[reset] Unmounting mounted directories in "/var/lib/kubelet"
E0205 14:59:00.632665     966 cleanupnode.go:100] [reset] Failed to evaluate the "/var/lib/kubelet" directory. Skipping its unmount and cleanup: lstat /var/lib/kubelet: no such file or directory
I0205 14:59:00.632713     966 cleanupnode.go:80] [reset] Removing Kubernetes-managed containers
I0205 14:59:01.873254     966 cleanupnode.go:88] [reset] Removing contents from the config and pki directories
I0205 14:59:01.876379     966 reset.go:211] [reset] Deleting content of /etc/cni/net.d
I0205 14:59:01.876393     966 reset.go:211] [reset] Deleting content of /var/lib/dockershim
I0205 14:59:01.876421     966 reset.go:211] [reset] Deleting content of /var/run/kubernetes
[reset] Deleting contents of config directories: [/etc/kubernetes/manifests /etc/kubernetes/pki]
... skipping 20 lines ...
I0205 14:59:06.692389     966 cleanupnode.go:58] [reset] Getting init system
[preflight] Running pre-flight checks
[reset] No etcd config found. Assuming external etcd
[reset] Please, manually reset etcd to prevent further issues
[reset] Stopping the kubelet service
[reset] Unmounting mounted directories in "/var/lib/kubelet"
E0205 14:59:06.787893     966 cleanupnode.go:100] [reset] Failed to evaluate the "/var/lib/kubelet" directory. Skipping its unmount and cleanup: lstat /var/lib/kubelet: no such file or directory
I0205 14:59:06.787958     966 cleanupnode.go:80] [reset] Removing Kubernetes-managed containers
[reset] Deleting contents of config directories: [/etc/kubernetes/manifests /etc/kubernetes/pki]
[reset] Deleting files: [/etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/bootstrap-kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf]
[reset] Deleting contents of stateful directories: [/etc/cni/net.d /var/lib/dockershim /var/run/kubernetes]

The reset process does not reset or clean up iptables rules or IPVS tables.
... skipping 19 lines ...
W0205 14:59:12.333852     990 removeetcdmember.go:79] [reset] No kubeadm config, using etcd pod spec to get data directory
I0205 14:59:12.333922     990 cleanupnode.go:58] [reset] Getting init system
[preflight] Running pre-flight checks
[reset] No etcd config found. Assuming external etcd
[reset] Please, manually reset etcd to prevent further issues
[reset] Stopping the kubelet service
E0205 14:59:12.445449     990 cleanupnode.go:100] [reset] Failed to evaluate the "/var/lib/kubelet" directory. Skipping its unmount and cleanup: lstat /var/lib/kubelet: no such file or directory
I0205 14:59:12.445481     990 cleanupnode.go:80] [reset] Removing Kubernetes-managed containers
[reset] Unmounting mounted directories in "/var/lib/kubelet"
[reset] Deleting contents of config directories: [/etc/kubernetes/manifests /etc/kubernetes/pki]
[reset] Deleting files: [/etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/bootstrap-kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf]
[reset] Deleting contents of stateful directories: [/etc/cni/net.d /var/lib/dockershim /var/run/kubernetes]

... skipping 20 lines ...
Deleting cluster "kinder-xony" ...
time="14:59:16" level=debug msg="Running: /usr/bin/docker [docker ps -q -a --no-trunc --filter label=io.k8s.sigs.kind.cluster --format {{.Names}}\\t{{.Label \"io.k8s.sigs.kind.cluster\"}} --filter label=io.k8s.sigs.kind.cluster=kinder-xony]"
time="14:59:18" level=debug msg="Running: /usr/bin/docker [docker rm -f -v kinder-xony-lb kinder-xony-worker-2 kinder-xony-control-plane-2 kinder-xony-worker-1 kinder-xony-control-plane-1 kinder-xony-control-plane-3]"
 completed!

Ran 7 of 11 tasks in 0.000 seconds
FAIL! -- 6 tasks Passed | 1 Failed | 4 Skipped

see junit-runner.xml and task logs files for more details

Error: failed executing the workflow
+ EXIT_VALUE=1
+ set +o xtrace
Cleaning up after docker in docker.
================================================================================
[Barnacle] 2020/02/05 15:00:15 Cleaning up Docker data root...
[Barnacle] 2020/02/05 15:00:15 Removing all containers.
... skipping 15 lines ...