This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 9 succeeded
Started2020-02-02 14:14
Elapsed18m54s
Revisionrelease-1.15
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/e4a832fe-0e45-4b0d-881c-7381d14a6153/targets/test'}}
resultstorehttps://source.cloud.google.com/results/invocations/e4a832fe-0e45-4b0d-881c-7381d14a6153/targets/test

Test Failures


task-06-upgrade 5m0s

timeout. task did not completed in less than 5m0s as expected
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 9 Passed Tests

Show 3 Skipped Tests

Error lines from build-log.txt

... skipping 335 lines ...
Created symlink /etc/systemd/system/multi-user.target.wants/kubelet.service → /kind/systemd/kubelet.service.
Created symlink /etc/systemd/system/kubelet.service → /kind/systemd/kubelet.service.
time="14:16:32" level=debug msg="Running: [docker exec kind-build-d55aa1f9-cbe1-4543-988c-17ca3a2c0320 mkdir -p /etc/systemd/system/kubelet.service.d]"
time="14:16:33" level=info msg="Adding /etc/systemd/system/kubelet.service.d/10-kubeadm.conf to the image"
time="14:16:33" level=debug msg="Running: [docker exec kind-build-d55aa1f9-cbe1-4543-988c-17ca3a2c0320 cp /alter/bits/systemd/10-kubeadm.conf /etc/systemd/system/kubelet.service.d/10-kubeadm.conf]"
time="14:16:34" level=debug msg="Running: [docker exec kind-build-d55aa1f9-cbe1-4543-988c-17ca3a2c0320 chown -R root:root /etc/systemd/system/kubelet.service.d/10-kubeadm.conf]"
time="14:16:35" level=debug msg="Running: [docker exec kind-build-d55aa1f9-cbe1-4543-988c-17ca3a2c0320 /bin/sh -c echo \"KUBELET_EXTRA_ARGS=--fail-swap-on=false\" >> /etc/default/kubelet]"
time="14:16:35" level=debug msg="Running: [docker exec kind-build-d55aa1f9-cbe1-4543-988c-17ca3a2c0320 mkdir -p /kinder]"
time="14:16:36" level=debug msg="Running: [docker exec kind-build-d55aa1f9-cbe1-4543-988c-17ca3a2c0320 rsync -r /alter/bits/upgrade /kinder]"
time="14:16:48" level=debug msg="Running: [docker exec kind-build-d55aa1f9-cbe1-4543-988c-17ca3a2c0320 chown -R root:root /kinder/upgrade]"
time="14:16:48" level=debug msg="Running: [docker exec kind-build-d55aa1f9-cbe1-4543-988c-17ca3a2c0320 /bin/sh -c which docker || true]"
time="14:16:49" level=info msg="Detected docker as container runtime"
time="14:16:49" level=info msg="Pre loading images ..."
... skipping 176 lines ...
kinder-upgrade-control-plane-1:$ Preparing /kind/kubeadm.conf
time="14:18:52" level=debug msg="Running: /usr/bin/docker [docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}} kinder-upgrade-control-plane-1]"
time="14:18:52" level=debug msg="Running: [docker exec kinder-upgrade-control-plane-1 kubeadm version -o=short]"
time="14:18:53" level=debug msg="Preparing kubeadm config v1beta1 (kubeadm version 1.14.11-beta.1.2+c8b135d0b49c44)"
time="14:18:53" level=debug msg="Preparing dockerPatch for kubeadm config v1beta1 (kubeadm version 1.14.11-beta.1.2+c8b135d0b49c44)"
time="14:18:53" level=debug msg="Preparing automaticCopyCertsPatches for kubeadm config v1beta1 (kubeadm version 1.14.11-beta.1.2+c8b135d0b49c44)"
time="14:18:53" level=debug msg="generated config:\napiServer:\n  certSANs:\n  - localhost\n  - 172.17.0.3\napiVersion: kubeadm.k8s.io/v1beta1\nclusterName: kinder-upgrade\ncontrolPlaneEndpoint: 172.17.0.7:6443\ncontrollerManager:\n  extraArgs:\n    enable-hostpath-provisioner: \"true\"\nkind: ClusterConfiguration\nkubernetesVersion: v1.14.11-beta.1.2+c8b135d0b49c44\nnetworking:\n  podSubnet: 192.168.0.0/16\n  serviceSubnet: \"\"\nscheduler:\n  extraArgs: null\n---\napiVersion: kubeadm.k8s.io/v1beta1\nbootstrapTokens:\n- token: abcdef.0123456789abcdef\nkind: InitConfiguration\nlocalAPIEndpoint:\n  advertiseAddress: 172.17.0.3\n  bindPort: 6443\nnodeRegistration:\n  criSocket: /var/run/dockershim.sock\n  kubeletExtraArgs:\n    fail-swap-on: \"false\"\n    node-ip: 172.17.0.3\n---\napiVersion: kubelet.config.k8s.io/v1beta1\nevictionHard:\n  imagefs.available: 0%\n  nodefs.available: 0%\n  nodefs.inodesFree: 0%\nimageGCHighThresholdPercent: 100\nkind: KubeletConfiguration\n---\napiVersion: kubeproxy.config.k8s.io/v1alpha1\nkind: KubeProxyConfiguration\n"
time="14:18:53" level=debug msg="Running: [docker cp /tmp/kinder-upgrade-control-plane-1-573720111 kinder-upgrade-control-plane-1:/kind/kubeadm.conf]"

kinder-upgrade-lb:$ Updating load balancer configuration with 1 control plane backends
time="14:18:54" level=debug msg="Running: /usr/bin/docker [docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}} kinder-upgrade-control-plane-1]"
time="14:18:54" level=debug msg="Writing loadbalancer config on kinder-upgrade-lb..."
time="14:18:54" level=debug msg="Running: [docker cp /tmp/kinder-upgrade-lb-057304002 kinder-upgrade-lb:/usr/local/etc/haproxy/haproxy.cfg]"
... skipping 32 lines ...
I0202 14:18:56.632569     542 checks.go:382] validating the presence of executable ebtables
I0202 14:18:56.632624     542 checks.go:382] validating the presence of executable ethtool
I0202 14:18:56.632680     542 checks.go:382] validating the presence of executable socat
I0202 14:18:56.632724     542 checks.go:382] validating the presence of executable tc
I0202 14:18:56.632796     542 checks.go:382] validating the presence of executable touch
I0202 14:18:56.632895     542 checks.go:524] running all checks
[preflight] The system verification failed. Printing the output from the verification:
KERNEL_VERSION: 4.15.0-1044-gke
DOCKER_VERSION: 18.09.4
DOCKER_GRAPH_DRIVER: overlay2
OS: Linux
CGROUPS_CPU: enabled
CGROUPS_CPUACCT: enabled
CGROUPS_CPUSET: enabled
CGROUPS_DEVICES: enabled
CGROUPS_FREEZER: enabled
CGROUPS_MEMORY: enabled
	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/4.15.0-1044-gke\n", err: exit status 1
I0202 14:18:56.683441     542 checks.go:412] checking whether the given node name is reachable using net.LookupHost
I0202 14:18:56.683931     542 checks.go:622] validating kubelet version
I0202 14:18:56.792000     542 checks.go:131] validating if the service is enabled and active
I0202 14:18:56.822985     542 checks.go:209] validating availability of port 10250
I0202 14:18:56.823108     542 checks.go:209] validating availability of port 2379
I0202 14:18:56.823151     542 checks.go:209] validating availability of port 2380
... skipping 382 lines ...
kinder-upgrade-control-plane-2:$ Preparing /kind/kubeadm.conf
time="14:20:56" level=debug msg="Running: /usr/bin/docker [docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}} kinder-upgrade-control-plane-2]"
time="14:20:57" level=debug msg="Running: [docker exec kinder-upgrade-control-plane-2 kubeadm version -o=short]"
time="14:20:57" level=debug msg="Preparing kubeadm config v1beta1 (kubeadm version 1.14.11-beta.1.2+c8b135d0b49c44)"
time="14:20:57" level=debug msg="Preparing dockerPatch for kubeadm config v1beta1 (kubeadm version 1.14.11-beta.1.2+c8b135d0b49c44)"
time="14:20:57" level=debug msg="Preparing automaticCopyCertsPatches for kubeadm config v1beta1 (kubeadm version 1.14.11-beta.1.2+c8b135d0b49c44)"
time="14:20:57" level=debug msg="generated config:\napiVersion: kubeadm.k8s.io/v1beta1\ncontrolPlane:\n  localAPIEndpoint:\n    advertiseAddress: 172.17.0.2\n    bindPort: 6443\ndiscovery:\n  bootstrapToken:\n    apiServerEndpoint: 172.17.0.7:6443\n    token: abcdef.0123456789abcdef\n    unsafeSkipCAVerification: true\nkind: JoinConfiguration\nnodeRegistration:\n  criSocket: /var/run/dockershim.sock\n  kubeletExtraArgs:\n    fail-swap-on: \"false\"\n    node-ip: 172.17.0.2\n"
time="14:20:57" level=debug msg="Running: [docker cp /tmp/kinder-upgrade-control-plane-2-188544304 kinder-upgrade-control-plane-2:/kind/kubeadm.conf]"
time="14:20:58" level=debug msg="Running: [docker exec kinder-upgrade-control-plane-2 kubeadm version -o=short]"

kinder-upgrade-control-plane-2:$ kubeadm join --config=/kind/kubeadm.conf --v=6 --ignore-preflight-errors=Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables --certificate-key=0123456789012345678901234567890123456789012345678901234567890123
time="14:20:59" level=debug msg="Running: [docker exec kinder-upgrade-control-plane-2 kubeadm join --config=/kind/kubeadm.conf --v=6 --ignore-preflight-errors=Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables --certificate-key=0123456789012345678901234567890123456789012345678901234567890123]"
I0202 14:20:59.888638     686 join.go:367] [preflight] found NodeName empty; using OS hostname as NodeName
... skipping 17 lines ...
I0202 14:21:00.613685     686 checks.go:382] validating the presence of executable ebtables
I0202 14:21:00.613727     686 checks.go:382] validating the presence of executable ethtool
I0202 14:21:00.613787     686 checks.go:382] validating the presence of executable socat
I0202 14:21:00.613828     686 checks.go:382] validating the presence of executable tc
I0202 14:21:00.613869     686 checks.go:382] validating the presence of executable touch
I0202 14:21:00.613924     686 checks.go:524] running all checks
	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/4.15.0-1044-gke\n", err: exit status 1
I0202 14:21:00.698641     686 checks.go:412] checking whether the given node name is reachable using net.LookupHost
[preflight] The system verification failed. Printing the output from the verification:
KERNEL_VERSION: 4.15.0-1044-gke
DOCKER_VERSION: 18.09.4
DOCKER_GRAPH_DRIVER: overlay2
OS: Linux
CGROUPS_CPU: enabled
CGROUPS_CPUACCT: enabled
... skipping 278 lines ...
kinder-upgrade-control-plane-3:$ Preparing /kind/kubeadm.conf
time="14:23:14" level=debug msg="Running: /usr/bin/docker [docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}} kinder-upgrade-control-plane-3]"
time="14:23:14" level=debug msg="Running: [docker exec kinder-upgrade-control-plane-3 kubeadm version -o=short]"
time="14:23:15" level=debug msg="Preparing kubeadm config v1beta1 (kubeadm version 1.14.11-beta.1.2+c8b135d0b49c44)"
time="14:23:15" level=debug msg="Preparing dockerPatch for kubeadm config v1beta1 (kubeadm version 1.14.11-beta.1.2+c8b135d0b49c44)"
time="14:23:15" level=debug msg="Preparing automaticCopyCertsPatches for kubeadm config v1beta1 (kubeadm version 1.14.11-beta.1.2+c8b135d0b49c44)"
time="14:23:15" level=debug msg="generated config:\napiVersion: kubeadm.k8s.io/v1beta1\ncontrolPlane:\n  localAPIEndpoint:\n    advertiseAddress: 172.17.0.4\n    bindPort: 6443\ndiscovery:\n  bootstrapToken:\n    apiServerEndpoint: 172.17.0.7:6443\n    token: abcdef.0123456789abcdef\n    unsafeSkipCAVerification: true\nkind: JoinConfiguration\nnodeRegistration:\n  criSocket: /var/run/dockershim.sock\n  kubeletExtraArgs:\n    fail-swap-on: \"false\"\n    node-ip: 172.17.0.4\n"
time="14:23:15" level=debug msg="Running: [docker cp /tmp/kinder-upgrade-control-plane-3-176247778 kinder-upgrade-control-plane-3:/kind/kubeadm.conf]"
time="14:23:16" level=debug msg="Running: [docker exec kinder-upgrade-control-plane-3 kubeadm version -o=short]"

kinder-upgrade-control-plane-3:$ kubeadm join --config=/kind/kubeadm.conf --v=6 --ignore-preflight-errors=Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables --certificate-key=0123456789012345678901234567890123456789012345678901234567890123
time="14:23:16" level=debug msg="Running: [docker exec kinder-upgrade-control-plane-3 kubeadm join --config=/kind/kubeadm.conf --v=6 --ignore-preflight-errors=Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables --certificate-key=0123456789012345678901234567890123456789012345678901234567890123]"
I0202 14:23:17.691611     818 join.go:367] [preflight] found NodeName empty; using OS hostname as NodeName
... skipping 17 lines ...
I0202 14:23:18.555407     818 checks.go:382] validating the presence of executable ebtables
I0202 14:23:18.555486     818 checks.go:382] validating the presence of executable ethtool
I0202 14:23:18.555532     818 checks.go:382] validating the presence of executable socat
I0202 14:23:18.555569     818 checks.go:382] validating the presence of executable tc
I0202 14:23:18.555904     818 checks.go:382] validating the presence of executable touch
I0202 14:23:18.555997     818 checks.go:524] running all checks
	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/4.15.0-1044-gke\n", err: exit status 1
I0202 14:23:18.660049     818 checks.go:412] checking whether the given node name is reachable using net.LookupHost
I0202 14:23:18.660469     818 checks.go:622] validating kubelet version
[preflight] The system verification failed. Printing the output from the verification:
KERNEL_VERSION: 4.15.0-1044-gke
DOCKER_VERSION: 18.09.4
DOCKER_GRAPH_DRIVER: overlay2
OS: Linux
CGROUPS_CPU: enabled
CGROUPS_CPUACCT: enabled
... skipping 200 lines ...

kinder-upgrade-worker-1:$ Preparing /kind/kubeadm.conf
time="14:24:25" level=debug msg="Running: /usr/bin/docker [docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}} kinder-upgrade-worker-1]"
time="14:24:26" level=debug msg="Running: [docker exec kinder-upgrade-worker-1 kubeadm version -o=short]"
time="14:24:26" level=debug msg="Preparing kubeadm config v1beta1 (kubeadm version 1.14.11-beta.1.2+c8b135d0b49c44)"
time="14:24:26" level=debug msg="Preparing dockerPatch for kubeadm config v1beta1 (kubeadm version 1.14.11-beta.1.2+c8b135d0b49c44)"
time="14:24:26" level=debug msg="generated config:\napiVersion: kubeadm.k8s.io/v1beta1\ndiscovery:\n  bootstrapToken:\n    apiServerEndpoint: 172.17.0.7:6443\n    token: abcdef.0123456789abcdef\n    unsafeSkipCAVerification: true\nkind: JoinConfiguration\nnodeRegistration:\n  criSocket: /var/run/dockershim.sock\n  kubeletExtraArgs:\n    fail-swap-on: \"false\"\n    node-ip: 172.17.0.6\n"
time="14:24:26" level=debug msg="Running: [docker cp /tmp/kinder-upgrade-worker-1-480966500 kinder-upgrade-worker-1:/kind/kubeadm.conf]"

kinder-upgrade-worker-1:$ kubeadm join --config=/kind/kubeadm.conf --v=6 --ignore-preflight-errors=Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables
time="14:24:28" level=debug msg="Running: [docker exec kinder-upgrade-worker-1 kubeadm join --config=/kind/kubeadm.conf --v=6 --ignore-preflight-errors=Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables]"
[preflight] Running pre-flight checks
I0202 14:24:28.508683     877 join.go:367] [preflight] found NodeName empty; using OS hostname as NodeName
... skipping 16 lines ...
I0202 14:24:29.030370     877 checks.go:382] validating the presence of executable ebtables
I0202 14:24:29.030425     877 checks.go:382] validating the presence of executable ethtool
I0202 14:24:29.030525     877 checks.go:382] validating the presence of executable socat
I0202 14:24:29.030605     877 checks.go:382] validating the presence of executable tc
I0202 14:24:29.030982     877 checks.go:382] validating the presence of executable touch
I0202 14:24:29.031364     877 checks.go:524] running all checks
[preflight] The system verification failed. Printing the output from the verification:
KERNEL_VERSION: 4.15.0-1044-gke
DOCKER_VERSION: 18.09.4
DOCKER_GRAPH_DRIVER: overlay2
OS: Linux
CGROUPS_CPU: enabled
CGROUPS_CPUACCT: enabled
CGROUPS_CPUSET: enabled
CGROUPS_DEVICES: enabled
CGROUPS_FREEZER: enabled
CGROUPS_MEMORY: enabled
	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/4.15.0-1044-gke\n", err: exit status 1
I0202 14:24:29.125972     877 checks.go:412] checking whether the given node name is reachable using net.LookupHost
I0202 14:24:29.126538     877 checks.go:622] validating kubelet version
I0202 14:24:29.352510     877 checks.go:131] validating if the service is enabled and active
I0202 14:24:29.379036     877 checks.go:209] validating availability of port 10250
I0202 14:24:29.379331     877 checks.go:292] validating the existence of file /etc/kubernetes/pki/ca.crt
I0202 14:24:29.379352     877 checks.go:439] validating if the connectivity type is via proxy or direct
... skipping 87 lines ...

kinder-upgrade-worker-2:$ Preparing /kind/kubeadm.conf
time="14:25:06" level=debug msg="Running: /usr/bin/docker [docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}} kinder-upgrade-worker-2]"
time="14:25:06" level=debug msg="Running: [docker exec kinder-upgrade-worker-2 kubeadm version -o=short]"
time="14:25:07" level=debug msg="Preparing kubeadm config v1beta1 (kubeadm version 1.14.11-beta.1.2+c8b135d0b49c44)"
time="14:25:07" level=debug msg="Preparing dockerPatch for kubeadm config v1beta1 (kubeadm version 1.14.11-beta.1.2+c8b135d0b49c44)"
time="14:25:07" level=debug msg="generated config:\napiVersion: kubeadm.k8s.io/v1beta1\ndiscovery:\n  bootstrapToken:\n    apiServerEndpoint: 172.17.0.7:6443\n    token: abcdef.0123456789abcdef\n    unsafeSkipCAVerification: true\nkind: JoinConfiguration\nnodeRegistration:\n  criSocket: /var/run/dockershim.sock\n  kubeletExtraArgs:\n    fail-swap-on: \"false\"\n    node-ip: 172.17.0.5\n"
time="14:25:07" level=debug msg="Running: [docker cp /tmp/kinder-upgrade-worker-2-707842931 kinder-upgrade-worker-2:/kind/kubeadm.conf]"

kinder-upgrade-worker-2:$ kubeadm join --config=/kind/kubeadm.conf --v=6 --ignore-preflight-errors=Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables
time="14:25:07" level=debug msg="Running: [docker exec kinder-upgrade-worker-2 kubeadm join --config=/kind/kubeadm.conf --v=6 --ignore-preflight-errors=Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables]"
I0202 14:25:08.344344     909 join.go:367] [preflight] found NodeName empty; using OS hostname as NodeName
I0202 14:25:08.344395     909 joinconfiguration.go:75] loading configuration from "/kind/kubeadm.conf"
... skipping 16 lines ...
I0202 14:25:08.793438     909 checks.go:382] validating the presence of executable ebtables
I0202 14:25:08.793478     909 checks.go:382] validating the presence of executable ethtool
I0202 14:25:08.793517     909 checks.go:382] validating the presence of executable socat
I0202 14:25:08.793555     909 checks.go:382] validating the presence of executable tc
I0202 14:25:08.793597     909 checks.go:382] validating the presence of executable touch
I0202 14:25:08.793664     909 checks.go:524] running all checks
	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/4.15.0-1044-gke\n", err: exit status 1
I0202 14:25:08.845934     909 checks.go:412] checking whether the given node name is reachable using net.LookupHost
[preflight] The system verification failed. Printing the output from the verification:
KERNEL_VERSION: 4.15.0-1044-gke
DOCKER_VERSION: 18.09.4
DOCKER_GRAPH_DRIVER: overlay2
OS: Linux
CGROUPS_CPU: enabled
CGROUPS_CPUACCT: enabled
... skipping 1264 lines ...
[reset] Reading configuration from the cluster...
[reset] FYI: You can look at this config file with 'kubectl -n kube-system get cm kubeadm-config -oyaml'
I0202 14:31:08.428660   21063 round_trippers.go:438] GET https://172.17.0.7:6443/api/v1/namespaces/kube-system/configmaps/kubeadm-config  in 1 milliseconds
I0202 14:31:08.440664   21063 round_trippers.go:438] GET https://172.17.0.7:6443/api/v1/namespaces/kube-system/configmaps/kubeadm-config  in 0 milliseconds
I0202 14:31:08.497386   21063 round_trippers.go:438] GET https://172.17.0.7:6443/api/v1/namespaces/kube-system/configmaps/kubeadm-config  in 1 milliseconds
I0202 14:31:08.768225   21063 round_trippers.go:438] GET https://172.17.0.7:6443/api/v1/namespaces/kube-system/configmaps/kubeadm-config  in 1 milliseconds
W0202 14:31:08.768624   21063 reset.go:98] [reset] Unable to fetch the kubeadm-config ConfigMap from cluster: failed to get config map: Get https://172.17.0.7:6443/api/v1/namespaces/kube-system/configmaps/kubeadm-config: EOF
I0202 14:31:08.768823   21063 reset.go:120] [reset] Detected and using CRI socket: /var/run/dockershim.sock
I0202 14:31:08.769148   21063 removeetcdmember.go:54] [reset] Checking for etcd config
W0202 14:31:08.769254   21063 removeetcdmember.go:79] [reset] No kubeadm config, using etcd pod spec to get data directory
[preflight] Running pre-flight checks
[reset] Stopping the kubelet service
I0202 14:31:08.844904   21063 cleanupnode.go:58] [reset] Getting init system
... skipping 39 lines ...
I0202 14:31:24.875971   12585 uploadconfig.go:59] Removing APIEndpoint for Node "kinder-upgrade-control-plane-2"
I0202 14:31:24.884806   12585 round_trippers.go:438] PUT https://172.17.0.7:6443/api/v1/namespaces/kube-system/configmaps/kubeadm-config 200 OK in 7 milliseconds
I0202 14:31:24.885432   12585 removeetcdmember.go:54] [reset] Checking for etcd config
I0202 14:31:24.885466   12585 local.go:88] [etcd] creating etcd client that connects to etcd pods
I0202 14:31:24.889750   12585 round_trippers.go:438] GET https://172.17.0.7:6443/api/v1/namespaces/kube-system/configmaps/kubeadm-config 200 OK in 3 milliseconds
I0202 14:31:24.890077   12585 etcd.go:106] etcd endpoints read from pods: https://172.17.0.3:2379,https://172.17.0.4:2379
W0202 14:31:44.891075   12585 removeetcdmember.go:61] [reset] failed to remove etcd member: error syncing endpoints with etc: dial tcp 172.17.0.3:2379: connect: connection refused
.Please manually remove this etcd member using etcdctl
I0202 14:31:44.891152   12585 cleanupnode.go:58] [reset] Getting init system
[reset] Stopping the kubelet service
I0202 14:31:44.969682   12585 cleanupnode.go:106] [reset] Executing command "awk '$2 ~ path {print $2}' path=/var/lib/kubelet/ /proc/mounts | xargs -r umount"
[reset] Unmounting mounted directories in "/var/lib/kubelet"
I0202 14:31:45.027226   12585 cleanupnode.go:80] [reset] Removing Kubernetes-managed containers
... skipping 25 lines ...
[reset] Reading configuration from the cluster...
[reset] FYI: You can look at this config file with 'kubectl -n kube-system get cm kubeadm-config -oyaml'
I0202 14:32:45.411718   10911 round_trippers.go:438] GET https://172.17.0.7:6443/api/v1/namespaces/kube-system/configmaps/kubeadm-config  in 50014 milliseconds
I0202 14:32:45.424136   10911 round_trippers.go:438] GET https://172.17.0.7:6443/api/v1/namespaces/kube-system/configmaps/kubeadm-config  in 1 milliseconds
I0202 14:32:45.485118   10911 round_trippers.go:438] GET https://172.17.0.7:6443/api/v1/namespaces/kube-system/configmaps/kubeadm-config  in 1 milliseconds
I0202 14:32:45.753220   10911 round_trippers.go:438] GET https://172.17.0.7:6443/api/v1/namespaces/kube-system/configmaps/kubeadm-config  in 1 milliseconds
W0202 14:32:45.753448   10911 reset.go:98] [reset] Unable to fetch the kubeadm-config ConfigMap from cluster: failed to get config map: Get https://172.17.0.7:6443/api/v1/namespaces/kube-system/configmaps/kubeadm-config: EOF
I0202 14:32:45.753539   10911 reset.go:120] [reset] Detected and using CRI socket: /var/run/dockershim.sock
I0202 14:32:45.753593   10911 removeetcdmember.go:54] [reset] Checking for etcd config
W0202 14:32:45.753600   10911 removeetcdmember.go:79] [reset] No kubeadm config, using etcd pod spec to get data directory
[preflight] Running pre-flight checks
I0202 14:32:45.768049   10911 cleanupnode.go:58] [reset] Getting init system
[reset] Stopping the kubelet service
... skipping 97 lines ...
Deleting cluster "kinder-upgrade" ...
time="14:33:10" level=debug msg="Running: /usr/bin/docker [docker ps -q -a --no-trunc --filter label=io.k8s.sigs.kind.cluster --format {{.Names}}\\t{{.Label \"io.k8s.sigs.kind.cluster\"}} --filter label=io.k8s.sigs.kind.cluster=kinder-upgrade]"
time="14:33:11" level=debug msg="Running: /usr/bin/docker [docker rm -f -v kinder-upgrade-lb kinder-upgrade-control-plane-1 kinder-upgrade-control-plane-2 kinder-upgrade-control-plane-3 kinder-upgrade-worker-2 kinder-upgrade-worker-1]"
 completed!

Ran 10 of 13 tasks in 0.000 seconds
FAIL! -- 9 tasks Passed | 1 Failed | 3 Skipped

see junit-runner.xml and task logs files for more details

Error: failed executing the workflow
+ EXIT_VALUE=1
+ set +o xtrace
Cleaning up after docker in docker.
================================================================================
[Barnacle] 2020/02/02 14:33:26 Cleaning up Docker data root...
[Barnacle] 2020/02/02 14:33:26 Removing all containers.
... skipping 15 lines ...