This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 9 succeeded
Started2020-03-13 07:23
Elapsed14m31s
Revisionrelease-1.17
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/874427af-5559-4c92-8c42-7053ea4c8f51/targets/test'}}
resultstorehttps://source.cloud.google.com/results/invocations/874427af-5559-4c92-8c42-7053ea4c8f51/targets/test

Test Failures


task-06-upgrade 5m0s

timeout. task did not completed in less than 5m0s as expected
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 9 Passed Tests

Show 3 Skipped Tests

Error lines from build-log.txt

... skipping 293 lines ...
Created symlink /etc/systemd/system/multi-user.target.wants/kubelet.service → /kind/systemd/kubelet.service.
Created symlink /etc/systemd/system/kubelet.service → /kind/systemd/kubelet.service.
time="07:25:03" level=debug msg="Running: [docker exec kind-build-5266943d-20e5-4707-a5bd-d9e576788535 mkdir -p /etc/systemd/system/kubelet.service.d]"
time="07:25:04" level=info msg="Adding /etc/systemd/system/kubelet.service.d/10-kubeadm.conf to the image"
time="07:25:04" level=debug msg="Running: [docker exec kind-build-5266943d-20e5-4707-a5bd-d9e576788535 cp /alter/bits/systemd/10-kubeadm.conf /etc/systemd/system/kubelet.service.d/10-kubeadm.conf]"
time="07:25:04" level=debug msg="Running: [docker exec kind-build-5266943d-20e5-4707-a5bd-d9e576788535 chown -R root:root /etc/systemd/system/kubelet.service.d/10-kubeadm.conf]"
time="07:25:05" level=debug msg="Running: [docker exec kind-build-5266943d-20e5-4707-a5bd-d9e576788535 /bin/sh -c echo \"KUBELET_EXTRA_ARGS=--fail-swap-on=false\" >> /etc/default/kubelet]"
time="07:25:05" level=debug msg="Running: [docker exec kind-build-5266943d-20e5-4707-a5bd-d9e576788535 mkdir -p /kinder]"
time="07:25:06" level=debug msg="Running: [docker exec kind-build-5266943d-20e5-4707-a5bd-d9e576788535 rsync -r /alter/bits/upgrade /kinder]"
time="07:25:15" level=debug msg="Running: [docker exec kind-build-5266943d-20e5-4707-a5bd-d9e576788535 chown -R root:root /kinder/upgrade]"
time="07:25:16" level=debug msg="Running: [docker exec kind-build-5266943d-20e5-4707-a5bd-d9e576788535 /bin/sh -c which docker || true]"
time="07:25:16" level=info msg="Detected docker as container runtime"
time="07:25:16" level=info msg="Pre loading images ..."
... skipping 172 lines ...
kinder-upgrade-control-plane-1:$ Preparing /kind/kubeadm.conf
time="07:26:47" level=debug msg="Running: /usr/bin/docker [docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}} kinder-upgrade-control-plane-1]"
time="07:26:48" level=debug msg="Running: [docker exec kinder-upgrade-control-plane-1 kubeadm version -o=short]"
time="07:26:48" level=debug msg="Preparing kubeadm config v1beta2 (kubeadm version 1.16.9-beta.0.1+92e71139aa1639)"
time="07:26:48" level=debug msg="Preparing dockerPatch for kubeadm config v1beta2 (kubeadm version 1.16.9-beta.0.1+92e71139aa1639)"
time="07:26:48" level=debug msg="Preparing automaticCopyCertsPatches for kubeadm config v1beta2 (kubeadm version 1.16.9-beta.0.1+92e71139aa1639)"
time="07:26:48" level=debug msg="generated config:\napiServer:\n  certSANs:\n  - localhost\n  - 172.17.0.3\napiVersion: kubeadm.k8s.io/v1beta2\nclusterName: kinder-upgrade\ncontrolPlaneEndpoint: 172.17.0.7:6443\ncontrollerManager:\n  extraArgs:\n    enable-hostpath-provisioner: \"true\"\nkind: ClusterConfiguration\nkubernetesVersion: v1.16.9-beta.0.1+92e71139aa1639\nnetworking:\n  podSubnet: 192.168.0.0/16\n  serviceSubnet: \"\"\nscheduler:\n  extraArgs: null\n---\napiVersion: kubeadm.k8s.io/v1beta2\nbootstrapTokens:\n- token: abcdef.0123456789abcdef\ncertificateKey: \"0123456789012345678901234567890123456789012345678901234567890123\"\nkind: InitConfiguration\nlocalAPIEndpoint:\n  advertiseAddress: 172.17.0.3\n  bindPort: 6443\nnodeRegistration:\n  criSocket: /var/run/dockershim.sock\n  kubeletExtraArgs:\n    fail-swap-on: \"false\"\n    node-ip: 172.17.0.3\n---\napiVersion: kubelet.config.k8s.io/v1beta1\nevictionHard:\n  imagefs.available: 0%\n  nodefs.available: 0%\n  nodefs.inodesFree: 0%\nimageGCHighThresholdPercent: 100\nkind: KubeletConfiguration\n---\napiVersion: kubeproxy.config.k8s.io/v1alpha1\nkind: KubeProxyConfiguration\n"
time="07:26:48" level=debug msg="Running: [docker cp /tmp/kinder-upgrade-control-plane-1-394337419 kinder-upgrade-control-plane-1:/kind/kubeadm.conf]"

kinder-upgrade-lb:$ Updating load balancer configuration with 1 control plane backends
time="07:26:49" level=debug msg="Running: /usr/bin/docker [docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}} kinder-upgrade-control-plane-1]"
time="07:26:49" level=debug msg="Writing loadbalancer config on kinder-upgrade-lb..."
time="07:26:49" level=debug msg="Running: [docker cp /tmp/kinder-upgrade-lb-834286702 kinder-upgrade-lb:/usr/local/etc/haproxy/haproxy.cfg]"
... skipping 32 lines ...
I0313 07:26:52.787524     550 checks.go:377] validating the presence of executable ebtables
I0313 07:26:52.787599     550 checks.go:377] validating the presence of executable ethtool
I0313 07:26:52.787727     550 checks.go:377] validating the presence of executable socat
I0313 07:26:52.787790     550 checks.go:377] validating the presence of executable tc
I0313 07:26:52.787865     550 checks.go:377] validating the presence of executable touch
I0313 07:26:52.788042     550 checks.go:521] running all checks
[preflight] The system verification failed. Printing the output from the verification:
KERNEL_VERSION: 4.15.0-1044-gke
DOCKER_VERSION: 18.09.4
DOCKER_GRAPH_DRIVER: overlay2
OS: Linux
CGROUPS_CPU: enabled
CGROUPS_CPUACCT: enabled
CGROUPS_CPUSET: enabled
CGROUPS_DEVICES: enabled
CGROUPS_FREEZER: enabled
CGROUPS_MEMORY: enabled
	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/4.15.0-1044-gke\n", err: exit status 1
I0313 07:26:52.981892     550 checks.go:407] checking whether the given node name is reachable using net.LookupHost
I0313 07:26:52.982227     550 checks.go:619] validating kubelet version
I0313 07:26:53.143931     550 checks.go:129] validating if the service is enabled and active
I0313 07:26:53.175953     550 checks.go:202] validating availability of port 10250
I0313 07:26:53.176082     550 checks.go:202] validating availability of port 2379
I0313 07:26:53.176133     550 checks.go:202] validating availability of port 2380
... skipping 411 lines ...
kinder-upgrade-control-plane-2:$ Preparing /kind/kubeadm.conf
time="07:29:04" level=debug msg="Running: /usr/bin/docker [docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}} kinder-upgrade-control-plane-2]"
time="07:29:05" level=debug msg="Running: [docker exec kinder-upgrade-control-plane-2 kubeadm version -o=short]"
time="07:29:05" level=debug msg="Preparing kubeadm config v1beta2 (kubeadm version 1.16.9-beta.0.1+92e71139aa1639)"
time="07:29:05" level=debug msg="Preparing dockerPatch for kubeadm config v1beta2 (kubeadm version 1.16.9-beta.0.1+92e71139aa1639)"
time="07:29:05" level=debug msg="Preparing automaticCopyCertsPatches for kubeadm config v1beta2 (kubeadm version 1.16.9-beta.0.1+92e71139aa1639)"
time="07:29:05" level=debug msg="generated config:\napiVersion: kubeadm.k8s.io/v1beta2\ncontrolPlane:\n  certificateKey: \"0123456789012345678901234567890123456789012345678901234567890123\"\n  localAPIEndpoint:\n    advertiseAddress: 172.17.0.2\n    bindPort: 6443\ndiscovery:\n  bootstrapToken:\n    apiServerEndpoint: 172.17.0.7:6443\n    token: abcdef.0123456789abcdef\n    unsafeSkipCAVerification: true\nkind: JoinConfiguration\nnodeRegistration:\n  criSocket: /var/run/dockershim.sock\n  kubeletExtraArgs:\n    fail-swap-on: \"false\"\n    node-ip: 172.17.0.2\n"
time="07:29:05" level=debug msg="Running: [docker cp /tmp/kinder-upgrade-control-plane-2-522077286 kinder-upgrade-control-plane-2:/kind/kubeadm.conf]"
time="07:29:06" level=debug msg="Running: [docker exec kinder-upgrade-control-plane-2 kubeadm version -o=short]"

kinder-upgrade-control-plane-2:$ kubeadm join --config=/kind/kubeadm.conf --v=6 --ignore-preflight-errors=Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables
time="07:29:07" level=debug msg="Running: [docker exec kinder-upgrade-control-plane-2 kubeadm join --config=/kind/kubeadm.conf --v=6 --ignore-preflight-errors=Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables]"
I0313 07:29:07.521750     722 join.go:363] [preflight] found NodeName empty; using OS hostname as NodeName
... skipping 17 lines ...
I0313 07:29:07.930213     722 checks.go:377] validating the presence of executable ebtables
I0313 07:29:07.930266     722 checks.go:377] validating the presence of executable ethtool
I0313 07:29:07.930310     722 checks.go:377] validating the presence of executable socat
I0313 07:29:07.930365     722 checks.go:377] validating the presence of executable tc
I0313 07:29:07.930415     722 checks.go:377] validating the presence of executable touch
I0313 07:29:07.930512     722 checks.go:521] running all checks
	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/4.15.0-1044-gke\n", err: exit status 1
I0313 07:29:08.151040     722 checks.go:407] checking whether the given node name is reachable using net.LookupHost
[preflight] The system verification failed. Printing the output from the verification:
KERNEL_VERSION: 4.15.0-1044-gke
DOCKER_VERSION: 18.09.4
DOCKER_GRAPH_DRIVER: overlay2
OS: Linux
CGROUPS_CPU: enabled
CGROUPS_CPUACCT: enabled
... skipping 118 lines ...
I0313 07:29:26.650992     722 local.go:136] Adding etcd member: https://172.17.0.2:2380
[etcd] Announced new etcd member joining to the existing etcd cluster
[etcd] Creating static Pod manifest for "etcd"
I0313 07:29:26.697007     722 local.go:142] Updated etcd member list: [{kinder-upgrade-control-plane-2 https://172.17.0.2:2380} {kinder-upgrade-control-plane-1 https://172.17.0.3:2380}]
I0313 07:29:26.699102     722 etcd.go:372] [etcd] attempting to see if all cluster endpoints ([https://172.17.0.3:2379 https://172.17.0.2:2379]) are available 1/8
[etcd] Waiting for the new etcd member to join the cluster. This can take up to 40s
{"level":"warn","ts":"2020-03-13T07:29:40.973Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"passthrough:///https://172.17.0.2:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = context deadline exceeded"}
I0313 07:29:40.974071     722 etcd.go:377] [etcd] Attempt timed out
I0313 07:29:40.974084     722 etcd.go:369] [etcd] Waiting 5s until next retry
I0313 07:29:45.974336     722 etcd.go:372] [etcd] attempting to see if all cluster endpoints ([https://172.17.0.3:2379 https://172.17.0.2:2379]) are available 2/8
[upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0313 07:29:46.040450     722 round_trippers.go:443] POST https://172.17.0.7:6443/api/v1/namespaces/kube-system/configmaps 409 Conflict in 9 milliseconds
I0313 07:29:46.047485     722 round_trippers.go:443] GET https://172.17.0.7:6443/api/v1/namespaces/kube-system/configmaps/kubeadm-config 200 OK in 4 milliseconds
... skipping 65 lines ...
kinder-upgrade-control-plane-3:$ Preparing /kind/kubeadm.conf
time="07:29:54" level=debug msg="Running: /usr/bin/docker [docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}} kinder-upgrade-control-plane-3]"
time="07:29:54" level=debug msg="Running: [docker exec kinder-upgrade-control-plane-3 kubeadm version -o=short]"
time="07:29:55" level=debug msg="Preparing kubeadm config v1beta2 (kubeadm version 1.16.9-beta.0.1+92e71139aa1639)"
time="07:29:55" level=debug msg="Preparing dockerPatch for kubeadm config v1beta2 (kubeadm version 1.16.9-beta.0.1+92e71139aa1639)"
time="07:29:55" level=debug msg="Preparing automaticCopyCertsPatches for kubeadm config v1beta2 (kubeadm version 1.16.9-beta.0.1+92e71139aa1639)"
time="07:29:55" level=debug msg="generated config:\napiVersion: kubeadm.k8s.io/v1beta2\ncontrolPlane:\n  certificateKey: \"0123456789012345678901234567890123456789012345678901234567890123\"\n  localAPIEndpoint:\n    advertiseAddress: 172.17.0.4\n    bindPort: 6443\ndiscovery:\n  bootstrapToken:\n    apiServerEndpoint: 172.17.0.7:6443\n    token: abcdef.0123456789abcdef\n    unsafeSkipCAVerification: true\nkind: JoinConfiguration\nnodeRegistration:\n  criSocket: /var/run/dockershim.sock\n  kubeletExtraArgs:\n    fail-swap-on: \"false\"\n    node-ip: 172.17.0.4\n"
time="07:29:55" level=debug msg="Running: [docker cp /tmp/kinder-upgrade-control-plane-3-244066952 kinder-upgrade-control-plane-3:/kind/kubeadm.conf]"
time="07:29:55" level=debug msg="Running: [docker exec kinder-upgrade-control-plane-3 kubeadm version -o=short]"

kinder-upgrade-control-plane-3:$ kubeadm join --config=/kind/kubeadm.conf --v=6 --ignore-preflight-errors=Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables
time="07:29:56" level=debug msg="Running: [docker exec kinder-upgrade-control-plane-3 kubeadm join --config=/kind/kubeadm.conf --v=6 --ignore-preflight-errors=Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables]"
I0313 07:29:56.755009     765 join.go:363] [preflight] found NodeName empty; using OS hostname as NodeName
... skipping 17 lines ...
I0313 07:29:57.200415     765 checks.go:377] validating the presence of executable ebtables
I0313 07:29:57.200466     765 checks.go:377] validating the presence of executable ethtool
I0313 07:29:57.200583     765 checks.go:377] validating the presence of executable socat
I0313 07:29:57.200635     765 checks.go:377] validating the presence of executable tc
I0313 07:29:57.200739     765 checks.go:377] validating the presence of executable touch
I0313 07:29:57.200816     765 checks.go:521] running all checks
	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/4.15.0-1044-gke\n", err: exit status 1
I0313 07:29:57.385336     765 checks.go:407] checking whether the given node name is reachable using net.LookupHost
[preflight] The system verification failed. Printing the output from the verification:
KERNEL_VERSION: 4.15.0-1044-gke
DOCKER_VERSION: 18.09.4
DOCKER_GRAPH_DRIVER: overlay2
OS: Linux
CGROUPS_CPU: enabled
CGROUPS_CPUACCT: enabled
... skipping 118 lines ...
I0313 07:30:15.506909     765 local.go:136] Adding etcd member: https://172.17.0.4:2380
[etcd] Announced new etcd member joining to the existing etcd cluster
[etcd] Creating static Pod manifest for "etcd"
I0313 07:30:15.557472     765 local.go:142] Updated etcd member list: [{kinder-upgrade-control-plane-2 https://172.17.0.2:2380} {kinder-upgrade-control-plane-3 https://172.17.0.4:2380} {kinder-upgrade-control-plane-1 https://172.17.0.3:2380}]
[etcd] Waiting for the new etcd member to join the cluster. This can take up to 40s
I0313 07:30:15.558873     765 etcd.go:372] [etcd] attempting to see if all cluster endpoints ([https://172.17.0.2:2379 https://172.17.0.3:2379 https://172.17.0.4:2379]) are available 1/8
{"level":"warn","ts":"2020-03-13T07:30:21.374Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"passthrough:///https://172.17.0.4:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = context deadline exceeded"}
I0313 07:30:21.374548     765 etcd.go:377] [etcd] Attempt timed out
I0313 07:30:21.374558     765 etcd.go:369] [etcd] Waiting 5s until next retry
I0313 07:30:26.374766     765 etcd.go:372] [etcd] attempting to see if all cluster endpoints ([https://172.17.0.2:2379 https://172.17.0.3:2379 https://172.17.0.4:2379]) are available 2/8
[upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0313 07:30:26.490466     765 round_trippers.go:443] POST https://172.17.0.7:6443/api/v1/namespaces/kube-system/configmaps 409 Conflict in 11 milliseconds
I0313 07:30:26.495596     765 round_trippers.go:443] GET https://172.17.0.7:6443/api/v1/namespaces/kube-system/configmaps/kubeadm-config 200 OK in 4 milliseconds
... skipping 67 lines ...

kinder-upgrade-worker-1:$ Preparing /kind/kubeadm.conf
time="07:30:40" level=debug msg="Running: /usr/bin/docker [docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}} kinder-upgrade-worker-1]"
time="07:30:41" level=debug msg="Running: [docker exec kinder-upgrade-worker-1 kubeadm version -o=short]"
time="07:30:41" level=debug msg="Preparing kubeadm config v1beta2 (kubeadm version 1.16.9-beta.0.1+92e71139aa1639)"
time="07:30:41" level=debug msg="Preparing dockerPatch for kubeadm config v1beta2 (kubeadm version 1.16.9-beta.0.1+92e71139aa1639)"
time="07:30:41" level=debug msg="generated config:\napiVersion: kubeadm.k8s.io/v1beta2\ndiscovery:\n  bootstrapToken:\n    apiServerEndpoint: 172.17.0.7:6443\n    token: abcdef.0123456789abcdef\n    unsafeSkipCAVerification: true\nkind: JoinConfiguration\nnodeRegistration:\n  criSocket: /var/run/dockershim.sock\n  kubeletExtraArgs:\n    fail-swap-on: \"false\"\n    node-ip: 172.17.0.5\n"
time="07:30:41" level=debug msg="Running: [docker cp /tmp/kinder-upgrade-worker-1-845396730 kinder-upgrade-worker-1:/kind/kubeadm.conf]"

kinder-upgrade-worker-1:$ kubeadm join --config=/kind/kubeadm.conf --v=6 --ignore-preflight-errors=Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables
time="07:30:42" level=debug msg="Running: [docker exec kinder-upgrade-worker-1 kubeadm join --config=/kind/kubeadm.conf --v=6 --ignore-preflight-errors=Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables]"
I0313 07:30:42.912045     794 join.go:363] [preflight] found NodeName empty; using OS hostname as NodeName
I0313 07:30:42.912102     794 joinconfiguration.go:75] loading configuration from "/kind/kubeadm.conf"
... skipping 16 lines ...
I0313 07:30:43.384964     794 checks.go:377] validating the presence of executable ebtables
I0313 07:30:43.385006     794 checks.go:377] validating the presence of executable ethtool
I0313 07:30:43.385486     794 checks.go:377] validating the presence of executable socat
I0313 07:30:43.385550     794 checks.go:377] validating the presence of executable tc
I0313 07:30:43.385587     794 checks.go:377] validating the presence of executable touch
I0313 07:30:43.385666     794 checks.go:521] running all checks
	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/4.15.0-1044-gke\n", err: exit status 1
I0313 07:30:43.624819     794 checks.go:407] checking whether the given node name is reachable using net.LookupHost
[preflight] The system verification failed. Printing the output from the verification:
KERNEL_VERSION: 4.15.0-1044-gke
DOCKER_VERSION: 18.09.4
DOCKER_GRAPH_DRIVER: overlay2
OS: Linux
CGROUPS_CPU: enabled
CGROUPS_CPUACCT: enabled
... skipping 91 lines ...

kinder-upgrade-worker-2:$ Preparing /kind/kubeadm.conf
time="07:31:11" level=debug msg="Running: /usr/bin/docker [docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}} kinder-upgrade-worker-2]"
time="07:31:12" level=debug msg="Running: [docker exec kinder-upgrade-worker-2 kubeadm version -o=short]"
time="07:31:12" level=debug msg="Preparing kubeadm config v1beta2 (kubeadm version 1.16.9-beta.0.1+92e71139aa1639)"
time="07:31:12" level=debug msg="Preparing dockerPatch for kubeadm config v1beta2 (kubeadm version 1.16.9-beta.0.1+92e71139aa1639)"
time="07:31:12" level=debug msg="generated config:\napiVersion: kubeadm.k8s.io/v1beta2\ndiscovery:\n  bootstrapToken:\n    apiServerEndpoint: 172.17.0.7:6443\n    token: abcdef.0123456789abcdef\n    unsafeSkipCAVerification: true\nkind: JoinConfiguration\nnodeRegistration:\n  criSocket: /var/run/dockershim.sock\n  kubeletExtraArgs:\n    fail-swap-on: \"false\"\n    node-ip: 172.17.0.6\n"
time="07:31:12" level=debug msg="Running: [docker cp /tmp/kinder-upgrade-worker-2-935415825 kinder-upgrade-worker-2:/kind/kubeadm.conf]"

kinder-upgrade-worker-2:$ kubeadm join --config=/kind/kubeadm.conf --v=6 --ignore-preflight-errors=Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables
time="07:31:13" level=debug msg="Running: [docker exec kinder-upgrade-worker-2 kubeadm join --config=/kind/kubeadm.conf --v=6 --ignore-preflight-errors=Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables]"
I0313 07:31:14.520559     824 join.go:363] [preflight] found NodeName empty; using OS hostname as NodeName
I0313 07:31:14.520609     824 joinconfiguration.go:75] loading configuration from "/kind/kubeadm.conf"
... skipping 16 lines ...
I0313 07:31:14.946697     824 checks.go:377] validating the presence of executable ebtables
I0313 07:31:14.946819     824 checks.go:377] validating the presence of executable ethtool
I0313 07:31:14.946982     824 checks.go:377] validating the presence of executable socat
I0313 07:31:14.947077     824 checks.go:377] validating the presence of executable tc
I0313 07:31:14.947141     824 checks.go:377] validating the presence of executable touch
I0313 07:31:14.947201     824 checks.go:521] running all checks
[preflight] The system verification failed. Printing the output from the verification:
KERNEL_VERSION: 4.15.0-1044-gke
DOCKER_VERSION: 18.09.4
DOCKER_GRAPH_DRIVER: overlay2
OS: Linux
CGROUPS_CPU: enabled
CGROUPS_CPUACCT: enabled
CGROUPS_CPUSET: enabled
CGROUPS_DEVICES: enabled
CGROUPS_FREEZER: enabled
CGROUPS_MEMORY: enabled
	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/4.15.0-1044-gke\n", err: exit status 1
I0313 07:31:15.170491     824 checks.go:407] checking whether the given node name is reachable using net.LookupHost
I0313 07:31:15.170836     824 checks.go:619] validating kubelet version
I0313 07:31:15.301729     824 checks.go:129] validating if the service is enabled and active
I0313 07:31:15.328603     824 checks.go:202] validating availability of port 10250
I0313 07:31:15.328919     824 checks.go:287] validating the existence of file /etc/kubernetes/pki/ca.crt
I0313 07:31:15.328946     824 checks.go:433] validating if the connectivity type is via proxy or direct
... skipping 1370 lines ...
I0313 07:36:56.370825   17496 local.go:106] [etcd] get the member id from peer: https://172.17.0.3:2380
I0313 07:36:56.387315   17496 local.go:112] [etcd] removing etcd member: https://172.17.0.3:2380, id: 12858828581462913056
I0313 07:36:56.418556   17496 local.go:117] [etcd] Updated etcd member list: [{kinder-upgrade-control-plane-2 https://172.17.0.2:2380} {kinder-upgrade-control-plane-3 https://172.17.0.4:2380}]
I0313 07:36:56.418636   17496 cleanupnode.go:57] [reset] Getting init system
[reset] Stopping the kubelet service
[reset] Unmounting mounted directories in "/var/lib/kubelet"
W0313 07:36:56.513633   17496 unmount_linux.go:42] [reset] Failed to unmount mounted directory in /var/lib/kubelet: /var/lib/kubelet
I0313 07:36:56.606522   17496 cleanupnode.go:79] [reset] Removing Kubernetes-managed containers
I0313 07:37:05.762392   17496 cleanupnode.go:87] [reset] Removing contents from the config and pki directories
[reset] Deleting contents of config directories: [/etc/kubernetes/manifests /etc/kubernetes/pki]
[reset] Deleting files: [/etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/bootstrap-kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf]
I0313 07:37:05.764135   17496 reset.go:218] [reset] Deleting content of /var/lib/etcd
[reset] Deleting contents of stateful directories: [/var/lib/etcd /var/lib/kubelet /var/lib/dockershim /var/run/kubernetes /var/lib/cni]
... skipping 39 lines ...
I0313 07:37:06.707266   10076 local.go:106] [etcd] get the member id from peer: https://172.17.0.2:2380
I0313 07:37:06.724200   10076 local.go:112] [etcd] removing etcd member: https://172.17.0.2:2380, id: 5855934381863565740
[reset] Stopping the kubelet service
I0313 07:37:06.747291   10076 local.go:117] [etcd] Updated etcd member list: [{kinder-upgrade-control-plane-3 https://172.17.0.4:2380}]
I0313 07:37:06.747342   10076 cleanupnode.go:57] [reset] Getting init system
[reset] Unmounting mounted directories in "/var/lib/kubelet"
W0313 07:37:06.835992   10076 unmount_linux.go:42] [reset] Failed to unmount mounted directory in /var/lib/kubelet: /var/lib/kubelet
I0313 07:37:06.953758   10076 cleanupnode.go:79] [reset] Removing Kubernetes-managed containers
[reset] Deleting contents of config directories: [/etc/kubernetes/manifests /etc/kubernetes/pki]
I0313 07:37:14.899379   10076 cleanupnode.go:87] [reset] Removing contents from the config and pki directories
[reset] Deleting files: [/etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/bootstrap-kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf]
[reset] Deleting contents of stateful directories: [/var/lib/etcd /var/lib/kubelet /var/lib/dockershim /var/run/kubernetes /var/lib/cni]
I0313 07:37:14.903351   10076 reset.go:218] [reset] Deleting content of /var/lib/etcd
... skipping 32 lines ...
I0313 07:37:15.685324    9734 round_trippers.go:443] PUT https://172.17.0.7:6443/api/v1/namespaces/kube-system/configmaps/kubeadm-config?timeout=10s 200 OK in 5 milliseconds
I0313 07:37:15.685617    9734 removeetcdmember.go:54] [reset] Checking for etcd config
I0313 07:37:15.685673    9734 local.go:97] [etcd] creating etcd client that connects to etcd pods
I0313 07:37:15.688622    9734 round_trippers.go:443] GET https://172.17.0.7:6443/api/v1/namespaces/kube-system/configmaps/kubeadm-config?timeout=10s 200 OK in 2 milliseconds
I0313 07:37:15.688930    9734 etcd.go:107] etcd endpoints read from pods: 
[reset] Stopping the kubelet service
W0313 07:37:15.689841    9734 removeetcdmember.go:61] [reset] failed to remove etcd member: error syncing endpoints with etc: etcdclient: no available endpoints
.Please manually remove this etcd member using etcdctl
I0313 07:37:15.689883    9734 cleanupnode.go:57] [reset] Getting init system
[reset] Unmounting mounted directories in "/var/lib/kubelet"
W0313 07:37:15.763090    9734 unmount_linux.go:42] [reset] Failed to unmount mounted directory in /var/lib/kubelet: /var/lib/kubelet
I0313 07:37:15.818527    9734 cleanupnode.go:79] [reset] Removing Kubernetes-managed containers
I0313 07:37:23.126455    9734 cleanupnode.go:87] [reset] Removing contents from the config and pki directories
[reset] Deleting contents of config directories: [/etc/kubernetes/manifests /etc/kubernetes/pki]
I0313 07:37:23.127835    9734 reset.go:218] [reset] Deleting content of /var/lib/etcd
[reset] Deleting files: [/etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/bootstrap-kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf]
[reset] Deleting contents of stateful directories: [/var/lib/etcd /var/lib/kubelet /var/lib/dockershim /var/run/kubernetes /var/lib/cni]
... skipping 22 lines ...
I0313 07:37:23.714760    7321 cleanupnode.go:57] [reset] Getting init system
[preflight] Running pre-flight checks
[reset] No etcd config found. Assuming external etcd
[reset] Please, manually reset etcd to prevent further issues
[reset] Stopping the kubelet service
[reset] Unmounting mounted directories in "/var/lib/kubelet"
W0313 07:37:23.798209    7321 unmount_linux.go:42] [reset] Failed to unmount mounted directory in /var/lib/kubelet: /var/lib/kubelet
I0313 07:37:23.901415    7321 cleanupnode.go:79] [reset] Removing Kubernetes-managed containers
I0313 07:37:27.640382    7321 cleanupnode.go:87] [reset] Removing contents from the config and pki directories
[reset] Deleting contents of config directories: [/etc/kubernetes/manifests /etc/kubernetes/pki]
[reset] Deleting files: [/etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/bootstrap-kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf]
[reset] Deleting contents of stateful directories: [/var/lib/kubelet /var/lib/dockershim /var/run/kubernetes /var/lib/cni]
I0313 07:37:27.640788    7321 reset.go:218] [reset] Deleting content of /var/lib/kubelet
... skipping 21 lines ...
I0313 07:37:28.214231    6838 cleanupnode.go:57] [reset] Getting init system
[preflight] Running pre-flight checks
[reset] No etcd config found. Assuming external etcd
[reset] Please, manually reset etcd to prevent further issues
[reset] Stopping the kubelet service
[reset] Unmounting mounted directories in "/var/lib/kubelet"
W0313 07:37:28.293452    6838 unmount_linux.go:42] [reset] Failed to unmount mounted directory in /var/lib/kubelet: /var/lib/kubelet
I0313 07:37:28.381383    6838 cleanupnode.go:79] [reset] Removing Kubernetes-managed containers
I0313 07:37:32.215654    6838 cleanupnode.go:87] [reset] Removing contents from the config and pki directories
[reset] Deleting contents of config directories: [/etc/kubernetes/manifests /etc/kubernetes/pki]
[reset] Deleting files: [/etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/bootstrap-kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf]
[reset] Deleting contents of stateful directories: [/var/lib/kubelet /var/lib/dockershim /var/run/kubernetes /var/lib/cni]
I0313 07:37:32.216741    6838 reset.go:218] [reset] Deleting content of /var/lib/kubelet
... skipping 20 lines ...
Deleting cluster "kinder-upgrade" ...
time="07:37:32" level=debug msg="Running: /usr/bin/docker [docker ps -q -a --no-trunc --filter label=io.k8s.sigs.kind.cluster --format {{.Names}}\\t{{.Label \"io.k8s.sigs.kind.cluster\"}} --filter label=io.k8s.sigs.kind.cluster=kinder-upgrade]"
time="07:37:32" level=debug msg="Running: /usr/bin/docker [docker rm -f -v kinder-upgrade-lb kinder-upgrade-worker-2 kinder-upgrade-control-plane-3 kinder-upgrade-control-plane-2 kinder-upgrade-worker-1 kinder-upgrade-control-plane-1]"
 completed!

Ran 10 of 13 tasks in 0.000 seconds
FAIL! -- 9 tasks Passed | 1 Failed | 3 Skipped

see junit-runner.xml and task logs files for more details

Error: failed executing the workflow
+ EXIT_VALUE=1
+ set +o xtrace
Cleaning up after docker in docker.
================================================================================
Cleaning up binfmt_misc ...
================================================================================
... skipping 2 lines ...