This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 40 succeeded
Started2020-03-14 07:27
Elapsed19m15s
Revisionrelease-1.16
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/abf310a7-bb4a-4feb-99be-81cd3991f584/targets/test'}}
resultstorehttps://source.cloud.google.com/results/invocations/abf310a7-bb4a-4feb-99be-81cd3991f584/targets/test

Test Failures


task-06-e2e-kubeadm 5m0s

timeout. task did not completed in less than 5m0s as expected
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 40 Passed Tests

Show 7 Skipped Tests

Error lines from build-log.txt

... skipping 274 lines ...
Created symlink /etc/systemd/system/multi-user.target.wants/kubelet.service → /kind/systemd/kubelet.service.
Created symlink /etc/systemd/system/kubelet.service → /kind/systemd/kubelet.service.
time="07:30:11" level=debug msg="Running: [docker exec kind-build-519c9509-a701-4c67-b5c7-27aadcfd8ec2 mkdir -p /etc/systemd/system/kubelet.service.d]"
time="07:30:13" level=info msg="Adding /etc/systemd/system/kubelet.service.d/10-kubeadm.conf to the image"
time="07:30:13" level=debug msg="Running: [docker exec kind-build-519c9509-a701-4c67-b5c7-27aadcfd8ec2 cp /alter/bits/systemd/10-kubeadm.conf /etc/systemd/system/kubelet.service.d/10-kubeadm.conf]"
time="07:30:14" level=debug msg="Running: [docker exec kind-build-519c9509-a701-4c67-b5c7-27aadcfd8ec2 chown -R root:root /etc/systemd/system/kubelet.service.d/10-kubeadm.conf]"
time="07:30:16" level=debug msg="Running: [docker exec kind-build-519c9509-a701-4c67-b5c7-27aadcfd8ec2 /bin/sh -c echo \"KUBELET_EXTRA_ARGS=--fail-swap-on=false\" >> /etc/default/kubelet]"
time="07:30:17" level=debug msg="Running: [docker exec kind-build-519c9509-a701-4c67-b5c7-27aadcfd8ec2 cp /alter/bits/kubeadm /usr/bin/kubeadm]"
time="07:30:19" level=debug msg="Running: [docker exec kind-build-519c9509-a701-4c67-b5c7-27aadcfd8ec2 chown -R root:root /usr/bin/kubeadm]"
time="07:30:21" level=debug msg="Running: [docker exec kind-build-519c9509-a701-4c67-b5c7-27aadcfd8ec2 /bin/sh -c which docker || true]"
time="07:30:22" level=info msg="Detected docker as container runtime"
time="07:30:22" level=info msg="Pre loading images ..."
time="07:30:22" level=debug msg="Running: [docker exec kind-build-519c9509-a701-4c67-b5c7-27aadcfd8ec2 mkdir -p /kind/images]"
... skipping 175 lines ...
kinder-xony-control-plane-1:$ Preparing /kind/kubeadm.conf
time="07:32:40" level=debug msg="Running: /usr/bin/docker [docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}} kinder-xony-control-plane-1]"
time="07:32:41" level=debug msg="Running: [docker exec kinder-xony-control-plane-1 kubeadm version -o=short]"
time="07:32:42" level=debug msg="Preparing kubeadm config v1beta2 (kubeadm version 1.17.5-beta.0.1+106c255ad7ab80)"
time="07:32:42" level=debug msg="Preparing dockerPatch for kubeadm config v1beta2 (kubeadm version 1.17.5-beta.0.1+106c255ad7ab80)"
time="07:32:42" level=debug msg="Preparing automaticCopyCertsPatches for kubeadm config v1beta2 (kubeadm version 1.17.5-beta.0.1+106c255ad7ab80)"
time="07:32:42" level=debug msg="generated config:\napiServer:\n  certSANs:\n  - localhost\n  - 172.17.0.4\napiVersion: kubeadm.k8s.io/v1beta2\nclusterName: kinder-xony\ncontrolPlaneEndpoint: 172.17.0.7:6443\ncontrollerManager:\n  extraArgs:\n    enable-hostpath-provisioner: \"true\"\nkind: ClusterConfiguration\nkubernetesVersion: v1.16.9-beta.0.1+92e71139aa1639\nnetworking:\n  podSubnet: 192.168.0.0/16\n  serviceSubnet: \"\"\nscheduler:\n  extraArgs: null\n---\napiVersion: kubeadm.k8s.io/v1beta2\nbootstrapTokens:\n- token: abcdef.0123456789abcdef\ncertificateKey: \"0123456789012345678901234567890123456789012345678901234567890123\"\nkind: InitConfiguration\nlocalAPIEndpoint:\n  advertiseAddress: 172.17.0.4\n  bindPort: 6443\nnodeRegistration:\n  criSocket: /var/run/dockershim.sock\n  kubeletExtraArgs:\n    fail-swap-on: \"false\"\n    node-ip: 172.17.0.4\n---\napiVersion: kubelet.config.k8s.io/v1beta1\nevictionHard:\n  imagefs.available: 0%\n  nodefs.available: 0%\n  nodefs.inodesFree: 0%\nimageGCHighThresholdPercent: 100\nkind: KubeletConfiguration\n---\napiVersion: kubeproxy.config.k8s.io/v1alpha1\nkind: KubeProxyConfiguration\n"
time="07:32:42" level=debug msg="Running: [docker cp /tmp/kinder-xony-control-plane-1-945722784 kinder-xony-control-plane-1:/kind/kubeadm.conf]"

kinder-xony-lb:$ Updating load balancer configuration with 1 control plane backends
time="07:32:43" level=debug msg="Running: /usr/bin/docker [docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}} kinder-xony-control-plane-1]"
time="07:32:43" level=debug msg="Writing loadbalancer config on kinder-xony-lb..."
time="07:32:43" level=debug msg="Running: [docker cp /tmp/kinder-xony-lb-076547711 kinder-xony-lb:/usr/local/etc/haproxy/haproxy.cfg]"
... skipping 33 lines ...
I0314 07:32:48.319111     579 checks.go:376] validating the presence of executable ebtables
I0314 07:32:48.319236     579 checks.go:376] validating the presence of executable ethtool
I0314 07:32:48.319336     579 checks.go:376] validating the presence of executable socat
I0314 07:32:48.319416     579 checks.go:376] validating the presence of executable tc
I0314 07:32:48.319485     579 checks.go:376] validating the presence of executable touch
I0314 07:32:48.319584     579 checks.go:520] running all checks
	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/4.15.0-1044-gke\n", err: exit status 1
I0314 07:32:48.779275     579 checks.go:406] checking whether the given node name is reachable using net.LookupHost
[preflight] The system verification failed. Printing the output from the verification:
KERNEL_VERSION: 4.15.0-1044-gke
DOCKER_VERSION: 18.09.4
DOCKER_GRAPH_DRIVER: overlay2
OS: Linux
CGROUPS_CPU: enabled
CGROUPS_CPUACCT: enabled
... skipping 336 lines ...
kinder-xony-control-plane-2:$ Preparing /kind/kubeadm.conf
time="07:34:43" level=debug msg="Running: /usr/bin/docker [docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}} kinder-xony-control-plane-2]"
time="07:34:44" level=debug msg="Running: [docker exec kinder-xony-control-plane-2 kubeadm version -o=short]"
time="07:34:45" level=debug msg="Preparing kubeadm config v1beta2 (kubeadm version 1.17.5-beta.0.1+106c255ad7ab80)"
time="07:34:45" level=debug msg="Preparing dockerPatch for kubeadm config v1beta2 (kubeadm version 1.17.5-beta.0.1+106c255ad7ab80)"
time="07:34:45" level=debug msg="Preparing automaticCopyCertsPatches for kubeadm config v1beta2 (kubeadm version 1.17.5-beta.0.1+106c255ad7ab80)"
time="07:34:45" level=debug msg="generated config:\napiVersion: kubeadm.k8s.io/v1beta2\ncontrolPlane:\n  certificateKey: \"0123456789012345678901234567890123456789012345678901234567890123\"\n  localAPIEndpoint:\n    advertiseAddress: 172.17.0.5\n    bindPort: 6443\ndiscovery:\n  bootstrapToken:\n    apiServerEndpoint: 172.17.0.7:6443\n    token: abcdef.0123456789abcdef\n    unsafeSkipCAVerification: true\nkind: JoinConfiguration\nnodeRegistration:\n  criSocket: /var/run/dockershim.sock\n  kubeletExtraArgs:\n    fail-swap-on: \"false\"\n    node-ip: 172.17.0.5\n"
time="07:34:45" level=debug msg="Running: [docker cp /tmp/kinder-xony-control-plane-2-746380781 kinder-xony-control-plane-2:/kind/kubeadm.conf]"
time="07:34:47" level=debug msg="Running: [docker exec kinder-xony-control-plane-2 kubeadm version -o=short]"

kinder-xony-control-plane-2:$ kubeadm join --config=/kind/kubeadm.conf --v=6 --ignore-preflight-errors=Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables
time="07:34:48" level=debug msg="Running: [docker exec kinder-xony-control-plane-2 kubeadm join --config=/kind/kubeadm.conf --v=6 --ignore-preflight-errors=Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables]"
W0314 07:34:50.072595     709 join.go:346] [preflight] WARNING: JoinControlPane.controlPlane settings will be ignored when control-plane flag is not set.
... skipping 18 lines ...
I0314 07:34:51.038858     709 checks.go:376] validating the presence of executable ebtables
I0314 07:34:51.038904     709 checks.go:376] validating the presence of executable ethtool
I0314 07:34:51.038941     709 checks.go:376] validating the presence of executable socat
I0314 07:34:51.039031     709 checks.go:376] validating the presence of executable tc
I0314 07:34:51.039109     709 checks.go:376] validating the presence of executable touch
I0314 07:34:51.039191     709 checks.go:520] running all checks
	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/4.15.0-1044-gke\n", err: exit status 1
I0314 07:34:51.563569     709 checks.go:406] checking whether the given node name is reachable using net.LookupHost
I0314 07:34:51.563975     709 checks.go:618] validating kubelet version
[preflight] The system verification failed. Printing the output from the verification:
KERNEL_VERSION: 4.15.0-1044-gke
DOCKER_VERSION: 18.09.4
DOCKER_GRAPH_DRIVER: overlay2
OS: Linux
CGROUPS_CPU: enabled
CGROUPS_CPUACCT: enabled
... skipping 120 lines ...
I0314 07:35:24.147279     709 local.go:136] Adding etcd member: https://172.17.0.5:2380
I0314 07:35:24.323696     709 local.go:142] Updated etcd member list: [{kinder-xony-control-plane-1 https://172.17.0.4:2380} {kinder-xony-control-plane-2 https://172.17.0.5:2380}]
[etcd] Announced new etcd member joining to the existing etcd cluster
[etcd] Creating static Pod manifest for "etcd"
[etcd] Waiting for the new etcd member to join the cluster. This can take up to 40s
I0314 07:35:24.326473     709 etcd.go:408] [etcd] attempting to see if all cluster endpoints ([https://172.17.0.4:2379 https://172.17.0.5:2379]) are available 1/8
{"level":"warn","ts":"2020-03-14T07:35:41.579Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"passthrough:///https://172.17.0.5:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = context deadline exceeded"}
I0314 07:35:41.579463     709 etcd.go:388] Failed to get etcd status for https://172.17.0.5:2379: context deadline exceeded
[upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0314 07:35:43.040452     709 round_trippers.go:443] POST https://172.17.0.7:6443/api/v1/namespaces/kube-system/configmaps?timeout=10s 409 Conflict in 1388 milliseconds
I0314 07:35:43.072469     709 round_trippers.go:443] GET https://172.17.0.7:6443/api/v1/namespaces/kube-system/configmaps/kubeadm-config?timeout=10s 200 OK in 31 milliseconds
I0314 07:35:43.102491     709 round_trippers.go:443] PUT https://172.17.0.7:6443/api/v1/namespaces/kube-system/configmaps/kubeadm-config?timeout=10s 200 OK in 28 milliseconds
I0314 07:35:43.123562     709 round_trippers.go:443] POST https://172.17.0.7:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/roles?timeout=10s 409 Conflict in 18 milliseconds
I0314 07:35:43.132495     709 round_trippers.go:443] PUT https://172.17.0.7:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/roles/kubeadm:nodes-kubeadm-config?timeout=10s 200 OK in 8 milliseconds
... skipping 66 lines ...
kinder-xony-control-plane-3:$ Preparing /kind/kubeadm.conf
time="07:36:04" level=debug msg="Running: /usr/bin/docker [docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}} kinder-xony-control-plane-3]"
time="07:36:04" level=debug msg="Running: [docker exec kinder-xony-control-plane-3 kubeadm version -o=short]"
time="07:36:06" level=debug msg="Preparing kubeadm config v1beta2 (kubeadm version 1.17.5-beta.0.1+106c255ad7ab80)"
time="07:36:06" level=debug msg="Preparing dockerPatch for kubeadm config v1beta2 (kubeadm version 1.17.5-beta.0.1+106c255ad7ab80)"
time="07:36:06" level=debug msg="Preparing automaticCopyCertsPatches for kubeadm config v1beta2 (kubeadm version 1.17.5-beta.0.1+106c255ad7ab80)"
time="07:36:06" level=debug msg="generated config:\napiVersion: kubeadm.k8s.io/v1beta2\ncontrolPlane:\n  certificateKey: \"0123456789012345678901234567890123456789012345678901234567890123\"\n  localAPIEndpoint:\n    advertiseAddress: 172.17.0.3\n    bindPort: 6443\ndiscovery:\n  bootstrapToken:\n    apiServerEndpoint: 172.17.0.7:6443\n    token: abcdef.0123456789abcdef\n    unsafeSkipCAVerification: true\nkind: JoinConfiguration\nnodeRegistration:\n  criSocket: /var/run/dockershim.sock\n  kubeletExtraArgs:\n    fail-swap-on: \"false\"\n    node-ip: 172.17.0.3\n"
time="07:36:06" level=debug msg="Running: [docker cp /tmp/kinder-xony-control-plane-3-652052135 kinder-xony-control-plane-3:/kind/kubeadm.conf]"
time="07:36:07" level=debug msg="Running: [docker exec kinder-xony-control-plane-3 kubeadm version -o=short]"

kinder-xony-control-plane-3:$ kubeadm join --config=/kind/kubeadm.conf --v=6 --ignore-preflight-errors=Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables
time="07:36:09" level=debug msg="Running: [docker exec kinder-xony-control-plane-3 kubeadm join --config=/kind/kubeadm.conf --v=6 --ignore-preflight-errors=Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables]"
W0314 07:36:10.455301     823 join.go:346] [preflight] WARNING: JoinControlPane.controlPlane settings will be ignored when control-plane flag is not set.
... skipping 18 lines ...
I0314 07:36:11.641750     823 checks.go:376] validating the presence of executable ebtables
I0314 07:36:11.641785     823 checks.go:376] validating the presence of executable ethtool
I0314 07:36:11.641819     823 checks.go:376] validating the presence of executable socat
I0314 07:36:11.641856     823 checks.go:376] validating the presence of executable tc
I0314 07:36:11.641909     823 checks.go:376] validating the presence of executable touch
I0314 07:36:11.641960     823 checks.go:520] running all checks
[preflight] The system verification failed. Printing the output from the verification:
KERNEL_VERSION: 4.15.0-1044-gke
DOCKER_VERSION: 18.09.4
DOCKER_GRAPH_DRIVER: overlay2
OS: Linux
CGROUPS_CPU: enabled
CGROUPS_CPUACCT: enabled
CGROUPS_CPUSET: enabled
CGROUPS_DEVICES: enabled
CGROUPS_FREEZER: enabled
CGROUPS_MEMORY: enabled
	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/4.15.0-1044-gke\n", err: exit status 1
I0314 07:36:12.219447     823 checks.go:406] checking whether the given node name is reachable using net.LookupHost
I0314 07:36:12.220338     823 checks.go:618] validating kubelet version
I0314 07:36:12.600246     823 checks.go:128] validating if the service is enabled and active
I0314 07:36:12.638809     823 checks.go:201] validating availability of port 10250
I0314 07:36:12.639025     823 checks.go:432] validating if the connectivity type is via proxy or direct
I0314 07:36:12.639887     823 join.go:441] [preflight] Discovering cluster-info
... skipping 112 lines ...
I0314 07:36:47.382305     823 local.go:136] Adding etcd member: https://172.17.0.3:2380
[etcd] Announced new etcd member joining to the existing etcd cluster
[etcd] Creating static Pod manifest for "etcd"
I0314 07:36:47.466773     823 local.go:142] Updated etcd member list: [{kinder-xony-control-plane-1 https://172.17.0.4:2380} {kinder-xony-control-plane-2 https://172.17.0.5:2380} {kinder-xony-control-plane-3 https://172.17.0.3:2380}]
[etcd] Waiting for the new etcd member to join the cluster. This can take up to 40s
I0314 07:36:47.470075     823 etcd.go:408] [etcd] attempting to see if all cluster endpoints ([https://172.17.0.4:2379 https://172.17.0.5:2379 https://172.17.0.3:2379]) are available 1/8
{"level":"warn","ts":"2020-03-14T07:36:53.389Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"passthrough:///https://172.17.0.3:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = context deadline exceeded"}
I0314 07:36:53.389841     823 etcd.go:388] Failed to get etcd status for https://172.17.0.3:2379: context deadline exceeded
[upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0314 07:36:53.491527     823 round_trippers.go:443] POST https://172.17.0.7:6443/api/v1/namespaces/kube-system/configmaps?timeout=10s 409 Conflict in 21 milliseconds
I0314 07:36:53.502257     823 round_trippers.go:443] GET https://172.17.0.7:6443/api/v1/namespaces/kube-system/configmaps/kubeadm-config?timeout=10s 200 OK in 10 milliseconds
I0314 07:36:53.524480     823 round_trippers.go:443] PUT https://172.17.0.7:6443/api/v1/namespaces/kube-system/configmaps/kubeadm-config?timeout=10s 200 OK in 20 milliseconds
I0314 07:36:53.541947     823 round_trippers.go:443] POST https://172.17.0.7:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/roles?timeout=10s 409 Conflict in 14 milliseconds
I0314 07:36:53.549825     823 round_trippers.go:443] PUT https://172.17.0.7:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/roles/kubeadm:nodes-kubeadm-config?timeout=10s 200 OK in 7 milliseconds
... skipping 72 lines ...

kinder-xony-worker-1:$ Preparing /kind/kubeadm.conf
time="07:37:38" level=debug msg="Running: /usr/bin/docker [docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}} kinder-xony-worker-1]"
time="07:37:38" level=debug msg="Running: [docker exec kinder-xony-worker-1 kubeadm version -o=short]"
time="07:37:40" level=debug msg="Preparing kubeadm config v1beta2 (kubeadm version 1.17.5-beta.0.1+106c255ad7ab80)"
time="07:37:40" level=debug msg="Preparing dockerPatch for kubeadm config v1beta2 (kubeadm version 1.17.5-beta.0.1+106c255ad7ab80)"
time="07:37:40" level=debug msg="generated config:\napiVersion: kubeadm.k8s.io/v1beta2\ndiscovery:\n  bootstrapToken:\n    apiServerEndpoint: 172.17.0.7:6443\n    token: abcdef.0123456789abcdef\n    unsafeSkipCAVerification: true\nkind: JoinConfiguration\nnodeRegistration:\n  criSocket: /var/run/dockershim.sock\n  kubeletExtraArgs:\n    fail-swap-on: \"false\"\n    node-ip: 172.17.0.6\n"
time="07:37:40" level=debug msg="Running: [docker cp /tmp/kinder-xony-worker-1-127568753 kinder-xony-worker-1:/kind/kubeadm.conf]"

kinder-xony-worker-1:$ kubeadm join --config=/kind/kubeadm.conf --v=6 --ignore-preflight-errors=Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables
time="07:37:41" level=debug msg="Running: [docker exec kinder-xony-worker-1 kubeadm join --config=/kind/kubeadm.conf --v=6 --ignore-preflight-errors=Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables]"
W0314 07:37:43.203492     872 join.go:346] [preflight] WARNING: JoinControlPane.controlPlane settings will be ignored when control-plane flag is not set.
I0314 07:37:43.203686     872 join.go:371] [preflight] found NodeName empty; using OS hostname as NodeName
... skipping 17 lines ...
I0314 07:37:44.355892     872 checks.go:376] validating the presence of executable ebtables
I0314 07:37:44.355931     872 checks.go:376] validating the presence of executable ethtool
I0314 07:37:44.355967     872 checks.go:376] validating the presence of executable socat
I0314 07:37:44.356120     872 checks.go:376] validating the presence of executable tc
I0314 07:37:44.356202     872 checks.go:376] validating the presence of executable touch
I0314 07:37:44.356256     872 checks.go:520] running all checks
[preflight] The system verification failed. Printing the output from the verification:
KERNEL_VERSION: 4.15.0-1044-gke
DOCKER_VERSION: 18.09.4
DOCKER_GRAPH_DRIVER: overlay2
OS: Linux
CGROUPS_CPU: enabled
CGROUPS_CPUACCT: enabled
CGROUPS_CPUSET: enabled
CGROUPS_DEVICES: enabled
CGROUPS_FREEZER: enabled
CGROUPS_MEMORY: enabled
	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/4.15.0-1044-gke\n", err: exit status 1
I0314 07:37:44.900656     872 checks.go:406] checking whether the given node name is reachable using net.LookupHost
I0314 07:37:44.902045     872 checks.go:618] validating kubelet version
I0314 07:37:45.386338     872 checks.go:128] validating if the service is enabled and active
I0314 07:37:45.450865     872 checks.go:201] validating availability of port 10250
I0314 07:37:45.451371     872 checks.go:286] validating the existence of file /etc/kubernetes/pki/ca.crt
I0314 07:37:45.451395     872 checks.go:432] validating if the connectivity type is via proxy or direct
... skipping 87 lines ...

kinder-xony-worker-2:$ Preparing /kind/kubeadm.conf
time="07:38:38" level=debug msg="Running: /usr/bin/docker [docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}} kinder-xony-worker-2]"
time="07:38:39" level=debug msg="Running: [docker exec kinder-xony-worker-2 kubeadm version -o=short]"
time="07:38:40" level=debug msg="Preparing kubeadm config v1beta2 (kubeadm version 1.17.5-beta.0.1+106c255ad7ab80)"
time="07:38:40" level=debug msg="Preparing dockerPatch for kubeadm config v1beta2 (kubeadm version 1.17.5-beta.0.1+106c255ad7ab80)"
time="07:38:40" level=debug msg="generated config:\napiVersion: kubeadm.k8s.io/v1beta2\ndiscovery:\n  bootstrapToken:\n    apiServerEndpoint: 172.17.0.7:6443\n    token: abcdef.0123456789abcdef\n    unsafeSkipCAVerification: true\nkind: JoinConfiguration\nnodeRegistration:\n  criSocket: /var/run/dockershim.sock\n  kubeletExtraArgs:\n    fail-swap-on: \"false\"\n    node-ip: 172.17.0.2\n"
time="07:38:40" level=debug msg="Running: [docker cp /tmp/kinder-xony-worker-2-878378524 kinder-xony-worker-2:/kind/kubeadm.conf]"

kinder-xony-worker-2:$ kubeadm join --config=/kind/kubeadm.conf --v=6 --ignore-preflight-errors=Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables
time="07:38:41" level=debug msg="Running: [docker exec kinder-xony-worker-2 kubeadm join --config=/kind/kubeadm.conf --v=6 --ignore-preflight-errors=Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables]"
W0314 07:38:42.894032     945 join.go:346] [preflight] WARNING: JoinControlPane.controlPlane settings will be ignored when control-plane flag is not set.
I0314 07:38:42.894097     945 join.go:371] [preflight] found NodeName empty; using OS hostname as NodeName
... skipping 17 lines ...
I0314 07:38:44.026208     945 checks.go:376] validating the presence of executable ebtables
I0314 07:38:44.026244     945 checks.go:376] validating the presence of executable ethtool
I0314 07:38:44.026281     945 checks.go:376] validating the presence of executable socat
I0314 07:38:44.026321     945 checks.go:376] validating the presence of executable tc
I0314 07:38:44.026356     945 checks.go:376] validating the presence of executable touch
I0314 07:38:44.026898     945 checks.go:520] running all checks
[preflight] The system verification failed. Printing the output from the verification:
KERNEL_VERSION: 4.15.0-1044-gke
DOCKER_VERSION: 18.09.4
DOCKER_GRAPH_DRIVER: overlay2
OS: Linux
CGROUPS_CPU: enabled
CGROUPS_CPUACCT: enabled
CGROUPS_CPUSET: enabled
CGROUPS_DEVICES: enabled
CGROUPS_FREEZER: enabled
CGROUPS_MEMORY: enabled
	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/4.15.0-1044-gke\n", err: exit status 1
I0314 07:38:44.539945     945 checks.go:406] checking whether the given node name is reachable using net.LookupHost
I0314 07:38:44.540702     945 checks.go:618] validating kubelet version
I0314 07:38:44.802100     945 checks.go:128] validating if the service is enabled and active
I0314 07:38:44.878620     945 checks.go:201] validating availability of port 10250
I0314 07:38:44.879626     945 checks.go:286] validating the existence of file /etc/kubernetes/pki/ca.crt
I0314 07:38:44.880289     945 checks.go:432] validating if the connectivity type is via proxy or direct
... skipping 767 lines ...
time="07:44:45" level=debug msg="Running: /usr/bin/docker [docker ps -q -a --no-trunc --filter label=io.k8s.sigs.kind.cluster --format {{.Names}}\\t{{.Label \"io.k8s.sigs.kind.cluster\"}} --filter label=io.k8s.sigs.kind.cluster=kinder-xony]"
[AfterEach] [k8s.io] [sig-cluster-lifecycle] [area-kubeadm] DNS addon
  /home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:152
Mar 14 07:44:45.264: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
•
Ran 31 of 37 Specs in 1.001 seconds
SUCCESS! -- 31 Passed | 0 Failed | 0 Pending | 6 Skipped
PASS

Ginkgo ran 1 suite in 1.225868191s
Test Suite Passed
time="07:44:45" level=debug msg="Running: /usr/bin/docker [docker inspect -f {{index .Config.Labels \"io.k8s.sigs.kind.role\"}} kinder-xony-lb]"
time="07:44:46" level=debug msg="Running: /usr/bin/docker [docker inspect -f {{index .Config.Labels \"io.k8s.sigs.kind.role\"}} kinder-xony-control-plane-1]"
... skipping 87 lines ...
I0314 07:45:06.356677   16756 local.go:106] [etcd] get the member id from peer: https://172.17.0.4:2380
I0314 07:45:06.386757   16756 local.go:112] [etcd] removing etcd member: https://172.17.0.4:2380, id: 4682922252190157995
I0314 07:45:06.432812   16756 local.go:117] [etcd] Updated etcd member list: [{kinder-xony-control-plane-2 https://172.17.0.5:2380} {kinder-xony-control-plane-3 https://172.17.0.3:2380}]
I0314 07:45:06.433872   16756 cleanupnode.go:57] [reset] Getting init system
[reset] Stopping the kubelet service
[reset] Unmounting mounted directories in "/var/lib/kubelet"
W0314 07:45:06.606135   16756 unmount_linux.go:42] [reset] Failed to unmount mounted directory in /var/lib/kubelet: /var/lib/kubelet
I0314 07:45:06.826066   16756 cleanupnode.go:79] [reset] Removing Kubernetes-managed containers
I0314 07:45:29.795863   16756 cleanupnode.go:87] [reset] Removing contents from the config and pki directories
[reset] Deleting contents of config directories: [/etc/kubernetes/manifests /etc/kubernetes/pki]
I0314 07:45:29.798420   16756 reset.go:218] [reset] Deleting content of /var/lib/etcd
[reset] Deleting files: [/etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/bootstrap-kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf]
[reset] Deleting contents of stateful directories: [/var/lib/etcd /var/lib/kubelet /var/lib/dockershim /var/run/kubernetes /var/lib/cni]
... skipping 38 lines ...
I0314 07:45:31.571438    8634 etcd.go:125] update etcd endpoints: https://172.17.0.5:2379,https://172.17.0.3:2379
I0314 07:45:31.571449    8634 local.go:106] [etcd] get the member id from peer: https://172.17.0.5:2380
I0314 07:45:31.591807    8634 local.go:112] [etcd] removing etcd member: https://172.17.0.5:2380, id: 5189662743265453658
[reset] Stopping the kubelet service
I0314 07:45:31.664815    8634 local.go:117] [etcd] Updated etcd member list: [{kinder-xony-control-plane-3 https://172.17.0.3:2380}]
I0314 07:45:31.665854    8634 cleanupnode.go:57] [reset] Getting init system
W0314 07:45:31.816244    8634 unmount_linux.go:42] [reset] Failed to unmount mounted directory in /var/lib/kubelet: /var/lib/kubelet
[reset] Unmounting mounted directories in "/var/lib/kubelet"
I0314 07:45:31.878731    8634 cleanupnode.go:79] [reset] Removing Kubernetes-managed containers
[reset] Deleting contents of config directories: [/etc/kubernetes/manifests /etc/kubernetes/pki]
I0314 07:45:45.596016    8634 cleanupnode.go:87] [reset] Removing contents from the config and pki directories
[reset] Deleting files: [/etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/bootstrap-kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf]
[reset] Deleting contents of stateful directories: [/var/lib/etcd /var/lib/kubelet /var/lib/dockershim /var/run/kubernetes /var/lib/cni]
... skipping 32 lines ...
I0314 07:45:46.971989    8000 uploadconfig.go:58] Removing APIEndpoint for Node "kinder-xony-control-plane-3"
I0314 07:45:46.980809    8000 round_trippers.go:443] PUT https://172.17.0.7:6443/api/v1/namespaces/kube-system/configmaps/kubeadm-config?timeout=10s 200 OK in 5 milliseconds
I0314 07:45:46.982306    8000 removeetcdmember.go:54] [reset] Checking for etcd config
I0314 07:45:46.982347    8000 local.go:97] [etcd] creating etcd client that connects to etcd pods
I0314 07:45:46.987334    8000 round_trippers.go:443] GET https://172.17.0.7:6443/api/v1/namespaces/kube-system/configmaps/kubeadm-config?timeout=10s 200 OK in 4 milliseconds
I0314 07:45:46.988473    8000 etcd.go:107] etcd endpoints read from pods: 
W0314 07:45:46.990874    8000 removeetcdmember.go:61] [reset] failed to remove etcd member: error syncing endpoints with etc: etcdclient: no available endpoints
.Please manually remove this etcd member using etcdctl
I0314 07:45:46.990934    8000 cleanupnode.go:57] [reset] Getting init system
[reset] Stopping the kubelet service
[reset] Unmounting mounted directories in "/var/lib/kubelet"
W0314 07:45:47.154222    8000 unmount_linux.go:42] [reset] Failed to unmount mounted directory in /var/lib/kubelet: /var/lib/kubelet
I0314 07:45:47.214340    8000 cleanupnode.go:79] [reset] Removing Kubernetes-managed containers
I0314 07:45:59.467082    8000 cleanupnode.go:87] [reset] Removing contents from the config and pki directories
[reset] Deleting contents of config directories: [/etc/kubernetes/manifests /etc/kubernetes/pki]
I0314 07:45:59.472423    8000 reset.go:218] [reset] Deleting content of /var/lib/etcd
[reset] Deleting files: [/etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/bootstrap-kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf]
[reset] Deleting contents of stateful directories: [/var/lib/etcd /var/lib/kubelet /var/lib/dockershim /var/run/kubernetes /var/lib/cni]
... skipping 21 lines ...
[reset] No etcd config found. Assuming external etcd
[reset] Please, manually reset etcd to prevent further issues
[reset] Stopping the kubelet service
I0314 07:46:00.642945    6618 removeetcdmember.go:54] [reset] Checking for etcd config
W0314 07:46:00.643635    6618 removeetcdmember.go:79] [reset] No kubeadm config, using etcd pod spec to get data directory
I0314 07:46:00.644363    6618 cleanupnode.go:57] [reset] Getting init system
W0314 07:46:00.782007    6618 unmount_linux.go:42] [reset] Failed to unmount mounted directory in /var/lib/kubelet: /var/lib/kubelet
[reset] Unmounting mounted directories in "/var/lib/kubelet"
I0314 07:46:00.835644    6618 cleanupnode.go:79] [reset] Removing Kubernetes-managed containers
I0314 07:46:05.298825    6618 cleanupnode.go:87] [reset] Removing contents from the config and pki directories
[reset] Deleting contents of config directories: [/etc/kubernetes/manifests /etc/kubernetes/pki]
[reset] Deleting files: [/etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/bootstrap-kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf]
[reset] Deleting contents of stateful directories: [/var/lib/kubelet /var/lib/dockershim /var/run/kubernetes /var/lib/cni]
... skipping 22 lines ...
I0314 07:46:06.584315    6181 reset.go:102] [reset] Could not obtain a client set from the kubeconfig file: /etc/kubernetes/admin.conf
I0314 07:46:06.584368    6181 reset.go:120] [reset] Detected and using CRI socket: /var/run/dockershim.sock
I0314 07:46:06.584394    6181 removeetcdmember.go:54] [reset] Checking for etcd config
W0314 07:46:06.584398    6181 removeetcdmember.go:79] [reset] No kubeadm config, using etcd pod spec to get data directory
I0314 07:46:06.584420    6181 cleanupnode.go:57] [reset] Getting init system
[reset] Unmounting mounted directories in "/var/lib/kubelet"
W0314 07:46:06.727129    6181 unmount_linux.go:42] [reset] Failed to unmount mounted directory in /var/lib/kubelet: /var/lib/kubelet
I0314 07:46:06.793868    6181 cleanupnode.go:79] [reset] Removing Kubernetes-managed containers
I0314 07:46:11.917891    6181 cleanupnode.go:87] [reset] Removing contents from the config and pki directories
[reset] Deleting contents of config directories: [/etc/kubernetes/manifests /etc/kubernetes/pki]
[reset] Deleting files: [/etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/bootstrap-kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf]
[reset] Deleting contents of stateful directories: [/var/lib/kubelet /var/lib/dockershim /var/run/kubernetes /var/lib/cni]
I0314 07:46:11.920398    6181 reset.go:218] [reset] Deleting content of /var/lib/kubelet
... skipping 20 lines ...
Deleting cluster "kinder-xony" ...
time="07:46:12" level=debug msg="Running: /usr/bin/docker [docker ps -q -a --no-trunc --filter label=io.k8s.sigs.kind.cluster --format {{.Names}}\\t{{.Label \"io.k8s.sigs.kind.cluster\"}} --filter label=io.k8s.sigs.kind.cluster=kinder-xony]"
time="07:46:13" level=debug msg="Running: /usr/bin/docker [docker rm -f -v kinder-xony-lb kinder-xony-control-plane-1 kinder-xony-control-plane-3 kinder-xony-worker-1 kinder-xony-control-plane-2 kinder-xony-worker-2]"
 completed!

Ran 10 of 11 tasks in 0.000 seconds
FAIL! -- 9 tasks Passed | 1 Failed | 1 Skipped

see junit-runner.xml and task logs files for more details

Error: failed executing the workflow
+ EXIT_VALUE=1
+ set +o xtrace
Cleaning up after docker in docker.
================================================================================
Cleaning up binfmt_misc ...
================================================================================
... skipping 2 lines ...