This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 23 succeeded
Started2019-05-14 18:10
Elapsed1h5m
Revision
Buildergke-prow-containerd-pool-99179761-59r5
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/8112e778-b310-4efa-8f9b-b1dd65a748ae/targets/test'}}
pod66209908-7673-11e9-b740-0a580a6c086f
resultstorehttps://source.cloud.google.com/results/invocations/8112e778-b310-4efa-8f9b-b1dd65a748ae/targets/test
infra-commit281ddc29a
job-versionv1.12.9-beta.0.41+8c3d5963f4d793
master_os_image
node_os_imageubuntu-gke-1804-d1703-0-v20190409
pod66209908-7673-11e9-b740-0a580a6c086f
revisionv1.12.9-beta.0.41+8c3d5963f4d793

Test Failures


Check APIReachability 53s

error starting ./cluster/kubectl.sh --match-server-version=false version: exec: already started
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 23 Passed Tests

Show 2006 Skipped Tests

Error lines from build-log.txt

... skipping 12 lines ...
I0514 18:10:12.458] process 44 exited with code 0 after 0.0m
I0514 18:10:12.458] Will upload results to gs://kubernetes-jenkins/logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com
I0514 18:10:12.458] Root: /workspace
I0514 18:10:12.459] cd to /workspace
I0514 18:10:12.459] Configure environment...
I0514 18:10:12.459] Call:  git show -s --format=format:%ct HEAD
W0514 18:10:12.463] fatal: Not a git repository (or any of the parent directories): .git
I0514 18:10:12.463] process 56 exited with code 128 after 0.0m
W0514 18:10:12.463] Unable to print commit date for HEAD
I0514 18:10:12.464] Call:  gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json
W0514 18:10:13.315] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
I0514 18:10:13.496] process 57 exited with code 0 after 0.0m
I0514 18:10:13.497] Call:  gcloud config get-value account
... skipping 417 lines ...
I0514 18:24:20.817] NAME             LOCATION    MASTER_VERSION                   MASTER_IP      MACHINE_TYPE   NODE_VERSION                     NUM_NODES  STATUS
I0514 18:24:20.818] test-2430af97aa  us-west1-b  1.12.9-beta.0.41+8c3d5963f4d793  35.247.99.118  n1-standard-2  1.12.9-beta.0.41+8c3d5963f4d793  3          RUNNING
W0514 18:24:20.919] 2019/05/14 18:24:20 process.go:155: Step 'gcloud container clusters create --quiet --project=kube-gke-upg-1-2-1-4-upg-clu-n --zone=us-west1-b --machine-type=n1-standard-2 --image-type=custom --num-nodes=3 --network=test-2430af97aa --image-family=pipeline-1 --image-project=ubuntu-os-gke-cloud-devel --cluster-version=1.12.9-beta.0.41+8c3d5963f4d793 test-2430af97aa' finished in 3m34.520707238s
W0514 18:24:20.919] 2019/05/14 18:24:20 process.go:153: Running: ./cluster/kubectl.sh --match-server-version=false version
W0514 18:24:34.348] Unable to connect to the server: net/http: TLS handshake timeout
W0514 18:24:34.356] 2019/05/14 18:24:34 process.go:155: Step './cluster/kubectl.sh --match-server-version=false version' finished in 13.533106954s
W0514 18:24:34.413] 2019/05/14 18:24:34 e2e.go:333: Failed to reach api. Sleeping for 10 seconds before retrying... ([./cluster/kubectl.sh --match-server-version=false version])
W0514 18:24:44.413] 2019/05/14 18:24:44 process.go:153: Running: ./cluster/kubectl.sh --match-server-version=false version
W0514 18:24:44.414] 2019/05/14 18:24:44 process.go:155: Step './cluster/kubectl.sh --match-server-version=false version' finished in 10.919µs
W0514 18:24:44.414] 2019/05/14 18:24:44 e2e.go:333: Failed to reach api. Sleeping for 10 seconds before retrying... ([./cluster/kubectl.sh --match-server-version=false version])
W0514 18:24:54.413] 2019/05/14 18:24:54 process.go:153: Running: ./cluster/kubectl.sh --match-server-version=false version
W0514 18:24:54.414] 2019/05/14 18:24:54 process.go:155: Step './cluster/kubectl.sh --match-server-version=false version' finished in 9.681µs
W0514 18:24:54.414] 2019/05/14 18:24:54 e2e.go:333: Failed to reach api. Sleeping for 10 seconds before retrying... ([./cluster/kubectl.sh --match-server-version=false version])
W0514 18:25:04.414] 2019/05/14 18:25:04 process.go:153: Running: ./cluster/kubectl.sh --match-server-version=false version
W0514 18:25:04.414] 2019/05/14 18:25:04 process.go:155: Step './cluster/kubectl.sh --match-server-version=false version' finished in 17.984µs
W0514 18:25:04.414] 2019/05/14 18:25:04 e2e.go:333: Failed to reach api. Sleeping for 10 seconds before retrying... ([./cluster/kubectl.sh --match-server-version=false version])
W0514 18:25:14.414] 2019/05/14 18:25:14 process.go:153: Running: ./cluster/kubectl.sh --match-server-version=false version
W0514 18:25:14.414] 2019/05/14 18:25:14 process.go:155: Step './cluster/kubectl.sh --match-server-version=false version' finished in 11.142µs
W0514 18:25:14.415] 2019/05/14 18:25:14 process.go:153: Running: ./cluster/kubectl.sh --match-server-version=false get nodes -oyaml
W0514 18:25:18.227] 2019/05/14 18:25:18 process.go:155: Step './cluster/kubectl.sh --match-server-version=false get nodes -oyaml' finished in 3.812934306s
W0514 18:25:18.228] 2019/05/14 18:25:18 e2e.go:444: Listing resources...
W0514 18:25:18.229] 2019/05/14 18:25:18 process.go:153: Running: ./cluster/gce/list-resources.sh
... skipping 45 lines ...
I0514 18:25:49.677] W0514 18:25:49.677111    1756 gce.go:467] No network name or URL specified.
I0514 18:25:52.917] May 14 18:25:52.917: INFO: cluster-master-image: 
I0514 18:25:52.918] May 14 18:25:52.917: INFO: cluster-node-image: ubuntu-gke-1804-d1703-0-v20190409
I0514 18:25:52.918] May 14 18:25:52.917: INFO: >>> kubeConfig: /tmp/gke-kubecfg902781572
I0514 18:25:52.920] May 14 18:25:52.920: INFO: Waiting up to 30m0s for all (but 0) nodes to be schedulable
I0514 18:25:53.126] May 14 18:25:53.126: INFO: Waiting up to 10m0s for all pods (need at least 8) in namespace 'kube-system' to be running and ready
I0514 18:25:53.791] May 14 18:25:53.791: INFO: The status of Pod fluentd-gcp-v3.2.0-h7qnq is Running (Ready = false), waiting for it to be either Running (with Ready = true) or Failed
I0514 18:25:53.791] May 14 18:25:53.791: INFO: 16 / 17 pods in namespace 'kube-system' are running and ready (0 seconds elapsed)
I0514 18:25:53.791] May 14 18:25:53.791: INFO: expected 8 pod replicas in namespace 'kube-system', 8 are Running and Ready.
I0514 18:25:53.792] May 14 18:25:53.791: INFO: POD                       NODE                                            PHASE    GRACE  CONDITIONS
I0514 18:25:53.792] May 14 18:25:53.791: INFO: fluentd-gcp-v3.2.0-h7qnq  gke-test-2430af97aa-default-pool-32717786-h0qf  Running  60s    [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-05-14 18:24:16 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2019-05-14 18:25:43 +0000 UTC ContainersNotReady containers with unready status: [fluentd-gcp prometheus-to-sd-exporter]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2019-05-14 18:25:43 +0000 UTC ContainersNotReady containers with unready status: [fluentd-gcp prometheus-to-sd-exporter]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-05-14 18:24:16 +0000 UTC  }]
I0514 18:25:53.792] May 14 18:25:53.791: INFO: 
I0514 18:25:55.925] May 14 18:25:55.924: INFO: The status of Pod fluentd-gcp-v3.2.0-4k2kk is Pending (Ready = false), waiting for it to be either Running (with Ready = true) or Failed
I0514 18:25:55.925] May 14 18:25:55.925: INFO: 16 / 17 pods in namespace 'kube-system' are running and ready (2 seconds elapsed)
I0514 18:25:55.925] May 14 18:25:55.925: INFO: expected 8 pod replicas in namespace 'kube-system', 8 are Running and Ready.
I0514 18:25:55.926] May 14 18:25:55.925: INFO: POD                       NODE                                            PHASE    GRACE  CONDITIONS
I0514 18:25:55.926] May 14 18:25:55.925: INFO: fluentd-gcp-v3.2.0-4k2kk  gke-test-2430af97aa-default-pool-32717786-h0qf  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-05-14 18:25:55 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2019-05-14 18:25:55 +0000 UTC ContainersNotReady containers with unready status: [fluentd-gcp prometheus-to-sd-exporter]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2019-05-14 18:25:55 +0000 UTC ContainersNotReady containers with unready status: [fluentd-gcp prometheus-to-sd-exporter]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-05-14 18:25:55 +0000 UTC  }]
I0514 18:25:55.926] May 14 18:25:55.925: INFO: 
I0514 18:25:57.922] May 14 18:25:57.922: INFO: 17 / 17 pods in namespace 'kube-system' are running and ready (4 seconds elapsed)
... skipping 2113 lines ...
I0514 19:10:19.997] ------------------------------
I0514 19:10:19.998] SSSSSSSSSSSSSSSSSSSSSSSSMay 14 19:10:19.996: INFO: Running AfterSuite actions on all node
I0514 19:10:19.998] May 14 19:10:19.996: INFO: Running AfterSuite actions on node 1
I0514 19:10:19.998] May 14 19:10:19.996: INFO: Skipping dumping logs from cluster
I0514 19:10:19.998] 
I0514 19:10:19.998] Ran 6 of 2012 Specs in 2670.491 seconds
I0514 19:10:20.009] SUCCESS! -- 6 Passed | 0 Failed | 0 Pending | 2006 Skipped PASS
I0514 19:10:20.027] 
I0514 19:10:20.027] Ginkgo ran 1 suite in 44m31.313818694s
I0514 19:10:20.027] Test Suite Passed
I0514 19:10:20.065] Checking for custom logdump instances, if any
I0514 19:10:20.096] Using 'use_custom_instance_list' with gke, skipping check for LOG_DUMP_SSH_KEY and LOG_DUMP_SSH_USER
W0514 19:10:20.197] 2019/05/14 19:10:20 process.go:155: Step './hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Reboot\] --minStartupPods=8 --num-nodes=3 --report-dir=/workspace/_artifacts --disable-log-dump=true' finished in 44m31.963940013s
... skipping 37 lines ...
W0514 19:11:09.178] #          See https://cloud.google.com/kubernetes-engine/docs/concepts/node-images#modifications
W0514 19:11:09.179] #          for more information.
W0514 19:11:09.179] ##############################################################################
W0514 19:11:09.740] scp: /var/log/fluentd.log*: No such file or directory
W0514 19:11:09.741] scp: /var/log/node-problem-detector.log*: No such file or directory
W0514 19:11:09.741] scp: /var/log/kubelet.cov*: No such file or directory
W0514 19:11:09.914] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1].
W0514 19:11:09.938] ##############################################################################
W0514 19:11:09.939] # WARNING: Any changes on the boot disk of the node must be made via
W0514 19:11:09.939] #          DaemonSet in order to preserve them across node (re)creations.
W0514 19:11:09.939] #          Node will be (re)created during manual-upgrade, auto-upgrade,
W0514 19:11:09.939] #          auto-repair or auto-scaling.
W0514 19:11:09.939] #          See https://cloud.google.com/kubernetes-engine/docs/concepts/node-images#modifications
... skipping 7 lines ...
W0514 19:11:10.132] #          See https://cloud.google.com/kubernetes-engine/docs/concepts/node-images#modifications
W0514 19:11:10.132] #          for more information.
W0514 19:11:10.133] ##############################################################################
W0514 19:11:10.508] scp: /var/log/fluentd.log*: No such file or directory
W0514 19:11:10.508] scp: /var/log/node-problem-detector.log*: No such file or directory
W0514 19:11:10.509] scp: /var/log/kubelet.cov*: No such file or directory
W0514 19:11:10.514] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1].
W0514 19:11:10.699] scp: /var/log/fluentd.log*: No such file or directory
W0514 19:11:10.699] scp: /var/log/node-problem-detector.log*: No such file or directory
W0514 19:11:10.699] scp: /var/log/kubelet.cov*: No such file or directory
W0514 19:11:10.706] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1].
W0514 19:11:10.801] 2019/05/14 19:11:10 process.go:155: Step 'bash -c 
W0514 19:11:10.801] function log_dump_custom_get_instances() {
W0514 19:11:10.801]   if [[ $1 == "master" ]]; then
W0514 19:11:10.801]     return 0
W0514 19:11:10.802]   fi
W0514 19:11:10.802] 
... skipping 48 lines ...
W0514 19:15:54.131] Listed 0 items.
W0514 19:15:54.743] Listed 0 items.
W0514 19:15:54.807] 2019/05/14 19:15:54 process.go:155: Step './cluster/gce/list-resources.sh' finished in 10.116423256s
W0514 19:15:54.807] 2019/05/14 19:15:54 process.go:153: Running: diff -sw -U0 -F^\[.*\]$ /workspace/_artifacts/gcp-resources-before.txt /workspace/_artifacts/gcp-resources-after.txt
W0514 19:15:54.809] 2019/05/14 19:15:54 process.go:155: Step 'diff -sw -U0 -F^\[.*\]$ /workspace/_artifacts/gcp-resources-before.txt /workspace/_artifacts/gcp-resources-after.txt' finished in 1.982556ms
W0514 19:15:54.810] 2019/05/14 19:15:54 process.go:96: Saved XML output to /workspace/_artifacts/junit_runner.xml.
W0514 19:15:56.109] 2019/05/14 19:15:56 main.go:314: Something went wrong: encountered 1 errors: [error starting ./cluster/kubectl.sh --match-server-version=false version: exec: already started]
W0514 19:15:56.115] Traceback (most recent call last):
W0514 19:15:56.115]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 778, in <module>
W0514 19:15:56.175]     main(parse_args())
W0514 19:15:56.175]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 626, in main
W0514 19:15:56.175]     mode.start(runner_args)
W0514 19:15:56.176]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 262, in start
W0514 19:15:56.176]     check_env(env, self.command, *args)
W0514 19:15:56.176]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 111, in check_env
W0514 19:15:56.176]     subprocess.check_call(cmd, env=env)
W0514 19:15:56.176]   File "/usr/lib/python2.7/subprocess.py", line 186, in check_call
W0514 19:15:56.176]     raise CalledProcessError(retcode, cmd)
W0514 19:15:56.177] subprocess.CalledProcessError: Command '('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--up', '--down', '--test', '--deployment=gke', '--provider=gke', '--cluster=test-2430af97aa', '--gcp-network=test-2430af97aa', '--check-leaked-resources', '--gcp-zone=us-west1-b', '--gcp-cloud-sdk=gs://cloud-sdk-testing/ci/staging', '--gke-environment=test', '--image-family=pipeline-1', '--image-project=ubuntu-os-gke-cloud-devel', '--gcp-node-image=custom', '--extract=ci/k8s-stable2', '--timeout=180m', '--test_args=--ginkgo.focus=\\[Feature:Reboot\\] --minStartupPods=8')' returned non-zero exit status 1
E0514 19:15:56.192] Command failed
I0514 19:15:56.192] process 259 exited with code 1 after 65.7m
E0514 19:15:56.192] FAIL: ci-kubernetes-e2e-gke-ubuntu1-k8sstable2-reboot
I0514 19:15:56.193] Call:  gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json
W0514 19:15:57.114] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
I0514 19:15:57.198] process 3104 exited with code 0 after 0.0m
I0514 19:15:57.198] Call:  gcloud config get-value account
I0514 19:15:57.566] process 3116 exited with code 0 after 0.0m
I0514 19:15:57.566] Will upload results to gs://kubernetes-jenkins/logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com
I0514 19:15:57.567] Upload result and artifacts...
I0514 19:15:57.567] Gubernator results at https://gubernator.k8s.io/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gke-ubuntu1-k8sstable2-reboot/1128361814824849411
I0514 19:15:57.567] Call:  gsutil ls gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gke-ubuntu1-k8sstable2-reboot/1128361814824849411/artifacts
W0514 19:15:59.108] CommandException: One or more URLs matched no objects.
E0514 19:15:59.303] Command failed
I0514 19:15:59.304] process 3128 exited with code 1 after 0.0m
W0514 19:15:59.304] Remote dir gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gke-ubuntu1-k8sstable2-reboot/1128361814824849411/artifacts not exist yet
I0514 19:15:59.304] Call:  gsutil -m -q -o GSUtil:use_magicfile=True cp -r -c -z log,txt,xml /workspace/_artifacts gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gke-ubuntu1-k8sstable2-reboot/1128361814824849411/artifacts
I0514 19:16:02.215] process 3270 exited with code 0 after 0.0m
I0514 19:16:02.216] Call:  git rev-parse HEAD
W0514 19:16:02.220] fatal: Not a git repository (or any of the parent directories): .git
E0514 19:16:02.220] Command failed
I0514 19:16:02.220] process 3908 exited with code 128 after 0.0m
I0514 19:16:02.221] Call:  git rev-parse HEAD
I0514 19:16:02.376] process 3909 exited with code 0 after 0.0m
I0514 19:16:02.376] Call:  gsutil stat gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gke-ubuntu1-k8sstable2-reboot/jobResultsCache.json
I0514 19:16:03.853] process 3910 exited with code 0 after 0.0m
I0514 19:16:03.854] Call:  gsutil -q cat 'gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gke-ubuntu1-k8sstable2-reboot/jobResultsCache.json#1557839419040433'
... skipping 8 lines ...