This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 6 succeeded
Started2020-02-17 05:44
Elapsed35m55s
Revision
Buildergke-prow-default-pool-cf4891d4-fwhg
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/a023dbd9-19e3-4e65-bcbf-0ed46eb1ea4f/targets/test'}}
pod7816417b-5148-11ea-9bea-16a0f55e352c
resultstorehttps://source.cloud.google.com/results/invocations/a023dbd9-19e3-4e65-bcbf-0ed46eb1ea4f/targets/test
infra-commitf5dd3ee0e
job-versionv1.16.8-beta.0.1+abdce0eac9e732
pod7816417b-5148-11ea-9bea-16a0f55e352c
revisionv1.16.8-beta.0.1+abdce0eac9e732

Test Failures


Up 28m42s

error creating cluster: error during gcloud container clusters create --quiet --enable-legacy-authorization --project=k8s-gke-cvm-1-6-mstr-ctl-skew --zone=us-central1-c --machine-type=n1-standard-2 --image-type=gci --num-nodes=3 --network=bootstrap-e2e --cluster-version=1.16.8-beta.0.1+abdce0eac9e732 bootstrap-e2e: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 6 Passed Tests

Error lines from build-log.txt

... skipping 15 lines ...
I0217 05:44:49.856] process 47 exited with code 0 after 0.0m
I0217 05:44:49.857] Will upload results to gs://kubernetes-jenkins/logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com
I0217 05:44:49.857] Root: /workspace
I0217 05:44:49.857] cd to /workspace
I0217 05:44:49.857] Configure environment...
I0217 05:44:49.858] Call:  git show -s --format=format:%ct HEAD
W0217 05:44:49.864] fatal: not a git repository (or any of the parent directories): .git
I0217 05:44:49.864] process 60 exited with code 128 after 0.0m
W0217 05:44:49.864] Unable to print commit date for HEAD
I0217 05:44:49.865] Call:  gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json
W0217 05:44:50.453] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
I0217 05:44:50.806] process 61 exited with code 0 after 0.0m
I0217 05:44:50.807] Call:  gcloud config get-value account
... skipping 418 lines ...
W0217 05:46:32.109] 
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100  445k  100  445k    0     0  25.6M      0 --:--:-- --:--:-- --:--:-- 25.6M
W0217 05:46:32.110]   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
W0217 05:46:32.110]                                  Dload  Upload   Total   Spent    Left  Speed
W0217 05:46:33.018] 
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
 32  546M   32  175M    0     0   221M      0  0:00:02 --:--:--  0:00:02  220M
 38  546M   38  211M    0     0   218M      0  0:00:02 --:--:--  0:00:02  218M
W0217 05:46:33.019] curl: (56) OpenSSL SSL_read: SSL_ERROR_SYSCALL, errno 104
W0217 05:46:33.023] 2020/02/17 05:46:33 process.go:155: Step './get-kube.sh' finished in 1.235974186s
W0217 05:46:33.024] 2020/02/17 05:46:33 extract_k8s.go:298: U=https://storage.googleapis.com/kubernetes-release-dev/ci R=v1.16.8-beta.0.1+abdce0eac9e732 get-kube.sh failed: error during ./get-kube.sh: exit status 56
W0217 05:46:33.024] 2020/02/17 05:46:33 process.go:153: Running: ./get-kube.sh
I0217 05:46:33.124] Found preexisting kubernetes.tar.gz, release v1.16.8-beta.0.1+abdce0eac9e732
I0217 05:46:33.124] Using preexisting kubernetes.tar.gz
I0217 05:46:33.125] Will also delete preexisting 'kubernetes' directory.
I0217 05:46:33.125] Unpacking kubernetes release v1.16.8-beta.0.1+abdce0eac9e732
I0217 05:46:35.149] Kubernetes release: v1.16.8-beta.0.1+abdce0eac9e732
... skipping 77 lines ...
W0217 05:47:42.713] WARNING: Starting in 1.12, default node pools in new clusters will have their legacy Compute Engine instance metadata endpoints disabled by default. To create a cluster with legacy instance metadata endpoints disabled in the default node pool, run `clusters create` with the flag `--metadata disable-legacy-endpoints=true`.
W0217 05:47:42.713] WARNING: Starting with version 1.18, clusters will have shielded GKE nodes by default.
W0217 05:47:42.713] WARNING: Your Pod address range (`--cluster-ipv4-cidr`) can accommodate at most 1008 node(s). 
W0217 05:47:42.713] This will disable the autorepair feature for nodes. Please see https://cloud.google.com/kubernetes-engine/docs/node-auto-repair for more information on node autorepairs.
W0217 05:47:45.507] Creating cluster bootstrap-e2e in us-central1-c...
W0217 06:15:49.920] ..............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done.
W0217 06:15:50.105] ERROR: (gcloud.container.clusters.create) Operation [<Operation
W0217 06:15:50.105]  clusterConditions: [<StatusCondition
W0217 06:15:50.106]  message: u"All cluster resources were brought up, but: only 0 nodes out of 3 have registered; this is likely due to the Master failing to approve new Node registrations; try re-creating the cluster or contact support if that doesn't work.">]
W0217 06:15:50.106]  detail: u"All cluster resources were brought up, but: only 0 nodes out of 3 have registered; this is likely due to the Master failing to approve new Node registrations; try re-creating the cluster or contact support if that doesn't work."
W0217 06:15:50.106]  endTime: u'2020-02-17T06:15:48.049663872Z'
W0217 06:15:50.106]  name: u'operation-1581918465467-5e76641b'
W0217 06:15:50.106]  nodepoolConditions: []
... skipping 7 lines ...
W0217 06:15:50.107]  stages: []>
W0217 06:15:50.108]  selfLink: u'https://test-container.sandbox.googleapis.com/v1/projects/577491345426/zones/us-central1-c/operations/operation-1581918465467-5e76641b'
W0217 06:15:50.108]  startTime: u'2020-02-17T05:47:45.467693034Z'
W0217 06:15:50.108]  status: StatusValueValuesEnum(DONE, 3)
W0217 06:15:50.108]  statusMessage: u"All cluster resources were brought up, but: only 0 nodes out of 3 have registered; this is likely due to the Master failing to approve new Node registrations; try re-creating the cluster or contact support if that doesn't work."
W0217 06:15:50.108]  targetLink: u'https://test-container.sandbox.googleapis.com/v1/projects/577491345426/zones/us-central1-c/clusters/bootstrap-e2e'
W0217 06:15:50.109]  zone: u'us-central1-c'>] finished with error: All cluster resources were brought up, but: only 0 nodes out of 3 have registered; this is likely due to the Master failing to approve new Node registrations; try re-creating the cluster or contact support if that doesn't work.
W0217 06:15:50.206] 2020/02/17 06:15:50 process.go:155: Step 'gcloud container clusters create --quiet --enable-legacy-authorization --project=k8s-gke-cvm-1-6-mstr-ctl-skew --zone=us-central1-c --machine-type=n1-standard-2 --image-type=gci --num-nodes=3 --network=bootstrap-e2e --cluster-version=1.16.8-beta.0.1+abdce0eac9e732 bootstrap-e2e' finished in 28m7.967236522s
W0217 06:15:51.061] 2020/02/17 06:15:51 process.go:153: Running: gcloud compute firewall-rules describe e2e-ports-d548d8ed --project=k8s-gke-cvm-1-6-mstr-ctl-skew --format=value(name)
W0217 06:15:52.230] 2020/02/17 06:15:52 process.go:155: Step 'gcloud compute firewall-rules describe e2e-ports-d548d8ed --project=k8s-gke-cvm-1-6-mstr-ctl-skew --format=value(name)' finished in 1.167903813s
W0217 06:15:52.230] 2020/02/17 06:15:52 gke.go:540: Couldn't describe firewall 'e2e-ports-d548d8ed', assuming it doesn't exist and creating it
W0217 06:15:53.959] 2020/02/17 06:15:53 process.go:153: Running: gcloud compute firewall-rules create e2e-ports-d548d8ed --project=k8s-gke-cvm-1-6-mstr-ctl-skew --network=bootstrap-e2e --allow=tcp:22,tcp:80,tcp:8080,tcp:9090,tcp:30000-32767,udp:30000-32767 --target-tags=gke-bootstrap-e2e-083c07e5-node
W0217 06:15:54.772] Creating firewall...
... skipping 37 lines ...
W0217 06:16:39.099] 
W0217 06:16:39.099] Specify --start=47346 in the next get-serial-port-output invocation to get only the new output starting from here.
W0217 06:16:40.212] scp: /var/log/kube-proxy.log*: No such file or directory
W0217 06:16:40.212] scp: /var/log/fluentd.log*: No such file or directory
W0217 06:16:40.213] scp: /var/log/node-problem-detector.log*: No such file or directory
W0217 06:16:40.213] scp: /var/log/kubelet.cov*: No such file or directory
W0217 06:16:40.213] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1].
W0217 06:16:40.384] scp: /var/log/kube-proxy.log*: No such file or directory
W0217 06:16:40.384] scp: /var/log/fluentd.log*: No such file or directory
W0217 06:16:40.384] scp: /var/log/node-problem-detector.log*: No such file or directory
W0217 06:16:40.385] scp: /var/log/kubelet.cov*: No such file or directory
W0217 06:16:40.387] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1].
W0217 06:16:40.566] scp: /var/log/kube-proxy.log*: No such file or directory
W0217 06:16:40.566] scp: /var/log/fluentd.log*: No such file or directory
W0217 06:16:40.566] scp: /var/log/node-problem-detector.log*: No such file or directory
W0217 06:16:40.566] scp: /var/log/kubelet.cov*: No such file or directory
W0217 06:16:40.570] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1].
W0217 06:16:40.671] Project: k8s-gke-cvm-1-6-mstr-ctl-skew
W0217 06:16:40.671] Network Project: k8s-gke-cvm-1-6-mstr-ctl-skew
W0217 06:16:40.671] Zone: us-central1-c
W0217 06:16:43.264] INSTANCE_GROUPS=
W0217 06:16:43.264] NODE_NAMES=
W0217 06:16:43.267] 2020/02/17 06:16:43 process.go:155: Step 'bash -c 
... skipping 24 lines ...
W0217 06:19:54.440] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-gke-cvm-1-6-mstr-ctl-skew/global/firewalls/e2e-ports-d548d8ed].
W0217 06:19:54.546] 2020/02/17 06:19:54 process.go:155: Step 'gcloud compute firewall-rules delete -q e2e-ports-d548d8ed --project=k8s-gke-cvm-1-6-mstr-ctl-skew' finished in 8.221024635s
W0217 06:19:55.667] 2020/02/17 06:19:55 process.go:153: Running: gcloud compute networks delete -q bootstrap-e2e --project=k8s-gke-cvm-1-6-mstr-ctl-skew
W0217 06:20:33.902] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-gke-cvm-1-6-mstr-ctl-skew/global/networks/bootstrap-e2e].
W0217 06:20:34.020] 2020/02/17 06:20:34 process.go:155: Step 'gcloud compute networks delete -q bootstrap-e2e --project=k8s-gke-cvm-1-6-mstr-ctl-skew' finished in 38.352810519s
W0217 06:20:34.021] 2020/02/17 06:20:34 process.go:96: Saved XML output to /workspace/_artifacts/junit_runner.xml.
W0217 06:20:34.027] 2020/02/17 06:20:34 main.go:316: Something went wrong: starting e2e cluster: error creating cluster: error during gcloud container clusters create --quiet --enable-legacy-authorization --project=k8s-gke-cvm-1-6-mstr-ctl-skew --zone=us-central1-c --machine-type=n1-standard-2 --image-type=gci --num-nodes=3 --network=bootstrap-e2e --cluster-version=1.16.8-beta.0.1+abdce0eac9e732 bootstrap-e2e: exit status 1
W0217 06:20:34.035] Traceback (most recent call last):
W0217 06:20:34.036]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 779, in <module>
W0217 06:20:34.036]     main(parse_args())
W0217 06:20:34.036]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 627, in main
W0217 06:20:34.036]     mode.start(runner_args)
W0217 06:20:34.036]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 262, in start
W0217 06:20:34.037]     check_env(env, self.command, *args)
W0217 06:20:34.037]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 111, in check_env
W0217 06:20:34.037]     subprocess.check_call(cmd, env=env)
W0217 06:20:34.037]   File "/usr/lib/python2.7/subprocess.py", line 190, in check_call
W0217 06:20:34.038]     raise CalledProcessError(retcode, cmd)
W0217 06:20:34.038] subprocess.CalledProcessError: Command '('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--up', '--down', '--test', '--deployment=gke', '--provider=gke', '--cluster=bootstrap-e2e', '--gcp-network=bootstrap-e2e', '--check-leaked-resources', '--check-version-skew=false', '--extract=ci/k8s-beta', '--extract=ci/k8s-stable1', '--gcp-cloud-sdk=gs://cloud-sdk-testing/ci/staging', '--gcp-node-image=gci', '--gcp-zone=us-central1-c', '--gke-create-command=container clusters create --quiet --enable-legacy-authorization', '--gke-environment=test', '--test_args=--ginkgo.focus=Kubectl.*\\[Serial\\] --kubectl-path=../../../../kubernetes_skew/cluster/kubectl.sh --minStartupPods=8', '--timeout=120m')' returned non-zero exit status 1
E0217 06:20:34.053] Command failed
I0217 06:20:34.053] process 268 exited with code 1 after 35.7m
E0217 06:20:34.054] FAIL: ci-kubernetes-e2e-gke-stable1-beta-gci-kubectl-skew-serial
I0217 06:20:34.054] Call:  gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json
W0217 06:20:34.687] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
I0217 06:20:34.755] process 2818 exited with code 0 after 0.0m
I0217 06:20:34.755] Call:  gcloud config get-value account
I0217 06:20:35.274] process 2831 exited with code 0 after 0.0m
I0217 06:20:35.274] Will upload results to gs://kubernetes-jenkins/logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com
I0217 06:20:35.275] Upload result and artifacts...
I0217 06:20:35.275] Gubernator results at https://gubernator.k8s.io/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gke-stable1-beta-gci-kubectl-skew-serial/1229280418046414848
I0217 06:20:35.275] Call:  gsutil ls gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gke-stable1-beta-gci-kubectl-skew-serial/1229280418046414848/artifacts
W0217 06:20:36.507] CommandException: One or more URLs matched no objects.
E0217 06:20:36.685] Command failed
I0217 06:20:36.685] process 2844 exited with code 1 after 0.0m
W0217 06:20:36.685] Remote dir gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gke-stable1-beta-gci-kubectl-skew-serial/1229280418046414848/artifacts not exist yet
I0217 06:20:36.685] Call:  gsutil -m -q -o GSUtil:use_magicfile=True cp -r -c -z log,txt,xml /workspace/_artifacts gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gke-stable1-beta-gci-kubectl-skew-serial/1229280418046414848/artifacts
I0217 06:20:39.240] process 2989 exited with code 0 after 0.0m
I0217 06:20:39.241] Call:  git rev-parse HEAD
W0217 06:20:39.248] fatal: not a git repository (or any of the parent directories): .git
E0217 06:20:39.248] Command failed
I0217 06:20:39.248] process 3597 exited with code 128 after 0.0m
I0217 06:20:39.248] Call:  git rev-parse HEAD
I0217 06:20:39.254] process 3598 exited with code 0 after 0.0m
I0217 06:20:39.255] Call:  gsutil stat gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gke-stable1-beta-gci-kubectl-skew-serial/jobResultsCache.json
I0217 06:20:40.696] process 3599 exited with code 0 after 0.0m
I0217 06:20:40.697] Call:  gsutil -q cat 'gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gke-stable1-beta-gci-kubectl-skew-serial/jobResultsCache.json#1581913212820273'
... skipping 8 lines ...