ci-kubernetes-e2e-gke-gci-new-gci-master-upgrade-cluster-new #1173863913075249166
Recent runs || View in Spyglass
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 1 failed / 6 succeeded |
| Started | |
| Elapsed | 31m53s |
| Revision | |
| Builder | gke-prow-ssd-pool-1a225945-mhkp |
| links | {u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/2c26f41b-e4fc-41c8-9bb9-51c51b43d0b3/targets/test'}} |
| pod | 2d9f445b-d91e-11e9-b0f7-b204a12bbfd6 |
| resultstore | https://source.cloud.google.com/results/invocations/2c26f41b-e4fc-41c8-9bb9-51c51b43d0b3/targets/test |
| infra-commit | 3e4b02a75 |
| job-version | v1.15.4-beta.0.47+67d2fcf276fcd9 |
| pod | 2d9f445b-d91e-11e9-b0f7-b204a12bbfd6 |
| revision | v1.15.4-beta.0.47+67d2fcf276fcd9 |
error creating cluster: error during gcloud container clusters create --quiet --project=k8s-jkns-gke-serial-1-3 --zone=us-central1-c --machine-type=n1-standard-2 --image-type=gci --num-nodes=3 --network=bootstrap-e2e --cluster-version=1.15.4-beta.0.47+67d2fcf276fcd9 bootstrap-e2e: exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
Deferred TearDown
DumpClusterLogs (--up failed)
Extract
TearDown Previous
Timeout
listResources Before
... skipping 12 lines ... I0917 07:39:15.048] process 45 exited with code 0 after 0.0m I0917 07:39:15.049] Will upload results to gs://kubernetes-jenkins/logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com I0917 07:39:15.049] Root: /workspace I0917 07:39:15.049] cd to /workspace I0917 07:39:15.049] Configure environment... I0917 07:39:15.050] Call: git show -s --format=format:%ct HEAD W0917 07:39:15.053] fatal: Not a git repository (or any of the parent directories): .git I0917 07:39:15.054] process 57 exited with code 128 after 0.0m W0917 07:39:15.054] Unable to print commit date for HEAD I0917 07:39:15.055] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W0917 07:39:15.574] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com] I0917 07:39:15.898] process 58 exited with code 0 after 0.0m I0917 07:39:15.898] Call: gcloud config get-value account ... skipping 469 lines ... W0917 07:41:44.997] WARNING: Currently VPC-native is not the default mode during cluster creation. In the future, this will become the default mode and can be disabled using `--no-enable-ip-alias` flag. Use `--[no-]enable-ip-alias` flag to suppress this warning. W0917 07:41:44.998] WARNING: Starting in 1.12, default node pools in new clusters will have their legacy Compute Engine instance metadata endpoints disabled by default. To create a cluster with legacy instance metadata endpoints disabled in the default node pool, run `clusters create` with the flag `--metadata disable-legacy-endpoints=true`. W0917 07:41:44.999] WARNING: Your Pod address range (`--cluster-ipv4-cidr`) can accommodate at most 1008 node(s). W0917 07:41:44.999] This will disable the autorepair feature for nodes. Please see https://cloud.google.com/kubernetes-engine/docs/node-auto-repair for more information on node autorepairs. W0917 07:41:47.977] Creating cluster bootstrap-e2e in us-central1-c... W0917 07:52:46.731] ......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. W0917 07:52:46.794] ERROR: (gcloud.container.clusters.create) Operation [<Operation W0917 07:52:46.795] clusterConditions: [] W0917 07:52:46.795] detail: u'All cluster resources were brought up, but the cluster API is reporting that: component "kube-apiserver" from endpoint "gke-d544c73415c212c30a6e-9f10" is unhealthy.' W0917 07:52:46.795] endTime: u'2019-09-17T07:52:45.360582873Z' W0917 07:52:46.795] name: u'operation-1568706107825-b3663ae2' W0917 07:52:46.796] nodepoolConditions: [] W0917 07:52:46.796] operationType: OperationTypeValueValuesEnum(CREATE_CLUSTER, 1) W0917 07:52:46.796] selfLink: u'https://test-container.sandbox.googleapis.com/v1/projects/1067977771918/zones/us-central1-c/operations/operation-1568706107825-b3663ae2' W0917 07:52:46.796] startTime: u'2019-09-17T07:41:47.825032269Z' W0917 07:52:46.796] status: StatusValueValuesEnum(DONE, 3) W0917 07:52:46.797] statusMessage: u'All cluster resources were brought up, but the cluster API is reporting that: component "kube-apiserver" from endpoint "gke-d544c73415c212c30a6e-9f10" is unhealthy.' W0917 07:52:46.797] targetLink: u'https://test-container.sandbox.googleapis.com/v1/projects/1067977771918/zones/us-central1-c/clusters/bootstrap-e2e' W0917 07:52:46.797] zone: u'us-central1-c'>] finished with error: All cluster resources were brought up, but the cluster API is reporting that: component "kube-apiserver" from endpoint "gke-d544c73415c212c30a6e-9f10" is unhealthy. W0917 07:52:46.852] 2019/09/17 07:52:46 process.go:155: Step 'gcloud container clusters create --quiet --project=k8s-jkns-gke-serial-1-3 --zone=us-central1-c --machine-type=n1-standard-2 --image-type=gci --num-nodes=3 --network=bootstrap-e2e --cluster-version=1.15.4-beta.0.47+67d2fcf276fcd9 bootstrap-e2e' finished in 11m2.270502552s W0917 07:52:47.439] 2019/09/17 07:52:47 process.go:153: Running: bash -c W0917 07:52:47.440] function log_dump_custom_get_instances() { W0917 07:52:47.440] if [[ $1 == "master" ]]; then W0917 07:52:47.440] return 0 W0917 07:52:47.440] fi ... skipping 14 lines ... I0917 07:52:47.545] Dumping logs from nodes locally to '/workspace/_artifacts' I0917 07:52:47.545] Dumping logs for nodes provided by log_dump_custom_get_instances() function W0917 07:52:48.849] WARNING: --filter : operator evaluation is changing for consistency across Google APIs. metadata.created-by:*zones/us-central1-c/instanceGroupManagers/gke-bootstrap-e2e-default-pool-8065ede2-grp currently matches but will not match in the near future. Run `gcloud topic filters` for details. I0917 07:59:53.294] Changing logfiles to be world-readable for download I0917 07:59:53.341] Changing logfiles to be world-readable for download I0917 07:59:53.445] Changing logfiles to be world-readable for download W0917 08:00:24.364] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255]. W0917 08:00:24.436] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255]. W0917 08:00:24.482] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255]. W0917 08:01:00.429] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255]. W0917 08:01:00.462] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255]. W0917 08:01:00.618] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255]. W0917 08:01:36.545] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255]. W0917 08:01:36.612] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255]. W0917 08:01:36.750] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255]. W0917 08:02:12.914] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255]. W0917 08:02:13.006] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255]. W0917 08:02:13.031] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255]. W0917 08:02:49.077] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255]. W0917 08:02:49.219] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255]. W0917 08:02:49.232] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255]. W0917 08:03:25.335] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255]. W0917 08:03:25.379] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255]. W0917 08:03:25.419] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255]. I0917 08:03:25.519] Copying 'kern.log kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov docker/log kubelet.log supervisor/supervisord.log supervisor/kubelet-stdout.log supervisor/kubelet-stderr.log supervisor/docker-stdout.log supervisor/docker-stderr.log' from gke-bootstrap-e2e-default-pool-8065ede2-3bf5 I0917 08:03:25.520] Copying 'kern.log kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov docker/log kubelet.log supervisor/supervisord.log supervisor/kubelet-stdout.log supervisor/kubelet-stderr.log supervisor/docker-stdout.log supervisor/docker-stderr.log' from gke-bootstrap-e2e-default-pool-8065ede2-hhhr I0917 08:03:25.521] Copying 'kern.log kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov docker/log kubelet.log supervisor/supervisord.log supervisor/kubelet-stdout.log supervisor/kubelet-stderr.log supervisor/docker-stdout.log supervisor/docker-stderr.log' from gke-bootstrap-e2e-default-pool-8065ede2-znp8 W0917 08:03:26.613] W0917 08:03:26.614] Specify --start=44055 in the next get-serial-port-output invocation to get only the new output starting from here. W0917 08:03:26.635] W0917 08:03:26.636] Specify --start=44093 in the next get-serial-port-output invocation to get only the new output starting from here. W0917 08:03:26.707] W0917 08:03:26.707] Specify --start=44033 in the next get-serial-port-output invocation to get only the new output starting from here. W0917 08:05:37.913] ssh: connect to host 35.225.15.111 port 22: Connection timed out W0917 08:05:37.913] ssh: connect to host 34.66.52.116 port 22: Connection timed out W0917 08:05:37.913] ssh: connect to host 34.70.175.140 port 22: Connection timed out W0917 08:05:37.920] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1]. W0917 08:05:37.920] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1]. W0917 08:05:37.920] ERROR: (gcloud.compute.scp) [/usr/bin/scp] exited with return code [1]. W0917 08:05:38.010] Project: k8s-jkns-gke-serial-1-3 W0917 08:05:38.010] Network Project: k8s-jkns-gke-serial-1-3 W0917 08:05:38.011] Zone: us-central1-c W0917 08:05:40.488] INSTANCE_GROUPS= W0917 08:05:40.488] NODE_NAMES= W0917 08:05:40.489] 2019/09/17 08:05:40 process.go:155: Step 'bash -c ... skipping 21 lines ... W0917 08:09:38.751] 2019/09/17 08:09:38 process.go:155: Step 'gcloud compute firewall-rules describe e2e-ports-8065ede2 --project=k8s-jkns-gke-serial-1-3 --format=value(name)' finished in 818.638045ms W0917 08:09:38.752] 2019/09/17 08:09:38 gke.go:631: Found no rules for firewall 'e2e-ports-8065ede2', assuming resources are clean W0917 08:09:39.569] 2019/09/17 08:09:39 process.go:153: Running: gcloud compute networks delete -q bootstrap-e2e --project=k8s-jkns-gke-serial-1-3 W0917 08:10:37.646] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gke-serial-1-3/global/networks/bootstrap-e2e]. W0917 08:10:37.740] 2019/09/17 08:10:37 process.go:155: Step 'gcloud compute networks delete -q bootstrap-e2e --project=k8s-jkns-gke-serial-1-3' finished in 58.169848668s W0917 08:10:37.740] 2019/09/17 08:10:37 process.go:96: Saved XML output to /workspace/_artifacts/junit_runner.xml. W0917 08:10:59.018] 2019/09/17 08:10:59 main.go:319: Something went wrong: starting e2e cluster: error creating cluster: error during gcloud container clusters create --quiet --project=k8s-jkns-gke-serial-1-3 --zone=us-central1-c --machine-type=n1-standard-2 --image-type=gci --num-nodes=3 --network=bootstrap-e2e --cluster-version=1.15.4-beta.0.47+67d2fcf276fcd9 bootstrap-e2e: exit status 1 W0917 08:10:59.022] Traceback (most recent call last): W0917 08:10:59.022] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 778, in <module> W0917 08:10:59.022] main(parse_args()) W0917 08:10:59.022] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 626, in main W0917 08:10:59.022] mode.start(runner_args) W0917 08:10:59.022] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 262, in start W0917 08:10:59.022] check_env(env, self.command, *args) W0917 08:10:59.022] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 111, in check_env W0917 08:10:59.023] subprocess.check_call(cmd, env=env) W0917 08:10:59.023] File "/usr/lib/python2.7/subprocess.py", line 186, in check_call W0917 08:10:59.023] raise CalledProcessError(retcode, cmd) W0917 08:10:59.023] subprocess.CalledProcessError: Command '('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--up', '--down', '--test', '--deployment=gke', '--provider=gke', '--cluster=bootstrap-e2e', '--gcp-network=bootstrap-e2e', '--check-leaked-resources', '--check-version-skew=false', '--extract=ci/latest', '--extract=ci/k8s-stable1', '--gcp-cloud-sdk=gs://cloud-sdk-testing/ci/staging', '--gcp-node-image=gci', '--gcp-zone=us-central1-c', '--gke-environment=test', '--skew', '--timeout=1200m', '--test_args=--ginkgo.focus=\\[Serial\\]|\\[Disruptive\\] --ginkgo.skip=\\[Flaky\\]|\\[Feature:.+\\]', '--upgrade_args=--ginkgo.focus=\\[Feature:ClusterUpgrade\\] --upgrade-target=ci/latest --upgrade-image=gci')' returned non-zero exit status 1 E0917 08:10:59.031] Command failed I0917 08:10:59.032] process 260 exited with code 1 after 31.7m E0917 08:10:59.032] FAIL: ci-kubernetes-e2e-gke-gci-new-gci-master-upgrade-cluster-new I0917 08:10:59.032] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W0917 08:10:59.577] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com] I0917 08:10:59.633] process 2367 exited with code 0 after 0.0m I0917 08:10:59.633] Call: gcloud config get-value account I0917 08:10:59.955] process 2379 exited with code 0 after 0.0m I0917 08:10:59.955] Will upload results to gs://kubernetes-jenkins/logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com I0917 08:10:59.955] Upload result and artifacts... I0917 08:10:59.956] Gubernator results at https://gubernator.k8s.io/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gke-gci-new-gci-master-upgrade-cluster-new/1173863913075249166 I0917 08:10:59.956] Call: gsutil ls gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gke-gci-new-gci-master-upgrade-cluster-new/1173863913075249166/artifacts W0917 08:11:01.111] CommandException: One or more URLs matched no objects. E0917 08:11:01.243] Command failed I0917 08:11:01.243] process 2391 exited with code 1 after 0.0m W0917 08:11:01.244] Remote dir gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gke-gci-new-gci-master-upgrade-cluster-new/1173863913075249166/artifacts not exist yet I0917 08:11:01.244] Call: gsutil -m -q -o GSUtil:use_magicfile=True cp -r -c -z log,txt,xml /workspace/_artifacts gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gke-gci-new-gci-master-upgrade-cluster-new/1173863913075249166/artifacts I0917 08:11:03.308] process 2533 exited with code 0 after 0.0m I0917 08:11:03.309] Call: git rev-parse HEAD W0917 08:11:03.313] fatal: Not a git repository (or any of the parent directories): .git E0917 08:11:03.314] Command failed I0917 08:11:03.314] process 3066 exited with code 128 after 0.0m I0917 08:11:03.314] Call: git rev-parse HEAD I0917 08:11:03.319] process 3067 exited with code 0 after 0.0m I0917 08:11:03.319] Call: gsutil stat gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gke-gci-new-gci-master-upgrade-cluster-new/jobResultsCache.json I0917 08:11:04.471] process 3068 exited with code 0 after 0.0m I0917 08:11:04.472] Call: gsutil -q cat 'gs://kubernetes-jenkins/logs/ci-kubernetes-e2e-gke-gci-new-gci-master-upgrade-cluster-new/jobResultsCache.json#1568700617349165' ... skipping 8 lines ...