This job view page is being replaced by Spyglass soon. Check out the new job view.
PRandyzhangx: fix azure retry issue when return 2XX with error
ResultFAILURE
Tests 1 failed / 6 succeeded
Started2019-05-28 06:00
Elapsed1h21m
Revision
Buildergke-prow-containerd-pool-99179761-245v
Refs master:50fb78b9
78298:8a45ba19
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/7db8b1a6-acca-47e9-b6ac-9009f12250fe/targets/test'}}
podcd1abc89-810d-11e9-9830-f6e86b77c731
resultstorehttps://source.cloud.google.com/results/invocations/7db8b1a6-acca-47e9-b6ac-9009f12250fe/targets/test
infra-commitd9f399bc7
job-versionv1.16.0-alpha.0.397+3141bcdf3e0d3a-dirty
podcd1abc89-810d-11e9-9830-f6e86b77c731
repok8s.io/kubernetes
repo-commit3141bcdf3e0d3a236f9249fc36c0db52999f85a9
repos{u'k8s.io/kubernetes': u'master:50fb78b90b9646faaa53f92166fb54c62e4c0679,78298:8a45ba19814d612df04a5d3290795cc2797a1f13', u'k8s.io/release': u'master'}
revisionv1.16.0-alpha.0.397+3141bcdf3e0d3a-dirty

Test Failures


Up 30m21s

error creating cluster: cannot deploy: cannot get the create deployment future response: Code="DeploymentFailed" Message="At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-debug for usage details." Details=[{"code":"Conflict","message":"{\r\n  \"status\": \"Failed\",\r\n  \"error\": {\r\n    \"code\": \"ResourceDeploymentFailure\",\r\n    \"message\": \"The resource operation completed with terminal provisioning state 'Failed'.\",\r\n    \"details\": [\r\n      {\r\n        \"code\": \"VMExtensionProvisioningError\",\r\n        \"message\": \"VM has reported a failure when processing extension 'cse-master-0'. Error message: \\\"Enable failed: failed to execute command: command terminated with exit status=30\\n[stdout]\\n\\n[stderr]\\nConnection to k8s.gcr.io 443 port [tcp/https] succeeded!\\nConnection to gcr.io 443 port [tcp/https] succeeded!\\nConnection to docker.io 443 port [tcp/https] succeeded!\\n\\\".\"\r\n      }\r\n    ]\r\n  }\r\n}"}]
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 6 Passed Tests

Error lines from build-log.txt

... skipping 929 lines ...
W0528 06:53:23.954] 2019/05/28 06:53:23 azure.go:409: Validating deployment ARM templates.
W0528 06:53:25.306] 2019/05/28 06:53:25 azure.go:415: Deploying cluster kubetest-3821161e-810e-11e9-a2b8-72f156ac7571 in resource group kubetest-3821161e-810e-11e9-a2b8-72f156ac7571.
W0528 07:11:40.709] 2019/05/28 07:11:40 azure.go:674: Deleting resource group: kubetest-3821161e-810e-11e9-a2b8-72f156ac7571.
W0528 07:21:43.024] 2019/05/28 07:21:43 process.go:96: Saved XML output to /workspace/_artifacts/junit_runner.xml.
W0528 07:21:43.025] 2019/05/28 07:21:43 process.go:153: Running: bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"
W0528 07:21:43.475] 2019/05/28 07:21:43 process.go:155: Step 'bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"' finished in 452.641418ms
W0528 07:21:43.476] 2019/05/28 07:21:43 main.go:314: Something went wrong: starting e2e cluster: error creating cluster: cannot deploy: cannot get the create deployment future response: Code="DeploymentFailed" Message="At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-debug for usage details." Details=[{"code":"Conflict","message":"{\r\n  \"status\": \"Failed\",\r\n  \"error\": {\r\n    \"code\": \"ResourceDeploymentFailure\",\r\n    \"message\": \"The resource operation completed with terminal provisioning state 'Failed'.\",\r\n    \"details\": [\r\n      {\r\n        \"code\": \"VMExtensionProvisioningError\",\r\n        \"message\": \"VM has reported a failure when processing extension 'cse-master-0'. Error message: \\\"Enable failed: failed to execute command: command terminated with exit status=30\\n[stdout]\\n\\n[stderr]\\nConnection to k8s.gcr.io 443 port [tcp/https] succeeded!\\nConnection to gcr.io 443 port [tcp/https] succeeded!\\nConnection to docker.io 443 port [tcp/https] succeeded!\\n\\\".\"\r\n      }\r\n    ]\r\n  }\r\n}"}]
W0528 07:21:43.479] Traceback (most recent call last):
W0528 07:21:43.479]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 778, in <module>
W0528 07:21:43.496]     main(parse_args())
W0528 07:21:43.496]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 626, in main
W0528 07:21:43.496]     mode.start(runner_args)
W0528 07:21:43.496]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 262, in start
W0528 07:21:43.497]     check_env(env, self.command, *args)
W0528 07:21:43.497]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 111, in check_env
W0528 07:21:43.497]     subprocess.check_call(cmd, env=env)
W0528 07:21:43.497]   File "/usr/lib/python2.7/subprocess.py", line 186, in check_call
W0528 07:21:43.514]     raise CalledProcessError(retcode, cmd)
W0528 07:21:43.516] subprocess.CalledProcessError: Command '('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--build=bazel', '--stage=gs://kubernetes-release-pull/ci/pull-kubernetes-e2e-aks-engine-azure', '--up', '--down', '--test', '--deployment=acsengine', '--provider=skeleton', '--cluster=bootstrap-e2e', '--gcp-network=bootstrap-e2e', '--ginkgo-parallel=30', '--acsengine-agentpoolcount=3', '--acsengine-admin-username=azureuser', '--acsengine-creds=/etc/azure-cred/credentials', '--acsengine-orchestratorRelease=1.15', '--acsengine-mastervmsize=Standard_DS2_v2', '--acsengine-agentvmsize=Standard_DS2_v2', '--acsengine-hyperkube=True', '--acsengine-location=centralus', '--acsengine-public-key=/etc/azure-ssh/azure-ssh-pub', '--acsengine-template-url=https://raw.githubusercontent.com/Azure/aks-engine/master/examples/kubernetes.json', '--acsengine-download-url=https://github.com/Azure/aks-engine/releases/download/v0.36.1/aks-engine-v0.36.1-linux-amd64.tar.gz', '--test_args=--ginkgo.focus=\\[Conformance\\]|\\[NodeConformance\\] --ginkgo.skip=\\[sig-node\\]\\sMount\\spropagation|\\[sig-network\\]\\sNetwork\\sshould\\sset\\sTCP\\sCLOSE_WAIT\\stimeout|\\[sig-storage\\]\\sPersistentVolumes-local\\sStress\\swith\\slocal\\svolume\\sprovisioner\\s\\[Serial\\]\\sshould\\suse\\sbe\\sable\\sto\\sprocess\\smany\\spods\\sand\\sreuse\\slocal\\svolumes|should\\sunmount\\sif\\spod\\sis\\sgracefully\\sdeleted\\swhile\\skubelet\\sis\\sdown\\s\\[Disruptive\\]\\[Slow\\]|should\\sunmount\\sif\\spod\\sis\\sforce\\sdeleted\\swhile\\skubelet\\sis\\sdown\\s\\[Disruptive\\]\\[Slow\\]|\\[sig-network\\]\\sServices\\sshould\\sbe\\sable\\sto\\screate\\sa\\sfunctioning\\sNodePort\\sservice|\\[sig-scheduling\\]\\sSchedulerPredicates\\s\\[Serial\\]\\svalidates\\sMaxPods\\slimit\\snumber\\sof\\spods\\sthat\\sare\\sallowed\\sto\\srun\\s\\[Slow\\]|\\[sig-storage\\]\\sDynamic\\sProvisioning\\sDynamicProvisioner\\sDefault\\sshould\\screate\\sand\\sdelete\\sdefault\\spersistent\\svolumes\\s\\[Slow\\]|\\[sig-storage\\]\\sDynamic\\sProvisioning\\sDynamicProvisioner\\sshould\\sprovision\\sstorage\\swith\\sdifferent\\sparameters|\\[sig-storage\\]\\sDynamic\\sProvisioning\\sDynamicProvisioner\\sshould\\stest\\sthat\\sdeleting\\sa\\sclaim\\sbefore\\sthe\\svolume\\sis\\sprovisioned\\sdeletes\\sthe\\svolume.|\\[sig-apps\\]\\sStatefulSet\\s\\[k8s.io\\]\\sBasic\\sStatefulSet\\sfunctionality\\s\\[StatefulSetBasic\\]\\sshould\\sadopt\\smatching\\sorphans\\sand\\srelease\\snon-matching\\spods|\\[sig-apps\\]\\sStatefulSet\\s\\[k8s.io\\]\\sBasic\\sStatefulSet\\sfunctionality\\s\\[StatefulSetBasic\\]\\sshould\\snot\\sdeadlock\\swhen\\sa\\spod.s\\spredecessor\\sfails|\\[sig-apps\\]\\sStatefulSet\\s\\[k8s.io\\]\\sBasic\\sStatefulSet\\sfunctionality\\s\\[StatefulSetBasic\\]\\sshould\\sperform\\srolling\\supdates\\sand\\sroll\\sbacks\\sof\\stemplate\\smodifications\\swith\\sPVCs|\\[sig-apps\\]\\sStatefulSet\\s\\[k8s.io\\]\\sBasic\\sStatefulSet\\sfunctionality\\s\\[StatefulSetBasic\\]\\sshould\\sprovide\\sbasic\\sidentity|\\[sig-storage\\]\\sPersistentVolumes\\sDefault\\sStorageClass\\spods\\sthat\\suse\\smultiple\\svolumes\\sshould\\sbe\\sreschedulable|\\[sig-storage\\]\\sPVC\\sProtection|\\[sig-storage\\]\\sDynamic\\sProvisioning\\s\\[k8s.io\\]\\sGlusterDynamicProvisioner|\\[sig-storage\\]\\sVolumes\\sAzure\\sDisk\\sshould\\sbe\\smountable\\s\\[Slow\\]|\\[sig-apps\\]\\sNetwork\\sPartition\\s\\[Disruptive\\]\\s\\[Slow\\]|\\[sig-network\\]\\sDNS\\sconfigMap|\\[k8s.io\\]\\s\\[sig-node\\]\\sKubelet\\s\\[Serial\\]\\s\\[Slow\\]\\s\\[k8s.io\\]\\s\\[sig-node\\]\\sregular\\sresource\\susage\\stracking\\sresource\\stracking\\sfor\\s0\\spods\\sper\\snode|\\[k8s.io\\]\\s\\[sig-node\\]\\sKubelet\\s\\[Serial\\]\\s\\[Slow\\]\\s\\[k8s.io\\]\\s\\[sig-node\\]\\sregular\\sresource\\susage\\stracking\\sresource\\stracking\\sfor\\s100\\spods\\sper\\snode|Horizontal\\spod\\sautoscaling\\s\\(scale\\sresource:\\sCPU\\)|\\[sig-storage\\]\\sDynamic\\sProvisioning\\sDynamicProvisioner\\sExternal\\sshould\\slet\\san\\sexternal\\sdynamic\\sprovisioner\\screate\\sand\\sdelete\\spersistent\\svolumes\\s\\[Slow\\]|ESIPP|\\[sig-network\\]\\sServices\\sshould\\spreserve\\ssource\\spod\\sIP\\sfor\\straffic\\sthru\\sservice\\scluster\\sIP|In-tree\\sVolumes|PersistentVolumes-local|CSI\\sVolumes|should\\swrite\\sentries\\sto\\s/etc/hosts|\\[Slow\\]|\\[Serial\\]|\\[Disruptive\\]|\\[Flaky\\]|\\[Feature:.+\\]|\\[NodeFeature:.+\\]', '--timeout=420m')' returned non-zero exit status 1
E0528 07:21:43.523] Command failed
I0528 07:21:43.524] process 672 exited with code 1 after 78.9m
E0528 07:21:43.524] FAIL: pull-kubernetes-e2e-aks-engine-azure
I0528 07:21:43.524] Call:  gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json
W0528 07:21:44.336] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
I0528 07:21:44.393] process 96825 exited with code 0 after 0.0m
I0528 07:21:44.394] Call:  gcloud config get-value account
I0528 07:21:44.886] process 96837 exited with code 0 after 0.0m
I0528 07:21:44.886] Will upload results to gs://kubernetes-jenkins/pr-logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com
I0528 07:21:44.886] Upload result and artifacts...
I0528 07:21:44.886] Gubernator results at https://gubernator.k8s.io/build/kubernetes-jenkins/pr-logs/pull/78298/pull-kubernetes-e2e-aks-engine-azure/1133251556183904256
I0528 07:21:44.887] Call:  gsutil ls gs://kubernetes-jenkins/pr-logs/pull/78298/pull-kubernetes-e2e-aks-engine-azure/1133251556183904256/artifacts
W0528 07:21:46.255] CommandException: One or more URLs matched no objects.
E0528 07:21:46.427] Command failed
I0528 07:21:46.427] process 96849 exited with code 1 after 0.0m
W0528 07:21:46.427] Remote dir gs://kubernetes-jenkins/pr-logs/pull/78298/pull-kubernetes-e2e-aks-engine-azure/1133251556183904256/artifacts not exist yet
I0528 07:21:46.428] Call:  gsutil -m -q -o GSUtil:use_magicfile=True cp -r -c -z log,txt,xml /workspace/_artifacts gs://kubernetes-jenkins/pr-logs/pull/78298/pull-kubernetes-e2e-aks-engine-azure/1133251556183904256/artifacts
I0528 07:21:48.877] process 96991 exited with code 0 after 0.0m
I0528 07:21:48.878] Call:  git rev-parse HEAD
I0528 07:21:48.883] process 97515 exited with code 0 after 0.0m
... skipping 21 lines ...