This job view page is being replaced by Spyglass soon. Check out the new job view.
PRfeiskyer: Automated cherry pick of #794: consolidate logs for instance not found error
ResultABORTED
Tests 1 failed / 24 succeeded
Started2021-09-07 02:21
Elapsed51m52s
Revision5facb92ee56bfd6f80f71782a786c5339d72a66d
Refs 797

Test Failures


Cloud provider Azure e2e suite Azure Credential Provider should be able to pull private images from acr without docker secrets set explicitly 20s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Cloud\sprovider\sAzure\se2e\ssuite\sAzure\sCredential\sProvider\sshould\sbe\sable\sto\spull\sprivate\simages\sfrom\sacr\swithout\sdocker\ssecrets\sset\sexplicitly$'
/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/auth/cred.go:58
Expected
    <string>: 
not to equal
    <string>: 
/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/auth/cred.go:74
				
				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid


Show 24 Passed Tests

Show 10 Skipped Tests

Error lines from build-log.txt

... skipping 228 lines ...
Sep  7 02:32:37.883: INFO: Creating a kubernetes client
Sep  7 02:32:37.883: INFO: Kubernetes configuration file name: /root/tmp501927299/kubeconfig/kubeconfig.francecentral.json
Sep  7 02:32:38.235: INFO: Creating deployment servicelb-test
[It] should support multiple external services sharing one preset public IP address
  /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:264
Sep  7 02:32:38.375: INFO: Creating public IP resource named service-lb-public-remain18af
Sep  7 02:32:44.694: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 02:32:54.812: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 02:33:04.812: INFO: Exposure successfully, get external ip: 20.199.112.2
Sep  7 02:33:04.812: INFO: Successfully created LoadBalancer service1 in namespace e2e-tests-service-lb-4klt2 with IP 20.199.112.2
Sep  7 02:33:05.074: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 02:33:15.193: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 02:33:25.194: INFO: Exposure successfully, get external ip: 20.199.112.2
Sep  7 02:33:25.194: INFO: Successfully created LoadBalancer service2 in namespace e2e-tests-service-lb-4klt2 with IP 20.199.112.2
STEP: Cleaning up
Sep  7 02:33:25.503: INFO: Deleting public IP resource named service-lb-public-remain18af in resource group kubetest-jrorsjdu
Sep  7 02:33:25.903: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=0 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-jrorsjdu/providers/Microsoft.Network/publicIPAddresses/service-lb-public-remain18af can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-jrorsjdu/providers/Microsoft.Network/loadBalancers/kubetest-jrorsjdu/frontendIPConfigurations/a90908bfac1204f84beeee004df4fcc9. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon
Sep  7 02:33:28.623: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=0 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-jrorsjdu/providers/Microsoft.Network/publicIPAddresses/service-lb-public-remain18af can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-jrorsjdu/providers/Microsoft.Network/loadBalancers/kubetest-jrorsjdu/frontendIPConfigurations/a90908bfac1204f84beeee004df4fcc9. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon
Sep  7 02:33:30.300: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=0 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-jrorsjdu/providers/Microsoft.Network/publicIPAddresses/service-lb-public-remain18af can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-jrorsjdu/providers/Microsoft.Network/loadBalancers/kubetest-jrorsjdu/frontendIPConfigurations/a90908bfac1204f84beeee004df4fcc9. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon
Sep  7 02:33:32.322: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=0 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-jrorsjdu/providers/Microsoft.Network/publicIPAddresses/service-lb-public-remain18af can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-jrorsjdu/providers/Microsoft.Network/loadBalancers/kubetest-jrorsjdu/frontendIPConfigurations/a90908bfac1204f84beeee004df4fcc9. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon
Sep  7 02:33:34.298: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=0 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-jrorsjdu/providers/Microsoft.Network/publicIPAddresses/service-lb-public-remain18af can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-jrorsjdu/providers/Microsoft.Network/loadBalancers/kubetest-jrorsjdu/frontendIPConfigurations/a90908bfac1204f84beeee004df4fcc9. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon
Sep  7 02:33:36.303: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=0 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-jrorsjdu/providers/Microsoft.Network/publicIPAddresses/service-lb-public-remain18af can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-jrorsjdu/providers/Microsoft.Network/loadBalancers/kubetest-jrorsjdu/frontendIPConfigurations/a90908bfac1204f84beeee004df4fcc9. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon
Sep  7 02:33:38.302: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=0 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-jrorsjdu/providers/Microsoft.Network/publicIPAddresses/service-lb-public-remain18af can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-jrorsjdu/providers/Microsoft.Network/loadBalancers/kubetest-jrorsjdu/frontendIPConfigurations/a90908bfac1204f84beeee004df4fcc9. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon
Sep  7 02:33:40.650: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=0 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-jrorsjdu/providers/Microsoft.Network/publicIPAddresses/service-lb-public-remain18af can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-jrorsjdu/providers/Microsoft.Network/loadBalancers/kubetest-jrorsjdu/frontendIPConfigurations/a90908bfac1204f84beeee004df4fcc9. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon
Sep  7 02:33:42.329: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=0 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-jrorsjdu/providers/Microsoft.Network/publicIPAddresses/service-lb-public-remain18af can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-jrorsjdu/providers/Microsoft.Network/loadBalancers/kubetest-jrorsjdu/frontendIPConfigurations/a90908bfac1204f84beeee004df4fcc9. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon
[AfterEach] Ensure LoadBalancer
  /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:78
Sep  7 02:33:44.462: INFO: Deleting namespace e2e-tests-service-lb-4klt2

• [SLOW TEST:83.419 seconds]
Ensure LoadBalancer
... skipping 15 lines ...
Sep  7 02:34:01.072: INFO: Kubernetes configuration file name: /root/tmp501927299/kubeconfig/kubeconfig.francecentral.json
[It] should support service annotation 'service.beta.kubernetes.io/azure-load-balancer-internal'
  /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:153
Sep  7 02:34:01.497: INFO: Creating service annotation-test in namespace e2e-tests-service-99wsg
Sep  7 02:34:01.641: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-99wsg
Sep  7 02:34:01.641: INFO: Waiting service to expose...
Sep  7 02:34:01.757: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 02:34:11.875: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 02:34:21.875: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 02:34:31.875: INFO: Exposure successfully, get external ip: 10.240.0.6
STEP: Validating whether the load balancer is internal
Sep  7 02:34:31.875: INFO: Validating external IP not be public and internal accessible
Sep  7 02:34:31.875: INFO: Create a front pod to connect to service
Sep  7 02:34:32.019: INFO: Call from the created pod
Sep  7 02:34:32.144: INFO: waiting for the pod succeeded
... skipping 25 lines ...
Sep  7 02:35:17.545: INFO: Creating a test namespace
Sep  7 02:35:17.666: INFO: Creating a kubernetes client
Sep  7 02:35:17.666: INFO: Kubernetes configuration file name: /root/tmp501927299/kubeconfig/kubeconfig.francecentral.json
Sep  7 02:35:18.011: INFO: Creating deployment servicelb-test
[It] should support multiple external services sharing one newly created public IP address
  /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:301
Sep  7 02:35:18.480: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 02:35:28.599: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 02:35:38.598: INFO: Exposure successfully, get external ip: 51.103.60.145
Sep  7 02:35:38.598: INFO: Successfully created LoadBalancer service1 in namespace e2e-tests-service-lb-mwv9x with IP 51.103.60.145
Sep  7 02:35:38.867: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 02:35:48.987: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 02:35:58.985: INFO: Exposure successfully, get external ip: 51.103.60.145
Sep  7 02:35:58.985: INFO: Successfully created LoadBalancer service2 in namespace e2e-tests-service-lb-mwv9x with IP 51.103.60.145
STEP: Deleting one service and check if the other service works well
Sep  7 02:35:59.268: INFO: Exposure successfully, get external ip: 51.103.60.145
STEP: Deleting all services
STEP: Checking if the public IP has been deleted
... skipping 28 lines ...
Sep  7 02:36:53.122: INFO: Creating deployment servicelb-test
[It] should add all nodes in different agent pools to backends [MultipleAgentPools]
  /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/standard_lb.go:82
Sep  7 02:36:53.247: INFO: Creating service servicelb-test in namespace e2e-tests-service-lb-nqm49
Sep  7 02:36:53.426: INFO: Successfully created LoadBalancer service servicelb-test in namespace e2e-tests-service-lb-nqm49
Sep  7 02:36:53.426: INFO: Waiting service to expose...
Sep  7 02:36:53.542: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 02:37:03.660: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 02:37:13.661: INFO: Exposure successfully, get external ip: 51.103.7.100
Sep  7 02:37:13.661: INFO: Getting public IPs in the resourceGroup kubetest-jrorsjdu
Sep  7 02:37:13.906: INFO: Getting public IP frontend configuration ID
Sep  7 02:37:13.906: INFO: Successfully obtained PIP front config id: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-jrorsjdu/providers/Microsoft.Network/loadBalancers/kubetest-jrorsjdu/frontendIPConfigurations/a853a34c602a148f88b19ca28d40b480
Sep  7 02:37:13.906: INFO: Getting loadBalancer name from pipFrontendConfigurationID
Sep  7 02:37:13.906: INFO: Got loadBalancerName "kubetest-jrorsjdu"
... skipping 34 lines ...
Sep  7 02:37:55.923: INFO: found one k8s virtual network k8s-vnet-27007793
STEP: Test subnet doesn't exist. Creating a new one...
Sep  7 02:37:57.262: INFO: creating a new subnet lb-subnet, 10.0.0.0/24
Sep  7 02:37:57.544: INFO: Creating service annotation-test in namespace e2e-tests-service-hc8vs
Sep  7 02:37:57.692: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-hc8vs
Sep  7 02:37:57.692: INFO: Waiting service to expose...
Sep  7 02:37:57.809: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 02:38:07.928: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 02:38:17.926: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 02:38:27.928: INFO: Exposure successfully, get external ip: 10.0.0.4
Sep  7 02:38:27.928: INFO: Get External IP: 10.0.0.4
STEP: Validating external ip in target subnet
Sep  7 02:38:27.928: INFO: cleaning up test service annotation-test
Sep  7 02:38:28.097: INFO: Deleting service annotation-test in namespace e2e-tests-service-hc8vs
Sep  7 02:38:40.336: INFO: cleaning up test subnet lb-subnet
... skipping 52 lines ...
[It] should support updating internal IP when updating internal service
  /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:134
Sep  7 02:39:17.738: INFO: Getting virtual network list
Sep  7 02:39:17.976: INFO: found one k8s virtual network k8s-vnet-27007793
Sep  7 02:39:19.022: INFO: Successfully created LoadBalancer service servicelb-test in namespace e2e-tests-service-lb-dqfq6
STEP: Waiting for exposure of internal service with specific IP
Sep  7 02:39:19.142: INFO: Fail to get ingress, retry it in 10s seconds
Sep  7 02:39:29.261: INFO: Fail to get ingress, retry it in 10s seconds
Sep  7 02:39:39.260: INFO: Fail to get ingress, retry it in 10s seconds
Sep  7 02:39:49.259: INFO: Exposure successfully
Sep  7 02:39:49.535: INFO: Events list:
Sep  7 02:39:49.535: INFO: 0. {{ } {servicelb-test-76bf687774-8hzzt.16a269d02678dc98  e2e-tests-service-lb-dqfq6  c2a70292-db6c-4934-abe9-c7857b8678f5 4871 0 2021-09-07 02:39:17 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-scheduler Update events.k8s.io/v1 2021-09-07 02:39:17 +0000 UTC FieldsV1 {"f:action":{},"f:eventTime":{},"f:note":{},"f:reason":{},"f:regarding":{"f:apiVersion":{},"f:kind":{},"f:name":{},"f:namespace":{},"f:resourceVersion":{},"f:uid":{}},"f:reportingController":{},"f:reportingInstance":{},"f:type":{}}}]} {Pod e2e-tests-service-lb-dqfq6 servicelb-test-76bf687774-8hzzt 3a07ea1d-ba40-4881-99cb-ea85327b9584 v1 4860 } Scheduled Successfully assigned e2e-tests-service-lb-dqfq6/servicelb-test-76bf687774-8hzzt to k8s-agentpool1-27007793-1 { } 0001-01-01 00:00:00 +0000 UTC 0001-01-01 00:00:00 +0000 UTC 0 Normal 2021-09-07 02:39:17.781103 +0000 UTC nil Binding nil default-scheduler default-scheduler-k8s-master-27007793-0}
Sep  7 02:39:49.535: INFO: 1. {{ } {servicelb-test-76bf687774-8hzzt.16a269d06b945d8e  e2e-tests-service-lb-dqfq6  83d198fe-04ea-442e-9f6f-402720650f7c 4894 0 2021-09-07 02:39:18 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2021-09-07 02:39:18 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:apiVersion":{},"f:fieldPath":{},"f:kind":{},"f:name":{},"f:namespace":{},"f:resourceVersion":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Pod e2e-tests-service-lb-dqfq6 servicelb-test-76bf687774-8hzzt 3a07ea1d-ba40-4881-99cb-ea85327b9584 v1 4864 spec.containers{test-app}} Pulling Pulling image "nginx:1.15" {kubelet k8s-agentpool1-27007793-1} 2021-09-07 02:39:18 +0000 UTC 2021-09-07 02:39:18 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }
Sep  7 02:39:49.535: INFO: 2. {{ } {servicelb-test-76bf687774-8hzzt.16a269d12d4d97ed  e2e-tests-service-lb-dqfq6  903424fa-d522-4f2d-a5c9-7731bfb9159f 4940 0 2021-09-07 02:39:22 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2021-09-07 02:39:22 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:apiVersion":{},"f:fieldPath":{},"f:kind":{},"f:name":{},"f:namespace":{},"f:resourceVersion":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Pod e2e-tests-service-lb-dqfq6 servicelb-test-76bf687774-8hzzt 3a07ea1d-ba40-4881-99cb-ea85327b9584 v1 4864 spec.containers{test-app}} Pulled Successfully pulled image "nginx:1.15" in 3.25012649s {kubelet k8s-agentpool1-27007793-1} 2021-09-07 02:39:22 +0000 UTC 2021-09-07 02:39:22 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }
Sep  7 02:39:49.535: INFO: 3. {{ } {servicelb-test-76bf687774-8hzzt.16a269d131bcbbcb  e2e-tests-service-lb-dqfq6  3a973000-1bd3-4568-9ea8-83ace5a01cd0 4941 0 2021-09-07 02:39:22 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2021-09-07 02:39:22 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:apiVersion":{},"f:fieldPath":{},"f:kind":{},"f:name":{},"f:namespace":{},"f:resourceVersion":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Pod e2e-tests-service-lb-dqfq6 servicelb-test-76bf687774-8hzzt 3a07ea1d-ba40-4881-99cb-ea85327b9584 v1 4864 spec.containers{test-app}} Created Created container test-app {kubelet k8s-agentpool1-27007793-1} 2021-09-07 02:39:22 +0000 UTC 2021-09-07 02:39:22 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }
... skipping 57 lines ...
Sep  7 02:40:28.650: INFO: Creating deployment servicelb-test
[It] should support updating an internal service to a public service with assigned IP
  /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:177
Sep  7 02:40:28.959: INFO: Successfully created LoadBalancer service servicelb-test in namespace e2e-tests-service-lb-8j6t2
Sep  7 02:40:28.959: INFO: Creating public IP resource named service-lb-internal-none-public-IP656b
STEP: Waiting for exposure of the original service without assigned lb private IP
Sep  7 02:40:33.912: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 02:40:44.030: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 02:40:54.030: INFO: Exposure successfully, get external ip: 10.240.0.6
Sep  7 02:40:54.262: INFO: Events list:
Sep  7 02:40:54.262: INFO: 0. {{ } {servicelb-test-76bf687774-2d99l.16a269e0b08da7bf  e2e-tests-service-lb-8j6t2  6e73aec2-f0c6-4df0-b6df-81d24c551ac6 5336 0 2021-09-07 02:40:28 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-scheduler Update events.k8s.io/v1 2021-09-07 02:40:28 +0000 UTC FieldsV1 {"f:action":{},"f:eventTime":{},"f:note":{},"f:reason":{},"f:regarding":{"f:apiVersion":{},"f:kind":{},"f:name":{},"f:namespace":{},"f:resourceVersion":{},"f:uid":{}},"f:reportingController":{},"f:reportingInstance":{},"f:type":{}}}]} {Pod e2e-tests-service-lb-8j6t2 servicelb-test-76bf687774-2d99l 08bda136-0034-4806-a90e-fbcb1478a88e v1 5321 } Scheduled Successfully assigned e2e-tests-service-lb-8j6t2/servicelb-test-76bf687774-2d99l to k8s-agentpool1-27007793-1 { } 0001-01-01 00:00:00 +0000 UTC 0001-01-01 00:00:00 +0000 UTC 0 Normal 2021-09-07 02:40:28.817197 +0000 UTC nil Binding nil default-scheduler default-scheduler-k8s-master-27007793-0}
Sep  7 02:40:54.262: INFO: 1. {{ } {servicelb-test-76bf687774-2d99l.16a269e0f80b9715  e2e-tests-service-lb-8j6t2  cd557965-d387-4599-975f-a321570aec86 5363 0 2021-09-07 02:40:30 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2021-09-07 02:40:30 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:apiVersion":{},"f:fieldPath":{},"f:kind":{},"f:name":{},"f:namespace":{},"f:resourceVersion":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Pod e2e-tests-service-lb-8j6t2 servicelb-test-76bf687774-2d99l 08bda136-0034-4806-a90e-fbcb1478a88e v1 5326 spec.containers{test-app}} Pulling Pulling image "nginx:1.15" {kubelet k8s-agentpool1-27007793-1} 2021-09-07 02:40:30 +0000 UTC 2021-09-07 02:40:30 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }
Sep  7 02:40:54.262: INFO: 2. {{ } {servicelb-test-76bf687774-2d99l.16a269e1c324f300  e2e-tests-service-lb-8j6t2  d7a6812a-6a27-4b1a-adde-1396fa2ec808 5403 0 2021-09-07 02:40:33 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2021-09-07 02:40:33 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:apiVersion":{},"f:fieldPath":{},"f:kind":{},"f:name":{},"f:namespace":{},"f:resourceVersion":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Pod e2e-tests-service-lb-8j6t2 servicelb-test-76bf687774-2d99l 08bda136-0034-4806-a90e-fbcb1478a88e v1 5326 spec.containers{test-app}} Pulled Successfully pulled image "nginx:1.15" in 3.407424278s {kubelet k8s-agentpool1-27007793-1} 2021-09-07 02:40:33 +0000 UTC 2021-09-07 02:40:33 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }
Sep  7 02:40:54.262: INFO: 3. {{ } {servicelb-test-76bf687774-2d99l.16a269e1c7405e28  e2e-tests-service-lb-8j6t2  9531dc0f-fddf-489a-9d0c-3d6f13e6d877 5409 0 2021-09-07 02:40:33 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2021-09-07 02:40:33 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:apiVersion":{},"f:fieldPath":{},"f:kind":{},"f:name":{},"f:namespace":{},"f:resourceVersion":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Pod e2e-tests-service-lb-8j6t2 servicelb-test-76bf687774-2d99l 08bda136-0034-4806-a90e-fbcb1478a88e v1 5326 spec.containers{test-app}} Created Created container test-app {kubelet k8s-agentpool1-27007793-1} 2021-09-07 02:40:33 +0000 UTC 2021-09-07 02:40:33 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }
... skipping 32 lines ...
Sep  7 02:41:04.753: INFO: still unmatched external IP, retry it in 10s seconds
Sep  7 02:41:14.754: INFO: still unmatched external IP, retry it in 10s seconds
Sep  7 02:41:24.769: INFO: still unmatched external IP, retry it in 10s seconds
Sep  7 02:41:34.814: INFO: Exposure successfully
STEP: Cleaning up
Sep  7 02:41:34.983: INFO: Deleting public IP resource named service-lb-internal-none-public-IP656b in resource group kubetest-jrorsjdu
Sep  7 02:41:36.075: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=0 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-jrorsjdu/providers/Microsoft.Network/publicIPAddresses/service-lb-internal-none-public-IP656b can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-jrorsjdu/providers/Microsoft.Network/loadBalancers/kubetest-jrorsjdu/frontendIPConfigurations/ad7d47c32cc5c49e29d607ee78e34ff8. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon
Sep  7 02:41:38.480: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=0 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-jrorsjdu/providers/Microsoft.Network/publicIPAddresses/service-lb-internal-none-public-IP656b can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-jrorsjdu/providers/Microsoft.Network/loadBalancers/kubetest-jrorsjdu/frontendIPConfigurations/ad7d47c32cc5c49e29d607ee78e34ff8. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon
[AfterEach] Ensure LoadBalancer
  /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:78
Sep  7 02:41:40.669: INFO: Deleting namespace e2e-tests-service-lb-8j6t2

• [SLOW TEST:84.850 seconds]
Ensure LoadBalancer
... skipping 16 lines ...
[It] should support service annotation `service.beta.kubernetes.io/azure-shared-securityrule`
  /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:297
STEP: Exposing two services with shared security rule
Sep  7 02:41:53.661: INFO: Creating service annotation-test in namespace e2e-tests-service-9qttb
Sep  7 02:41:53.808: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-9qttb
Sep  7 02:41:53.808: INFO: Waiting service to expose...
Sep  7 02:41:53.924: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 02:42:04.041: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 02:42:14.044: INFO: Exposure successfully, get external ip: 51.138.217.250
Sep  7 02:42:14.044: INFO: Creating service annotation-test-share in namespace e2e-tests-service-9qttb
Sep  7 02:42:14.201: INFO: Successfully created LoadBalancer service annotation-test-share in namespace e2e-tests-service-9qttb
Sep  7 02:42:14.201: INFO: Waiting service to expose...
Sep  7 02:42:14.316: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 02:42:24.435: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 02:42:34.435: INFO: Exposure successfully, get external ip: 20.74.96.180
STEP: Validate shared security rule exists
Sep  7 02:42:34.435: INFO: Getting virtual network list
Sep  7 02:42:34.850: INFO: got sg list, length = 1
STEP: Cleaning up
Sep  7 02:42:35.020: INFO: Deleting service annotation-test-share in namespace e2e-tests-service-9qttb
... skipping 23 lines ...
[It] should support service annotation 'service.beta.kubernetes.io/azure-dns-label-name'
  /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:109
STEP: Create service
Sep  7 02:44:02.787: INFO: Creating service annotation-test in namespace e2e-tests-service-q7bp8
Sep  7 02:44:02.927: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-q7bp8
Sep  7 02:44:02.927: INFO: Waiting service to expose...
Sep  7 02:44:03.043: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 02:44:13.161: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 02:44:23.163: INFO: Exposure successfully, get external ip: 51.138.220.124
STEP: Validating External domain name
Sep  7 02:44:23.164: INFO: Get domain name: annotation-test03bdd4c9-94ad-4bea-b84f-fc2313c84001.francecentral.cloudapp.azure.com
Sep  7 02:44:53.165: INFO: Received the following error when validating http://annotation-test03bdd4c9-94ad-4bea-b84f-fc2313c84001.francecentral.cloudapp.azure.com:80: Get "http://annotation-test03bdd4c9-94ad-4bea-b84f-fc2313c84001.francecentral.cloudapp.azure.com:80": dial tcp 51.138.220.124:80: i/o timeout
Sep  7 02:44:53.165: INFO: Retrying in 20 seconds
Sep  7 02:45:13.498: INFO: cleaning up test service annotation-test
Sep  7 02:45:13.656: INFO: Deleting service annotation-test in namespace e2e-tests-service-q7bp8
[AfterEach] Service with annotation
  /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:97
Sep  7 02:45:48.015: INFO: Deleting namespace e2e-tests-service-q7bp8
... skipping 17 lines ...
Sep  7 02:46:00.842: INFO: Creating deployment servicelb-test
[It] should have no operation since no change in service when update [Slow]
  /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:223
Sep  7 02:46:00.967: INFO: Creating public IP resource named service-lb-public-remain3a30
Sep  7 02:46:06.407: INFO: Successfully created LoadBalancer service servicelb-test in namespace e2e-tests-service-lb-wxxzv
STEP: Waiting for exposure of the original service with assigned lb private IP
Sep  7 02:46:06.523: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 02:46:16.642: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 02:46:26.641: INFO: Exposure successfully, get external ip: 51.103.50.70
STEP: Update without changing the service and wait for a while
Sep  7 02:46:26.641: INFO: External IP is now 51.103.50.70
Sep  7 02:46:26.758: INFO: testlabel3a30
Sep  7 02:46:27.006: INFO: External IP is still 51.103.50.70
Sep  7 02:46:37.183: INFO: External IP is still 51.103.50.70
... skipping 56 lines ...
Sep  7 02:56:07.123: INFO: External IP is still 51.103.50.70
Sep  7 02:56:17.124: INFO: External IP is still 51.103.50.70
Sep  7 02:56:27.130: INFO: External IP is still 51.103.50.70
Sep  7 02:56:27.246: INFO: External IP is still 51.103.50.70
STEP: Cleaning up
Sep  7 02:56:27.409: INFO: Deleting public IP resource named service-lb-public-remain3a30 in resource group kubetest-jrorsjdu
Sep  7 02:56:28.718: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=0 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-jrorsjdu/providers/Microsoft.Network/publicIPAddresses/service-lb-public-remain3a30 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-jrorsjdu/providers/Microsoft.Network/loadBalancers/kubetest-jrorsjdu/frontendIPConfigurations/ab107e6af5621409abc2943b379ae5cb. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon
Sep  7 02:56:31.139: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=0 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-jrorsjdu/providers/Microsoft.Network/publicIPAddresses/service-lb-public-remain3a30 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-jrorsjdu/providers/Microsoft.Network/loadBalancers/kubetest-jrorsjdu/frontendIPConfigurations/ab107e6af5621409abc2943b379ae5cb. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon
[AfterEach] Ensure LoadBalancer
  /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:78
Sep  7 02:56:33.275: INFO: Deleting namespace e2e-tests-service-lb-wxxzv

• [SLOW TEST:649.265 seconds]
Ensure LoadBalancer
... skipping 15 lines ...
[It] can set source IP prefixes automatically according to corresponding service tag
  /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:139
STEP: Creating service and wait it to expose
Sep  7 02:56:50.239: INFO: Creating service nsg-test in namespace e2e-tests-nsg-2v48j
Sep  7 02:56:50.411: INFO: Successfully created LoadBalancer service nsg-test in namespace e2e-tests-nsg-2v48j
Sep  7 02:56:50.411: INFO: Waiting service to expose...
Sep  7 02:56:50.528: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 02:57:00.646: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 02:57:10.645: INFO: Exposure successfully, get external ip: 51.138.218.153
STEP: Validating if the corresponding IP prefix existing in nsg
Sep  7 02:57:10.646: INFO: Getting virtual network list
Sep  7 02:57:11.049: INFO: got sg list, length = 1
[AfterEach] Network security group
  /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:73
... skipping 52 lines ...
  /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:379
STEP: Creating two test pips
Sep  7 02:57:51.499: INFO: Creating public IP resource named pip1
Sep  7 02:57:57.150: INFO: Creating public IP resource named pip2
STEP: Creating a service referring to the first pip
STEP: Waiting for the service to expose
Sep  7 02:57:59.875: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 02:58:09.994: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 02:58:19.992: INFO: Exposure successfully, get external ip: 51.103.49.148
STEP: Updating the service to refer to the second service
STEP: Waiting for service IP to be updated
Sep  7 02:58:20.353: INFO: Exposure successfully, get external ip: 51.103.49.148
Sep  7 02:58:30.470: INFO: Exposure successfully, get external ip: 51.103.49.148
Sep  7 02:58:40.471: INFO: Exposure successfully, get external ip: 51.103.49.152
... skipping 103 lines ...
Sep  7 02:59:23.861: INFO: Kubernetes configuration file name: /root/tmp501927299/kubeconfig/kubeconfig.francecentral.json
Sep  7 02:59:24.210: INFO: Creating deployment nsg-test
[It] should support service annotation `service.beta.kubernetes.io/azure-deny-all-except-load-balancer-source-ranges`
  /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:162
STEP: Creating a test service with the deny rule annotation but without `service.Spec.LoadBalancerSourceRanges`
STEP: Waiting for the service to expose
Sep  7 02:59:24.642: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 02:59:34.760: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 02:59:44.760: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 02:59:54.760: INFO: Exposure successfully, get external ip: 10.240.0.6
STEP: Checking if there is a deny_all rule
Sep  7 02:59:54.760: INFO: Getting virtual network list
Sep  7 02:59:55.016: INFO: got sg list, length = 1
STEP: Deleting the service
Sep  7 02:59:55.182: INFO: Deleting service nsg-test in namespace e2e-tests-nsg-7c9kw
STEP: Creating a test service with the deny rule annotation and `service.Spec.LoadBalancerSourceRanges`
STEP: Waiting for the service to expose
Sep  7 03:00:07.684: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 03:00:17.802: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 03:00:27.802: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 03:00:37.801: INFO: Exposure successfully, get external ip: 10.240.0.6
STEP: Checking if there is a LoadBalancerSourceRanges rule
Sep  7 03:00:37.801: INFO: Getting virtual network list
Sep  7 03:00:37.962: INFO: got sg list, length = 1
STEP: Checking if there is a deny_all rule
[AfterEach] Network security group
... skipping 18 lines ...
Sep  7 03:01:12.450: INFO: Creating a test namespace
Sep  7 03:01:12.571: INFO: Creating a kubernetes client
Sep  7 03:01:12.571: INFO: Kubernetes configuration file name: /root/tmp501927299/kubeconfig/kubeconfig.francecentral.json
Sep  7 03:01:12.916: INFO: Creating deployment servicelb-test
[It] should support multiple internal services sharing one IP address
  /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:352
Sep  7 03:01:13.337: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 03:01:23.455: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 03:01:33.456: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 03:01:43.455: INFO: Exposure successfully, get external ip: 10.240.0.6
Sep  7 03:01:43.455: INFO: Successfully created LoadBalancer service1 in namespace e2e-tests-service-lb-4m78r with IP 10.240.0.6
Sep  7 03:01:43.719: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 03:01:53.837: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 03:02:03.837: INFO: Exposure successfully, get external ip: 10.240.0.6
Sep  7 03:02:03.837: INFO: Successfully created LoadBalancer service2 in namespace e2e-tests-service-lb-4m78r with IP 10.240.0.6
STEP: Cleaning up
[AfterEach] Ensure LoadBalancer
  /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:78
Sep  7 03:02:04.388: INFO: Deleting namespace e2e-tests-service-lb-4m78r
... skipping 20 lines ...
[It] should support assigning to specific IP when updating public service
  /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:91
Sep  7 03:02:27.532: INFO: Successfully created LoadBalancer service servicelb-test in namespace e2e-tests-service-lb-c2cxf
Sep  7 03:02:27.533: INFO: Creating public IP resource named service-lb-public-none-IP1cd4
Sep  7 03:02:33.301: INFO: PIP to 20.188.56.149
STEP: Waiting for exposure of the original service without assigned lb IP
Sep  7 03:02:33.419: INFO: Fail to find ingress, retry it in 10 seconds
Sep  7 03:02:43.535: INFO: Exposure successfully, get external ip: 20.74.21.97
STEP: Updating service to bound to specific public IP
Sep  7 03:02:43.535: INFO: will update IP to 20.188.56.149
Sep  7 03:02:43.906: INFO: still unmatched external IP, retry it in 10s seconds
Sep  7 03:02:54.024: INFO: still unmatched external IP, retry it in 10s seconds
Sep  7 03:03:04.023: INFO: still unmatched external IP, retry it in 10s seconds
Sep  7 03:03:14.024: INFO: still unmatched external IP, retry it in 10s seconds
Sep  7 03:03:24.025: INFO: Exposure successfully
STEP: Cleaning up
Sep  7 03:03:24.204: INFO: Deleting public IP resource named service-lb-public-none-IP1cd4 in resource group kubetest-jrorsjdu
Sep  7 03:03:25.323: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=0 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-jrorsjdu/providers/Microsoft.Network/publicIPAddresses/service-lb-public-none-IP1cd4 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-jrorsjdu/providers/Microsoft.Network/loadBalancers/kubetest-jrorsjdu/frontendIPConfigurations/a7bce58e1604b44caa7c764277760fc6. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon
Sep  7 03:03:27.738: INFO: error: network.PublicIPAddressesClient#Delete: Failure sending request: StatusCode=0 -- Original Error: Code="PublicIPAddressCannotBeDeleted" Message="Public IP address /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-jrorsjdu/providers/Microsoft.Network/publicIPAddresses/service-lb-public-none-IP1cd4 can not be deleted since it is still allocated to resource /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kubetest-jrorsjdu/providers/Microsoft.Network/loadBalancers/kubetest-jrorsjdu/frontendIPConfigurations/a7bce58e1604b44caa7c764277760fc6. In order to delete the public IP, disassociate/detach the Public IP address from the resource.  To learn how to do this, see aka.ms/deletepublicip." Details=[], will retry soon
[AfterEach] Ensure LoadBalancer
  /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:78
Sep  7 03:03:30.241: INFO: Deleting namespace e2e-tests-service-lb-c2cxf

• [SLOW TEST:75.855 seconds]
Ensure LoadBalancer
... skipping 21 lines ...