kubernetes-sigs/cloud-provider-azure PR #1848 pull-cloud-provider-azure-e2e-ccm-vmss-capz-1-24 #1537344125295136768
Recent runs || View in Spyglass
Recent runs || View in Spyglass
| PR | k8s-infra-cherrypick-robot: [release-1.24] feat(load-balancer): support specifying Public IP address prefix to produce IP of Load Balancer |
| Result | FAILURE |
| Tests | 1 failed / 40 succeeded |
| Started | |
| Elapsed | 1h58m |
| Revision | 993516b218b8b23ab137ac1217fbdb0c8c8830bb |
| Refs |
1848 |
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Cloud\sprovider\sAzure\se2e\ssuite\sService\swith\sannotation\sshould\ssupport\sservice\sannotation\s\`service\.beta\.kubernetes\.io\/azure\-pip\-prefix\-id\`$'
/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:420
Unexpected error:
<autorest.DetailedError>: {
Original: <*azure.ServiceError | 0xc0009b6780>{
Code: "StaticPublicIPCountLimitReached",
Message: "Cannot create more than 100 public IP addresses with static allocation method for this subscription in this region.",
Target: nil,
Details: [],
InnerError: nil,
AdditionalInfo: nil,
},
PackageType: "network.PublicIPPrefixesClient",
Method: "CreateOrUpdate",
StatusCode: <int>400,
Message: "Failure sending request",
ServiceError: nil,
Response: {
Status: "400 Bad Request",
StatusCode: 400,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Pragma": ["no-cache"],
"X-Ms-Arm-Service-Request-Id": [
"a1e36cc8-9e18-4a3e-9383-e2969a674a47",
],
"Date": [
"Thu, 16 Jun 2022 09:20:28 GMT",
],
"Content-Length": ["225"],
"X-Ms-Ratelimit-Remaining-Subscription-Writes": ["1196"],
"X-Content-Type-Options": ["nosniff"],
"Content-Type": [
"application/json; charset=utf-8",
],
"X-Ms-Request-Id": [
"9f7d5af3-8213-4d0c-a072-f509f11aef1e",
],
"X-Ms-Correlation-Request-Id": [
"f0d13a0f-f270-4ad7-9c4b-39f7b204cc7f",
],
"Cache-Control": ["no-cache"],
"Expires": ["-1"],
"Strict-Transport-Security": [
"max-age=31536000; includeSubDomains",
],
"Server": [
"Microsoft-HTTPAPI/2.0",
"Microsoft-HTTPAPI/2.0",
],
"X-Ms-Routing-Request-Id": [
"CENTRALUS:20220616T092028Z:f0d13a0f-f270-4ad7-9c4b-39f7b204cc7f",
],
},
Body: <io.nopCloser>{
Reader: <*bytes.Reader | 0xc000412d80>{
s: [123, 13, 10, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 13, 10, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 83, 116, 97, 116, 105, 99, 80, 117, 98, 108, 105, 99, 73, 80, 67, 111, 117, 110, 116, 76, 105, 109, 105, 116, 82, 101, 97, 99, 104, 101, 100, 34, 44, 13, 10, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 97, 110, 110, 111, 116, 32, 99, 114, 101, 97, 116, 101, 32, 109, 111, 114, 101, 32, 116, 104, 97, 110, 32, 49, 48, 48, 32, 112, 117, 98, 108, 105, 99, 32, 73, 80, 32, 97, 100, 100, 114, 101, 115, 115, 101, 115, 32, 119, 105, 116, 104, 32, 115, 116, 97, 116, 105, 99, 32, 97, 108, 108, 111, 99, 97, 116, 105, 111, 110, 32, 109, 101, 116, 104, 111, 100, 32, 102, 111, 114, 32, 116, 104, 105, 115, 32, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 32, 105, 110, 32, 116, 104, 105, 115, 32, 114, 101, 103, 105, 111, 110, 46, 34, 44, 13, 10, 32, 32, 32, 32, 34, 100, 101, 116, 97, 105, 108, 115, 34, 58, 32, 91, 93, 13, 10, 32, 32, 125, 13, 10, 125],
i: 0,
prevRune: -1,
},
},
ContentLength: 225,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "PUT",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "management.azure.com",
Path: "/subscriptions/===REDACTED===/resourceGroups/capz-jbmbu4/providers/Microsoft.Network/publicIPPrefixes/prefix2",
RawPath: "",
ForceQuery: false,
RawQuery: "api-version=2021-08-01",
Fragment: "",
...
Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.
Learn more here: https://onsi.github.io/gomega/#adjusting-output
network.PublicIPPrefixesClient#CreateOrUpdate: Failure sending request: StatusCode=400 -- Original Error: Code="StaticPublicIPCountLimitReached" Message="Cannot create more than 100 public IP addresses with static allocation method for this subscription in this region." Details=[]
occurred
/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:430
Jun 16 09:19:20.859: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55]
Jun 16 09:19:20.859: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63]
Jun 16 09:19:20.860: INFO: Creating a test namespace [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:87]
Jun 16 09:19:20.979: INFO: Creating deployment annotation-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:86]
Jun 16 09:19:21.096: INFO: Waiting for backend pods to be ready [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:91]
Jun 16 09:19:21.243: INFO: 4 pods in namespace e2e-tests-service-qrcz2 are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:83]
Jun 16 09:19:31.393: INFO: 0 pods in namespace e2e-tests-service-qrcz2 are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:83]
Jun 16 09:19:31.393: INFO: Creating Azure clients [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:95]
Jun 16 09:19:31.393: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55]
Jun 16 09:19:31.393: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63]
�[1mSTEP�[0m: Creating two test PIPPrefix
Jun 16 09:19:31.564: INFO: Creating PublicIPPrefix named prefix1 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:215]
Jun 16 09:20:24.945: INFO: Creating PublicIPPrefix named prefix2 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:215]
Jun 16 09:20:28.617: INFO: Deleting namespace e2e-tests-service-qrcz2 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:135]
from junit_01.xml
Filter through log files | View test history on testgrid
Cloud provider Azure e2e suite Azure Credential Provider should be able to pull private images from acr without docker secrets set explicitly
Cloud provider Azure e2e suite Azure node resources should set correct private IP address for every node
Cloud provider Azure e2e suite Azure node resources should set node provider id correctly
Cloud provider Azure e2e suite Azure node resources should set route table correctly when the cluster is enabled by kubenet [Kubenet]
Cloud provider Azure e2e suite Ensure LoadBalancer should have no operation since no change in service when update [Slow]
Cloud provider Azure e2e suite Ensure LoadBalancer should support BYO public IP
Cloud provider Azure e2e suite Ensure LoadBalancer should support assigning to specific IP when updating public service
Cloud provider Azure e2e suite Ensure LoadBalancer should support mixed protocol services
Cloud provider Azure e2e suite Ensure LoadBalancer should support multiple external services sharing one newly created public IP address
Cloud provider Azure e2e suite Ensure LoadBalancer should support multiple external services sharing one preset public IP address
Cloud provider Azure e2e suite Ensure LoadBalancer should support multiple internal services sharing one IP address
Cloud provider Azure e2e suite Ensure LoadBalancer should support updating an internal service to a public service with assigned IP
Cloud provider Azure e2e suite Ensure LoadBalancer should support updating internal IP when updating internal service
Cloud provider Azure e2e suite Lifecycle of VMSS should add node object when VMSS instance allocated
Cloud provider Azure e2e suite Lifecycle of VMSS should delete node object when VMSS instance deallocated
Cloud provider Azure e2e suite Multi-ports service When ExternalTrafficPolicy is updated Should not have error occurred
Cloud provider Azure e2e suite Network security group can set source IP prefixes automatically according to corresponding service tag
Cloud provider Azure e2e suite Network security group should add the rule when expose a service
Cloud provider Azure e2e suite Network security group should support service annotation `service.beta.kubernetes.io/azure-deny-all-except-load-balancer-source-ranges`
Cloud provider Azure e2e suite Private link service should support multiple internal services sharing one private link service
Cloud provider Azure e2e suite Private link service should support service annotation 'service.beta.kubernetes.io/azure-pls-auto-approval'
Cloud provider Azure e2e suite Private link service should support service annotation 'service.beta.kubernetes.io/azure-pls-create'
Cloud provider Azure e2e suite Private link service should support service annotation 'service.beta.kubernetes.io/azure-pls-fqdns'
Cloud provider Azure e2e suite Private link service should support service annotation 'service.beta.kubernetes.io/azure-pls-ip-configuration-ip-address'
Cloud provider Azure e2e suite Private link service should support service annotation 'service.beta.kubernetes.io/azure-pls-ip-configuration-ip-address-count'
Cloud provider Azure e2e suite Private link service should support service annotation 'service.beta.kubernetes.io/azure-pls-ip-configuration-subnet'
Cloud provider Azure e2e suite Private link service should support service annotation 'service.beta.kubernetes.io/azure-pls-name'
Cloud provider Azure e2e suite Private link service should support service annotation 'service.beta.kubernetes.io/azure-pls-proxy-protocol'
Cloud provider Azure e2e suite Private link service should support service annotation 'service.beta.kubernetes.io/azure-pls-visibility'
Cloud provider Azure e2e suite Service with annotation should support service annotation 'service.beta.kubernetes.io/azure-dns-label-name'
Cloud provider Azure e2e suite Service with annotation should support service annotation 'service.beta.kubernetes.io/azure-load-balancer-health-probe-num-of-probe' and port specific configs
Cloud provider Azure e2e suite Service with annotation should support service annotation 'service.beta.kubernetes.io/azure-load-balancer-health-probe-protocol' and port specific configs
Cloud provider Azure e2e suite Service with annotation should support service annotation 'service.beta.kubernetes.io/azure-load-balancer-internal'
Cloud provider Azure e2e suite Service with annotation should support service annotation 'service.beta.kubernetes.io/azure-load-balancer-internal-subnet'
Cloud provider Azure e2e suite Service with annotation should support service annotation 'service.beta.kubernetes.io/azure-load-balancer-resource-group'
Cloud provider Azure e2e suite Service with annotation should support service annotation 'service.beta.kubernetes.io/azure-load-balancer-tcp-idle-timeout'
Cloud provider Azure e2e suite Service with annotation should support service annotation `service.beta.kubernetes.io/azure-pip-name`
Cloud provider Azure e2e suite Service with annotation should support service annotation `service.beta.kubernetes.io/azure-pip-tags`
Cloud provider Azure e2e suite Service with annotation should support service annotation `service.beta.kubernetes.io/azure-shared-securityrule`
Cloud provider Azure e2e suite [StandardLoadBalancer] Standard load balancer should add all nodes in different agent pools to backends [MultipleAgentPools]
Cloud provider Azure e2e suite Azure nodes should expose zones correctly after created [VMSS][Serial][Slow]
Cloud provider Azure e2e suite Azure nodes should support crossing resource groups [Multi-Group][AvailabilitySet]
Cloud provider Azure e2e suite Cluster size autoscaler [Feature:Autoscaling][Serial][Slow] should balance the sizes of multiple node group if the `--balance-node-groups` is set to true [Multi-Nodepool]
Cloud provider Azure e2e suite Cluster size autoscaler [Feature:Autoscaling][Serial][Slow] should scale up or down if deployment replicas leave nodes busy or idle
Cloud provider Azure e2e suite Cluster size autoscaler [Feature:Autoscaling][Serial][Slow] should scale up, deploy a statefulset with disks attached, scale down, and certain pods + disks should be evicted to a new node
Cloud provider Azure e2e suite Cluster size autoscaler [Feature:Autoscaling][Serial][Slow] should support multiple node pools with quick scaling [Multi-Nodepool]
Cloud provider Azure e2e suite Cluster size autoscaler [Feature:Autoscaling][Serial][Slow] should support one node pool with slow scaling [Single Nodepool]
Cloud provider Azure e2e suite Cluster size autoscaler [Feature:Autoscaling][Serial][Slow] should support scaling up or down Azure Spot VM [VMSS][Spot VM]
Cloud provider Azure e2e suite Cluster size autoscaler [Feature:Autoscaling][Serial][Slow] should support scaling up or down due to the consuming of GPU resource
Cloud provider Azure e2e suite Ensure LoadBalancer should support node label `node.kubernetes.io/exclude-from-external-load-balancers`
Cloud provider Azure e2e suite [StandardLoadBalancer] Standard load balancer should make outbound IP of pod same as in SLB's outbound rules
Cloud provider Azure e2e suite [[Multi-Nodepool]][VMSS] should support service annotation `service.beta.kubernetes.io/azure-load-balancer-mode`
... skipping 78 lines ... https://docs.docker.com/engine/reference/commandline/login/#credentials-store Login Succeeded /home/prow/go/src/sigs.k8s.io/cloud-provider-azure /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure Image Tag is 42bab20 Error response from daemon: manifest for capzci.azurecr.io/azure-cloud-controller-manager:42bab20 not found: manifest unknown: manifest tagged by "42bab20" is not found Build Linux Azure amd64 cloud controller manager make: Entering directory '/home/prow/go/src/sigs.k8s.io/cloud-provider-azure' make ARCH=amd64 build-ccm-image make[1]: Entering directory '/home/prow/go/src/sigs.k8s.io/cloud-provider-azure' docker buildx inspect img-builder > /dev/null || docker buildx create --name img-builder --use error: no builder "img-builder" found img-builder # enable qemu for arm64 build # https://github.com/docker/buildx/issues/464#issuecomment-741507760 docker run --privileged --rm tonistiigi/binfmt --uninstall qemu-aarch64 Unable to find image 'tonistiigi/binfmt:latest' locally latest: Pulling from tonistiigi/binfmt ... skipping 1099 lines ... certificate.cert-manager.io "selfsigned-cert" deleted # Create secret for AzureClusterIdentity ./hack/create-identity-secret.sh make[2]: Entering directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure' make[2]: Nothing to be done for 'kubectl'. make[2]: Leaving directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure' Error from server (NotFound): secrets "cluster-identity-secret" not found secret/cluster-identity-secret created secret/cluster-identity-secret labeled # Deploy CAPI curl --retry 3 -sSL https://github.com/kubernetes-sigs/cluster-api/releases/download/v1.1.4/cluster-api-components.yaml | /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/hack/tools/bin/envsubst-v2.0.0-20210730161058-179042472c46 | kubectl apply -f - namespace/capi-system created customresourcedefinition.apiextensions.k8s.io/clusterclasses.cluster.x-k8s.io created ... skipping 122 lines ... # Wait for the kubeconfig to become available. timeout --foreground 300 bash -c "while ! kubectl get secrets | grep capz-jbmbu4-kubeconfig; do sleep 1; done" capz-jbmbu4-kubeconfig cluster.x-k8s.io/secret 1 0s # Get kubeconfig and store it locally. kubectl get secrets capz-jbmbu4-kubeconfig -o json | jq -r .data.value | base64 --decode > ./kubeconfig timeout --foreground 600 bash -c "while ! kubectl --kubeconfig=./kubeconfig get nodes | grep control-plane; do sleep 1; done" error: the server doesn't have a resource type "nodes" capz-jbmbu4-control-plane-xjzhv NotReady control-plane 9s v1.24.1 run "kubectl --kubeconfig=./kubeconfig ..." to work with the new target cluster make[1]: Leaving directory '/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure' Installing cloud-provider-azure components via helm WARNING: Kubernetes configuration file is group-readable. This is insecure. Location: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig WARNING: Kubernetes configuration file is world-readable. This is insecure. Location: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig ... skipping 59 lines ... Jun 16 08:24:30.068: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55] Jun 16 08:24:30.068: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] Jun 16 08:24:30.338: INFO: Creating deployment servicelb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/standard_lb.go:65] Jun 16 08:24:30.467: INFO: Creating service servicelb-test in namespace e2e-tests-service-lb-4pxqg [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:879] Jun 16 08:24:30.754: INFO: Successfully created LoadBalancer service servicelb-test in namespace e2e-tests-service-lb-4pxqg [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:883] Jun 16 08:24:30.755: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:886] Jun 16 08:24:30.889: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:24:41.024: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:24:51.008: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:25:01.029: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:25:11.011: INFO: Exposure successfully, get external ip: 20.103.17.228 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 08:25:11.012: INFO: checking the connectivity of the public IP 20.103.17.228 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Jun 16 08:25:26.479: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Jun 16 08:25:26.479: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] Jun 16 08:25:26.479: INFO: Getting public IPs in the resourceGroup capz-jbmbu4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:841] Jun 16 08:25:26.987: INFO: Getting public IP frontend configuration ID [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:845] ... skipping 22 lines ... Jun 16 08:26:33.331: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55] Jun 16 08:26:33.331: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] Jun 16 08:26:33.503: INFO: Creating deployment servicelb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/standard_lb.go:65] Jun 16 08:26:33.620: INFO: Creating service servicelb-test in namespace e2e-tests-service-lb-r69hz [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:879] Jun 16 08:26:33.842: INFO: Successfully created LoadBalancer service servicelb-test in namespace e2e-tests-service-lb-r69hz [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:883] Jun 16 08:26:33.842: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:886] Jun 16 08:26:33.958: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:26:44.073: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:26:54.078: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:27:04.072: INFO: Exposure successfully, get external ip: 20.103.21.140 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 08:27:04.072: INFO: checking the connectivity of the public IP 20.103.21.140 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Jun 16 08:27:34.074: INFO: got error Get "http://20.103.21.140:80": dial tcp 20.103.21.140:80: i/o timeout, will retry [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173] Jun 16 08:27:54.291: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Jun 16 08:27:54.291: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] Jun 16 08:27:54.291: INFO: Getting public IPs in the resourceGroup capz-jbmbu4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:841] Jun 16 08:27:55.222: INFO: Getting public IP frontend configuration ID [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:845] Jun 16 08:27:55.222: INFO: Successfully obtained PIP front config id: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/capz-jbmbu4/providers/Microsoft.Network/loadBalancers/capz-jbmbu4/frontendIPConfigurations/a74fb2278590b4739a3cf30d244be675 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:858] Jun 16 08:27:55.222: INFO: Getting loadBalancer name from pipFrontendConfigurationID [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:860] ... skipping 21 lines ... Jun 16 08:29:07.000: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] Jun 16 08:29:07.170: INFO: Creating deployment nsg-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:68] [1mSTEP[0m: Creating a service and expose it Jun 16 08:29:07.306: INFO: Creating service nsg-test in namespace e2e-tests-nsg-km454 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:879] Jun 16 08:29:07.557: INFO: Successfully created LoadBalancer service nsg-test in namespace e2e-tests-nsg-km454 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:883] Jun 16 08:29:07.557: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:886] Jun 16 08:29:07.671: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:29:17.809: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:29:27.785: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:29:37.787: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:29:47.791: INFO: Exposure successfully, get external ip: 20.103.22.182 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 08:29:47.791: INFO: checking the connectivity of the public IP 20.103.22.182 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Jun 16 08:30:17.811: INFO: got error Get "http://20.103.22.182:80": dial tcp 20.103.22.182:80: i/o timeout, will retry [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173] Jun 16 08:30:38.026: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Jun 16 08:30:38.026: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] [1mSTEP[0m: Validating ip exists in Security Group Jun 16 08:30:38.026: INFO: Getting virtual network list [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:139] Jun 16 08:30:38.999: INFO: got sg list, length = 2 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:161] Jun 16 08:30:38.999: INFO: Found target security rule [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:231] ... skipping 25 lines ... Jun 16 08:31:52.482: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] Jun 16 08:31:52.652: INFO: Creating deployment nsg-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:68] [1mSTEP[0m: Creating service and wait it to expose Jun 16 08:31:52.770: INFO: Creating service nsg-test in namespace e2e-tests-nsg-87tnj [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:145] Jun 16 08:31:52.995: INFO: Successfully created LoadBalancer service nsg-test in namespace e2e-tests-nsg-87tnj [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:149] [1mSTEP[0m: Waiting for the service to be exposed Jun 16 08:31:53.110: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:32:03.229: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:32:13.226: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:32:23.230: INFO: Exposure successfully, get external ip: 20.23.160.54 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] [1mSTEP[0m: Validating if the corresponding IP prefix existing in nsg Jun 16 08:32:23.231: INFO: Getting virtual network list [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:139] Jun 16 08:32:23.650: INFO: got sg list, length = 2 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:161] Jun 16 08:32:23.772: INFO: Deleting namespace e2e-tests-nsg-87tnj [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:135] ... skipping 11 lines ... Jun 16 08:33:24.233: INFO: Creating a test namespace [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:87] Jun 16 08:33:24.352: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55] Jun 16 08:33:24.352: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] Jun 16 08:33:24.521: INFO: Creating deployment nsg-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:68] [1mSTEP[0m: Creating a test service with the deny rule annotation but without `service.Spec.LoadBalancerSourceRanges` [1mSTEP[0m: Waiting for the service to expose Jun 16 08:33:24.980: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:33:35.101: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:33:45.095: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:33:55.094: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:34:05.101: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] [1mSTEP[0m: Checking if there is a deny_all rule Jun 16 08:34:05.101: INFO: Getting virtual network list [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:139] Jun 16 08:34:05.744: INFO: got sg list, length = 2 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:161] [1mSTEP[0m: Deleting the service Jun 16 08:34:05.744: INFO: Deleting service nsg-test in namespace e2e-tests-nsg-nts6h [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:48] [1mSTEP[0m: Creating a test service with the deny rule annotation and `service.Spec.LoadBalancerSourceRanges` [1mSTEP[0m: Waiting for the service to expose Jun 16 08:34:50.365: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:35:00.485: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:35:10.480: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:35:20.488: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:35:30.485: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] [1mSTEP[0m: Checking if there is a LoadBalancerSourceRanges rule Jun 16 08:35:30.485: INFO: Getting virtual network list [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:139] Jun 16 08:35:30.652: INFO: got sg list, length = 2 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:161] [1mSTEP[0m: Checking if there is a deny_all rule Jun 16 08:35:30.772: INFO: Deleting namespace e2e-tests-nsg-nts6h [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:135] ... skipping 64 lines ... Azure node resources [90m/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/node.go:49[0m should set route table correctly when the cluster is enabled by kubenet [Kubenet] [90m/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/node.go:238[0m [90m------------------------------[0m [0mMulti-ports service[0m [90mWhen ExternalTrafficPolicy is updated[0m [1mShould not have error occurred[0m [37m/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:728[0m Jun 16 08:36:42.114: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55] Jun 16 08:36:42.114: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] Jun 16 08:36:42.115: INFO: Creating a test namespace [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:87] Jun 16 08:36:42.243: INFO: Creating deployment multiport-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:701] Jun 16 08:36:42.361: INFO: Waiting for backend pods to be ready [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:706] ... skipping 3 lines ... Jun 16 08:36:52.675: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55] Jun 16 08:36:52.675: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] [1mSTEP[0m: Getting the service Jun 16 08:36:52.844: INFO: Creating service multiport-test in namespace e2e-tests-mpservice-vkzkr [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:731] Jun 16 08:36:53.011: INFO: Successfully created LoadBalancer service multiport-test in namespace e2e-tests-mpservice-vkzkr [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:735] Jun 16 08:36:53.011: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:738] Jun 16 08:36:53.126: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:37:03.245: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:37:13.247: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:37:23.242: INFO: Exposure successfully, get external ip: 20.23.160.167 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 08:37:23.242: INFO: checking the connectivity of the public IP 20.23.160.167 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Jun 16 08:37:38.895: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Jun 16 08:37:38.895: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] [1mSTEP[0m: Changing ExternalTrafficPolicy of the service to Local Jun 16 08:37:38.895: INFO: Updating service multiport-test in namespace e2e-tests-mpservice-vkzkr [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:753] ... skipping 27 lines ... [32m• [SLOW TEST:125.104 seconds][0m Multi-ports service [90m/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:667[0m When ExternalTrafficPolicy is updated [90m/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:727[0m Should not have error occurred [90m/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:728[0m [90m------------------------------[0m [36mS[0m [90m------------------------------[0m [0mAzure nodes[0m [1mshould support crossing resource groups [Multi-Group][AvailabilitySet][0m ... skipping 29 lines ... Jun 16 08:39:00.609: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55] Jun 16 08:39:00.609: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] Jun 16 08:39:00.778: INFO: Creating deployment pls-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:70] Jun 16 08:39:00.897: INFO: Creating service pls-test in namespace e2e-tests-pls-bvbkl [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:879] Jun 16 08:39:01.131: INFO: Successfully created LoadBalancer service pls-test in namespace e2e-tests-pls-bvbkl [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:883] Jun 16 08:39:01.131: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:886] Jun 16 08:39:01.250: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:39:11.368: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:39:21.367: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:39:31.372: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:39:41.371: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:39:51.365: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 08:39:51.365: INFO: Get Internal IP: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:101] Jun 16 08:39:51.365: INFO: Getting load balancers in the resourceGroup capz-jbmbu4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:421] Jun 16 08:39:52.211: INFO: Looking for internal load balancer frontend config ID with private ip as frontend [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:425] Jun 16 08:39:52.211: INFO: Successfully obtained LB frontend config: ad09d1f9a07d04c6b9d1860b5dd30afd [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:437] Jun 16 08:39:52.211: INFO: Getting private link service(pls-ad09d1f9a07d04c6b9d1860b5dd30afd) from rg(capz-jbmbu4) [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:446] ... skipping 17 lines ... Jun 16 08:40:53.808: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55] Jun 16 08:40:53.808: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] Jun 16 08:40:53.976: INFO: Creating deployment pls-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:70] Jun 16 08:40:54.094: INFO: Creating service pls-test in namespace e2e-tests-pls-rzc6h [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:879] Jun 16 08:40:54.319: INFO: Successfully created LoadBalancer service pls-test in namespace e2e-tests-pls-rzc6h [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:883] Jun 16 08:40:54.319: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:886] Jun 16 08:40:54.452: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:41:04.576: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:41:14.574: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:41:24.567: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:41:34.571: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:41:44.566: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 08:41:44.566: INFO: Get Internal IP: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:129] Jun 16 08:41:44.566: INFO: Getting load balancers in the resourceGroup capz-jbmbu4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:421] Jun 16 08:41:45.544: INFO: Looking for internal load balancer frontend config ID with private ip as frontend [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:425] Jun 16 08:41:45.544: INFO: Successfully obtained LB frontend config: a5f5df5d842814bdaaaf4c4e08673c43 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:437] Jun 16 08:41:45.544: INFO: Getting private link service(testpls) from rg(capz-jbmbu4) [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:446] ... skipping 20 lines ... Jun 16 08:42:59.078: INFO: Getting virtual network list [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:36] [1mSTEP[0m: Test subnet doesn't exist. Creating a new one... Jun 16 08:43:01.777: INFO: creating a new subnet pls-subnet, 10.2.0.0/24 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:73] Jun 16 08:43:02.357: INFO: Creating service pls-test in namespace e2e-tests-pls-wpxqv [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:879] Jun 16 08:43:02.523: INFO: Successfully created LoadBalancer service pls-test in namespace e2e-tests-pls-wpxqv [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:883] Jun 16 08:43:02.523: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:886] Jun 16 08:43:02.670: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:43:12.784: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:43:22.785: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:43:32.785: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:43:42.783: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:43:52.783: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:44:02.793: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 08:44:02.793: INFO: Get Internal IP: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:178] Jun 16 08:44:02.793: INFO: Getting load balancers in the resourceGroup capz-jbmbu4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:421] Jun 16 08:44:02.968: INFO: Looking for internal load balancer frontend config ID with private ip as frontend [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:425] Jun 16 08:44:02.968: INFO: Successfully obtained LB frontend config: aef59c610958c485fbd4a26813334d8b [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:437] Jun 16 08:44:02.968: INFO: Getting private link service(pls-aef59c610958c485fbd4a26813334d8b) from rg(capz-jbmbu4) [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:446] ... skipping 19 lines ... Jun 16 08:44:55.320: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55] Jun 16 08:44:55.320: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] Jun 16 08:44:55.496: INFO: Creating deployment pls-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:70] Jun 16 08:44:55.613: INFO: Creating service pls-test in namespace e2e-tests-pls-6fcgn [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:879] Jun 16 08:44:56.281: INFO: Successfully created LoadBalancer service pls-test in namespace e2e-tests-pls-6fcgn [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:883] Jun 16 08:44:56.281: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:886] Jun 16 08:44:56.397: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:45:06.514: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:45:16.520: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:45:26.514: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:45:36.513: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:45:46.520: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 08:45:46.520: INFO: Get Internal IP: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:202] Jun 16 08:45:46.520: INFO: Getting load balancers in the resourceGroup capz-jbmbu4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:421] Jun 16 08:45:46.890: INFO: Looking for internal load balancer frontend config ID with private ip as frontend [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:425] Jun 16 08:45:46.890: INFO: Successfully obtained LB frontend config: a7c018a906db047f58bf67d732429a85 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:437] Jun 16 08:45:46.890: INFO: Getting private link service(pls-a7c018a906db047f58bf67d732429a85) from rg(capz-jbmbu4) [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:446] ... skipping 17 lines ... Jun 16 08:46:38.906: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55] Jun 16 08:46:38.906: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] Jun 16 08:46:39.075: INFO: Creating deployment pls-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:70] Jun 16 08:46:39.193: INFO: Creating service pls-test in namespace e2e-tests-pls-hpcl9 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:879] Jun 16 08:46:39.439: INFO: Successfully created LoadBalancer service pls-test in namespace e2e-tests-pls-hpcl9 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:883] Jun 16 08:46:39.439: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:886] Jun 16 08:46:39.553: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:46:49.669: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:46:59.666: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:47:09.666: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:47:19.668: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 08:47:19.668: INFO: Get Internal IP: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:223] Jun 16 08:47:19.668: INFO: Getting virtual network list [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:36] Jun 16 08:47:24.162: INFO: Now update private link service's static ip to 10.1.0.8 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:228] Jun 16 08:47:24.276: INFO: service's annotations: map[service.beta.kubernetes.io/azure-load-balancer-internal:true service.beta.kubernetes.io/azure-pls-create:true service.beta.kubernetes.io/azure-pls-ip-configuration-ip-address:10.1.0.8] [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:233] Jun 16 08:47:24.531: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] ... skipping 21 lines ... Jun 16 08:48:40.743: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55] Jun 16 08:48:40.743: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] Jun 16 08:48:40.915: INFO: Creating deployment pls-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:70] Jun 16 08:48:41.039: INFO: Creating service pls-test in namespace e2e-tests-pls-hmw7b [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:879] Jun 16 08:48:41.254: INFO: Successfully created LoadBalancer service pls-test in namespace e2e-tests-pls-hmw7b [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:883] Jun 16 08:48:41.254: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:886] Jun 16 08:48:41.368: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:48:51.483: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:49:01.483: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:49:11.489: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:49:21.486: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:49:31.485: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 08:49:31.485: INFO: Get Internal IP: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:270] Jun 16 08:49:31.485: INFO: Getting load balancers in the resourceGroup capz-jbmbu4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:421] Jun 16 08:49:32.079: INFO: Looking for internal load balancer frontend config ID with private ip as frontend [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:425] Jun 16 08:49:32.079: INFO: Successfully obtained LB frontend config: a33a3f12960b54ee39df495607c06814 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:437] Jun 16 08:49:32.079: INFO: Getting private link service(pls-a33a3f12960b54ee39df495607c06814) from rg(capz-jbmbu4) [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:446] ... skipping 17 lines ... Jun 16 08:50:33.664: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55] Jun 16 08:50:33.664: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] Jun 16 08:50:33.833: INFO: Creating deployment pls-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:70] Jun 16 08:50:33.950: INFO: Creating service pls-test in namespace e2e-tests-pls-w8lsn [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:879] Jun 16 08:50:34.192: INFO: Successfully created LoadBalancer service pls-test in namespace e2e-tests-pls-w8lsn [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:883] Jun 16 08:50:34.192: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:886] Jun 16 08:50:34.309: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:50:44.425: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:50:54.428: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:51:04.422: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:51:14.431: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:51:24.427: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:51:34.423: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 08:51:34.423: INFO: Get Internal IP: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:296] Jun 16 08:51:34.423: INFO: Getting load balancers in the resourceGroup capz-jbmbu4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:421] Jun 16 08:51:34.983: INFO: Looking for internal load balancer frontend config ID with private ip as frontend [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:425] Jun 16 08:51:34.983: INFO: Successfully obtained LB frontend config: a67732b589dfd420d965370790fa8108 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:437] Jun 16 08:51:34.983: INFO: Getting private link service(pls-a67732b589dfd420d965370790fa8108) from rg(capz-jbmbu4) [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:446] ... skipping 17 lines ... Jun 16 08:52:36.574: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55] Jun 16 08:52:36.574: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] Jun 16 08:52:36.742: INFO: Creating deployment pls-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:70] Jun 16 08:52:36.860: INFO: Creating service pls-test in namespace e2e-tests-pls-sgzlg [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:879] Jun 16 08:52:37.108: INFO: Successfully created LoadBalancer service pls-test in namespace e2e-tests-pls-sgzlg [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:883] Jun 16 08:52:37.108: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:886] Jun 16 08:52:37.237: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:52:47.352: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:52:57.350: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:53:07.351: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:53:17.351: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 08:53:17.351: INFO: Get Internal IP: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:323] Jun 16 08:53:17.351: INFO: Getting load balancers in the resourceGroup capz-jbmbu4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:421] Jun 16 08:53:17.888: INFO: Looking for internal load balancer frontend config ID with private ip as frontend [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:425] Jun 16 08:53:17.888: INFO: Successfully obtained LB frontend config: a4474a238ece440ff892893cfcf66adf [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:437] Jun 16 08:53:17.888: INFO: Getting private link service(pls-a4474a238ece440ff892893cfcf66adf) from rg(capz-jbmbu4) [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:446] ... skipping 17 lines ... Jun 16 08:54:09.489: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55] Jun 16 08:54:09.489: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] Jun 16 08:54:09.660: INFO: Creating deployment pls-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:70] Jun 16 08:54:09.791: INFO: Creating service pls-test in namespace e2e-tests-pls-ctp66 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:879] Jun 16 08:54:10.022: INFO: Successfully created LoadBalancer service pls-test in namespace e2e-tests-pls-ctp66 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:883] Jun 16 08:54:10.022: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:886] Jun 16 08:54:10.136: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:54:20.256: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:54:30.258: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:54:40.250: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:54:50.251: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 08:54:50.251: INFO: Get Internal IP: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:356] Jun 16 08:54:50.251: INFO: Getting load balancers in the resourceGroup capz-jbmbu4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:421] Jun 16 08:54:51.311: INFO: Looking for internal load balancer frontend config ID with private ip as frontend [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:425] Jun 16 08:54:51.311: INFO: Successfully obtained LB frontend config: ab44da987ec974e85ab66f7406f7d064 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:437] Jun 16 08:54:51.311: INFO: Getting private link service(pls-ab44da987ec974e85ab66f7406f7d064) from rg(capz-jbmbu4) [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:446] ... skipping 17 lines ... Jun 16 08:55:42.535: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55] Jun 16 08:55:42.535: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] Jun 16 08:55:42.708: INFO: Creating deployment pls-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:70] Jun 16 08:55:42.827: INFO: Creating service service1 in namespace e2e-tests-pls-sc8gk [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:879] Jun 16 08:55:43.094: INFO: Successfully created LoadBalancer service service1 in namespace e2e-tests-pls-sc8gk [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:883] Jun 16 08:55:43.094: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:886] Jun 16 08:55:43.231: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:55:53.356: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:56:03.348: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:56:13.349: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:56:23.344: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 08:56:23.344: INFO: Successfully created service1 in namespace e2e-tests-pls-sc8gk with IP 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:377] Jun 16 08:56:23.615: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:56:33.729: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 08:56:33.729: INFO: Successfully created service2 in namespace e2e-tests-pls-sc8gk with IP 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:390] Jun 16 08:56:33.729: INFO: Getting load balancers in the resourceGroup capz-jbmbu4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:421] Jun 16 08:56:34.287: INFO: Looking for internal load balancer frontend config ID with private ip as frontend [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:425] Jun 16 08:56:34.287: INFO: Successfully obtained LB frontend config: ae9ecbb78f8f94425a483334e42097e1 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:437] Jun 16 08:56:34.287: INFO: Getting private link service(pls-ae9ecbb78f8f94425a483334e42097e1) from rg(capz-jbmbu4) [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/private_link_service.go:446] ... skipping 48 lines ... Jun 16 08:57:51.393: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55] Jun 16 08:57:51.393: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] [1mSTEP[0m: Create service Jun 16 08:57:51.565: INFO: Creating service annotation-test in namespace e2e-tests-service-8fgqx [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:879] Jun 16 08:57:51.733: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-8fgqx [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:883] Jun 16 08:57:51.733: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:886] Jun 16 08:57:51.847: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:58:01.963: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:58:11.962: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:58:21.962: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 08:58:31.970: INFO: Exposure successfully, get external ip: 20.31.164.150 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 08:58:31.970: INFO: checking the connectivity of the public IP 20.31.164.150 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Jun 16 08:58:32.185: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Jun 16 08:58:32.185: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] [1mSTEP[0m: Validating External domain name Jun 16 08:58:32.186: INFO: Get domain name: annotation-test2fd5e476-c405-4508-8862-1b9ed6a1586c.westeurope.cloudapp.azure.com [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:75] ... skipping 20 lines ... Jun 16 09:00:01.823: INFO: Creating Azure clients [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:95] Jun 16 09:00:01.823: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55] Jun 16 09:00:01.823: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] Jun 16 09:00:01.994: INFO: Creating service annotation-test in namespace e2e-tests-service-24pqd [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:879] Jun 16 09:00:02.187: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-24pqd [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:883] Jun 16 09:00:02.187: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:886] Jun 16 09:00:02.301: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:00:12.415: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:00:22.419: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:00:32.422: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:00:42.423: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 09:00:42.423: INFO: cleaning up test service annotation-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:164] Jun 16 09:00:42.423: INFO: Deleting service annotation-test in namespace e2e-tests-service-24pqd [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:48] Jun 16 09:01:38.903: INFO: Deleting namespace e2e-tests-service-24pqd [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:135] [32m• [SLOW TEST:114.004 seconds][0m ... skipping 19 lines ... Jun 16 09:01:55.998: INFO: Getting virtual network list [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:36] [1mSTEP[0m: Test subnet doesn't exist. Creating a new one... Jun 16 09:01:58.299: INFO: creating a new subnet a--------------------------------------------------z, 10.2.0.0/24 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:73] Jun 16 09:01:59.048: INFO: Creating service annotation-test in namespace e2e-tests-service-9xcgm [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:879] Jun 16 09:01:59.212: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-9xcgm [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:883] Jun 16 09:01:59.212: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:886] Jun 16 09:01:59.325: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:02:09.439: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:02:19.442: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:02:29.440: INFO: Exposure successfully, get external ip: 10.2.0.4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 09:02:29.440: INFO: Get External IP: 10.2.0.4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:212] [1mSTEP[0m: Validating external ip in target subnet Jun 16 09:02:29.440: INFO: cleaning up test service annotation-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:208] Jun 16 09:02:29.440: INFO: Deleting service annotation-test in namespace e2e-tests-service-9xcgm [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:48] Jun 16 09:03:11.824: INFO: cleaning up test subnet a--------------------------------------------------z [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:194] ... skipping 19 lines ... Jun 16 09:03:29.582: INFO: Creating Azure clients [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:95] Jun 16 09:03:29.582: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55] Jun 16 09:03:29.583: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] Jun 16 09:03:29.750: INFO: Creating service annotation-test in namespace e2e-tests-service-tb8qd [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:879] Jun 16 09:03:29.915: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-tb8qd [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:883] Jun 16 09:03:29.915: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:886] Jun 16 09:03:30.030: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:03:40.144: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:03:50.146: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:04:00.144: INFO: Exposure successfully, get external ip: 20.31.167.184 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 09:04:00.144: INFO: checking the connectivity of the public IP 20.31.167.184 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Jun 16 09:04:00.362: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Jun 16 09:04:00.362: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] Jun 16 09:04:00.362: INFO: Getting public IPs in the resourceGroup capz-jbmbu4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:841] Jun 16 09:04:00.759: INFO: Getting public IP frontend configuration ID [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:845] ... skipping 26 lines ... [1mSTEP[0m: resource group e2e-b951 created [1mSTEP[0m: creating test PIP in the test resource group Jun 16 09:05:08.731: INFO: Creating public IP resource named testPIP-9943 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:190] [1mSTEP[0m: Creating service annotation-test in namespace e2e-tests-service-khgr4 Jun 16 09:05:15.627: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-khgr4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:285] [1mSTEP[0m: Waiting service to expose... Jun 16 09:05:15.757: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:05:25.874: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:05:35.870: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:05:45.877: INFO: Exposure successfully, get external ip: 20.4.71.30 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 09:05:45.877: INFO: checking the connectivity of the public IP 20.4.71.30 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Jun 16 09:06:15.877: INFO: got error Get "http://20.4.71.30:80": dial tcp 20.4.71.30:80: i/o timeout, will retry [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173] Jun 16 09:06:36.112: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Jun 16 09:06:36.112: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] Jun 16 09:06:36.112: INFO: Getting public IPs in the resourceGroup e2e-b951 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:841] Jun 16 09:06:36.393: INFO: Getting public IP frontend configuration ID [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:845] Jun 16 09:06:36.393: INFO: Successfully obtained PIP front config id: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/capz-jbmbu4/providers/Microsoft.Network/loadBalancers/capz-jbmbu4/frontendIPConfigurations/acc8705564788416ea1bf1b6dba5248c [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:858] Jun 16 09:06:36.393: INFO: Getting loadBalancer name from pipFrontendConfigurationID [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:860] ... skipping 26 lines ... Jun 16 09:08:50.784: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55] Jun 16 09:08:50.785: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] [1mSTEP[0m: Exposing two services with shared security rule Jun 16 09:08:51.157: INFO: Creating service annotation-test in namespace e2e-tests-service-crj8l [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:879] Jun 16 09:08:51.314: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-crj8l [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:883] Jun 16 09:08:51.314: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:886] Jun 16 09:08:51.427: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:09:01.540: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:09:11.541: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:09:21.552: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:09:31.541: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:09:41.552: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:09:51.554: INFO: Exposure successfully, get external ip: 20.31.166.236 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 09:09:51.554: INFO: checking the connectivity of the public IP 20.31.166.236 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Jun 16 09:09:51.767: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Jun 16 09:09:51.767: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] Jun 16 09:09:51.767: INFO: Creating service annotation-test-share in namespace e2e-tests-service-crj8l [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:879] Jun 16 09:09:51.916: INFO: Successfully created LoadBalancer service annotation-test-share in namespace e2e-tests-service-crj8l [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:883] Jun 16 09:09:51.916: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:886] Jun 16 09:09:52.031: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:10:02.154: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:10:12.145: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:10:22.155: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:10:32.154: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:10:42.154: INFO: Exposure successfully, get external ip: 20.238.248.82 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 09:10:42.154: INFO: checking the connectivity of the public IP 20.238.248.82 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Jun 16 09:11:12.155: INFO: got error Get "http://20.238.248.82:80": dial tcp 20.238.248.82:80: i/o timeout, will retry [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173] Jun 16 09:11:32.383: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Jun 16 09:11:32.383: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] [1mSTEP[0m: Validate shared security rule exists Jun 16 09:11:32.383: INFO: Getting virtual network list [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:139] Jun 16 09:11:32.863: INFO: got sg list, length = 2 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:161] Jun 16 09:11:32.863: INFO: Found target security rule [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/network_security_group.go:254] ... skipping 20 lines ... Jun 16 09:13:10.607: INFO: 0 pods in namespace e2e-tests-service-4qkg9 are pending [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/pod_utils.go:83] Jun 16 09:13:10.607: INFO: Creating Azure clients [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:95] Jun 16 09:13:10.607: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55] Jun 16 09:13:10.607: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] [1mSTEP[0m: Creating a service with custom tags [1mSTEP[0m: Waiting service to expose... Jun 16 09:13:11.038: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:13:21.156: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:13:31.165: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:13:41.159: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:13:51.158: INFO: Exposure successfully, get external ip: 20.31.165.46 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 09:13:51.158: INFO: checking the connectivity of the public IP 20.31.165.46 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Jun 16 09:14:21.161: INFO: got error Get "http://20.31.165.46:80": dial tcp 20.31.165.46:80: i/o timeout, will retry [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173] Jun 16 09:14:41.376: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Jun 16 09:14:41.376: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] [1mSTEP[0m: Checking tags on the corresponding public IP Jun 16 09:14:42.153: INFO: tags: [c:d e: a:b ] [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:831] Jun 16 09:14:42.153: INFO: expectedTags: [a:b c:d e: ] [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:831] [1mSTEP[0m: Updating annotation and check tags again ... skipping 26 lines ... Jun 16 09:16:07.081: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] [1mSTEP[0m: Creating two test pips Jun 16 09:16:07.249: INFO: Creating public IP resource named pip1 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:190] Jun 16 09:16:13.076: INFO: Creating public IP resource named pip2 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:190] [1mSTEP[0m: Creating a service referring to the first pip [1mSTEP[0m: Waiting for the service to expose Jun 16 09:16:16.839: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:16:26.956: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:16:36.961: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:16:46.962: INFO: Exposure successfully, get external ip: 20.224.200.222 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 09:16:46.962: INFO: checking the connectivity of the public IP 20.224.200.222 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Jun 16 09:17:16.969: INFO: got error Get "http://20.224.200.222:80": dial tcp 20.224.200.222:80: i/o timeout, will retry [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173] Jun 16 09:17:37.188: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Jun 16 09:17:37.188: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] [1mSTEP[0m: Updating the service to refer to the second service [1mSTEP[0m: Waiting for service IP to be updated Jun 16 09:17:37.637: INFO: expected IP is 20.126.108.228, current IP is 20.224.200.222, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:138] Jun 16 09:17:47.758: INFO: Exposure successfully, get external ip: 20.126.108.228 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 09:17:47.758: INFO: checking the connectivity of the public IP 20.126.108.228 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Jun 16 09:18:17.759: INFO: got error Get "http://20.126.108.228:80": dial tcp 20.126.108.228:80: i/o timeout, will retry [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173] Jun 16 09:18:37.993: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Jun 16 09:18:37.993: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] [1mSTEP[0m: Cleaning up test service Jun 16 09:18:37.994: INFO: Deleting service annotation-test in namespace e2e-tests-service-hzzzz [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:48] [1mSTEP[0m: Cleaning up test PIPs Jun 16 09:19:14.500: INFO: Deleting namespace e2e-tests-service-hzzzz [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:135] ... skipping 25 lines ... [91m[1m• Failure [74.125 seconds][0m Service with annotation [90m/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:60[0m [91m[1mshould support service annotation `service.beta.kubernetes.io/azure-pip-prefix-id` [It][0m [90m/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:420[0m [91mUnexpected error: <autorest.DetailedError>: { Original: <*azure.ServiceError | 0xc0009b6780>{ Code: "StaticPublicIPCountLimitReached", Message: "Cannot create more than 100 public IP addresses with static allocation method for this subscription in this region.", Target: nil, Details: [], ... skipping 73 lines ... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output network.PublicIPPrefixesClient#CreateOrUpdate: Failure sending request: StatusCode=400 -- Original Error: Code="StaticPublicIPCountLimitReached" Message="Cannot create more than 100 public IP addresses with static allocation method for this subscription in this region." Details=[] occurred[0m /home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:430 [90m------------------------------[0m [0mService with annotation[0m [1mshould support service annotation 'service.beta.kubernetes.io/azure-load-balancer-health-probe-num-of-probe' and port specific configs[0m ... skipping 9 lines ... Jun 16 09:20:45.539: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55] Jun 16 09:20:45.539: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] [1mSTEP[0m: Creating a service with health probe annotations Jun 16 09:20:45.707: INFO: Creating service annotation-test in namespace e2e-tests-service-h97vj [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:879] Jun 16 09:20:45.854: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-h97vj [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:883] Jun 16 09:20:45.854: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:886] Jun 16 09:20:45.968: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:20:56.090: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:21:06.081: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:21:16.082: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:21:26.083: INFO: Exposure successfully, get external ip: 20.103.182.243 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 09:21:26.083: INFO: checking the connectivity of the public IP 20.103.182.243 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Jun 16 09:21:56.089: INFO: got error Get "http://20.103.182.243:80": dial tcp 20.103.182.243:80: i/o timeout, will retry [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173] Jun 16 09:22:16.308: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Jun 16 09:22:16.308: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] Jun 16 09:22:16.308: INFO: Getting public IPs in the resourceGroup capz-jbmbu4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:841] Jun 16 09:22:16.837: INFO: Getting public IP frontend configuration ID [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:845] Jun 16 09:22:16.837: INFO: Successfully obtained PIP front config id: /subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/capz-jbmbu4/providers/Microsoft.Network/loadBalancers/capz-jbmbu4/frontendIPConfigurations/aef642779df624d7989869b0d9ef1a15 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:858] Jun 16 09:22:16.837: INFO: Getting loadBalancer name from pipFrontendConfigurationID [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:860] ... skipping 25 lines ... Jun 16 09:23:37.056: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55] Jun 16 09:23:37.056: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] [1mSTEP[0m: Creating a service with health probe annotations Jun 16 09:23:37.228: INFO: Creating service annotation-test in namespace e2e-tests-service-8lqr6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:879] Jun 16 09:23:37.376: INFO: Successfully created LoadBalancer service annotation-test in namespace e2e-tests-service-8lqr6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:883] Jun 16 09:23:37.376: INFO: Waiting service to expose... [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:886] Jun 16 09:23:37.489: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:23:47.602: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:23:57.602: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:24:07.603: INFO: Exposure successfully, get external ip: 20.103.183.72 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 09:24:07.603: INFO: checking the connectivity of the public IP 20.103.183.72 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Jun 16 09:24:07.819: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Jun 16 09:24:07.820: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] Jun 16 09:24:07.820: INFO: Getting public IPs in the resourceGroup capz-jbmbu4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:841] Jun 16 09:24:08.648: INFO: Getting public IP frontend configuration ID [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:845] ... skipping 20 lines ... Jun 16 09:25:12.001: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] Jun 16 09:25:12.002: INFO: Creating a test namespace [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:87] Jun 16 09:25:12.120: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55] Jun 16 09:25:12.120: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] Jun 16 09:25:12.289: INFO: Creating deployment servicelb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:82] [1mSTEP[0m: creating a mixed protocol service Jun 16 09:25:12.830: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:25:22.947: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:25:32.953: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:25:42.948: INFO: Exposure successfully, get external ip: 20.31.109.203 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 09:25:42.948: INFO: checking the connectivity of the public IP 20.31.109.203 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Jun 16 09:25:50.417: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Jun 16 09:25:50.417: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] [1mSTEP[0m: checking load balancing rules Jun 16 09:25:50.417: INFO: Getting public IPs in the resourceGroup capz-jbmbu4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:841] ... skipping 20 lines ... Jun 16 09:27:04.013: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] Jun 16 09:27:04.184: INFO: Creating deployment servicelb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:82] [1mSTEP[0m: creating a public IP with tags Jun 16 09:27:04.303: INFO: Creating public IP resource named service-lb-public-IPccd5 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:190] Jun 16 09:27:09.314: INFO: created pip with address 20.123.164.218 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:153] [1mSTEP[0m: creating a service referencing the public IP Jun 16 09:27:09.583: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:27:19.704: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:27:29.702: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:27:39.704: INFO: Exposure successfully, get external ip: 20.123.164.218 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 09:27:39.704: INFO: checking the connectivity of the public IP 20.123.164.218 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Jun 16 09:28:09.721: INFO: got error Get "http://20.123.164.218:80": dial tcp 20.123.164.218:80: i/o timeout, will retry [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173] Jun 16 09:28:32.975: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Jun 16 09:28:32.975: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] [1mSTEP[0m: deleting the service Jun 16 09:28:32.975: INFO: Deleting service servicelb-test in namespace e2e-tests-service-lb-9mj5p [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:48] [1mSTEP[0m: test if the pip still exists [1mSTEP[0m: test if the tags are changed ... skipping 17 lines ... Jun 16 09:29:16.700: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] Jun 16 09:29:16.869: INFO: Creating deployment servicelb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:82] Jun 16 09:29:17.336: INFO: Successfully created LoadBalancer service servicelb-test in namespace e2e-tests-service-lb-97467 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:187] Jun 16 09:29:17.336: INFO: Creating public IP resource named service-lb-public-none-IP1e10 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:190] Jun 16 09:29:21.573: INFO: PIP to 20.229.203.81 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:192] [1mSTEP[0m: Waiting for exposure of the original service without assigned lb IP Jun 16 09:29:21.686: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:29:31.808: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:29:41.800: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:29:51.803: INFO: Exposure successfully, get external ip: 20.31.105.103 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 09:29:51.803: INFO: checking the connectivity of the public IP 20.31.105.103 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Jun 16 09:29:52.018: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Jun 16 09:29:52.018: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] [1mSTEP[0m: Updating service to bound to specific public IP Jun 16 09:29:52.018: INFO: will update IP to 20.229.203.81 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:209] Jun 16 09:29:52.371: INFO: expected IP is 20.229.203.81, current IP is 20.31.105.103, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:138] Jun 16 09:30:02.485: INFO: expected IP is 20.229.203.81, current IP is 20.31.105.103, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:138] Jun 16 09:30:12.488: INFO: expected IP is 20.229.203.81, current IP is 20.31.105.103, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:138] Jun 16 09:30:22.493: INFO: Exposure successfully, get external ip: 20.229.203.81 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 09:30:22.493: INFO: checking the connectivity of the public IP 20.229.203.81 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Jun 16 09:30:52.493: INFO: got error Get "http://20.229.203.81:80": dial tcp 20.229.203.81:80: i/o timeout, will retry [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:173] Jun 16 09:31:12.715: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Jun 16 09:31:12.715: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] [1mSTEP[0m: Cleaning up Jun 16 09:31:12.715: INFO: Deleting service servicelb-test in namespace e2e-tests-service-lb-97467 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:48] Jun 16 09:31:49.073: INFO: Deleting public IP resource named service-lb-public-none-IP1e10 in resource group capz-jbmbu4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:265] Jun 16 09:31:49.796: INFO: Deleting namespace e2e-tests-service-lb-97467 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:135] ... skipping 13 lines ... Jun 16 09:31:56.268: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55] Jun 16 09:31:56.268: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] Jun 16 09:31:56.438: INFO: Creating deployment servicelb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:82] Jun 16 09:31:56.556: INFO: Getting virtual network list [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:36] Jun 16 09:32:00.099: INFO: Successfully created LoadBalancer service servicelb-test in namespace e2e-tests-service-lb-58kjn [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:230] [1mSTEP[0m: Waiting for exposure of internal service with specific IP Jun 16 09:32:00.213: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:32:10.335: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:32:20.326: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:32:30.327: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 09:32:30.488: INFO: Events list: [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:243] Jun 16 09:32:30.488: INFO: 0. {{ } {servicelb-test-c847bf99d-9bbqd.16f90ffcd72ccf21 e2e-tests-service-lb-58kjn 740655e1-bae3-4ad9-bd20-d6bdf24bd709 17783 0 2022-06-16 09:31:56 +0000 UTC <nil> <nil> map[] map[] [] [] [{kube-scheduler Update events.k8s.io/v1 2022-06-16 09:31:56 +0000 UTC FieldsV1 {"f:action":{},"f:eventTime":{},"f:note":{},"f:reason":{},"f:regarding":{},"f:reportingController":{},"f:reportingInstance":{},"f:type":{}} }]} {Pod e2e-tests-service-lb-58kjn servicelb-test-c847bf99d-9bbqd 46743256-ac1c-4fb2-96a6-4b90a01f87dd v1 17771 } Scheduled Successfully assigned e2e-tests-service-lb-58kjn/servicelb-test-c847bf99d-9bbqd to capz-jbmbu4-mp-0000000 { } 0001-01-01 00:00:00 +0000 UTC 0001-01-01 00:00:00 +0000 UTC 0 Normal 2022-06-16 09:31:56.651575 +0000 UTC nil Binding nil default-scheduler default-scheduler-capz-jbmbu4-control-plane-xjzhv} [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:245] Jun 16 09:32:30.489: INFO: 1. {{ } {servicelb-test-c847bf99d-9bbqd.16f90ffd26023ae8 e2e-tests-service-lb-58kjn 796dc195-f389-4caf-aedd-26f31ff37c9f 17810 0 2022-06-16 09:31:57 +0000 UTC <nil> <nil> map[] map[] [] [] [{kubelet Update v1 2022-06-16 09:31:57 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Pod e2e-tests-service-lb-58kjn servicelb-test-c847bf99d-9bbqd 46743256-ac1c-4fb2-96a6-4b90a01f87dd v1 17777 spec.containers{test-app}} Pulling Pulling image "nginx:1.15" {kubelet capz-jbmbu4-mp-0000000} 2022-06-16 09:31:57 +0000 UTC 2022-06-16 09:31:57 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil nil } [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:245] Jun 16 09:32:30.489: INFO: 2. {{ } {servicelb-test-c847bf99d-9bbqd.16f90ffd9214c4b4 e2e-tests-service-lb-58kjn 8a7bf921-5cc3-4017-922c-614ad8a7f1c0 17833 0 2022-06-16 09:31:59 +0000 UTC <nil> <nil> map[] map[] [] [] [{kubelet Update v1 2022-06-16 09:31:59 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Pod e2e-tests-service-lb-58kjn servicelb-test-c847bf99d-9bbqd 46743256-ac1c-4fb2-96a6-4b90a01f87dd v1 17777 spec.containers{test-app}} Pulled Successfully pulled image "nginx:1.15" in 1.813138052s {kubelet capz-jbmbu4-mp-0000000} 2022-06-16 09:31:59 +0000 UTC 2022-06-16 09:31:59 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil nil } [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:245] Jun 16 09:32:30.489: INFO: 3. {{ } {servicelb-test-c847bf99d-9bbqd.16f90ffd950088b8 e2e-tests-service-lb-58kjn 89cec5a4-c58c-48a2-aefa-78a99fe644a9 17834 0 2022-06-16 09:31:59 +0000 UTC <nil> <nil> map[] map[] [] [] [{kubelet Update v1 2022-06-16 09:31:59 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Pod e2e-tests-service-lb-58kjn servicelb-test-c847bf99d-9bbqd 46743256-ac1c-4fb2-96a6-4b90a01f87dd v1 17777 spec.containers{test-app}} Created Created container test-app {kubelet capz-jbmbu4-mp-0000000} 2022-06-16 09:31:59 +0000 UTC 2022-06-16 09:31:59 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil nil } [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:245] Jun 16 09:32:30.489: INFO: 4. {{ } {servicelb-test-c847bf99d-9bbqd.16f90ffda196e194 e2e-tests-service-lb-58kjn 186e1349-b6d7-4b73-9029-b52f1114f6ba 17838 0 2022-06-16 09:32:00 +0000 UTC <nil> <nil> map[] map[] [] [] [{kubelet Update v1 2022-06-16 09:32:00 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Pod e2e-tests-service-lb-58kjn servicelb-test-c847bf99d-9bbqd 46743256-ac1c-4fb2-96a6-4b90a01f87dd v1 17777 spec.containers{test-app}} Started Started container test-app {kubelet capz-jbmbu4-mp-0000000} 2022-06-16 09:32:00 +0000 UTC 2022-06-16 09:32:00 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil nil } [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:245] Jun 16 09:32:30.489: INFO: 5. {{ } {servicelb-test-c847bf99d-9h6nf.16f90ffcd21573ef e2e-tests-service-lb-58kjn 580e5515-58b0-4fd2-8ed5-760371d91a26 17779 0 2022-06-16 09:31:56 +0000 UTC <nil> <nil> map[] map[] [] [] [{kube-scheduler Update events.k8s.io/v1 2022-06-16 09:31:56 +0000 UTC FieldsV1 {"f:action":{},"f:eventTime":{},"f:note":{},"f:reason":{},"f:regarding":{},"f:reportingController":{},"f:reportingInstance":{},"f:type":{}} }]} {Pod e2e-tests-service-lb-58kjn servicelb-test-c847bf99d-9h6nf fbd18e91-7312-451f-83b7-efdb05b7aca0 v1 17767 } Scheduled Successfully assigned e2e-tests-service-lb-58kjn/servicelb-test-c847bf99d-9h6nf to capz-jbmbu4-mp-0000001 { } 0001-01-01 00:00:00 +0000 UTC 0001-01-01 00:00:00 +0000 UTC 0 Normal 2022-06-16 09:31:56.566154 +0000 UTC nil Binding nil default-scheduler default-scheduler-capz-jbmbu4-control-plane-xjzhv} [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:245] Jun 16 09:32:30.489: INFO: 6. {{ } {servicelb-test-c847bf99d-9h6nf.16f90ffd1d484a30 e2e-tests-service-lb-58kjn fcc74d40-ccc6-4150-bb27-a181dd6d0888 17808 0 2022-06-16 09:31:57 +0000 UTC <nil> <nil> map[] map[] [] [] [{kubelet Update v1 2022-06-16 09:31:57 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Pod e2e-tests-service-lb-58kjn servicelb-test-c847bf99d-9h6nf fbd18e91-7312-451f-83b7-efdb05b7aca0 v1 17769 } FailedMount MountVolume.SetUp failed for volume "kube-api-access-wndsb" : failed to sync configmap cache: timed out waiting for the condition {kubelet capz-jbmbu4-mp-0000001} 2022-06-16 09:31:57 +0000 UTC 2022-06-16 09:31:57 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil nil } [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:245] Jun 16 09:32:30.489: INFO: 7. {{ } {servicelb-test-c847bf99d-9h6nf.16f90ffd6cbd7dd3 e2e-tests-service-lb-58kjn aab91a77-5b10-4a6e-8bff-7e867223521a 17826 0 2022-06-16 09:31:59 +0000 UTC <nil> <nil> map[] map[] [] [] [{kubelet Update v1 2022-06-16 09:31:59 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Pod e2e-tests-service-lb-58kjn servicelb-test-c847bf99d-9h6nf fbd18e91-7312-451f-83b7-efdb05b7aca0 v1 17769 spec.containers{test-app}} Pulling Pulling image "nginx:1.15" {kubelet capz-jbmbu4-mp-0000001} 2022-06-16 09:31:59 +0000 UTC 2022-06-16 09:31:59 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil nil } [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:245] Jun 16 09:32:30.489: INFO: 8. {{ } {servicelb-test-c847bf99d-9h6nf.16f90ffdb0381cf5 e2e-tests-service-lb-58kjn 24f41ad4-5493-4755-89e3-b02c539223a1 17843 0 2022-06-16 09:32:00 +0000 UTC <nil> <nil> map[] map[] [] [] [{kubelet Update v1 2022-06-16 09:32:00 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Pod e2e-tests-service-lb-58kjn servicelb-test-c847bf99d-9h6nf fbd18e91-7312-451f-83b7-efdb05b7aca0 v1 17769 spec.containers{test-app}} Pulled Successfully pulled image "nginx:1.15" in 1.132078102s {kubelet capz-jbmbu4-mp-0000001} 2022-06-16 09:32:00 +0000 UTC 2022-06-16 09:32:00 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil nil } [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:245] Jun 16 09:32:30.489: INFO: 9. {{ } {servicelb-test-c847bf99d-9h6nf.16f90ffdb5298bb3 e2e-tests-service-lb-58kjn 1ce3b6ad-d724-4b84-8e58-a73a6cc9d242 17850 0 2022-06-16 09:32:00 +0000 UTC <nil> <nil> map[] map[] [] [] [{kubelet Update v1 2022-06-16 09:32:00 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Pod e2e-tests-service-lb-58kjn servicelb-test-c847bf99d-9h6nf fbd18e91-7312-451f-83b7-efdb05b7aca0 v1 17769 spec.containers{test-app}} Created Created container test-app {kubelet capz-jbmbu4-mp-0000001} 2022-06-16 09:32:00 +0000 UTC 2022-06-16 09:32:00 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil nil } [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:245] Jun 16 09:32:30.489: INFO: 10. {{ } {servicelb-test-c847bf99d-9h6nf.16f90ffdbc25583c e2e-tests-service-lb-58kjn db888c67-d20d-43d0-8c2f-46d4c4fb4fef 17855 0 2022-06-16 09:32:00 +0000 UTC <nil> <nil> map[] map[] [] [] [{kubelet Update v1 2022-06-16 09:32:00 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Pod e2e-tests-service-lb-58kjn servicelb-test-c847bf99d-9h6nf fbd18e91-7312-451f-83b7-efdb05b7aca0 v1 17769 spec.containers{test-app}} Started Started container test-app {kubelet capz-jbmbu4-mp-0000001} 2022-06-16 09:32:00 +0000 UTC 2022-06-16 09:32:00 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil nil } [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:245] Jun 16 09:32:30.489: INFO: 11. {{ } {servicelb-test-c847bf99d-l5l24.16f90ffcd94eb0e2 e2e-tests-service-lb-58kjn 7a209bc6-48da-4c32-8308-003b53d1e97d 17791 0 2022-06-16 09:31:56 +0000 UTC <nil> <nil> map[] map[] [] [] [{kube-scheduler Update events.k8s.io/v1 2022-06-16 09:31:56 +0000 UTC FieldsV1 {"f:action":{},"f:eventTime":{},"f:note":{},"f:reason":{},"f:regarding":{},"f:reportingController":{},"f:reportingInstance":{},"f:type":{}} }]} {Pod e2e-tests-service-lb-58kjn servicelb-test-c847bf99d-l5l24 c3a90aeb-a357-4489-912c-e18a758fa241 v1 17776 } Scheduled Successfully assigned e2e-tests-service-lb-58kjn/servicelb-test-c847bf99d-l5l24 to capz-jbmbu4-mp-0000000 { } 0001-01-01 00:00:00 +0000 UTC 0001-01-01 00:00:00 +0000 UTC 0 Normal 2022-06-16 09:31:56.687347 +0000 UTC nil Binding nil default-scheduler default-scheduler-capz-jbmbu4-control-plane-xjzhv} [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:245] Jun 16 09:32:30.489: INFO: 12. {{ } {servicelb-test-c847bf99d-l5l24.16f90ffd26741a16 e2e-tests-service-lb-58kjn 6a8b672d-1212-4523-b0a9-532cb9282976 17811 0 2022-06-16 09:31:57 +0000 UTC <nil> <nil> map[] map[] [] [] [{kubelet Update v1 2022-06-16 09:31:57 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Pod e2e-tests-service-lb-58kjn servicelb-test-c847bf99d-l5l24 c3a90aeb-a357-4489-912c-e18a758fa241 v1 17785 spec.containers{test-app}} Pulling Pulling image "nginx:1.15" {kubelet capz-jbmbu4-mp-0000000} 2022-06-16 09:31:57 +0000 UTC 2022-06-16 09:31:57 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil nil } [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:245] ... skipping 42 lines ... Jun 16 09:33:33.326: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55] Jun 16 09:33:33.326: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] Jun 16 09:33:33.500: INFO: Creating deployment servicelb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:82] Jun 16 09:33:33.874: INFO: Successfully created LoadBalancer service servicelb-test in namespace e2e-tests-service-lb-cxq7r [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:270] Jun 16 09:33:33.874: INFO: Creating public IP resource named service-lb-internal-none-public-IP2758 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:190] [1mSTEP[0m: Waiting for exposure of the original service without assigned lb private IP Jun 16 09:33:39.125: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:33:49.254: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:33:59.246: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:34:09.244: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 09:34:09.614: INFO: Events list: [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:290] Jun 16 09:34:09.614: INFO: 0. {{ } {servicelb-test-c847bf99d-5jvgv.16f910136b2bf408 e2e-tests-service-lb-cxq7r 4ac1877e-572d-4a0e-b353-86f3829f9f46 18209 0 2022-06-16 09:33:33 +0000 UTC <nil> <nil> map[] map[] [] [] [{kube-scheduler Update events.k8s.io/v1 2022-06-16 09:33:33 +0000 UTC FieldsV1 {"f:action":{},"f:eventTime":{},"f:note":{},"f:reason":{},"f:regarding":{},"f:reportingController":{},"f:reportingInstance":{},"f:type":{}} }]} {Pod e2e-tests-service-lb-cxq7r servicelb-test-c847bf99d-5jvgv 8be8b178-2a5c-4279-bda2-05260a458248 v1 18198 } Scheduled Successfully assigned e2e-tests-service-lb-cxq7r/servicelb-test-c847bf99d-5jvgv to capz-jbmbu4-mp-0000000 { } 0001-01-01 00:00:00 +0000 UTC 0001-01-01 00:00:00 +0000 UTC 0 Normal 2022-06-16 09:33:33.623823 +0000 UTC nil Binding nil default-scheduler default-scheduler-capz-jbmbu4-control-plane-xjzhv} [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:292] Jun 16 09:34:09.614: INFO: 1. {{ } {servicelb-test-c847bf99d-5jvgv.16f91013b7eac10e e2e-tests-service-lb-cxq7r b64611c9-115a-4a3f-b3a1-e2699c5f4547 18256 0 2022-06-16 09:33:34 +0000 UTC <nil> <nil> map[] map[] [] [] [{kubelet Update v1 2022-06-16 09:33:34 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Pod e2e-tests-service-lb-cxq7r servicelb-test-c847bf99d-5jvgv 8be8b178-2a5c-4279-bda2-05260a458248 v1 18200 spec.containers{test-app}} Pulling Pulling image "nginx:1.15" {kubelet capz-jbmbu4-mp-0000000} 2022-06-16 09:33:34 +0000 UTC 2022-06-16 09:33:34 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil nil } [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:292] Jun 16 09:34:09.614: INFO: 2. {{ } {servicelb-test-c847bf99d-5jvgv.16f91013ed9fc5dd e2e-tests-service-lb-cxq7r dc0b2dd7-645d-4be1-b09c-4aaca6143d8d 18263 0 2022-06-16 09:33:35 +0000 UTC <nil> <nil> map[] map[] [] [] [{kubelet Update v1 2022-06-16 09:33:35 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Pod e2e-tests-service-lb-cxq7r servicelb-test-c847bf99d-5jvgv 8be8b178-2a5c-4279-bda2-05260a458248 v1 18200 spec.containers{test-app}} Pulled Successfully pulled image "nginx:1.15" in 901.039195ms {kubelet capz-jbmbu4-mp-0000000} 2022-06-16 09:33:35 +0000 UTC 2022-06-16 09:33:35 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil nil } [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:292] Jun 16 09:34:09.614: INFO: 3. {{ } {servicelb-test-c847bf99d-5jvgv.16f91013f1151cdf e2e-tests-service-lb-cxq7r 7fbe1b57-04cd-43f4-8341-eb8d94609d5d 18265 0 2022-06-16 09:33:35 +0000 UTC <nil> <nil> map[] map[] [] [] [{kubelet Update v1 2022-06-16 09:33:35 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Pod e2e-tests-service-lb-cxq7r servicelb-test-c847bf99d-5jvgv 8be8b178-2a5c-4279-bda2-05260a458248 v1 18200 spec.containers{test-app}} Created Created container test-app {kubelet capz-jbmbu4-mp-0000000} 2022-06-16 09:33:35 +0000 UTC 2022-06-16 09:33:35 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil nil } [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:292] ... skipping 59 lines ... Jun 16 09:36:11.853: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55] Jun 16 09:36:11.853: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] Jun 16 09:36:12.023: INFO: Creating deployment servicelb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:82] Jun 16 09:36:12.140: INFO: Creating public IP resource named service-lb-public-remain0b09 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:190] Jun 16 09:36:16.544: INFO: Successfully created LoadBalancer service servicelb-test in namespace e2e-tests-service-lb-xg9px [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:319] [1mSTEP[0m: Waiting for exposure of the original service with assigned lb private IP Jun 16 09:36:16.659: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:36:26.774: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:36:36.778: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:36:46.777: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:36:56.783: INFO: Exposure successfully, get external ip: 20.8.119.58 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 09:36:56.783: INFO: checking the connectivity of the public IP 20.8.119.58 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Jun 16 09:37:12.400: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Jun 16 09:37:12.400: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] [1mSTEP[0m: Update without changing the service and wait for a while Jun 16 09:37:12.400: INFO: External IP is now 20.8.119.58 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:334] ... skipping 48 lines ... Jun 16 09:42:56.430: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] Jun 16 09:42:56.431: INFO: Creating a test namespace [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:87] Jun 16 09:42:56.547: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55] Jun 16 09:42:56.547: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] Jun 16 09:42:56.715: INFO: Creating deployment servicelb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:82] Jun 16 09:42:56.833: INFO: Creating public IP resource named service-lb-public-remain09b4 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/network_utils.go:190] Jun 16 09:43:02.909: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:43:13.024: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:43:23.035: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:43:33.031: INFO: Exposure successfully, get external ip: 52.157.214.161 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 09:43:33.031: INFO: checking the connectivity of the public IP 52.157.214.161 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Jun 16 09:43:40.498: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Jun 16 09:43:40.498: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] Jun 16 09:43:40.498: INFO: Successfully created LoadBalancer service1 in namespace e2e-tests-service-lb-bbp9k with IP 52.157.214.161 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:379] Jun 16 09:43:40.763: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:43:50.877: INFO: Exposure successfully, get external ip: 52.157.214.161 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 09:43:50.877: INFO: checking the connectivity of the public IP 52.157.214.161 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Jun 16 09:43:50.877: INFO: Successfully created LoadBalancer service2 in namespace e2e-tests-service-lb-bbp9k with IP 52.157.214.161 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:391] [1mSTEP[0m: Cleaning up Jun 16 09:43:50.877: INFO: Deleting service service1 in namespace e2e-tests-service-lb-bbp9k [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:48] Jun 16 09:43:59.229: INFO: Deleting service service2 in namespace e2e-tests-service-lb-bbp9k [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:48] ... skipping 12 lines ... Jun 16 09:44:42.695: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55] Jun 16 09:44:42.695: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] Jun 16 09:44:42.695: INFO: Creating a test namespace [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:87] Jun 16 09:44:42.813: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55] Jun 16 09:44:42.813: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] Jun 16 09:44:42.981: INFO: Creating deployment servicelb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:82] Jun 16 09:44:43.435: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:44:53.549: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:45:03.559: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:45:13.549: INFO: Exposure successfully, get external ip: 20.76.213.58 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 09:45:13.549: INFO: checking the connectivity of the public IP 20.76.213.58 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Jun 16 09:45:20.849: INFO: succeeded [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:178] Jun 16 09:45:20.850: INFO: validation finished [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:186] Jun 16 09:45:20.850: INFO: Successfully created LoadBalancer service1 in namespace e2e-tests-service-lb-d45fp with IP 20.76.213.58 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:410] Jun 16 09:45:21.115: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:45:31.236: INFO: Exposure successfully, get external ip: 20.76.213.58 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 09:45:31.236: INFO: checking the connectivity of the public IP 20.76.213.58 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:96] Jun 16 09:45:31.236: INFO: Successfully created LoadBalancer service2 in namespace e2e-tests-service-lb-d45fp with IP 20.76.213.58 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:422] [1mSTEP[0m: Deleting one service and check if the other service works well Jun 16 09:45:31.236: INFO: Deleting service service1 in namespace e2e-tests-service-lb-d45fp [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:48] Jun 16 09:45:39.700: INFO: Exposure successfully, get external ip: 20.76.213.58 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] ... skipping 15 lines ... Jun 16 09:46:33.143: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55] Jun 16 09:46:33.143: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] Jun 16 09:46:33.144: INFO: Creating a test namespace [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:87] Jun 16 09:46:33.260: INFO: Creating a kubernetes client [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:55] Jun 16 09:46:33.260: INFO: Kubernetes configuration file name: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/kubeconfig [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:63] Jun 16 09:46:33.429: INFO: Creating deployment servicelb-test [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:82] Jun 16 09:46:33.931: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:46:44.056: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:46:54.053: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:47:04.046: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:47:14.047: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 09:47:14.047: INFO: Successfully created LoadBalancer service1 in namespace e2e-tests-service-lb-bsfss with IP 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:459] Jun 16 09:47:14.321: INFO: Fail to find ingress, retry in 10 seconds [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:132] Jun 16 09:47:24.435: INFO: Exposure successfully, get external ip: 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:147] Jun 16 09:47:24.435: INFO: Successfully created LoadBalancer service2 in namespace e2e-tests-service-lb-bsfss with IP 10.1.0.6 [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/ensureloadbalancer.go:471] [1mSTEP[0m: Cleaning up Jun 16 09:47:24.435: INFO: Deleting service service1 in namespace e2e-tests-service-lb-bsfss [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:48] Jun 16 09:47:28.789: INFO: Deleting service service2 in namespace e2e-tests-service-lb-bsfss [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/service_utils.go:48] Jun 16 09:48:01.263: INFO: Deleting namespace e2e-tests-service-lb-bsfss [/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/utils/utils.go:135] ... skipping 130 lines ... JUnit report was created: /logs/artifacts/junit_01.xml [91m[1mSummarizing 1 Failure:[0m [91m[1m[Fail] [0m[90mService with annotation [0m[91m[1m[It] should support service annotation `service.beta.kubernetes.io/azure-pip-prefix-id` [0m [37m/home/prow/go/src/sigs.k8s.io/cloud-provider-azure/tests/e2e/network/service_annotations.go:430[0m [1m[91mRan 41 of 53 Specs in 5514.662 seconds[0m [1m[91mFAIL![0m -- [32m[1m40 Passed[0m | [91m[1m1 Failed[0m | [33m[1m0 Pending[0m | [36m[1m12 Skipped[0m [38;5;228mYou're using deprecated Ginkgo functionality:[0m [38;5;228m=============================================[0m [1m[38;5;10mGinkgo 2.0[0m is under active development and will introduce several new features, improvements, and a small handful of breaking changes. A release candidate for 2.0 is now available and 2.0 should GA in Fall 2021. [1mPlease give the RC a try and send us feedback![0m - To learn more, view the migration guide at [38;5;14m[4mhttps://github.com/onsi/ginkgo/blob/ver2/docs/MIGRATING_TO_V2.md[0m ... skipping 5 lines ... [38;5;9m[1mIf this change will be impactful to you please leave a comment on [38;5;14m[4mhttps://github.com/onsi/ginkgo/issues/711[0m[0m [1mLearn more at:[0m [38;5;14m[4mhttps://github.com/onsi/ginkgo/blob/ver2/docs/MIGRATING_TO_V2.md#removed-custom-reporters[0m [38;5;243mTo silence deprecations that can be silenced set the following environment variable:[0m [38;5;243mACK_GINKGO_DEPRECATIONS=1.16.5[0m --- FAIL: TestAzureTest (5514.68s) FAIL FAIL sigs.k8s.io/cloud-provider-azure/tests/e2e 5514.721s FAIL make: *** [Makefile:362: test-ccm-e2e] Error 1 NAME STATUS ROLES AGE VERSION INTERNAL-IP EXTERNAL-IP OS-IMAGE KERNEL-VERSION CONTAINER-RUNTIME capz-jbmbu4-control-plane-h9g4r Ready control-plane 96m v1.24.1 10.0.0.5 <none> Ubuntu 20.04.4 LTS 5.13.0-1025-azure containerd://1.6.2 capz-jbmbu4-control-plane-pgfcp Ready control-plane 94m v1.24.1 10.0.0.6 <none> Ubuntu 20.04.4 LTS 5.13.0-1025-azure containerd://1.6.2 capz-jbmbu4-control-plane-xjzhv Ready control-plane 98m v1.24.1 10.0.0.4 <none> Ubuntu 20.04.4 LTS 5.13.0-1025-azure containerd://1.6.2 capz-jbmbu4-mp-0000001 Ready,SchedulingDisabled <none> 96m v1.24.1 10.1.0.5 <none> Ubuntu 20.04.4 LTS 5.13.0-1025-azure containerd://1.6.2 capz-jbmbu4-mp-0000002 Ready <none> 2m49s v1.24.1 10.1.0.4 <none> Ubuntu 20.04.4 LTS 5.13.0-1025-azure containerd://1.6.2 ... skipping 60 lines ... Jun 16 09:57:05.674: INFO: Collecting boot logs for VMSS instance 3 of scale set capz-jbmbu4-mp-0 [1mSTEP[0m: Dumping workload cluster default/capz-jbmbu4 kube-system pod logs [1mSTEP[0m: Creating log watcher for controller kube-system/calico-node-27qnm, container calico-node [1mSTEP[0m: Collecting events for Pod kube-system/etcd-capz-jbmbu4-control-plane-h9g4r [1mSTEP[0m: Collecting events for Pod kube-system/kube-controller-manager-capz-jbmbu4-control-plane-xjzhv [1mSTEP[0m: failed to find events of Pod "etcd-capz-jbmbu4-control-plane-h9g4r" [1mSTEP[0m: Creating log watcher for controller kube-system/kube-proxy-26wrh, container kube-proxy [1mSTEP[0m: Collecting events for Pod kube-system/kube-apiserver-capz-jbmbu4-control-plane-pgfcp [1mSTEP[0m: Collecting events for Pod kube-system/kube-proxy-xwpsk [1mSTEP[0m: Collecting events for Pod kube-system/kube-controller-manager-capz-jbmbu4-control-plane-pgfcp [1mSTEP[0m: Collecting events for Pod kube-system/kube-scheduler-capz-jbmbu4-control-plane-h9g4r [1mSTEP[0m: Creating log watcher for controller kube-system/kube-controller-manager-capz-jbmbu4-control-plane-h9g4r, container kube-controller-manager [1mSTEP[0m: failed to find events of Pod "kube-controller-manager-capz-jbmbu4-control-plane-pgfcp" [1mSTEP[0m: Creating log watcher for controller kube-system/kube-controller-manager-capz-jbmbu4-control-plane-pgfcp, container kube-controller-manager [1mSTEP[0m: failed to find events of Pod "kube-apiserver-capz-jbmbu4-control-plane-pgfcp" [1mSTEP[0m: Fetching kube-system pod logs took 1.136167136s [1mSTEP[0m: Collecting events for Pod kube-system/kube-scheduler-capz-jbmbu4-control-plane-xjzhv [1mSTEP[0m: Collecting events for Pod kube-system/calico-node-27qnm [1mSTEP[0m: Creating log watcher for controller kube-system/calico-node-7k7dq, container calico-node [1mSTEP[0m: Collecting events for Pod kube-system/calico-node-7k7dq [1mSTEP[0m: Creating log watcher for controller kube-system/calico-node-9rl2q, container calico-node ... skipping 41 lines ... [1mSTEP[0m: Creating log watcher for controller kube-system/kube-apiserver-capz-jbmbu4-control-plane-h9g4r, container kube-apiserver [1mSTEP[0m: Collecting events for Pod kube-system/kube-proxy-x9scn [1mSTEP[0m: Creating log watcher for controller kube-system/kube-proxy-x9scn, container kube-proxy [1mSTEP[0m: Creating log watcher for controller kube-system/kube-proxy-xwpsk, container kube-proxy [1mSTEP[0m: Dumping workload cluster default/capz-jbmbu4 Azure activity log [1mSTEP[0m: Creating log watcher for controller kube-system/kube-apiserver-capz-jbmbu4-control-plane-pgfcp, container kube-apiserver [1mSTEP[0m: failed to find events of Pod "kube-scheduler-capz-jbmbu4-control-plane-xjzhv" [1mSTEP[0m: failed to find events of Pod "calico-node-7k7dq" [1mSTEP[0m: failed to find events of Pod "kube-proxy-xwpsk" [1mSTEP[0m: failed to find events of Pod "cloud-controller-manager-594dc79d59-j72k2" [1mSTEP[0m: failed to find events of Pod "calico-node-dsq8q" [1mSTEP[0m: Collecting events for Pod kube-system/kube-controller-manager-capz-jbmbu4-control-plane-h9g4r [1mSTEP[0m: failed to find events of Pod "etcd-capz-jbmbu4-control-plane-pgfcp" [1mSTEP[0m: failed to find events of Pod "calico-kube-controllers-7867496574-z6km4" [1mSTEP[0m: failed to find events of Pod "coredns-6d4b75cb6d-tdvmr" [1mSTEP[0m: failed to find events of Pod "kube-proxy-x9scn" [1mSTEP[0m: failed to find events of Pod "kube-apiserver-capz-jbmbu4-control-plane-h9g4r" [1mSTEP[0m: failed to find events of Pod "cloud-node-manager-ngqxg" [1mSTEP[0m: failed to find events of Pod "coredns-6d4b75cb6d-llx4d" [1mSTEP[0m: failed to find events of Pod "kube-apiserver-capz-jbmbu4-control-plane-xjzhv" [1mSTEP[0m: failed to find events of Pod "kube-controller-manager-capz-jbmbu4-control-plane-h9g4r" [1mSTEP[0m: failed to find events of Pod "kube-controller-manager-capz-jbmbu4-control-plane-xjzhv" [1mSTEP[0m: failed to find events of Pod "calico-node-9z69b" [1mSTEP[0m: failed to find events of Pod "kube-scheduler-capz-jbmbu4-control-plane-h9g4r" [1mSTEP[0m: failed to find events of Pod "cloud-node-manager-2pvr8" [1mSTEP[0m: failed to find events of Pod "cloud-node-manager-l4hnk" [1mSTEP[0m: failed to find events of Pod "kube-scheduler-capz-jbmbu4-control-plane-pgfcp" [1mSTEP[0m: failed to find events of Pod "kube-proxy-zt2tq" [1mSTEP[0m: failed to find events of Pod "etcd-capz-jbmbu4-control-plane-xjzhv" [1mSTEP[0m: Got error while iterating over activity logs for resource group capz-jbmbu4: insights.ActivityLogsClient#listNextResults: Failure sending next results request: StatusCode=500 -- Original Error: context deadline exceeded [1mSTEP[0m: Fetching activity logs took 30.000545408s ================ REDACTING LOGS ================ All sensitive variables are redacted make: Entering directory '/home/prow/go/src/sigs.k8s.io/cloud-provider-azure' rm -rf bin .pkg_config testResults make: Leaving directory '/home/prow/go/src/sigs.k8s.io/cloud-provider-azure' ... skipping 12 lines ...